zlacker

Devil's advocate here: did we consider that any such exponential back off goes out the window when users, faced with a non-working site, will just refresh the page therefor reseting the whole process?

>>Dextro+(OP)
The server load from that is negligible since those requests stop at the load balancer.

On that note, the 10 requests/second in the post is also negligible for the same reason. Only requests that hit backend servers matter

>>NavinF+e5
How does the load balancer know if they hit the tweet limit or not? Sounds like they need to query a db for that

>>8n4vid+Iu
The load balancer doesn't care about the source of request when it hits a hard requests per second limit. It all depends on how it is configured.

>>sheeps+I81
Oh, I was referring to the per user tweet limit

>>8n4vid+Iu
There are a million ways to skin that cat.

Personally I'd just cache HTTP 429 responses for 1 minute, but you could also implement rate-limiting inside the load balancer with an in-memory KV store or bloom filter if you wanted to.

Perhaps the context you're missing is that all large sites use ECMP routing and consistent hashing to ensure that requests from the same IP hit the same load balancer. Twitter only has ~238 million daily active users. 10 requests/second on keepalive TCP+TLS connections can be handled by a couple of nginx servers. The linked "Full-stack Drupal developer" has no idea how any of this works and it's kinda sad how most people in this thread took his post at face value