What do you do when flooded with requests? One good solution is batch processing.
In a simple architecture, a server processes requests as they’re received. This fails when requests come in faster than they’re processed. Oh no! Those requests are probably being dropped.
Yaron walks us through a simple solution called batch processing. All that’s needed queue and ingenuity.
A large part of the speed cost comes from the travel time to fetch the request. By grabbing multiple requests at a time (batching), you’ll see big time savings.