FAQ Series: What is batch processing?

What do you do when flooded with requests? One good solution is batch processing.

In a simple architecture, a server processes requests as they’re received. This fails when requests come in faster than they’re processed. Oh no! Those requests are probably being dropped.

Yaron walks us through a simple solution called batch processing. All that’s needed queue and ingenuity.

A large part of the speed cost comes from the travel time to fetch the request. By grabbing multiple requests at a time (batching), you’ll see big time savings.