FPM uses a request queue, so when all workers are busy they wait in line until a worker frees up to process it. With just 1 worker, this can take a long time to catch up, but with a reasonable number of workers you'll only wait a few seconds or even milliseconds depending on the app and how fast it can process requests.
The setting for that is listen.backlog
which defaults to 511 on Linux.