How to Deal With Rate Limited APIs in NodeJS
I need to make 100k API calls to an API that errors-out if I send more than 1000 API calls per minute.
From simplest to most complex
- Add a delay between calls
- Use RxJS
- Use a message queue
We tried RxJS, and it was too complex. Instead, we just added a delay using
setTimeout and inserted all the records into our own DB, so we don’t have to deal with the rate limiter at all.