When scrapy calls the paid agent api, proxy, it can only be obtained once every 5 seconds. Where do I need to set it?

scrapyapi5

because I originally wanted to get 100 ip, at a time and put it in the agent pool, but because the agent is unstable, it can not provide support for a long time. So I gave up the idea of getting 100 ip at once.

5request
Feb.28,2021

you can throw him into the cache, and the cache expires for 5 seconds


set a sleep pause time in the middleware that calls the proxy api.

MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1beb425-31a67.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1beb425-31a67.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?