Meituan takeout data encountered problems.

I am downloading Meituan takeout data now, but there are three problems.
one is that the address of the restaurant always changes. As soon as I got the list of restaurant URLs at the first level, the second level showed that I did not have access to the web page.
the second question is that when a web page is crawled by a DS counting machine, it shows that the page does not exist, but I can display it when I copy it to the browser with the same URL. Does this mean that Meituan found out that I was under the data and did a reverse crawl? The third problem with
is that I set the URL to a subordinate clue, but should I run a subordinate clue automatically when I run a higher-level clue? Now it doesn"t run automatically, what"s wrong with me?

C-sharp java python
Feb.15,2022

1. The change of the URL is the setting of the target website, which cannot be solved by the crawler. The fact that you have no right to access the page should not be the change of the URL, but the same situation as the second problem.
2. I encountered anti-crawling.
3. Hierarchical collection is set, and the two-level rules should be run manually separately, not automatically.
4. Need to change the agent IP, look for the kind of high concealment or exclusive.

Previous: Docker failed to deploy flask successfully (nginx+gunicorn)

Next: How do tasks that have been running be handled with a thread pool?

css mysql arrays josn react html typescript webpack npm sass R objective-c .net sql-server jquery python-3.x angularjs django angular excel regex iphone ajax linux xml pandas vba spring database wordpress string wpf xcode windows bash postgresql oracle multithreading eclipse list firebase algorithm macos forms image scala visual-studio azure bootstrap spring-boot react-native python-2.7 docker performance function winforms matlab powershell apache dataframe api sqlite numpy rest shell selenium flutter dart maven loops qt swing android-studio csv express file class tensorflow sorting codeigniter perl
MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1ea97ab-1f58.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1ea97ab-1f58.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?