Home page:
https://www.toutiao.com/c/use.
can get the URL of the article list page by grabbing the package:
https:. / / www.toutiao.com/c/use.
return format is json, The results are as follows:
I got the above connection in Firefox. If I open it in another browser, I can"t get the data.
question:
how can efficiently get the url of all articles in the specified user"s home page in python?
to get the article url, you must get the following parameters:
as, cp, max_behot_time and _ signature
Scheme:
1. Use python to achieve the generation process of the above parameters (is it large)
2. Use selenium to load pages (slow)
3. Please add
do you have any other plans? It can realize