I want to climb the ip list of the following website
https://free-proxy-list.net/
because every page will be updated with ip, I need to turn the page. At first, I can do it with selenium, but I think the cost is too high. So I want to use requests to do it.
clicked on the next button control and found that there was no JavaScript execution in the network of the browser"s monitor. And no data has been transmitted. I looked at those controls, such as the first
.<li class="fg-button ui-button ui-state-default first" id="proxylisttable_first"><a href="-sharp" aria-controls="proxylisttable" data-dt-idx="0" tabindex="0">First</a></li>
it feels like I updated table through aria-controls, but I checked and had no clue. If the data is not get from the server, where should the data be stored? I searched the html file and found that there seemed to be no ip data for other pages.