Python crawler static page crawl

usually after python crawls a static website, you can use xpath or css selectors to match elements, but what to do if the html element is dynamically formed by js after obtaining the data? open the page source code

clipboard.png
ul, ullijs

clipboard.png

how to match these data

Static-website page-crawler
Mar.04,2021

needs to execute js.
you can try using webdriver

you can use the selenium simulation browser to load the js and then match it.

Previous: How does the socketio of the client native platform unlisten for events?

Next: What about Mac brew: Closed pull requests,?

css mysql arrays josn react html typescript webpack npm sass R objective-c .net sql-server jquery python-3.x angularjs django angular excel regex iphone ajax linux xml pandas vba spring database wordpress string wpf xcode windows bash postgresql oracle multithreading eclipse list firebase algorithm macos forms image scala visual-studio azure bootstrap spring-boot react-native python-2.7 docker performance function winforms matlab powershell apache dataframe api sqlite numpy rest shell selenium flutter dart maven loops qt swing android-studio csv express file class tensorflow sorting codeigniter perl
MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1b3baa6-2c2bb.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1b3baa6-2c2bb.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?