How does the node crawler get the queried data on the page?

problem description

has written about simple crawlers. According to the web page opened by url , the content in the web page is the information to be crawled, which is easier to do.
now the page defaults to no data or not the data you want, so you need to click a query to re-query the desired data.
but click the query button, the url of the page is unchanged, so you cannot get the desired data according to the url of the page.

in this case, how to get the queried data through the crawler?

Web-crawler nodejs-crawler node.js javascript

Dec.29,2021

then you directly simulate sending the request url sent by clicking the "query" button, and then look at the returned value, instead of directly sending the url of the page

Previous: The value of Vue splicing variable

Next: After macos maven compiles the jar package, runs the log garbled on linux.

MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1e37186-43144.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1e37186-43144.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?