crawl URL: Code:
<?php
require "./phpQuery.php";
require "./QueryList.php";
use QL\QueryList;
$hj = QueryList::Query("http://q.10jqka.com.cn/gn/detail/field/199112/order/desc/page/1/ajax/1/code/300800",
array(
"content"=>array("td","text"),
)
);
$data = $hj->getData(function($x){
return $x["content"];
});
print_r($data);Page structure:
has a very neat structure, so it is theoretically easy to get data. Why is the result empty? Because the page is not a complete html?
QueryList does not support incomplete html,. You need to manually complete the html structure, or intercept some of the complete html code fragments you want to collect to QueryList to extract the content.
it is true that the table cannot be crawled
how does Querylist collect irregular table? <script type="application payload+json">...JSON...< script> and how to collect this JSON data set? ...
can be collected for the first time, and no array subscript is defined for the second error: 0 can be collected for the third time, so problems occur alternately. The code is as follows, and there is no problem when log comes out. public function get...
how querylist phantomjs simulates the mobile phone to grab the mobile page. When the destination URL returns, it indicates that the flash plug-in is not installed, and only the simulated mobile phone useragent can capture the playback address. <?php...
access to the official account requires authorization. Can this be crawled? ...
can queryList forge ip to prevent ip from being blocked, such as title =. = ...
problem description can be implemented independently: multithreaded capture and dynamic rendering pages but if you want to merge the two, you don t know how to do it. you help. the environmental background of the problems and what methods you hav...
it seems that the document is not loaded. how do you deal with such a problem? [Exception] Document with ID 8291f24461d0e759b6440677585a7ce7 isn t loaded. Use phpQuery::newDocument ($html) or phpQuery::newDocumentFile ($file) first. execute ...
return QueryList::get($url)->rules($rules)->range($range)->query(function ($item){ $re = []; $rt = QueryList::get($item[ link ])->query(); $re[ title ] = $rt->find( .gb-final-pn-article>h1 )-...
when collecting in tp5, error "fatal error: Call to undefined function collect () " ...