beginner python crawler, use scrapy framework to climb Douban movie list, no matter using response.xpath or response.css to return an empty array, very helpless, does this framework need any other settings?
does ps: python have a framework for parsing dom that is as easy to use as jq?
Code:
import scrapy
class ArticleTitle (scrapy.Spider):
name = "title"
start_urls = ["https://movie.douban.com/chart"]
def parse(self, response):
lists = response.css("div.indent>table")
for each in lists:
contents = each.css("p.12>a::text").extrat()
print(contents)
error screenshot:
