problem description
you need to extract keywords from url to the crawler, so you need to get the url that redis sends to the crawler.
related codes
/ / Please paste the code text below (do not replace the code with pictures)
redis_key = "weibospider:start_urls"
-sharpnames=start_urls.split("q%3D")[1].split("&page")[0]
global names
url = bytes_to_str(self.data, self.redis_encoding)
names= parse.unquote(str(redis_key).split("q%3D")[1].split("&page")[0])
what result do you expect?
I hope to get the text extracted by url in names.