An error occurred when Python3 crawled the short rent of Piglet.

just contacted python, according to https://blog.csdn.net/mtbaby/.
wanted to crawl piglet short rent information, but then IP was blocked.
then looks at the problem of agent ip , but still can"t get the information

. 
import requests
from lxml import etree
import time
proxies = {
    "http": "http://61.135.217.7:80",
}
user_agent = "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.162 Safari/537.36"
url = "http://hz.xiaozhu.com/"
headers = {"User-Agent": user_agent}
data = requests.get(url, headers=headers, proxies=proxies).text
h = etree.HTML(data)
home = h.xpath("//*[@id="page_list"]/ul/li")
time.sleep(2)
for div in home:
    title = h.xpath("./div[2]/div/a/span/text()")[0]  -sharp 
    price = h.xpath("./div[2]/span[1]/i/text()")[0]  -sharp 
    print("{}-->{}}".format(title, price))

the running result is as follows

hoping to help solve it. Thank you very much!

Web-crawler python
Feb.28,2021

not every agent IP is valid. You need to make sure that the agent is valid before using

. 
import requests
from pyquery import PyQuery as Q

headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36'}
proxies = {
    "http": "http://103.235.245.35:8080"
}

r = requests.get('http://hz.xiaozhu.com/', headers=headers, proxies=proxies)
for _ in Q(r.text)('-sharppage_list li'):
    title = Q(_).find('.result_title').text()
    price = Q(_).find('.result_price').text()

    print title, price

Previous: DataFrame ['column name'] = Series Why can't you do this?

Next: How to add token to the axios request method every time

css mysql arrays josn react html typescript webpack npm sass R objective-c .net sql-server jquery python-3.x angularjs django angular excel regex iphone ajax linux xml pandas vba spring database wordpress string wpf xcode windows bash postgresql oracle multithreading eclipse list firebase algorithm macos forms image scala visual-studio azure bootstrap spring-boot react-native python-2.7 docker performance function winforms matlab powershell apache dataframe api sqlite numpy rest shell selenium flutter dart maven loops qt swing android-studio csv express file class tensorflow sorting codeigniter perl
MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1e46d60-4391f.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1e46d60-4391f.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?