the following code opens the yahoo.com home page and outputs all the text in the p tag
import urllib.request
import lxml.html
chaper_url="https://www.yahoo.com/"
headers = {"User-Agent":"Mozilla/5.0 (Windows NT 6.1; WOW64; rv:23.0) Gecko/20100101 Firefox/23.0"}
req = urllib.request.Request(url=chaper_url, headers=headers)
myString=urllib.request.urlopen(req).read()
root=lxml.html.document_fromstring(myString)
txt=root.xpath("//p")
for etxt in txt:
print(etxt.text_content())
change the target: http://www.seek68.cn/bdhxqkml.
the same code structure
import urllib.request
import lxml.html
chaper_url="http://www.seek68.cn/bdhxqkml-7.htm"
headers = {"User-Agent":"Mozilla/5.0 (Windows NT 6.1; WOW64; rv:23.0) Gecko/20100101 Firefox/23.0"}
req = urllib.request.Request(url=chaper_url, headers=headers)
myString=urllib.request.urlopen(req).read()
root=lxml.html.document_fromstring(myString)
txt=root.xpath("//p")
for etxt in txt:
print(etxt.text_content())
the above code will get stuck in myString=urllib.request.urlopen (req). Read ()
Why?