When python3 uses urllib to climb a web page, why does he get only the top half of the html?

python version 3.7.0
when using the urllib crawler to get the html code of a web page, there was an error and the error was ignored.

html = data.decode(charset,errors="ignore")

gets only the top half of the html.

means that part of it is missing.
I would like to ask the great gods, what is this situation?
No results can be found on the Internet. Am I the only one to meet?
it"s true that python is fast at writing crawlers, but I"ve stepped on several holes at first.

Urllib python

Mar.22,2021

The

problem is solved. It is the problem of vs code. It would be nice to change the debugging environment. It seems that vs code still can not be used as a development environment.

is the content of the crawl too large. Vscode only displays

within a certain size by default.

Previous: Beginners ask how to use the framework to write projects to manage the SEO of each page?

Next: Laravel + vue uses phpstudy to open the project.

Python urllib request urlopen request web page returns bytes type
I am learning the urllib library. I use the following code to request the home page of the face degree, and the result is < class bytes >. I have tried a variety of methods to decode it, but all of them are unsuccessful (error or null) the followin...

Web-crawler request urllib python

Mar.28,2021
Problems with urllib in different versions of python!
import base64 import urllib2 class SGovToken(): TIME_OUT = 3600 LAST_UPDATE_TIME = "" TOKEN = def __init__(self, *args, **kwargs): pass def get_token_from_sgovernace(self,appid,appkey,url): if not app...

Urllib2 urllib python

Sep.16,2021
Py requests codec can't decode byte 0x8b to appear on the web page
from urllib.request import urlopen, urlcleanup, Request url = http: tech.qq.com a 20181210. request = Request (url) response = urlopen (request) content = response.read (). Decode ( gb2312 ) urlcleanup () appears: UnicodeDecodeError: gb23...

Web-crawler urllib python

Jan.27,2022

MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1b37e81-2c0b1.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1b37e81-2c0b1.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?