* * I would like to ask Senior Daniel two questions
1, java and python. Which two languages are more suitable for crawling systems?
2. In what language is Jinri Toutiao"s crawler crawling system written? * *
* * I would like to ask Senior Daniel two questions
1, java and python. Which two languages are more suitable for crawling systems?
2. In what language is Jinri Toutiao"s crawler crawling system written? * *
has nothing to do with language, the core of the real problem is resources.
how to build ip pool, whether you are familiar with anti-crawling strategy, whether you are familiar with HTTP, queue, cache.
these are all language-independent.
1, which of the two languages, java or python, is more suitable for crawling systems?
the crawling system has nothing to do with language. The use of Java or Python, should be taken into account, personal point of view, if you tend to do large-scale distributed, more stable crawlers, it is recommended to use Java, if it is used for simple crawling web pages, or pay attention to development efficiency, you can consider using Python. If you want to pay attention to both operational efficiency and development efficiency, you can consider using Python combined with CPP implementation, which is higher than the technical requirements of developers.
2. In what language is Jinri Toutiao's crawler crawling system written?
is said to be developed by crawlers using Java, and content recommendations and other services using the GE language.