when there are many pyspider projects, it is always stuck there and cannot run tasks automatically
it is not possible to add more than one processor fetcher.
adjust the default fetcher processor result_worker in the all decorator in the run.py file to 10 -!
how should the numbers in here be interpreted?
under the guidance of God, it has been bothering me for a long time.
number of tasks and blocks
I have a similar problem. I don't know how to deal with it. I'm looking for the answer
. [I 181119 10:35:00 processor:202] process i_snssdk_com:ecfe7de394e1734fab9074fba517023c -> [200] len:28508-> result: {'arc': {' fol:0 msg:0 err:None
[I 181119 10:37:29 processor:202] process i_snssdk_com:266344b683700cb638ca9ac7d1337fc4 https://i.snssdk.com/api/feed.-> [200] len:157158-> result: < generator fol:20 msg:0 err:None
[I 181119 10:37:30 processor:202] process i_snssdk_com:373956fb8fbc6ca5284c70f53ad6fd8a https://www.toutiao.com/i6624.-> [200] len:13457-> result: {'arc': {' fol:0 msg:0 err:None
[I 181119 10:38:55 processor:202] process i_snssdk_com:49e315bc651561ff6debd70d82a6dcc6 https://i.snssdk.com/api/feed.-> [200] len:172489-> result: < generator fol:10 msg:0 err:None
[I 181119 10:39:16 processor:202] process i_snssdk_com:ad9a22374422522ffa7ca3860ff92edc https://i.snssdk.com/api/feed.-> [200] len:168314-> result: < generator fol:2 msg:0 err:None
[I 181119 10:39:16 processor:202] process i_snssdk_com:d740f0fd599be0ca6b59998877840d9f https://www.toutiao.com/i6624.-> [200] len:26865-> result: { 'arc': {' fol:0 msg:0 err:None
[I 181119 10:41:36 processor:202] process i_snssdk_com:deb20e86e0e3b6b27e49ce3190a97ee8 https://i.snssdk.com/api/feed.-> [200] len:219209 -> result: < generator fol:20 msg:0 err:None
[I 181119 10:41:36 processor:202] process i_snssdk_com:59f69cc54069d1cae7da19d3d531e115 -> [200] len:29478-> result: {'arc': {' fol:0 msg:0 err:None
[I 181119 10:54:45 processor:202] process iObsssdk.com: A376c0a9fce81642d7c156d5eb68e15c https://i.snssdk.com/api/feed.-> [200] len:234305-> result: < generator fol:18 msg:0 err:None
Previous: Questions about the take () method in DelayQueue in java?
Next: How does vue display these two components at the same time?
it used to be fine, but now it doesn t work. I don t know what the reason is, and Baidu didn t find out why. I asked the boss for help, thank you D:python.ptc > D:python.ptc > pyspider all dazzle anacondalibsitelypackagespyspiderlibsutils.pyride1...