my colleagues and I have also done this kind of cooperation. After I have finished climbing the data, I can directly store the data to mysql, and check the data directly. We discussed the table structure of the database in advance.
Interface data format according to the needs of each other's platform, it is almost the same as writing an app interface. Give a json data
you can actually design the database structure. You can save it here and read it there. Relational databases like mysql and document databases like mongodb are fine.
your crawler is a winform project. You can do another web project. If your classmate needs any interface, you can write a corresponding web api interface to send json format data to him.
if you want to do it in the crawler winform project, you can write a socket server on your side and a socket client on your classmate's side to request data. However, it is not recommended to write the server in winform, it is recommended to use the web api, just mentioned, followed by the recommendation webservice and so on.
1. What is the order of magnitude of your data? it's MB,GB,PB?.
2. Whether your data is crawled down and stored in the file or in the database
3, how you plan to open the data to the other party, whether to provide web api, or ftp, or database access
once you have thought about these questions, you will naturally know what to do and which materials to study
.
