Log collection and parsing

as a beginner to big data, I first learned log collection (mainly flume), searched the relevant log collection architecture scheme. If it is flume, most of them recommend and support flume + kafka, as a beginner. I don"t quite understand, one is a distributed log collection system, and the other is why it is used in such a combination as MQ,? I also hope that the elders of the great gods will be grateful for their doubts for me.
in addition, if the log is collected, it needs to be analyzed and processed later, so as to recommend what technology is generally used for analysis.

Mar.25,2021

in fact, you can learn about another famous match, ELK, which may give you some understanding of log collection.

now that MQ, is referenced, the producer-consumer model can also learn about it.

MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1b3c1ae-2ba64.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1b3c1ae-2ba64.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?