I think ELK is a bit of a killer. Is there a simpler and lighter log processing plan?

what Google or Baidu can find is a set of log solutions, such as ELK, but for the current scale of our application, it feels a bit like killing a chicken with a knife.

I would like to ask my colleagues, when the scale of the application is not too small, how to solve the problem of log collection? Regardless of the log display, you just need to collect a certain server.

is there a shell script? Or the lightweight ones are open source tools that don"t cost too much to learn and build.

Thank you ~

Mar.29,2021

as long as you collect a certain server, assuming you don't think about real-time, you can do this:

  1. the log generated by the program does rotate, according to the date to generate files such as log-2018-01-01-01-01-02
  2. write a cron scheduled task to scp the log files to a unified server

you can consider using log4j to output logs to mongodb,. It's easy to install a mongo, and configure Log4j

.
MySQL Query : SELECT * FROM `codeshelper`.`v9_news` WHERE status=99 AND catid='6' ORDER BY rand() LIMIT 5
MySQL Error : Disk full (/tmp/#sql-temptable-64f5-1eb8e74-2716.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
MySQL Errno : 1021
Message : Disk full (/tmp/#sql-temptable-64f5-1eb8e74-2716.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
Need Help?