How to inspect a log file?

I have matlog and I let it record for 10-12 hours. Now I would like to inspect it for any suspicious/irregular entries. The problem is that I have end up with a huge log file with something like 3.5M entries. I found some repetitive entries from an UpdateManager which by removing them I’m now down to 95K entries. However it is still kinda big to inspect line by line so I was curious if there are any ideas of tools or practices on how to proceed.

PS: I have moved the log to my pc. I’m not trying to do it on the phone

azurefirefly, (edited )
@azurefirefly@lemmy.basedcount.com avatar

Cat grep and diff? Kde has some great apps for that, kate and kdiff3 are the two that come to mind

gohixo9650,

how would you use diff? Diff compared to what?

Max_P,
@Max_P@lemmy.max-p.me avatar

What’s a suspicious or irregular entry? It’s hard to inspect a log without at least a reference to what a good log might look like. Every device has fairly unique logs, so I doubt there’s an Android log analyzer that can tell you immediately if something is abnormal.

You can always collect a log file yourself that you deem be normal, and you can write some processing code to automatically remove lines that both have in common.

But for what you’re doing, you pretty much have to keep doing what’ve been doing: find big repetitive offenders, remove them, rinse and repeat until it’s all unique lines and hopefully only stuff worth looking at.

gohixo9650,

yes I wouldn’t expect something to automatically do it for me. I know that I have to do a lot manual inspection. I was mostly curious if there is any way to help this process, for example a tool that it can easily group same/similar entries, and allows me to easily remove them. Instead of what I’m doing now that I have to manually notice that something is repetitive. Then I have to open in vim and write a regex that removes this, but also be careful that it doesn’t remove anything else. Then rinse and repeat.

But I get that most probably I have to do it manually.

You can always collect a log file yourself that you deem be normal, and you can write some processing code to automatically remove lines that both have in common.

about this, I’m afraid it is even more difficult to be honest. Apart from I’m not sure where to find such log, as you already said, each device has fairly unique logs. I doubt I will manage to do anything valuable in any reasonable time frame.

Thanks for the suggestions though!

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • uselessserver093
  • Food
  • [email protected]
  • aaaaaaacccccccce
  • test
  • CafeMeta
  • testmag
  • MUD
  • RhythmGameZone
  • RSS
  • dabs
  • oklahoma
  • Socialism
  • KbinCafe
  • TheResearchGuardian
  • Ask_kbincafe
  • SuperSentai
  • feritale
  • KamenRider
  • All magazines