yes I wouldn’t expect something to automatically do it for me. I know that I have to do a lot manual inspection. I was mostly curious if there is any way to help this process, for example a tool that it can easily group same/similar entries, and allows me to easily remove them. Instead of what I’m doing now that I have to manually notice that something is repetitive. Then I have to open in vim and write a regex that removes this, but also be careful that it doesn’t remove anything else. Then rinse and repeat.
But I get that most probably I have to do it manually.
You can always collect a log file yourself that you deem be normal, and you can write some processing code to automatically remove lines that both have in common.
about this, I’m afraid it is even more difficult to be honest. Apart from I’m not sure where to find such log, as you already said, each device has fairly unique logs. I doubt I will manage to do anything valuable in any reasonable time frame.