I used to play around with custom ROMs back in the Nexus days but I use my phone now for so many banking and other security - focused things nowadays that I feel it is just too risky to do all of that on a device that uses a non OEM ROM.
Maybe I’m too paranoid, but phones have gotten so complex today that even highly technical users have trouble ensuring that every aspect of their device is safe unless it is locked down to some extent.