Yeah, on rewatch I generally start at season 2. Same with The Office (US). Both shows are phenomenal, but they take a while to find their footing.
However, I’d certainly argue that even on first viewing, the first seasons can be skipped. You might miss a bit of backstory, but you’d be able to understand most things perfectly fine.