I feel like I’ve seen paragraphs end with quotation marks and then pick back up with more quotation marks on the next paragraph in serious literature, so I’d say write how you want. That said, it is good to break up walls of dialogue every now and then to set the scene with small details like that.