Looking at a map of their range they might be in the very southernmost part maybe near Madison, but just barely. You’d probably had to head towards Illinois or Indiana for a better chance of finding them.
If you use the app iNaturalist you can also find geotagged groves. Taking a quick peek there’s a handful in southern WI like I said, but they really pick up once you move south.