Not really. Windows only supports FAT and NTFS filesystems natively. There was an old ext-fs driver back in the day, but I have not looked for one in a decade or more. There might be one out there already.
The deal with case-insensative support is likely from Windows users who are annoyed that Readme.md, readme.md, and README.MD are separate files on ext4 but the same file in FAT or NTFS. UNIX and Linux come from a school of thought that allowed you to do things like use different case in filenames.