The best option I’ve found is configuring sonarr (or whatever you’re using to grab releases) to get the files you want up front.
I’ve not seen anyone uploading audio tracks without video. I have a somewhat similar situation where I run two sonarr instances, one for English and one for Japanese