I think since we have it we played it at least twice a month (even more so after we now got Legends too), so can't really tell for longer breaks. I played Roll for the Galaxy, not Race, but had the same experience there you described about getting back easily after a longer break. I would imagine it similarly for Imperium, but guess thats also a personal thing.