I almost did the same to get eldritch blast as I thought my bard needed an every turn spell to cast. In my experience you are only a few levels away from having enough spell slots to make the problem go away. Also as a bard you will get the option to take a couple spells from any class which shoukd help round you out.