An Aeropress, Moka Pot or a Vietnamese Phin Filter are other cheap alternatives to try. But if you're overextracting in a French Press you might be doing something wrong with the brew time and/or the temperature.
It'd also help to know how darkly roasted it is and what type of beans they are.