Get a new RO unit. For the volume of water that you're talking about, I don't think that any diy action will be very effective.
I'm not sure about tannins having any effect on KH. Tannic acid should lower pH, but I'm pretty sure that the conjugate base, what's left after the H+ leaves and lowers pH, would contribute to KH. The net effect should balance, like adding CO2, pH goes down, KH stays the same.
Like OG said, water softner won't help either. It's just an ion swap. I'm not even sure that it even affects carbonates. I think that it just works on the cations Calcium and Magnesium, but I'm not positive about this.