Should I turn my powerhead off at night?

So just run the airline to the bottom of the tank and allow the bubbles to drift to the top? And that will be enough?
Unlikely, it needs to be dissolved somehow. Either get the bubbles so they are small enough they disappear before the surface, or keep them in the water somehow.

Using something like a reactor might work better in your case. But depends on the whole setup.
 
AquariaCentral.com