pH changes caused by CO2 do not harm fish. And you can drop the pH quite rapidly with no harm to the fish. You can do a 1° drop in an hour and do no harm to the fish.
This of course assumes that your tank is not low on O2 to start with.
This of course assumes that your tank is not low on O2 to start with.