Well I guess it depends on how many hiding spots there are in the tank. In a relatively bare tank (a few plants or decorations) I would suggest lights off. For a tank with lots of hiding spots lights on will probably fine as the fish can escape.
If there were no other fish in the tank then lights off would be best, IMO.