I'm most worried about the temperature swings between day and night. THe temp could easily swing 10-20 degrees in the spring here. Chiller in the day, heater at night? It might be possible, but it would be really tricky.
................but even one freeze could threaten goldfish. It'd be risky.