I just looked around on five different sites I found. A couple recommend "surface" cleaning only and not to agitate the sand too much.
A couple mentioned sand-sifting gobies, which I did have and plan to replace soon. One said never do 100%, and to do it in sections on different days.
This one said:
Poorly maintained substrates, however, tend
to accumulate detritus quickly and if this is not dealt with, anaerobic (oxygen poor) areas could develop as bacteria use oxygen to break down the detritus further. This can eventually lead to major problems. Detritus often acts as a source of phosphate as bacteria
decompose it and release stored phosphates. These phosphates then act as nutrients for undesirable algae growth such as "hair algae" (Derbesia) and "slime algae" (cyanobacteria). As there are still hobbyists who use undergravel filters with relatively thick substrate beds and others who would like to use a substrate in their
reef aquariums for aesthetic reasons, it is important to find a way to deal with detritus.
http://www2.hawaii.edu/~delbeek/gobies.html
This site also recommends the gobies (I love gobies). I think I'll just get more gobies and take out LARGE debris with a net. I'll probably still vacuum the sand (less so in the reef), just lightly and not as frequently.