It may help to purchase large diameter flexible tubing. I removed the large part of a teeny gravel vac, and use the rubber tubing to siphon out any junk on top of my sand (using the "hover" technique). Granted, that's in a 10 gallon. I do see larger rubber tubing sold in many lfs's... this would work better for bigger tanks. Also, fitting the end with a length of rigid tubing will help if you have taller tanks.
The reason you use rigid tubing versus the gravel vac tube, is better suction.
The reason you use rigid tubing versus the gravel vac tube, is better suction.