So now that I have a nice planted tank...

Just vac up the stuff on top of the carpet by hovering above it. If there are any areas of substrate you can reach, you can vac them as well.
 
I gently rest the vac on the plants or even lightly press into the carpet if I don't think it'll hurt the plants.
 
AquariaCentral.com