You may have some trouble planting DHG in gravel - it's hard enough with sand! : I hope your gravel is fairly small or your planting will probably fail altogether.
That being said, you would generally not gravel vac the area with DHG... accumulated mulm will serve as nutrients. Again, this shouldn't be a problem unless your gravel is too large. Pea gravel is the largest I would recommend for planting.