Neither brittle nor serpent stars will feed on sand infauna to any destructive extent. Only sand sifting starfish (eg, Archaster typicus) are risky in this regard.
Understand that the distinction between brittle and serpent stars is a totally arbitrary thing that people in the hobby have cooked up for themselves - scientifically, they aren't in different families. Both serpents and brittles will rob corals and other sessile critters if they aren't getting enough food themselves. IF ADEQUATELY FED, either should be ok. This means that you can't just leave them to scavenge on their own; you need to make a point to spot feed these guys with pieces of shrimp or krill. Still, I would avoid Ophiarachna incrassata, the green brittlestar that has been mentioned in this thread. It seems to have a more predatory nature even when well-fed, and it gets a bit on the large side.
FWIW, urchins are actually more risky additions IMO as all can be unpredictable. Coralline algae consumption is a given, but they will also plow through macroalgaes and the occasional soft coral. (Some urchin species are omnivorous and will eat meats when available).