Any and all decaying organic matter will contribute material to the nitrogen cycle and, therefore, the ammonia level. Providing that the mass of material is not too large the bacteria in the aquarium will cope with it but it is probably best to avoid taxing the system. So, whether you use your hand, a net or a siphon best to remove as much decaying material as feasible.
Beasts