Shrimp can help, depending on the species. Some tetras will nip at shrimp, as well, and of course, something like a bamboo shrimp won't help at all (and really, aren't great for new tanks).
Controlling nutrients and getting the plants growing is the best option--knowing what plants you have will be critical. Where did you get the seeds? Most commonly, the places selling it claim it's dwarf hairgrass or something similar. It will survive submerged for a few months, but ultimately dwindle and die. To be quite frank, I would count on this happening, and advise you to remove it now and replace it with tissue culture plants. Yes, it's a pain, but it will be less painful than dealing with the mess.
There are a number of safe fertilizer options. Look into Thrive--it's simple to dose, and quite helpful.