"Rusty" Java Fern deteriorating...why?

Most of the leaves on several of my 8 or so J. ferns have what looks like rust spots all over. The spots darken and become holes for the most part but some just have (and have for weeks) spots on them. I do not think it is algae. My A. nana, J. moss, Hornwort, and Corkscrew Val are doing well w/o algae or spots. Could the Hornwort (which is growing like mad!!) and others be outcompeteing the fern? Should I add ferts? Should I trim and remove the "infected" leaves?
http://www.aquariacentral.com/forums/showthread.php?threadid=4141

No. No babies. When I first got them, they were all (at least most) sprouting babies. I had them in a seperate tank for a couple weeks. I trimmed the really bad leaves, pulled the babies (left them in the Q-tank), and put them (the mature plants) in my main tank. Oh yeah, I bleached them too (1:20 for 2minutes). I'll keep an eye out for babies for now.