I don't think oceanic 'toxins' are evenly distributed (an estruary, for example, is probaby more nutrient heavy than an area of water hundreds of miles from land. For some reason, some SW fish are able to tolerate high toxins (damsels come to mind), even though they're usually found in low nutrient/low toxin reef environments.
Also not all marine fish are larger than their fresh water counter parts. It would interesting to know however, would a 8" grouper have a greater bio-load than a similarly sized cichlid, for example.
In reef set ups, keeping nutrient and 'toxin' levels as low as possible is desired because of the water quality requirements of certain corals, etc. I think the more fish you have the more challenging it would be to maintain that quality.
I have 75gal FW african cichlid tank with over 20 fish in it. Meanwhile my 65gal reef tank contains just 4 small fish (2"-2.5" and they're pretty much maxed out in size). Their small size and associated small dietary requirement translates into a small bioload which makes keeping water quality ideal for my corals. 20 small fish in my 65 SW tank would be deterimental. At least that's how I see it, anyway.
On the other hand, I've got a (in my opinion) overstocked SW Fish Only 45gal tank with 7 fish (2" to 4"). I've been very lax/negligent on water changes (maybe a 35%water change every 2 months; I'm actually overdue for a water change right now, but nitrates are only reading 15ppm as of yesterday). No way I could go that long without a water change in my FW tanks.