Actually, there really isn't a huge amount of variability between fish in the wild. Age, gender and dominance within a system will impact size, but otherwise, most fish reach a pretty standard length. I know that when we do population studies, average variation within an age class in pretty minimal--less than an inch. That's impressive, statistically. I've seen the hatchery raceways with 50,000 fish, and there will be 6-10 fish that are more than 1 inch different in size, in either direction. The closer a fish is to F01, the more likely they are to be all the same size. In the wild, being much different in size that your age group is a serious liability. Bigger, and you have to compete with older, wiser fish, smaller, and you can't get as much food as quickly. Schooling fish of the same species will preferentially school with their own size, since the disparity in size makes them stand out, with means they are easily targetted by a predator.
Obviously, comparing fish from a huge reservoir with those from a tiny creek will reveal some huge differences. However, you can legitimately say that their environments impact growth rates. Hence, a fish that is 2-3 inches in the wild should be able to easily reach that 3 inch mark in a home aquarium, since they stresses and limiting factors found in wild populations (ie, food, pollution, competition) can be controlled in an aquarium. If anything, the maxes provided from wild fish may be under-estimates for the potential size the fish could achieve in ideal conditions.