Pea gravel means the stones are the size of peas. Which is larger than Flourite. People tend to use pea gravel as a catch all term. But it's not.
Anytime you mix two or more different sizes of substrates the larger pieces will always end up on top over time.
Frequent disturbances of the substrate, removing plants, vacuuming and such will actually prevent this separation.