Good bottom feeder

If you want to keep the white cloud, get a 15g minimum, get 6-8 white clouds, your betta, and some kind of shrimp.

If you want to keep the 2g, get rid of the white cloud, the betta is cramped enough, and white clouds are schoolers and they can die of loneliness im sure (corys can, and they dont school nearly as much)
 
I would say your overstocked to begin with. If you want white clouds and Bettas, then you have to get a bigger tank. You would probably need a 15 gallon long minimum. I don't think you should have a Betta and white clouds together. White clouds prefer a lower temperature while Bettas prefer higher temperatures. IF you get a 15 gallon, you can have 1 Betta and anywhere from 6-10 ghost shrimp and possibly a mystery snail. You should start vacuuming the gravel with a gravel vac to keep your tank clean.
 
Bettas are not 'cramped' in two gallons and can live comfortably in as much space or even smaller (1 gallon is sufficient living space for bettas. I've made this arguement enough times now...)

... but they can't very well have many tankmates either in a tank that size. Mountain minnows are hardy and can live a long time in many different conditions... but if one is to consider their quality of life, having a single cloud in a small space would be far from optimal. Best to either give the fish back to the store or to a friend with a large community aquarium instead... or if funds permit, invest in a larger aquarium and a few more minnows for him to shoal with.

As for the food issue, I imagine overfeeding must be an issue. Try cutting back on the amount of food you administer and try to vacuum the aquarium's floor at least once a month. Ghost shrimp are delicate to poor water conditions and may die off easily, but those that persevere should last and make a good clean-up crew with proper water changes.

Personally, I'd say go with one (singular... or they'll mate!!) ramshorn snail. Granted, I'm no expert on invertebrates by any stretch but I think a snail would be hardier than shrimp, plus they have a protective shell to defend themselves against curious nips from your betta. I have a Thai betta who is fairly aggressive with his 'curiosity' and tends to nip at anything that piques his interest. This left me with a LOT of dead ghost shrimp... but my ramshorn learned to duck and cover when Dante was nearby and thusly Dante started to ignore him and now they go about their own business.
 
AquariaCentral.com