In my own personal experience, you might have a few problems if you get a pair of blue rams and they eventually spawn.
My bolivians are so laid back that nothing seems to rattle them, but I had a pair of blue rams in with them for a while and they constantly had my bolivians on the run.
Maybe if you just had one or even two of the same sex, but I'd be prepared to remove them just in case.