It certainly sounds like the fish are exhibiting signs of shock. Unless they were already sick in the store, or wherever they came from.
And I'm not simply voicing an opinion when I stress the importance of acclimation. In the gills, there are only 1 to 2 layers of cells separating the water from the fish's blood stream. Blood pH directly affects hemoglobin's affinity for oxygen, and its ability to expel CO2. And oxygen deprivation damages tissues and organs.
The fact is that a sudden pH shift will kill fish far more quickly than a little ammonia in the bag. There's nothing to lose by waiting.
Sorry to get all sciency. But getting the fish in the tank as quickly as possible is a big mistake, one that I made too many times when I was a newbie.