Well, if you pulled out your gravel, you just removed a fair portion of your biological filtration.
Test your aquarium water for ammonia and nitrites. Thats most likely what did it, If any are detected, follow up with daily water changes as well as the addition of something like stability and prime to the system in order to help process the waste and re-establish your biological filtration.