I would leave the media there. You have a pretty light load in there now. As long as you are monitoring it and doing the required water changes, you shouldn't have any issues.
Your ammonia is going to go up as soon as you add more load anyways...the bacteria you are generating are only capable of handling the load that is there.
Your ammonia is going to go up as soon as you add more load anyways...the bacteria you are generating are only capable of handling the load that is there.
