much depends on the status of your biofilter. if you've got zero ammonia and nitrite now (a 'cycled' filter) you can change "some" of the media. never replace all of it at the same time or you'll eliminate your bacterial colony. if you have sponge media such as in an Aquaclear, you can rinse it as needed without worrying about your biocolony .. it's virtually impossible to rinse out all the bacteria. i rinse my Aquaclear sponges every month.
if you've got filter "cartridges" with polymedia on both sides and carbon in the pouch within the two halves, you can cut some of the pad off the filter and place it inside or in back of a new filter and thus, seed it with alot of bacteria.
as far as vacuuming the gravel, i do so at every water change and i do a 50 percent water change on a weekly basis.