They will over time, but its not going to cause any serious trouble. The big pieces of driftwood I have in there will probably alter my water chemistry more then a few staples will. I can always pull the staples out after the ferns have rooted as well.