Here are some things I do that save cash, and honestly, look more natural.
1) My substrate is pebbles and coarse sand from local streams, then rinsed/cleaned well. If the stream is clean looking, pollution and diseases usually aren't an issue. Then again, I live in a somewhat rural area. I wouldn't do this in Chicago or L.A.
2) Rocks-- most anything very hard (ie, not easy to chip with a screwdriver) is safe. Put a few drops of vinegar on it (or muriatic acid, if you have it, is better) and if it fizzes, it will raise the pH of your tank, which you may not want unless you keep hardwater fish.
3) Driftwood-- there is tons upon tons of driftwoon in my local lakes and rivers. If you have access to a boat or a canoe, head along the shoreline and look for it, usually in shallow water or washed up on the shore. Be careful not to get anything that smells like it is decomposing. Good driftwood smells like peat moss and can't be dug far into with a screwdriver too easily. Clean with a very hard bristle brush (like a wire grill brush), and bleach for a few days in a 10% bleach solution-- then rinse well and soak again in clean water. (Actually, if the wood is very well scrubbed, I usuallly skip the bleach). I have a friend that make a ton of cash selling driftwood he's prepared.
DO NOT EVER use wood that hasn't spent some time floating around in a lake, river, or ocean (ie, stuff you find in the woods). I'm sure some types of wood are safe, but they are loaded with tannic acid, and it's best to let nature absorb most of it.
If you have a pressure washer (or access to one) or sandblasting equipment, either one can make driftwood look incredible. The pressurewasher, especially, does good at blasting out dirt, rotted bark, etc... But this isn't necessary. I don't b/c I don't have the equipment.
4) Live plants--- Here in the lowcountry in SC, we have wads of plants that are great in the aquarium. I just go to the lakes, poke around the shores, and see what I find (other than alligators and cottonmouth snakes). NJ should have some nice plants as well. Be careful not to transport any leeches or other critters by accident--- rinse them well under strong faucet water.