Not sure if you found something yet, but being that they are herbs for food use, my method of bug removal is to mix up some dish soap and water in a container, then swish the plant around in it for a bit, rinse it off and repeat if necessary. I usually have to do this every few days, as you never seem to get the eggs with the first wash.
Soapy water kills a bunch of things, but some bugs are harder to kill, and usually have to be totally immersed for several minutes before the soap gets them. Earwigs are easy to kill, aphids and spider mites are harder - especially if you want to go food safe!
Clarification, I dunk the plant only, not the pot or soil, so it takes some finesse to keep everything from falling into the container of soapy water. Sometimes it helps to take the plant outside and use a spray bottle of water to blast off the bugs.