Quantcast

meta commands Articles

How Meta Commands Can Help You Love Spiders
· 2

Nearly all search engines utilize spiders (which are also known by their original name, robots) to go out and scour the web looking for web pages. These search engine spiders then bring the data back to be indexed by the engine.