Quantcast

Get Your Sitemap Discovered Automatically with your Robots.txt File

Get the WebProNews Newsletter:
[ Search]

At Search Engine Strategies New York it was announced that you can now have your sitemap automatically discovered by configuring it in your Robots.txt file. It is simple and easy to do, you’ll just need to know the URL or web address of your sitemap.

First, open your Robots.txt file on your server for editing. Then you will need to add the following line to the end of the file (it can be anywhere, but the end is probably a good place).

Sitemap: http://www.mydomain.com/sitemap.xml

Save the Robots.txt file with the new line for the sitemap URL. There you go! Your whole file may look something like this:

User-agent: *
Disallow: /somefolder/
Disallow: /somethingelse/
Sitemap: http://www.soloseo.com/sitemap.php

Search engines already come to your Robots.txt file when they visit your domain, so on their next crawl they will automatically find your sitemap file.

If you have a new site/domain you will probably still want to submit the sitemap URL to the search engines. To submit you can either submit the URL through their interfaces or use a ping.

Submit Sitemap to Google or Ping Google with your Sitemap

Submit Sitemap to Yahoo or Ping Yahoo with your Sitemap

Submit Sitemap to MSN Live.com


Info for Ask.com Sitemaps
or Ping Ask.com by hitting this address:

http://submissions.ask.com/ping?sitemap=
http://www.yourdomain.com/sitemap.xml

Comments

Get Your Sitemap Discovered Automatically with your Robots.txt File
Comments Off
About Michael Jensen
Michael Jensen is a co-founder of SoloSEO.com, an online service for SEO project management and do-it-yourself SEO tools. SoloSEO.com allows web marketers of any skill level to manage keywords, content tracking, link building, and competitor data.

Michael started as a web application programmer, and has since managed, developed, and co-founded several web technology companies. His applications are providing document and workflow management solutions to businesses in various industries, from small businesses to large corporations, including several Fortune 500 companies. WebProNews Writer
Top Rated White Papers and Resources

Comments are closed.