When I first started managing SEO campaigns for clients, the XML Sitemap was a primary directive – no ifs, ands or buts. In my naivety, I couldn’t fathom why anyone would argue against creating a Sitemap and essentially pointing the search engines to my perfectly optimized content! Since then, I’ve had my eyes, and mind, opened to new ideas and viewpoints that have challenged my construct on a Sitemap’s necessity. Today, I’d like to quickly cover what an XML Sitemap is, the strongest PRO arguments, the strongest CON arguments and a peek into my personal experience.
What is an XML Sitemap?
To quote Sitemaps.org, “…a Sitemap is an XML file that lists URLs for a site along with additional metadata about each URL so that search engines can more intelligently crawl the site.” Sitemaps include instructions for the search engines telling them the relative importance of the page (homepage being the highest), the estimated frequency of updates (daily, weekly, monthly, etc.) and most importantly the exact URL structure for your website’s pages.
Sitemaps can be created with simple online programs like XML-Sitemaps.com, or other desktop applications like the gSiteCrawler exist for this purpose as well. More sophisticated webmasters can create automated programs to create Sitemap files, and for bloggers, plugins exist to automate the creation of your Sitemaps. What do you do with the Sitemap once it’s created? Typically, site owners then submit their Sitemaps to Google Webmaster Tools, Yahoo! SiteExplorer and the Live Search Webmaster Center to alert the search engines to the XML file and ultimately the site’s content.
Reasons to Include an XML Sitemap
- Submitting your Sitemap to the search engines can speed up the process of getting your site crawled and your pages indexed. To take that a step further, it can also open up the potential that more of your pages get indexed in the long run.
- This is a related point to #1, but Sitemaps can help the search engines to find and crawl pages “that aren’t easily discovered” – perhaps because of restrictive, advanced coding like AJAX or Flash.
Being able to pass extra information to the search engines *should* result in them crawling your site in a more optimal way.
Reasons NOT to Include an XML Sitemap
- Many of the SEOs that I follow and respect seem to hammer away on this point: Sitemaps hide architectural issues. Whether you hear it from SEOMoz or Matt McGee, this is an important concern to take note of. Those who oppose Sitemaps argue that you should fix the root of your crawlability issues (improve internal linking, other SEO factors instead).
- Sitemaps don’t necessarily get your content indexed, don’t target keywords and don’t add to your link building efforts! Instead of wasting resources on creating the perfect Sitemap, you could instead be optimizing your pages for your keywords and obtaining links.
Using a sitemap to solve crawlability issues is never a good idea. It’s like putting a band-aid on your chest after open-heart surgery. You need a lot more help than that.
Notes from My Personal Experience
Though I blindly accepted the over-arching idea of a Sitemap in my early SEO days, I now follow that path with more confidence. I’m inclined to believe that using a Sitemap isn’t a bad thing, and in most cases is a helpful SEO action item. The caveat to that is that you MUST adhere to the rock-solid core SEO tasks, and the very reasons people argue against using Sitemaps. DON’T use your Sitemap to hide a poor hierarchical site structure. DON’T use your Sitemap to leap-frog the search engines over your awful internal linking structure. DON’T submit your Sitemap and assume your path to SEO glory is done and over with…
I can talk and talk and talk about why I think you should or shouldn’t use a Sitemap, but stats speak louder than words. I’ve been working on a smallish-site that launched in late summer, than completely revamped again in September. Below you will see the organic traffic stats for the days BEFORE submitting the XML Sitemap, and the days AFTER:
I’ve had similar results with other sites as well. So, officially, I’ll go on record as saying I’m a proponent of using XML Sitemaps. What is your opinion on the great Sitemap debate? Do you have any stats or other data to support or disqualify the use of Sitemaps? Leave me a comment!