How Do Search Engines See Your Site? Try Using a Spider Simulator to Learn More
Posted By Joe On July 29, 2009 @ 1:25 pm In Crawlability | No Comments
If you want to understand someone, you should walk a mile in their shoes. When it comes to how search engines understand your website, you should work mile in their shoes. Okay, maybe this is a stretch. What I am saying is that if you want to understand how search engine spiders view your site, you should utilize a spider simulator tool. This way you’ll get an idea of what they’re seeing.
There are numerous spider simulators out there. Each pulls data slightly different. However, overall you will get glimpse into the data that search engine spiders/bots are pulling from your site.
As you run your website through a couple spider simulators, here are few questions to keep in mind:
- How accurately is my information being displayed?
- Are my most important keywords appearing in the results?
- What is my keyword density?
- What links are the bots are following off of my homepage?
Here a couple of spider simulators that provide some decent information.
FeedtheBot [1]
This is probably my favorite spider simulator. This simulator provides some of the most information in regards to on-page text, links, keywords, and keyword density.
SEO-Browser [2]
This is another tool that can provide quite a bit of helpful information including page load time, alt text information, number of external and internal links:
These are just two of many spider simulator tools out there. Do a little searching around to see which one or two suits you best.
Article printed from The Adventures of SEO Boy®: http://www.seoboy.com
URL to article: http://www.seoboy.com/how-do-search-engines-see-your-site-try-using-a-spider-simulator-to-learn-more/
URLs in this post:
[1] FeedtheBot: http://www.feedthebot.com/tools/spider/index.php
[2] SEO-Browser: http://www.seo-browser.com/
[3] Learn How to Harness the Power of Links to Improve Your Site’s Internal Linking Structure: http://www.seoboy.com/learn-how-to-harness-the-power-of-links-to-improve-your-site%e2%80%99s-internal-linking-structure/
[4] New Research Confirms Need for SEO: 81% of Internet Users Used Search Engines in 2008: http://www.seoboy.com/new-research-confirms-need-for-seo-81-of-internet-users-used-search-engines-in-2008/
[5] Learn How to Use the New Canonical Tag and Other META Tags to Control Your SEO Search Results: http://www.seoboy.com/use-new-canonical-tag-and-other-meta-tags-to-control-seo-search-results/
[6] Learn How to Project Traffic and Leads Using Google’s Insights for Search: http://www.seoboy.com/learn-how-to-project-traffic-and-leads-using-googles-insights-for-search/
[7] Learn How to Make Flash and SEO Play Nice Together: http://www.seoboy.com/learn-how-to-make-flash-and-seo-play-nice-together/
Click here to print.