Welcome to SEO Boy, the authority on search engine optimization -- how to articles, industry news, insider tips, and more! If you like what you see, you can receive free and daily updates via email or RSS.

Archive for the ‘Crawlability’ Category

Review: Having Planned in the Shadows of Google Caffeine

June 16th, 2010 | Finn | Crawlability, Search Behavior

Back in August 2009 the SEO World was teased by the anticipated launch of Google Caffeine. We were giving a place to play with it. And then Google threw Caffeine on one of the live servers and we got to Google-Dance with it all the way through the holidays.

And as January 2010 rolled around, a funny thing happened:  we got Caffeine-deprived. …

Read Full Article Read Full Article  |  Comments Comments  |  Sphinn It!

Do XML Sitemaps Really Matter?

April 22nd, 2010 | Finn | Crawlability

I was a copywriter before SEO found me. And when I say, “It found me.” I mean,  “the boss pulled me into a room and said he found out I do SEO copywriting,” – keywords, theme writing…In his mind I was the SEO expert – metaphysics help us.

And there were a lot of issues to sort out. Duplicate content, 100s of links indexing the same content (in the days before canonicals), stuff that wouldn’t index at all…
And let’s not mention …

Read Full Article Read Full Article  |  Comments 3 Comments  |  Sphinn It!

What about SEO? How to Redirect a Domain

March 29th, 2010 | Carrie | Advanced SEO Tips, Crawlability, Link Building

Domain-level redirects happen only once in a blue moon. As an SEO, it is not something you run into on a regular basis. Recently one of my clients redirected their entire domain. To my surprise, most of the resources online focused on the technical aspects of domain redirects, like htacess files, DNS adaptations, and so on. The tech-stuff is all very important, but what about SEO? How do I preserve my PageRank? How can I get my site quickly indexed? …

Read Full Article Read Full Article  |  Comments 1 Comment  |  Sphinn It!

Could SSO – Site Speed Optimization – Become the Next Big OnSite Optimization Focus?

November 18th, 2009 | Finn | Crawlability

As reported by SEO Boy, Google’s webspam team leader Matt Cutts hinted during PubCon that site speed could become a determining factor in SERPs. Nothing official has come from Google as to if/when the change to the algorithm could be made, but Cutts noted that if the change were to be made it would come after Google’s new indexing system “Caffiene” is fully implemented. And according to Cutts, Caffeine won’t be added to all the data centers till after …

Read Full Article Read Full Article  |  Comments 2 Comments  |  Sphinn It!

Can Search Engines Crawl Dynamically Generated Content?

November 3rd, 2009 | Amber | Crawlability

I’ve been researching this topic for the past week and have found many articles out there that contradict each other on whether search engines can and do crawl dynamically generated content on a webpage.

The answer to the million dollar question is yes. Technically, the search engines can crawl dynamic URLs and content that is dynamically generated. However, they rarely do. Did you think it was going to be that easy?!!

In a post from the Official Google Webmaster Central Blog

Read Full Article Read Full Article  |  Comments Comments  |  Sphinn It!

Less Links on Your Homepage Could Increase SEO Traffic

October 27th, 2009 | Amber | Crawlability

A while back Matt Cutts delivered some interesting news on PageRank Sculpting. He basically pointed out that the method of PageRank Sculpting really didn’t function as it was previously understood. For a quick recap: people used to add ‘nofollow’ tags to all “unimportant” links via their homepage in order to ‘save’ or ‘add’ more PageRank to the more important links on their homepage. Matt came back to say that by adding these nofollow tags you’re not giving more rank …

Read Full Article Read Full Article  |  Comments Comments  |  Sphinn It!

SEO and Google Docs: Things to expect

September 22nd, 2009 | Eric | Crawlability

Well, here’s a little tidbit that seemed to fly under radars, but not at SEOboy. This blog post announces the crawlability and indexing of of published Google docs tied to public websites. What?!

So within a week and a half we are going to start seeing documents within search results.  My first thought was “oh great, a whole lot of content clogging my results.”  It could happen.  One way to tone down the clutter is to have a tab …

Read Full Article Read Full Article  |  Comments Comments  |  Sphinn It!

3 Stats Reports I Use Often From Google Webmaster Tools

September 22nd, 2009 | Amber | Crawlability

If you’ve been doing any research on SEO this year, you’re going to hear a lot about content, content and more content. It’s no lie, content generation is great for SEO.  But there are other important things you can do to increase your SEO traffic and conversions that is more, reactionary.

I use Google Webmaster tools (GWMT) almost on a daily basis. Each time I login and click around I find something new about my website that I didn’t find …

Read Full Article Read Full Article  |  Comments Comments  |  Sphinn It!

Update on How To Use XML Sitemaps and Robots.txt Files

September 7th, 2009 | Amber | Crawlability

Just a few weeks ago I attended the SEOmoz conference in Seattle.  I learned a few things about and robots files that I wanted to bring to everyone’s attention.

Robots.txt Regarding PageRank

According to Rand, do not to add pages to your robots.txt file that have generated PageRank, or else you’re blocking that page from passing any of its juice along. Essentially, any page that is added to the Robots.txt file can still be indexed.  However if that page has generated any …

Read Full Article Read Full Article  |  Comments 1 Comment  |  Sphinn It!

Google Caffeine & How It Could Affect Your Rankings

August 24th, 2009 | Amber | Crawlability

So I’m sure you’ve heard of the news by now, the new Google Caffeine is a new search engine index which includes crawling, indexing and ranking changes.  Currently Google is providing webmasters and searchers to try it out and give Google feedback.  When Google Caffeine goes officially live, the new search infrastructure will replace what exists today.

According to Search Engine Land, and Google’s blog post about Caffeine, the new infrastructure may include crawling of the web more comprehensively, determining …

Read Full Article Read Full Article  |  Comments Comments  |  Sphinn It!