Showing posts with label Googlebot. Show all posts
Showing posts with label Googlebot. Show all posts

Friday, July 27, 2007

Underscores in URLs are now Treated as Word Separators by Google

Till now, Google used to treat dashes and underscores in the URL differently. A dash (hyphen) between two words in the URL (i.e. keyword-phrase) would tell Google that those are two different words (i.e. keyword +phrase). In the past, an underscore between two words in a URL (i.e. keyword_phrase) would tell Google that those words are a single word (i.e. keywordphrase). Now both underscores and hyphens in the URL are treated as word separators.

One key development that Matt shared with the audience was that underscores in URLs are now (or at least very soon to be) treated as word separators by Google. That's great news, because it historically hasn't been that way. Back in 2005, Matt stated that Google did not view underscores in URLs as word separators. That meant that in a URL like http://www.mysite.com/iphone_review.html Googlebot couldn't "see" the words iphone or review. Instead it read iphone_review as one word. I wouldn't recommend targeting "iphone_review" as a keyword, as I doubt anyone will be including an underscore in their Google query.

So it used to be--until now--that any benefit that you would have gotten by having a keyword-rich URL was negated by the use of underscores separating those words. TypePad and Movable Type blogs were particularly affected by this, as by default, underscores were used instead of hyphens. This new change in the Google algorithm should make bloggers using the TypePad service or the Movable Type blog software (and anyone else using underscores in their URLs) very happy, as I anticipate their Google traffic will be going up.

A few other highlights from Matt's talk that you may find interesting:
  • Matt claims that Google treats URLs with a query string the same as static URLs. Caveat: as long as there are no more than two or three parameters in the URL, that is! Put another way, you won't take a hit in your Google rankings if you have a question mark in your URL; just don't have more than two or three equals signs in the URL.
  • Matt stated that the number of slashes in your URL (i.e. the number of directories deep your page is) isn't a factor in your Google rankings. He went on to say that although it doesn't matter for Google, it is rumored to matter for Yahoo and MSN (Live Search). Matt addressed this because I specifically asked the question from the audience.
  • According to Matt, the file extension in your URL won't affect your rankings. So it's inconsequential whether you use .php, .html, .htm, .asp, .aspx, .jsp etc. The one extension you should avoid for your Web documents? .exe.
  • Matt stated it was myth that Google uses its status as a domain registrar to access domain registration data to use it as a ranking signal. According to Matt, being a registrar doesn't grant one special access to other registrars' customer data. Note that Matt didn't state whether Google is or isn't using WHOIS data as a signal. I believe they are.
  • When asked about how to get one's blog into Google News, Matt shared one of Google's requirements for inclusion: the blog must have multiple authors. So those of you wanting your blog showing up in Google News results, I hope it's a group blog!

Friday, July 13, 2007

Google to Introduce New Meta Tags

The ‘unavailable_after’ meta tag will soon be recognized by Google according to Dan Crow, Director of Crawl Systems at Google and Jill Whalen of High Rankings. Google is coming out with a new tag called “unavailable_after” which will allow people to tell Google when a particular page will no longer be available for crawling. So, it gives you the option to tell Google when Googlebot should no longer crawl that page.

This tag comes in handy when you have a limited time offer promotional page, and on this page, the promotion will expire on a specific date. For instance, if you have a special offer on your site that expires on a particular date, you might want to use the unavailable_after tag to let Google know when to stop indexing it. Or perhaps you write articles that are free for a particular amount of time, but then get moved to a paid-subscription area of your site. By using the "unavailable_after" tag, you can tell Google that they should not crawl this page, after the promotion expires. There are several practical scenarios for this tag.

For example, if you have a page that you would like to be removed from the search results at 6pm EST on July 23, 2007, you would add the following Meta tag:

meta content="unavailable_after: 23-Jul-2007 18:00:00 EST" name="GOOGLEBOT"

Once Google crawls the page and sees this Meta tag, it will take about a day for the page to be removed from the search results. Also this tag is only supported with web search. To remove the page completely from Google, including the cache copies, use the Google removal tool.
Google has also added support to control access to other types of documents, such as PDF files, audio, xls documents and so on via new X-Robots-Tag directive in the HTTP Header used to serve the file.

Here are examples of how to use the X-Robots-Tag:

Don't index this document:

X-Robots-Tag: noindex

Don't show cache or snippet in search results for this file:

X-Robots-Tag: noarchive, nosnippet

Don't index after a specific date (i.e. the "unavailable_after" tag):

X-Robots-Tag: unavailable_after: 7 Jul 2007 16:30:00 GMT

You can also combine these tags as well.

The Blogosphere

Loading...
website stats