Internet Marker

September 9, 2008

Google’s Crawler

Filed under: Uncategorized — imarker @ 6:36 am

Old news story about bankruptcy hammers stock. But what was interesting to me was the little glimpse at what Google’s Crawler is trying to find:

But Google said the only reason its search engine “crawler” bothered with the story was that it was listed on the Sun-Sentinel page of most-viewed stories — and with the weekend date on it, instead of the 2002 date.

To the crawler, “it was a new item that said, ‘Hey, look here,’ ” Google spokesman Gabriel Stricker said.

Read more…

No Comments »

No comments yet.

RSS feed for comments on this post.

Leave a comment

Powered by WordPress