Google Caffeine is an update to Google’s infrastructure and architecture.

Google announced on Tuesday, the completion of their new indexing system called Caffeine, which provides 50 percent fresher results for web searches than the last index.

They opened up a preview of the Caffeine update in August of 2009, where people could test it and compare the results to their index.

Google Caffeine

Google with Caffeine

The Google Caffeine Update was needed for three main reasons:

  • The amount of content and number of web documents is growing phenomenally in all languages.
  • The web pages are getting richer and more complex with videos, images, applications and rich data formats.
  • The “need for speed” with real time updates, fresh content and live news.

Plus the popularity rise of vertical searches and non-textual content.

The image below illustrates how Google’s old indexing system worked compared to Caffeine:

Google Caffeine

Google Caffeine Comparison

“Our old index had several layers, some of which were refreshed at a faster rate than others; the main layer would update every couple of weeks. To refresh a layer of the old index, we would analyze the entire web, which meant there was a significant delay between when we found a page and made it available to you.

With Caffeine, we analyze the web in small portions and update our search index on a continuous basis, globally. As we find new pages, or new information on existing pages, we can add these straight to the index. That means you can find fresher information than ever before — no matter when or where it was published.”

Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day.

So basically, Google’s Caffeine will crawl and index your newly published pages faster than before.
If you would like to know how Google Caffeine might affect your website, contact us to discuss our SEO services.

How Google Works:

A video by Matt Cutts, a software engineer, leading the quality control team at Google.