How google search engine spiders work

By Guest author,  Nancy Dafiewhare, MD Magnifique Media

Google has become the world’s most famous and most used search engine. It is now common for people to say “I’ll Google it” if they are looking for information about something. Search Engine Optimization (SEO) has now become one of the widely used techniques in digital marketing and rightly so. For anyone looking to market or are already marketing their products/services online via a website, SEO is not one to be ignored.

There are a lot of myths surrounding how Google indexes a website. Just like any other trade there are a lot of cowboy SEO techniques out there using black hat tricks to get Google’s attention.  These include stuffing the meta keywords of the webpage with words/phrases the website wishes to be found on.  The Google bot (Google’s search engine spider) has evolved a lot over the years and it continues evolving. It is aware of the black hat tricks and has taken steps to make sure such cheating websites do not get to the top of search engine results. Google no longer looks at the meta keywords in a website as part of the indexing process.

Get to the top of the search (

The things Google bot looks for in a website when indexing include:

  1. Coding of website:  In order for Google bot to successfully crawl your website, the website coding needs to be pure HTML (Hyper Text Mark-up Language).
  2. Meta title: This is the title of the page Google is crawling (it appears on top your browser telling you what page on a website you’re on for instance ‘About us’ page).
  3. Meta description:  These are a set of phrases or sentences that describes or summarise what the web page is about.
  4. Body content: This is the text content of the page. Google gathers this information together with the first two and decides if your website is genuine portrayal of what it is claiming to be.
  5. Back links: These are the number of external links that point to your page. If you have a good number of reputable websites that link to your own website then Google increases your website score which will help to push your website up on the search engine results.

As easy as it appears, a lot of websites still get these simple basics wrong and miss out on a lot of traffic due to improper indexing of their website. Watch this space for  some tips on how to climb to the top of the ranks!


  1. Hope this means pseudo-bank and other ‘deadly’ sites won’t be at the top of a google search. I since try both Bing and Google just to get the best choices.


  2. Lol! Well I hope so too! I’ve had some strange search results myself. I guess Google is nearing perfection on indexing but not quite there yet! Ciao.



  1. […] my last article, I looked at the ways Google indexes a website during crawling. This article will look at the […]


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: