« Step 1 - Set your Goals
Goals are in - What next? »
Build a Niche Store Affiliate Contest

Site index is ON!

July 16, 2007 | Author: Mark | Filed under: Tracking the Progress

Ah - I just had to write a quick post about the site being indexed… Some of you may ask, What is a site index? Well.. when a search engine finds a website, whether it is from an outside link (best method) or a search engine submission, its sends what is commonly called a “bot” or “spider” to come and crawl your site. Why is this important? Well, how the heck else will the search engines know what your website is about if it doesnt crawl the links!

Basically the bot comes in, looks around and reads the text from the page(s) and decides if it is worth what is written. It looks at several areas of the public content as well as many of the hidden tags (meta tags) and creates a relationship about the page, to the content that is written on it. Every time it sees a link, it will usually follow it to the next page, etc etc etc… repeat over and over again!

Today - this site has seen both Googlebot and Yahoo slurp run wild in the structure of the site and follow many of the links and pages. Thats good!

So you may be asking how did Google and Yahooo find it? Well on my own website design site (inactive for many months) I posted a single link to the site in the left column. When the bots visited THAT site early this weekend, they saw the new link and followed it here. Works like a charm!

The bots will likely come back several times each week from this point forward - that is the main reason you always want to set yourself a schedule for posting more content on your site. The bots will poke their head into a page and more or less look around real quick - if nothing has changed in the past few times, they just back out the door the same way they came in. If however you have changed the way the site looks (new text, articles etc) they will come inside and look around again and again.

Im out - Mark

This entry was posted on Monday, July 16th, 2007 and is filed under Tracking the Progress. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.



Stumble it!

Comments are closed.

SUBSCRIBE TO MY FEED

 Subscribe in a reader