Skip to Main Content


Use a robots.txt file

By: Lee Johnson - SEO Manager - CustomerStreet
Comments ( 0)
Dec
14

Do you have a robots.txt file set up on your server?

Here’s what Google says in their Webmaster Guidelines:

Make use of the robots.txt file on your web server. This file tells crawlers which directories can or cannot be crawled. Make sure it’s current for your site so that you don’t accidentally block the Googlebot crawler.

Visit robotstxt.org to learn how to instruct robots when they visit your site.

If you liked that, then try ...

Using Google for Keyword Research
Did you know that you can use Google's keyword research tool which suggests keywords "related" to the term/phrase you enter.

How to SEO a one page site
Some people here at Customer Street have very small websites but want to be found on the SERP's (search engine results pages).

  • Digg
  • Technorati
  • del.icio.us
  • BlinkList
  • Reddit
  • StumbleUpon
  • Furl
  • YahooMyWeb
1 Star2 Stars3 Stars4 Stars5 Stars
3.75
after 4 Votes

Leave a comment

Back to Top