Online Web Training

Search Engine Optimization Services - Creating a robots.txt file continued . . .

* By Robin Nobles, Director of Training for the Academy of Web Specialists

On the Spider Visits page, I found it particularly helpful to view the visits by Web page. In this manner, I could quickly see which spiders have visited which pages of the site and when. Just think of the value of this information when working with clients and their search engine optimization services. You can prove to them that spiders have visited their sites, even if the pages aren't yet indexed. You can also view spider visits by date or by spider.

Also, international spiders are included in the program, which is ideal for those sites that are aiming for a corner of the international market.

Where can you go to see this program for yourself?

Visit Website Management Tools and look for Robot-Manager 3.0 Professional Edition. Though the site also offers a Standard Edition of the software, I strongly advise you to look at the Professional Edition instead. Why? Because the Standard Edition doesn't include the spider analysis portion of the software, which is a "must have," in my opinion.

You can download a trial version of the software at no cost, then test drive it before purchasing. With the trial version, only 5 spiders can be selected and 20 spider visits picked up from the log file.

In Conclusion . . .

As the search engine optimization services and marketing industry continues to move forward, three major categories of tools or services need to be considered:

  • Web page checking, submission, and ranking tools
  • Web traffic analysis tools for analyzing human visitors to your site
  • Spider analysis tools for analyzing spider activity

If your current search engine optimization services and marketing plan doesn't cover each of those crucial areas, you need to look into expanding your tool arsenal. The information you can gain by analyzing your human and spider traffic will prove invaluable to you as you work toward strengthening your online business.



Home | Go to high search engine ranking article

Search Engine Ranking Foundations
[ Close Window ]
Search engine marketing training web site optimization online education Sitemap