Search Engine Robots

by Barbara J. Feldman on June 8, 2004 · 0 comments

If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or GoogleBot. These automated programs are search engine robots that crawl the Web looking for pages to add to their search data bases. To learn which robots belong to which search engines, read this article from JafSoft.com .

tagged as More tips like this one in Blogging,Search


{ 0 comments… add one now }

Leave a Comment