{"id":138,"date":"2004-06-08T08:17:10","date_gmt":"2004-06-08T13:17:10","guid":{"rendered":"http:\/\/www.internettipoftheweek.com\/?p=138"},"modified":"2004-06-08T08:17:10","modified_gmt":"2004-06-08T13:17:10","slug":"search-engine-robots","status":"publish","type":"post","link":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/","title":{"rendered":"Search Engine Robots"},"content":{"rendered":"<p>If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with  funny names like Slurp, Scooter, or GoogleBot.  These automated programs are search engine robots that crawl the Web looking for pages to add to their search data bases.  To learn which robots belong to which search engines, read this article from <a href=\"http:\/\/www.jafsoft.com\/searchengines\/webbots.html\" target=\"_blank\">JafSoft.com <\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or GoogleBot. These automated programs are search engine robots that crawl the Web looking for &#8230;<a href=\"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/\">[Continue]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[48,5],"tags":[2633],"class_list":{"0":"post-138","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-blogging","7":"category-search","8":"tag-online-publishing-2","9":"entry"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Search Engine Robots &#187; Tech Tips \u00bb Surfnetkids<\/title>\n<meta name=\"description\" content=\"If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Search Engine Robots &#187; Tech Tips \u00bb Surfnetkids\" \/>\n<meta property=\"og:description\" content=\"If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/\" \/>\n<meta property=\"og:site_name\" content=\"Tech Tips \u00bb Surfnetkids\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/surfnetkids\/\" \/>\n<meta property=\"article:published_time\" content=\"2004-06-08T13:17:10+00:00\" \/>\n<meta name=\"author\" content=\"Barbara J. Feldman\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@barbarafeldman\" \/>\n<meta name=\"twitter:site\" content=\"@barbarafeldman\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Barbara J. Feldman\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/\"},\"author\":{\"name\":\"Barbara J. Feldman\",\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/#\\\/schema\\\/person\\\/cdb196c6a51c0f75efece9d1acfc200a\"},\"headline\":\"Search Engine Robots\",\"datePublished\":\"2004-06-08T13:17:10+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/\"},\"wordCount\":66,\"commentCount\":0,\"keywords\":[\"online publishing\"],\"articleSection\":[\"Blogging\",\"Search\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/\",\"url\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/\",\"name\":\"Search Engine Robots &#187; Tech Tips \u00bb Surfnetkids\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/#website\"},\"datePublished\":\"2004-06-08T13:17:10+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/#\\\/schema\\\/person\\\/cdb196c6a51c0f75efece9d1acfc200a\"},\"description\":\"If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/138\\\/search-engine-robots\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Tech Tips\",\"item\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Blogging\",\"item\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/category\\\/blogging\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Search Engine Robots\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/#website\",\"url\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/\",\"name\":\"Tech Tips \u00bb Surfnetkids\",\"description\":\"for families and classrooms from Surfnetkids.com\",\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.surfnetkids.com\\\/tech\\\/#\\\/schema\\\/person\\\/cdb196c6a51c0f75efece9d1acfc200a\",\"name\":\"Barbara J. Feldman\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f6e46f3b8086ff1944261ad7589f4953e61a09467d9352840df2b96d32ad45bb?s=96&d=wavatar&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f6e46f3b8086ff1944261ad7589f4953e61a09467d9352840df2b96d32ad45bb?s=96&d=wavatar&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f6e46f3b8086ff1944261ad7589f4953e61a09467d9352840df2b96d32ad45bb?s=96&d=wavatar&r=g\",\"caption\":\"Barbara J. Feldman\"},\"description\":\"Barbara J. Feldman is a syndicated columnist and online publisher at Feldman Publishing. She has a computer science degree from University of California, Irvine, and has been a nerd for more than forty years. Follow Barbara Feldman\",\"sameAs\":[\"http:\\\/\\\/www.barbarafeldman.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Search Engine Robots &#187; Tech Tips \u00bb Surfnetkids","description":"If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/","og_locale":"en_US","og_type":"article","og_title":"Search Engine Robots &#187; Tech Tips \u00bb Surfnetkids","og_description":"If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or","og_url":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/","og_site_name":"Tech Tips \u00bb Surfnetkids","article_publisher":"https:\/\/www.facebook.com\/surfnetkids\/","article_published_time":"2004-06-08T13:17:10+00:00","author":"Barbara J. Feldman","twitter_card":"summary_large_image","twitter_creator":"@barbarafeldman","twitter_site":"@barbarafeldman","twitter_misc":{"Written by":"Barbara J. Feldman"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/#article","isPartOf":{"@id":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/"},"author":{"name":"Barbara J. Feldman","@id":"https:\/\/www.surfnetkids.com\/tech\/#\/schema\/person\/cdb196c6a51c0f75efece9d1acfc200a"},"headline":"Search Engine Robots","datePublished":"2004-06-08T13:17:10+00:00","mainEntityOfPage":{"@id":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/"},"wordCount":66,"commentCount":0,"keywords":["online publishing"],"articleSection":["Blogging","Search"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/","url":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/","name":"Search Engine Robots &#187; Tech Tips \u00bb Surfnetkids","isPartOf":{"@id":"https:\/\/www.surfnetkids.com\/tech\/#website"},"datePublished":"2004-06-08T13:17:10+00:00","author":{"@id":"https:\/\/www.surfnetkids.com\/tech\/#\/schema\/person\/cdb196c6a51c0f75efece9d1acfc200a"},"description":"If you have a website and occasionally look at your site traffic logs, you may notice visits from robots with funny names like Slurp, Scooter, or","breadcrumb":{"@id":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.surfnetkids.com\/tech\/138\/search-engine-robots\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Tech Tips","item":"https:\/\/www.surfnetkids.com\/tech\/"},{"@type":"ListItem","position":2,"name":"Blogging","item":"https:\/\/www.surfnetkids.com\/tech\/category\/blogging\/"},{"@type":"ListItem","position":3,"name":"Search Engine Robots"}]},{"@type":"WebSite","@id":"https:\/\/www.surfnetkids.com\/tech\/#website","url":"https:\/\/www.surfnetkids.com\/tech\/","name":"Tech Tips \u00bb Surfnetkids","description":"for families and classrooms from Surfnetkids.com","inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.surfnetkids.com\/tech\/#\/schema\/person\/cdb196c6a51c0f75efece9d1acfc200a","name":"Barbara J. Feldman","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/f6e46f3b8086ff1944261ad7589f4953e61a09467d9352840df2b96d32ad45bb?s=96&d=wavatar&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/f6e46f3b8086ff1944261ad7589f4953e61a09467d9352840df2b96d32ad45bb?s=96&d=wavatar&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f6e46f3b8086ff1944261ad7589f4953e61a09467d9352840df2b96d32ad45bb?s=96&d=wavatar&r=g","caption":"Barbara J. Feldman"},"description":"Barbara J. Feldman is a syndicated columnist and online publisher at Feldman Publishing. She has a computer science degree from University of California, Irvine, and has been a nerd for more than forty years. Follow Barbara Feldman","sameAs":["http:\/\/www.barbarafeldman.com"]}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/posts\/138","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/comments?post=138"}],"version-history":[{"count":0,"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/posts\/138\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/media?parent=138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/categories?post=138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.surfnetkids.com\/tech\/wp-json\/wp\/v2\/tags?post=138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}