金关村村长 发表于 2011-7-8 19:44:04

38.99.82.212

San Jose加州

38.99.82.212

这个ip不知道是不是google蜘蛛的

奇怪

cnweb 发表于 2011-7-8 19:45:38

不是的啦GOOGLE的一查就明白了

金关村村长 发表于 2011-7-8 19:47:06

不是google的那就不知道是哪里的了

金关村村长 发表于 2011-7-8 19:47:19

访问也不带user agent的

金关村村长 发表于 2011-7-8 19:54:01

Line 149: 66.249.71.172 - - GET /tag/Product/page/4 HTTP/1.1 200 5842 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 150: 66.249.71.172 - - GET /tag/Product/page/8 HTTP/1.1 200 6188 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 152: 66.249.71.172 - - GET /tag/Product/page/5 HTTP/1.1 200 6246 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 153: 66.249.71.172 - - GET /tag/Product/page/7 HTTP/1.1 200 6390 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 155: 66.249.71.172 - - GET /tag/Product/page/6 HTTP/1.1 200 6495 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 157: 66.249.71.172 - - GET /tag/Product/page/2 HTTP/1.1 200 5555 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 158: 66.249.71.172 - - GET /tag/Product/page/9 HTTP/1.1 200 6393 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 159: 66.249.71.172 - - GET /tag/Product/page/3 HTTP/1.1 200 5559 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 161: 66.249.71.172 - - GET /tag/Product/page/31 HTTP/1.1 200 6253 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 163: 66.249.71.172 - - GET /tag/Product/page/19 HTTP/1.1 200 6118 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 164: 66.249.71.172 - - GET /tag/Product/page/16 HTTP/1.1 200 6636 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 166: 66.249.71.172 - - GET /tag/Product/page/36 HTTP/1.1 200 6457 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 167: 66.249.71.172 - - GET /tag/Product/page/28 HTTP/1.1 200 6520 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 168: 66.249.71.172 - - GET /tag/Product/page/26 HTTP/1.1 200 6482 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 169: 66.249.71.172 - - GET /tag/Product/page/20 HTTP/1.1 200 6604 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 170: 66.249.71.172 - - GET /tag/Product/page/14 HTTP/1.1 200 6598 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 171: 66.249.71.172 - - GET /tag/Product/page/35 HTTP/1.1 200 6496 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 172: 66.249.71.172 - - GET /tag/Product/page/24 HTTP/1.1 200 6695 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 174: 66.249.71.172 - - GET /tag/Product/page/22 HTTP/1.1 200 6770 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 175: 66.249.71.172 - - GET /tag/Product/page/30 HTTP/1.1 200 6452 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 176: 66.249.71.172 - - GET /tag/Product/page/33 HTTP/1.1 200 6364 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 177: 66.249.71.172 - - GET /tag/Product/page/15 HTTP/1.1 200 6667 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 178: 66.249.71.172 - - GET /tag/Product/page/25 HTTP/1.1 200 6727 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 179: 66.249.71.172 - - GET /tag/Product/page/17 HTTP/1.1 200 6288 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 180: 66.249.71.172 - - GET /tag/Product/page/29 HTTP/1.1 200 6651 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 184: 66.249.71.172 - - GET /tag/Product/page/27 HTTP/1.1 200 6470 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 187: 66.249.71.172 - - GET /tag/Product/page/32 HTTP/1.1 200 6372 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 189: 66.249.71.172 - - GET /tag/Product/page/10 HTTP/1.1 200 6478 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -
      Line 190: 66.249.71.172 - - GET /tag/Product/page/21 HTTP/1.1 200 6651 - Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -

金关村村长 发表于 2011-7-8 19:55:41

给了google蜘蛛一个tag入口，之后看访问日志，不知道是按照什么规则来访问的

难道是随机的

greyboy 发表于 2011-7-8 21:14:55

google在美国的服务器都是显示xxxGoogle公司

金关村村长 发表于 2011-7-8 22:15:00

google有匿名蜘蛛的

西门小三 发表于 2011-7-8 22:18:34


17436.gif
不清楚

lemss 发表于 2011-7-8 22:37:03

不是的
页: [1]
查看完整版本: 38.99.82.212