nbweb 发表于 2013-8-13 14:27:26

求个dz和wp的禁止百度访问的robots.txt

dx的貌似本来有一些了,禁止百度的放在上面还是下面?

wp的怎么写?

SKIDROW 发表于 2013-8-13 15:47:13

[*]
[*]User-agent: Baiduspider
[*]
[*]Disallow: /
[*]
[*]User-agent: *
[*]
[*]Disallow: /wp-admin/
[*]Disallow: /wp-trackback
[*]Disallow: /wp-feed
[*]Disallow: /wp-comments
[*]Disallow: /wp-content/plugins
[*]Disallow: /wp-content/themes
[*]Disallow: /wp-login.php
[*]Disallow: /wp-register.php
[*]Disallow: /feed
[*]Disallow: /trackback
[*]Disallow: /cgi-bin
[*]Disallow: /comments
[*]Disallow: *?s=
[*]
[*]Sitemap: http://www.xxx.com/sitemap.xml复制代码

wshawn 发表于 2013-8-13 14:35:18

User-agent: Baiduspider
Disallow: /

具体看这边 http://www.baidu.com/search/robots.html

rqliang 发表于 2013-8-13 15:28:58

是在上面的,
lol.gif
页: [1]
查看完整版本: 求个dz和wp的禁止百度访问的robots.txt