Jump to content

Question about robots.txt


Guest llchrisb

Recommended Posts

User-agent: *

Disallow: /index.php?act=login

Disallow: /index.php?act=taf

Disallow: /admin/

Disallow: /classes/

Disallow: /docs/

Disallow: /extra/

Disallow: /images/

Disallow: /includes/

Disallow: /js/

Disallow: /language/

Disallow: /modules/

Disallow: /pear/

Disallow: /skins/

Disallow: /cart.php

Disallow: /confirmed.php

Disallow: /download.php

Disallow: /offLine.php

Disallow: /switch.php

Link to comment
Share on other sites

Guest llchrisb

It's controversial as to whether robots.txt is even of any value. Only a few robots support it. Using it cannot hurt.

That was my understanding, and what I was going for. Thanks for the heads up.

User-agent: *

Disallow: /index.php?act=login

Disallow: /index.php?act=taf

Disallow: /admin/

Disallow: /classes/

Disallow: /docs/

Disallow: /extra/

Disallow: /images/

Disallow: /includes/

Disallow: /js/

Disallow: /language/

Disallow: /modules/

Disallow: /pear/

Disallow: /skins/

Disallow: /cart.php

Disallow: /confirmed.php

Disallow: /download.php

Disallow: /offLine.php

Disallow: /switch.php

thanks convict, that's exactly what I was looking for.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...