Jump to content

[Resolved] robots.txt file missing


toast691

Recommended Posts

Using cubecart 6.0.12 on Retail therapy skin. URL is www.greenpatchseeds.com.au

Hi,

I'm not sure if these two are related but when I go to rebuild my sitemap I get a blank page without any error messages and nothing appears in the error log.

I did find an error in my cpanel admin area that the robots.txt file could not be found. Below is that error.

"2016-06-24 00:24:28.355 [INFO] [66.249.66.139:56697-0#APVH_69.73.183.189:443_greenpatchseeds.com.au] File not found [/home/augreenpatchseed/public_html/robots.txt] "

What I am wondering is how I re-generate the robots.txt file and would it resolve the sitemap issue as well?

Cheers

Stami

Link to comment
Share on other sites

You can create one incredibly easy. Using the programmer's text editor in your hosting account's control panel, create a new file "robots.txt" and for it's contents:

User-agent: *
Disallow:

Every decent web crawler will ask for your site's robots.txt file, and if found, will honor its contents. If a blank file or no file, the crawler will happily scan everything.

This will not fix the blank result after building a sitemap.

Link to comment
Share on other sites

  • 4 weeks later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...