vidmarc Posted June 27, 2018 Share Posted June 27, 2018 When I test my robots.txt using the Google console robots.txt Tester, I'm seeing errors for every line. Any suggestions as to how to fix them? Link to comment Share on other sites More sharing options...
Noodleman Posted June 27, 2018 Share Posted June 27, 2018 change to be full URLs Link to comment Share on other sites More sharing options...
vidmarc Posted June 27, 2018 Author Share Posted June 27, 2018 Thanks, done. All seems to be OK now. Link to comment Share on other sites More sharing options...
havenswift-hosting Posted June 27, 2018 Share Posted June 27, 2018 You shouldn't really have a .xml.gz AND a .xml version You dont have an image sitemap file - but then the built in function in CubeCart doesnt create one (we have a fantastic sitemap generator that creates images / news / video sitemaps as well as the standard sitemap and the program can be setup to run via cron so it is automatically created and has a large amount of configuration possible) Why would you want to disallow indexing of images ? Even without an image sitemap, the Google crawler can eventually pick up some images Ian Link to comment Share on other sites More sharing options...
Nelly111s Posted November 3, 2019 Share Posted November 3, 2019 I know this is a little old, but is the sitemap generator a freely available one, or bespoke and/or paid for? Link to comment Share on other sites More sharing options...
bsmither Posted November 4, 2019 Share Posted November 4, 2019 It is a feature of CubeCart. In admin, Maintenance, Rebuild tab, Miscellaneous section, check the box for Rebuild Sitemap and click Save. If PHP has a ZipArchive extension installed (and this is a normal requirement for CubeCart), CubeCart will create a zipped version of the XML file. CubeCart will then immediately notify Google that this file exists. Link to comment Share on other sites More sharing options...
havenswift-hosting Posted November 4, 2019 Share Posted November 4, 2019 8 hours ago, Nelly111s said: I know this is a little old, but is the sitemap generator a freely available one, or bespoke and/or paid for? As bsmither has said, there is a (relatively basic) xml sitemap generation function built into CubeCart. This is better than nothing but has to be run manually (which most store owners forget to do thereby presenting very old sitemap files to crawlers). The software that I mentioned has considerably more features, creates better sitemap files including separate image, video, news sitemap files if relevant ; can be scheduled to run automatically via cron say once per week ; and also has a lot of other features such as reporting broken links anywhere within your site - something which Google and other crawlers really dont like. If you would like more details, please contact me via PM or better still directly via our website Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.