Support Tickets - CMS 2.1 - robots.txt

CMS 2.1 - robots.txt

CMS 19.04.2016 2387 Bug Report Status: Closed Solution: Yes bluesatkv


Hi Jerome,

I thinka that you have bug in robots.txt. Your code is

User-agent: *
Disallow: include/
Disallow: class/
Disallow: admin/
Disallow: template/
Disallow: lang/
Disallow: js/
Disallow: css/
Disallow: _files/

Your code not work in Google Search Console - Tools for test robots.txt file

New code in robots.txt works good

#CMS Robots File - Custom modification
#Last change NO 19042016

User-agent: *
Disallow: /include
Disallow: /class
Disallow: /admin
Disallow: /template
Disallow: /lang
Disallow: /js
Disallow: /css
Disallow: /_files

Replies (2)

  • avatar Jerome

    Thank you for your suggestion, but better would be probably:

    #CMS Robots File
    #Last change NO 19042016

    User-agent: *
    Disallow: /include/
    Disallow: /class/
    Disallow: /admin/
    Disallow: /template/
    Disallow: /lang/
    Disallow: /js/
    Disallow: /css/
    Disallow: /_files/

    You could also add the sitemap path within the robots.txt, like this:

    Sitemap: path_to_sitemap_file
    19.04.2016 0
  • avatar bluesatkv

    Thanks.

    19.04.2016 0