Community

New post

Post

4 followers Follow
0
Avatar
Gina Scherzer

Robots.txt File

I recently had this message appear on several of my MotoCMS sites: "A description for this result is not available because of this site's robots.txt"

 

On October 19th, I updated my robots file to read: 

User-agent: * 
Disallow: *.swf$ 
Disallow: /admin/ 
Disallow: /images/previews/ 
Disallow: /images/modules/ 
Disallow: /xml/

Sitemap: http://ptlinktherapy.com/sitemap.xml

And I've requested that Google do a crawl and re-index my website since the website was not showing up on ANY pages in Google search results. I've also updated the site map. Now I'm wondering if there is something else wrong? Does it make sense to have the xml files hidden when that contains the sitemap? Is there any other troubleshooting I should be looking into? Because, at this point, it's completely pointless to have a site that doesn't even show up when I Google the exact domain of the website. My website is ptlinktherapy.com


3 comments

0
Avatar
Sam Clayton

Hello Gina

As I can see our technical specialist is solved this issue. Please contact us if you have any further questions.

Best regards,
Sam Clayton

0 votes
Comment actions Permalink
0
Avatar
Harry Parson

What was the answer?  Is this something I can fix on my site because I see the same Robot.txt for my site?

0 votes
Comment actions Permalink