Robots.txt problem

Status
Not open for further replies.
5 comments
how to make from this:

Code:
User-agent: *
Disallow:
Sitemap: [url]http://naked-sluts.us/sitemap.xml.gz[/url]

to this:

Code:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Sitemap: [url]http://naked-sluts.us/sitemap.xml.gz[/url]

I tried to rewrite the robots.txt in my FTP folder, but nothing happened.
 
It did not failed, i got the right file in my FTP folder, but when I use url for robots there its different than in the FTP folder. And dont know why..
 
Seems like your wordpress is loading the virtual robots.txt instead of the real one, which is odd. Maybe a plugin is interfering?!? I see that you're using wordpress SEO by yoast, it has the ability to edit your robots.txt file, try it. If that works, make sure to delete the physical robots.txt file.
 
Status
Not open for further replies.
Back
Top