Skip to content
WJunction - Webmaster Forum

Robots.txt problem

Status
Not open for further replies.

5 comments

how to make from this:

Code:
User-agent: *
Disallow:
Sitemap: [url]http://naked-sluts.us/sitemap.xml.gz[/url]

to this:

Code:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Sitemap: [url]http://naked-sluts.us/sitemap.xml.gz[/url]

I tried to rewrite the robots.txt in my FTP folder, but nothing happened.
 
It did not failed, i got the right file in my FTP folder, but when I use url for robots there its different than in the FTP folder. And dont know why..
 
Seems like your wordpress is loading the virtual robots.txt instead of the real one, which is odd. Maybe a plugin is interfering?!? I see that you're using wordpress SEO by yoast, it has the ability to edit your robots.txt file, try it. If that works, make sure to delete the physical robots.txt file.
 
Status
Not open for further replies.

About the author

W
Active Member · Joined
388
Messages
28
Reactions
28
Points

Advertise on WJunction

Reach 1000's of webmasters, hosts & affiliates. Banner & sponsored-thread slots available.

Contact us
Back
Top Bottom