Skip to content
WJunction - Webmaster Forum

URL blocked by robots.txt

Status
Not open for further replies.
Hello, i got warning error from google webmastertool after submit sitemap.

This is my robots.txt configuration;
Code:
[COLOR=#000000]User-agent: *[/COLOR]Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://mydomain.net/xmlsitemap.xml
Allow: /rsssitemap.xml [COLOR=#000000]Allow: /htmlsitemap.htm[/COLOR]

Hz9gWnU.jpg

May i know what im missing?
 

1 comment

As I know you should disallow robot txt for only /wp-admin/ , other is allowed.It's defautl, or in case you want to block some bot traffic, that crawl website and make high rate in bounce rate.
For this:
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

You can try with this:
Disallow: /wp-admin/
Allow: /
Allow: /wp-admin/admin-ajax.php
 
Status
Not open for further replies.

About the author

M
Active Member · Joined
2,674
Messages
446
Reactions
83
Points

Advertise on WJunction

Reach 1000's of webmasters, hosts & affiliates. Banner & sponsored-thread slots available.

Contact us
Back
Top Bottom