Google Webmaster Tools help

[gmrabbe]

What is this Robots.txt in "Google Webmaster Tools".
How can i create a good Robots.txt file?

Any one can help me...

Thanks in advance

 

[wedge1001]

just create a file name it Robots.txt
in your root-folder.

then insert it according to your needs
http://en.wikipedia.org/wiki/Robots_exclusion_standard
http://www.robotstxt.org/

 

[DoctorX]

First you need to know what is the benefit of it.
Robots.txt used to list the links that you dont want google to crowl them on your website.
Exmaple of one line in my robots.txt:
User-agent: * Disallow: /calendar.php

This will prevent google from indexing the link www.mywebsitenamw.com/calender.php.

This is my full Robots.txt :

User-agent: * Disallow: /calendar.php Disallow: /memberlist.php Disallow: /search.php Disallow: /newthread.php Disallow: /newreply.php Disallow: /member.php Disallow: /online.php Disallow: /attachment.php Disallow: /private.php Disallow: /register.php Disallow: /usercp.php Disallow: /ratethread.php Disallow: /editpost.php Disallow: /printthread.php Disallow: /sendthread.php Disallow: /usercp2.php Disallow: /polls.php Disallow: /private.php