Latest Announcemnent
New thread

Help with robots.txt

Status
Not open for further replies.
C

CK13

Active Member
989
2011
252
5
This is my robots.txt
Code: 
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
What does that mean?
Is everything ok, do I have to add somethig else to it?

PS: Still learning :P .
 
6 comments
Here's an example that is often used

Code: 
User-agent: *
Disallow: 
Disallow: /cgi-bin/
Sitemap: http://www.yoursite.com/sitemap.gz

What you should do
Create a sitemap and add it to the bottom of the text file.
 
@ MrSandvik If I put you're code will this be allowed:
[slide]http://imgcrave.com/u/untitlefe.jpg[/slide]

And is it safe to remove what is already there?
 
But what about my current robots file should i replace it or just copy the additional code?
Is it safe to remove what is already there?
 
Status
Not open for further replies.
Back
Top