Need help preventing SE to index page numbers

zyberakuma · Jun 21, 2012

hi!

does indexing site's page numbers a duplicate content? does it hurt my site? if so, how can i prevent Google from indexing my site's page numbers?

example:

[SLIDE]http://i2.lulzimg.com/733813b8f1.jpg[/SLIDE]

Code:

mysite.com/page/18/

is there anyway i can do it in robots.txt?

Thanks.

SJshah · Jun 22, 2012

You can use meta tags in the page <head> to tell bots not to index the page:

PHP:

<meta name="robots" content="noindex" />

Or just for Google:

PHP:

<meta name="googlebot" content="noindex" />

It will need to be in the <head> of every page you don't want indexed.

Also look around webmaster tools cause there's some options on there too.

happyvalentine · Jun 23, 2012

Hello

Hello, If you use "noindex" then your page will not be submitted in search engines which would be the worst case scenario. I think you have set page archive widget on your home page. Try to remove that archive if you have placed that in your homepage.

What about your permalinks structure? These things can be done via permalinks structure.

What is the type of your site? Wordpress? Phpbb? Vbulleting or blogspot?

zyberakuma · Jun 23, 2012

happyvalentine said:
Hello, If you use "noindex" then your page will not be submitted in search engines which would be the worst case scenario. I think you have set page archive widget on your home page. Try to remove that archive if you have placed that in your homepage.

What about your permalinks structure? These things can be done via permalinks structure.

What is the type of your site? Wordpress? Phpbb? Vbulleting or blogspot?

hi mate!

it's wordpress, i havent tried the meta tags yet coz i still dont know how to do it manually. do i tediously have to do it on every page? what about the page 1,2, etc. how will i do it? my OLD Framework was Thesis and its so easy to do it there.

right now upon watching this:

Code:

http://www.mattcutts.com/blog/robots-txt-remove-url/

i havent done anything (yet) thinking it was the same thing as what Matt was saying.

correct me if im wrong coz i wanted to fix it if it needed to be.

Thanks.

CyberDeViLZ · Jun 23, 2012

Go to

Code:

https://www.google.com/webmasters/tools/crawl-url-parameters?hl=en&siteUrl=http://www.mysite.com/

Code:

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1235687

zyberakuma · Jun 23, 2012

In general, URL parameters fall into one of two categories:

1. Parameters that don't change page content:

2. Parameters that change or determine the content of a page
* Paginates (for example, page=2): Displays a specific page of a long listing or article.

does this hurt the site? coz if it dont, ill just leave it as it is.

Search

Need help preventing SE to index page numbers

zyberakuma

Active Member

5 comments

SJshah

Active Member

happyvalentine

Active Member

zyberakuma

Active Member

CyberDeViLZ

Active Member

zyberakuma

Active Member

About the author

Trending

Advertise on WJunction