Duplicate products

david64 · #11 03-07-2009, 02:30 PM

Yeah. These products are coming up as duplicates. I think I mentioned this before.

TBH, it sounds as if your eCommerce system is a bit out of date.

Anyway as an example, you have:

http://petshop2u.co.uk/proddetail.ph...d-1520&cat=340
http://petshop2u.co.uk/proddetail.ph...ed-1520&cat=78
http://petshop2u.co.uk/proddetail.ph...e-cat-bed-1520

Which are all duplicates. Ideally these URLs would be totally re-written to:

http://petshop2u.co.uk/product/pink-palace-cat-bed

but it would be easiest to do have just:

http://petshop2u.co.uk/proddetail.ph...e-cat-bed-1520

Off the top of my head adding this to htaccess will sort the problem:

RewriteRule ^proddetail.php?prod=([a-z0-9-])+&cat=[0-9]+$ proddetail.php?prod=$1 [R=301,NS,L]

I would view that as a temporary measure. Really, I would look at getting the URLs sorted as they are printed out on page. There should only ever be one URL for each page and the best way to do that is only have 1 URL that will load the page and not a bunch of redirects.

Chubster · #12 03-07-2009, 03:11 PM

Cheers David....indeed I think you did mention this before....

So until the time I can get this sorted, will adding that line to htaccess as is be enough or will I need to write something for every duplicate product ?

Thanks muchly

david64 · #13 03-07-2009, 03:24 PM

Quote:

Originally Posted by Chubster

Cheers David....indeed I think you did mention this before....

So until the time I can get this sorted, will adding that line to htaccess as is be enough or will I need to write something for every duplicate product ?

The htaccess rule I posted above should redirect all those duplicate products to the root product page. This will stop search engines seeing multiples pages for one product. However, there is always the chance that that rule will need a little tweak and if you have other rules in htaccess you may need to put it in a certain position.

Give it a try and see if it forwards you from the duplicate product pages to the root product page.

Quote:

Originally Posted by Chubster

Thanks muchly

For Chubs, anything.

Chubster · #14 03-07-2009, 03:33 PM

Quote:

Originally Posted by david64

The htaccess rule I posted above should redirect all those duplicate products to the root product page. This will stop search engines seeing multiples pages for one product. However, there is always the chance that that rule will need a little tweak and if you have other rules in htaccess you may need to put it in a certain position.

Give it a try and see if it forwards you from the duplicate product pages to the root product page.

OK placed at top and that didnt work....

I will cheekily add my htaccess file below for you to see where it might be "tweaked"

Options +FollowSymlinks -MultiViews -indexes
RewriteEngine on
RewriteBase /

#Duplicate Products

RewriteRule ^proddetail.php?prod=([a-z0-9-])+&cat=[0-9]+$ proddetail.php?prod=$1 [R=301,NS,L]

RewriteCond %{HTTP_HOST} ^www\.(.+)$
RewriteRule ^(.*)$ http://%1/$1 [R=301,L]

RewriteCond %{THE_REQUEST} /index\.php\ HTTP/
RewriteRule ^index\.php$ / [R=301,L]

deny from 83.57.64.214
deny from 84.123.166.108

<Files 403.shtml>
order allow,deny
allow from all
</Files>

deny from 82.99.30.
deny from 118.69.172.180
deny from 222.124.
deny from 99.16.181.130
deny from 212.107.28.198
deny from 208.99.193.
deny from 78.97.229.173
deny from 67.212.137.5
deny from 208.71.89.180
deny from 208.99.199.
deny from 68.15.185.165

#Stop Image Hotlinking
RewriteCond %{HTTP_REFERER} !^http(s)?://(www.)?mydomain.co.uk [NC]
RewriteCond %{HTTP_REFERER} !^http(s)?://(www.)?mydomain [NC]
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !google\. [NC]
RewriteCond %{HTTP_REFERER} !search\?q=cache [NC]
RewriteCond %{HTTP_REFERER} !msn\. [NC]
RewriteCond %{HTTP_REFERER} !yahoo\. [NC]
RewriteCond %{REQUEST_URI} !^hotlinker.jpe$
RewriteRule .(jpe?g|png|gif|jpg)$ /images/hotlinker.jpe [NC,R,L]

Chubster · #15 03-07-2009, 03:35 PM

Quote:

Originally Posted by david64

For Chubs, anything.

Hmmm....free SEO till a certain other couple of pet sites are knocked off the top spot

david64 · #16 03-07-2009, 04:27 PM

Quote:

Originally Posted by Chubster

Hmmm....free SEO till a certain other couple of pet sites are knocked off the top spot

Quite a lot of work to go on PetShop2U to beat the competition

Code:

RewriteCond %{REQUEST_URI} ^/proddetail.php [NC]
RewriteCond %{QUERY_STRING} ^prod=([a-z0-9-]+)&cat [NC]
RewriteRule ^.+$ proddetail.php?prod=%1 [R=301,NC,L]

I tested this on local and it works. Should be ok to put it at the top of your htaccess.

Chubster · #17 03-07-2009, 04:34 PM

Quote:

Originally Posted by david64

Quite a lot of work to go on PetShop2U to beat the competition

Hey...you offered. Never said it would be easy

Code:

RewriteCond %{REQUEST_URI} ^/proddetail.php [NC]
RewriteCond %{QUERY_STRING} ^prod=([a-z0-9-]+)&cat [NC]
RewriteRule ^.+$ proddetail.php?prod=%1 [R=301,NC,L]

I tested this on local and it works. Should be ok to put it at the top of your htaccess.

Thanks very much David, will go add that now and see what happens

Chubster · #18 03-07-2009, 04:40 PM

...OMG. I think I love you

Cheers David thats done the trick brilliantly.....one step closer to the competition

david64 · #19 03-07-2009, 04:50 PM

No problem

Actually, I think for your main SERPs, you just need more link text. This site is on page one for "pet shop".

killaypetshop.co.uk

Only big boy is petsathome.com (as far as I can tell).