Comments on: robots.txt tips for WordPress to prevent Duplicate Content

By: Ecommerce Leeds

Ecommerce Leeds — Wed, 06 Jul 2011 06:17:08 +0000

I didn’t initially include a robots.txt in my blog and never had any issues with dupe content. It wasn’t until just recently I decided to add one, more for experimental purposes. So far, search engine traffic hasn’t improved or declined either way. WordPress out of the box isn’t great for SEO purposes, but with minor tweeks, I find that a robots.txt isn’t really necessary.

By: Ricky

Ricky — Fri, 21 May 2010 09:16:14 +0000

Great Post. This is new to me and I appreciate
it.

Thanks!

By: MoneyM8

MoneyM8 — Sun, 21 Jun 2009 19:36:54 +0000

Hi Squeaky,

robots interpret /page/ and /pages/ as different in the robots.txt file because they are due to one little “s”.

By: Squeaky

Squeaky — Sat, 25 Apr 2009 22:42:55 +0000

What is the difference between these two statements in the robots.txt file in WordPress?

Disallow: /page/
Disallow: /pages/

By: Egor

Egor — Fri, 22 Aug 2008 10:52:23 +0000

Hello webmaster been surfing the net for Seo Tips and found your blog reg ts.txt tips for WordPress to prevent Duplicate Content. You relly know your stuff! I\’d like to see more posts here. Will definitely bookmark this one and come back.

By: Money Talk

Money Talk — Wed, 20 Aug 2008 22:32:20 +0000

There is more reason to comment than ever before! Great post! I searched for a while to find the right answer to my questions!

By: Tony

Tony — Tue, 19 Aug 2008 04:55:27 +0000

Your site regarding robots.txt tips for WordPress to prevent Duplicate Content looks very interesting to me. I found it doing a search for money tips.