Duplicate Content Checker

Check whether pages on your website repeat each other. Compare two URLs side by side, paste a list of up to 100 pages, or crawl the whole site. You get a similarity score for every pair, groups of pages that overlap, identical pages, and shared titles and descriptions, so you know which pages to merge, rewrite or canonicalise.

How to check for duplicate content

1. Choose a mode: Compare 2 for two URLs, Page list for up to 100 URLs, or Whole site to crawl up to 500 pages live (750 to 1,000 by email).
2. Keep Ignore header, footer and menus ticked to compare only the main content.
3. Pick a threshold. 80% is a good start; lower it to find pages that partly overlap.
4. Review the Similar pairs and Clusters tabs, then check Same title / description / H1.
5. Download the CSVs to plan fixes with your team.

How to fix duplicate and near-duplicate pages

• Merge and redirect: if two pages target the same search, keep the stronger one, move any unique content into it and 301-redirect the other.
• Canonical tag: when both URLs must exist (tracking parameters, print versions, sorted product lists), point a canonical to the main version.
• Noindex: for filter, tag or internal search pages that add little on their own, a noindex tag keeps them out of search results.
• Rewrite: for location or service pages, add details only that page can have: local address, team, prices, photos, reviews and FAQs.
• Unique titles and descriptions: even similar pages should each say clearly what makes them different.

Want a full technical audit too? Run the website SEO crawler. After merging pages, test your redirects with the redirect checker.

Frequently asked questions

Does Google penalise duplicate content?

Usually not. Google’s guidance is that duplicate content on a site is not a reason for action unless it is meant to deceive or manipulate results. The real cost is that Google picks one version to show, which may not be the one you want, and similar pages compete with each other and split links.

How is similarity calculated?

The tool breaks each page’s text into overlapping four-word phrases and measures how many phrases two pages share (the Jaccard index). 100% means identical text. When more than 200 pages are compared, it uses a fast estimate from a sample of phrases, which is accurate to within a few percent.

What does ‘Ignore header, footer and menus’ do?

It compares only the main content of each page and leaves out the header, footer, navigation and sidebars, which repeat on every page. Turn it off to compare the full text of the page.

What similarity is too high?

There is no official number. As a rule of thumb, 90% or more is a near-duplicate, 70 to 90% is very similar, and 50 to 70% is worth a look. Location pages that only swap the city name are a common example of near-duplicates.

How do I fix duplicate pages?

Merge pages that serve the same purpose and 301-redirect the old URL to the one you keep. If you need both URLs (for example print or filter versions), point a canonical tag to the main version. Otherwise rewrite each page so it answers a different need with its own details.

Can it check if other websites copied my content?

This tool compares pages you enter or pages on one website. To compare your page with a page on another site, use Compare 2 pages and enter both URLs.

More free tools

See all free marketing tools