Duplicate URLS

Started by AMcCartney, January 09, 2014, 01:58:51 PM

AMcCartney

Hello everyone,

My company has a dynamic site that I am trying to develop a site map for.  My problem is that we are getting dulplicate results for many of our pages - one that has the main URL that I want included in the site map (example ...parts-i-106.html) and additional URLs that I don't want included (example: ...parts-i-106.html?clear_car=yes or ...parts-i-106.html?page=1). What settings should I be using to exclude the duplicate URLs that I want removed from the site map?

Thank you in advance for your help!

Webhelpforums

Start out by reading this article:
http://www.microsystools.com/products/sitemap-generator/help/duplicate-content-page-urls/


Then consider using canonical, noindex and similar at your website.
and/or
Use *analysis filters* + *output filters* in A1 Sitemap Generator.


If you have problem getting it to work, you can also email us your project file:
http://www.microsystools.com/home/contact.php

TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper