Sortable / Filterable Content site map

Started by alan, June 17, 2013, 11:30:41 PM

alan

Hello,

I have a website which has (among other things) a large list of items, lets say 150,  that the user can sort or filter
using a number of options. The filter/sort options that the user selects is then passed in the url as a query string
to reduce the list and only display the items matching the criteria.

When I run the sitemap generator, it creates mappings for every filter option and therefore lists many of the items
numerous times because they would show up in more than one of the filtering/sort-by selections.

My question is, Should I leave the map this way with a lot of duplicated content ? or is there a way to avoid the sitemap generator from following links generated by the filtering / sort-by options(buttons)  ?

Thanks in advance for any help ! :)

Webhelpforums

#1
If your website uses canonical, A1SG will know which URLs to exclude when building the actual sitemap files:
http://www.microsystools.com/products/sitemap-generator/help/sitemap-robots-noindex-nofollow/

Otherwise you can use "output filters":
http://www.microsystools.com/products/sitemap-generator/help/website-crawler-output-filters/
(To ensure the output after scan / generated sitemaps are correct)

To save crawler/analysis time and resources, use "crawler filters":
http://www.microsystools.com/products/sitemap-generator/help/website-crawler-scanner-filters/
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper