Excluding a folder and file type

  • 1 Replies


  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Excluding a folder and file type
« on: March 25, 2013, 02:16:17 PM »
I want to exclude certain pages from being indexed. However, it is an AND statement. I want to exclude all pages that are in the /products/ folder AND have the extension of .html. How would I do this?



  • Administrator
  • Hero Member
  • *****
  • 1425
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Excluding a folder and file type
« Reply #1 on: March 25, 2013, 02:47:39 PM »
You will want to use regular expressions in those case.

First see:

(which URLs/pages get analyzed)

(which URLs/pages get included in output)

Other help pages

Then create a regular expression like this
Code: [Select]
/products/.*\.htmlwhich will match any URL with */products/* and *.html*

As seen from help above, A1SG needs regex filters prepended with "::" so it becomes
Code: [Select]
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.


See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
A1 Website Analyzer
A1 Keyword Research
A1 Website Download
A1 Website Search Engine
A1 Website Scraper