Exclude variable URL from scan

Started by peter09, December 13, 2014, 12:49:05 PM

peter09

Have 100.000 links with keywords on my site that I didn´t want to scan:

/search.php?clearSearch=true&searchPhrase=keyword

=> keyword is variable so I want to exclude it automatically

But how ist the right regex code to exclude under output filters?

::search.php?clearSearch=true&searchPhrase=*

and some more didn´t runs


Webhelpforums

"output filters" only exclude URLs from output. To avoid analysis/crawl/scan you will also need to use "analysis filters".


In your case, you do not even need to use regular expressions, just use
"search.php?clearSearch=true&searchPhrase="
(without "")

in both "output filters" and "analysis filters".

If you have problems, drop an email with your project file :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper