See Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper

Exclude variable URL from scan

  • 1 Replies
  • 3728 Views
*

peter09

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Exclude variable URL from scan
« on: December 13, 2014, 12:49:05 PM »
Have 100.000 links with keywords on my site that I didn´t want to scan:

/search.php?clearSearch=true&searchPhrase=keyword

=> keyword is variable so I want to exclude it automatically

But how ist the right regex code to exclude under output filters?

::search.php?clearSearch=true&searchPhrase=*

and some more didn´t runs


*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1449
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Exclude variable URL from scan
« Reply #1 on: December 14, 2014, 12:27:20 PM »
"output filters" only exclude URLs from output. To avoid analysis/crawl/scan you will also need to use "analysis filters".


In your case, you do not even need to use regular expressions, just use
"search.php?clearSearch=true&searchPhrase="
(without "")

in both "output filters" and "analysis filters".

If you have problems, drop an email with your project file :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

 

Learn More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper