Where did 'Crawler filters' go?

Started by sam, June 18, 2013, 03:09:42 PM


Where did the 'Crawler filters' tab go?  I see it in some of the screenshots but I don't see it in my installation (latest version: 4.2.4)

I think I need it for what I am trying to accomplish

I want to prevent the crawler from going to links that don't contain a certain string

For example, I want to start here:

And only crawl links that follow this pattern:

Let's say my site has 100,000 pages that span other sections like blog.* -- I don't want the crawler to have to crawl all pages just to filter output after the fact

I have tried the 'Limit analysis' and 'Limit output' fields but they don't seem to work for this scenario, the crawler still attempts to crawl the entire website

What am I missing?

Any help would be appreciated, thank you



"Crawler filters" are now called "Analysis filters" in program user interface:

If you still do not see it, be sure to switch off "easy mode":

Hope this helps. Otherwise post again :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
website analysis spider tool for technical SEOA1 Website Analyzer
SEO tools for managing keywords and keyword listsA1 Keyword Research
complete website copier toolA1 Website Download
create custom website search enginesA1 Website Search Engine
scrape data into CSV, SQL and databasesA1 Website Scraper