Where did 'Crawler filters' go?

Started by sam, June 18, 2013, 03:09:42 PM


Where did the 'Crawler filters' tab go?  I see it in some of the screenshots but I don't see it in my installation (latest version: 4.2.4)

I think I need it for what I am trying to accomplish

I want to prevent the crawler from going to links that don't contain a certain string

For example, I want to start here:

And only crawl links that follow this pattern:

Let's say my site has 100,000 pages that span other sections like blog.* -- I don't want the crawler to have to crawl all pages just to filter output after the fact

I have tried the 'Limit analysis' and 'Limit output' fields but they don't seem to work for this scenario, the crawler still attempts to crawl the entire website

What am I missing?

Any help would be appreciated, thank you



"Crawler filters" are now called "Analysis filters" in program user interface:

If you still do not see it, be sure to switch off "easy mode":

Hope this helps. Otherwise post again :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac