Where did the 'Crawler filters' tab go? I see it in some of the screenshots but I don't see it in my installation (latest version: 4.2.4)
I think I need it for what I am trying to accomplish
I want to prevent the crawler from going to links that don't contain a certain string
For example, I want to start here:
http://mysite.com/index.php?go=news.home
And only crawl links that follow this pattern:
http://mysite.com/index.php?go=news.*
Let's say my site has 100,000 pages that span other sections like blog.* -- I don't want the crawler to have to crawl all pages just to filter output after the fact
I have tried the 'Limit analysis' and 'Limit output' fields but they don't seem to work for this scenario, the crawler still attempts to crawl the entire website
What am I missing?
Any help would be appreciated, thank you
Hi,
"Crawler filters" are now called "Analysis filters" in program user interface:
http://www.microsystools.com/products/website-analyzer/help/website-crawler-scanner-filters/ (http://www.microsystools.com/products/website-analyzer/help/website-crawler-scanner-filters/)
If you still do not see it, be sure to switch off "easy mode":
http://www.microsystools.com/products/website-analyzer/help/easy-website-analyzer-mode/ (http://www.microsystools.com/products/website-analyzer/help/easy-website-analyzer-mode/)
Hope this helps. Otherwise post again :)