Where did 'Crawler filters' go?

  • 1 Replies
  • 1570 Views
*

sam

  • Newbie
  • *
  • 4
  • +0/-0
    • View Profile
Where did 'Crawler filters' go?
« on: June 18, 2013, 03:09:42 PM »
Where did the 'Crawler filters' tab go?  I see it in some of the screenshots but I don't see it in my installation (latest version: 4.2.4)

I think I need it for what I am trying to accomplish

I want to prevent the crawler from going to links that don't contain a certain string

For example, I want to start here:
http://mysite.com/index.php?go=news.home

And only crawl links that follow this pattern:
http://mysite.com/index.php?go=news.*

Let's say my site has 100,000 pages that span other sections like blog.* -- I don't want the crawler to have to crawl all pages just to filter output after the fact

I have tried the 'Limit analysis' and 'Limit output' fields but they don't seem to work for this scenario, the crawler still attempts to crawl the entire website

What am I missing?

Any help would be appreciated, thank you
« Last Edit: June 18, 2013, 03:11:41 PM by sam »

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1385
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Where did 'Crawler filters' go?
« Reply #1 on: June 20, 2013, 09:39:17 AM »
Hi,

"Crawler filters" are now called "Analysis filters" in program user interface:
http://www.microsystools.com/products/website-analyzer/help/website-crawler-scanner-filters/

If you still do not see it, be sure to switch off "easy mode":
http://www.microsystools.com/products/website-analyzer/help/easy-website-analyzer-mode/

Hope this helps. Otherwise post again :)
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper