Can't get exclude analysis filters to work with request's parameters

  • 1 Replies
  • 1406 Views
*

cumulo

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Hi,

I am trying to download a website (www.example.com). I have manage to do about 95% of the job so far with A1 Website Download.

I have set POST login information and I can download a part of the website but I can't find a way to exclude the "LOGOUT" from the download so I only get a part of the website.

I know I can set it up in "Excluse analysis of internal URLs..." under Analysis filters but the problem is that the website doesn't use a simple www.example.com/logout.php page. It uses the logout as a parameter to any given page...

www.example.com/test1.php?doLogout=true
www.example.com/test2.php?doLogout=true
www.example.com/test3.php?doLogout=true

So i tried putting "doLogout=true" without the quotes of course to have the filter matches relative paths that contain doLogout=true but that doesn't seem to work so I wonder if this is since it's a parameter. I also tried with the quotes just in case. I looked a bit into regex but I don't understand regex right now.

I cannot completly ignore parameters since I need all the other URLs except those doLogout=true.

I'm currently using v4.1.3

Thank you for reading and further more for your support.

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1379
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Can't get exclude analysis filters to work with request's parameters
« Reply #1 on: December 24, 2012, 02:37:24 PM »
Notice that you will have to exclude in both output filters and analysis filters to prevent A1WD from making the HTTP request.

Also notice that for exclusions you can either make:
  • simple string matches "logout"
  • path matches (what you tried)
  • or more complex regular expression matches

If you still have problems, email your project to support:
http://www.microsystools.com/home/contact.php

...

Also make sure the login actually works. Unfortunately more and more sites have begun using techniques for login systems that are more complex than "old style" post form logins. (Combining Javascript/Ajax/Serverside validation, and not just e.g. session cookie post form logins.)

htp://www.microsystools.com/products/website-download/help/website-scan-login/
« Last Edit: December 24, 2012, 02:39:38 PM by Webhelpforums »
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper