exlude/filter link

  • 4 Replies
  • 1909 Views
*

sonosail

  • Newbie
  • *
  • 4
  • +0/-0
    • View Profile
exlude/filter link
« on: July 12, 2010, 03:52:48 PM »
My site has many page references that I wish to exclude from the crawl. Like http://mysite.com/mypage.asp?page=2.
So I would like to exclude any link that contains   ?page=   .  I've tried it a number of ways but can't manage to get to work.

I can't imagine that this would involve anthing to do with regex.  Just a simple string match. 

Thanks in advance.

Randy Browning

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1386
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: exlude/filter link
« Reply #1 on: July 12, 2010, 09:26:51 PM »
Hi,

You probably already have, but check the output filters help :: Do Not List URLs That Match Paths / Strings / Regex

(Also make sure you disable easy sitemap generator mode so you can see all the options.)


Have you tried adding:
Code: [Select]
:mypage.asp?page= (with the colon in front for a "path match")
?

Actually
Code: [Select]
?page= should work as well since that makes a "string/text match".

If it does not work, please email me with your website address, and I will be happy to create a project file for you!
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

*

sonosail

  • Newbie
  • *
  • 4
  • +0/-0
    • View Profile
Re: exlude/filter link
« Reply #2 on: July 13, 2010, 02:42:07 PM »
Easy mode is off.  I see where it should be entered. Syntax just never seemed to right or something.  Let me give your suggestion a try.

Thanks very much.

Randy Browning

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1386
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: exlude/filter link
« Reply #3 on: July 14, 2010, 12:42:12 PM »
In the article I linked arlier, there's also a demo project you can try that demonstrates output exclude filters using both regular expressions, string/text match and path match! :)
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

*

sonosail

  • Newbie
  • *
  • 4
  • +0/-0
    • View Profile
Re: exlude/filter link
« Reply #4 on: July 14, 2010, 02:54:45 PM »
Saw the file but haven't tried it. I'll load it and take a look.
Thanks again.

Randy Browning

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper