Any option to avoid External link?

  • 3 Replies
  • 479 Views
*

ericleonardo

  • Newbie
  • *
  • 2
  • +0/-0
    • View Profile
Any option to avoid External link?
« on: May 12, 2017, 07:22:38 PM »
Hello! Please, is there any way to avoid following External links?
So crawler would spend time only on what matters (my website).

Another minor question: Does crawler load all script on current page or just HTML content?

Thanks!
Eric

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1329
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Any option to avoid External link?
« Reply #1 on: May 13, 2017, 10:03:27 AM »
Quote
Hello! Please, is there any way to avoid following External links?
So crawler would spend time only on what matters (my website).

Default is to ignore external links.  However, certain scan presets enable checking and analyzing external links. The option hat controls this is found here:
Scan website | Data collection | Verify external links exist (and analyze if applicable)
Scan website | Data collection | Store found external URLs


Quote
Another minor question: Does crawler load all script on current page or just HTML content?

Default HTML, but can also to some degree do AJAX, Javascript, CSS and more, but it depends on settings.

Settings that affect this are:
Javascript: "Scan website | Crawler options | Try search inside Javascript"
CSS: "Scan website | Crawler options | Try search inside CSS"
PDF: "Scan website | Crawler options | Try search inside PDF"
Flash: "Scan website | Crawler options | Try search inside Flash"
AJAX: "Scan website | Crawler engine | default path type and handler"  where you can choose "HTTP using WinInet/IE" (IE is used to load the page and execute any "onload" Javascript/AJAX that alters the content.)

« Last Edit: May 16, 2017, 07:04:49 AM by Webhelpforums »
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

*

ericleonardo

  • Newbie
  • *
  • 2
  • +0/-0
    • View Profile
Re: Any option to avoid External link?
« Reply #2 on: May 13, 2017, 10:38:54 AM »
Thank you very much!

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1329
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Any option to avoid External link?
« Reply #3 on: May 16, 2017, 07:03:26 AM »
Just expanded the earlier answer. If you have more questions about A1 Sitemap Generator, let us know :)
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper