Any option to avoid External link?

Started by ericleonardo, May 12, 2017, 07:22:38 PM

ericleonardo

Hello! Please, is there any way to avoid following External links?
So crawler would spend time only on what matters (my website).

Another minor question: Does crawler load all script on current page or just HTML content?

Thanks!
Eric

Webhelpforums

#1
QuoteHello! Please, is there any way to avoid following External links?
So crawler would spend time only on what matters (my website).

Default is to ignore external links.  However, certain scan presets enable checking and analyzing external links. The option hat controls this is found here:
Scan website | Data collection | Verify external links exist (and analyze if applicable)
Scan website | Data collection | Store found external URLs


QuoteAnother minor question: Does crawler load all script on current page or just HTML content?

Default HTML, but can also to some degree do AJAX, Javascript, CSS and more, but it depends on settings.

Settings that affect this are:
Javascript: "Scan website | Crawler options | Try search inside Javascript"
CSS: "Scan website | Crawler options | Try search inside CSS"
PDF: "Scan website | Crawler options | Try search inside PDF"
Flash: "Scan website | Crawler options | Try search inside Flash"
AJAX: "Scan website | Crawler engine | default path type and handler"  where you can choose "HTTP using WinInet/IE" (IE is used to load the page and execute any "onload" Javascript/AJAX that alters the content.)

TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

ericleonardo


Webhelpforums

Just expanded the earlier answer. If you have more questions about A1 Sitemap Generator, let us know :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper