Scan or re-crawl

  • 1 Replies
  • 424 Views
*

wairds

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Scan or re-crawl
« on: February 27, 2018, 10:11:55 AM »
What is the difference between scan and re-crawl?

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1385
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Scan or re-crawl
« Reply #1 on: February 27, 2018, 06:49:14 PM »
Hi,

From https://www.microsystools.com/products/sitemap-generator/help/sitemap-generator-resume-scan/

Quote
Resume Full Versus Resume Fix Errors Versus Recrawl
  • Resume (full):
    • Keeps all URLs from earlier scan.
    • Will crawl and analyze all URLs that are not flagged as fully analyzed.
    • If any new URLs are found, these will be crawled as well.
  • Resume (fix errors):
    • Keeps all URLs from earlier scan.
    • Will test all URLs that somehow error responded during crawl.
  • Recrawl (full) - also called Refresh:
    • Keeps all URLs from earlier scan.
    • Will crawl and analyze all URLs. This includes URLs that do not include analysis required in their crawl state flags.
    • In the future, it is possible that the recrawl will prioritize URLs based on e.g. importance, when last checked, how often page changes etc.
    • If any new URLs are found, these will be crawled as well.
    • Useful in cases where you have locked content, e.g. page title for a specific URL, and want to make sure the locked data is kept. Use the Lock buttons found next to different data such as titles. For more information on how to lock page titles and other data across recrawls, read about editing page titles and descriptions.
  • Recrawl (listed only):
    • Like Recrawl, but will not analyze or include any new URLs in scan results.
  • None of the above options checked:
    • The default and recommended in most cases.
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper