Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Sitemap Generator => Topic started by: wairds on February 27, 2018, 10:11:55 AM

Title: Scan or re-crawl
Post by: wairds on February 27, 2018, 10:11:55 AM
What is the difference between scan and re-crawl?
Title: Re: Scan or re-crawl
Post by: Webhelpforums on February 27, 2018, 06:49:14 PM
Hi,

From https://www.microsystools.com/products/sitemap-generator/help/sitemap-generator-resume-scan/ (https://www.microsystools.com/products/sitemap-generator/help/sitemap-generator-resume-scan/)

QuoteResume Full Versus Resume Fix Errors Versus Recrawl

  • Resume (full):

    • Keeps all URLs from earlier scan.
    • Will crawl and analyze all URLs that are not flagged as fully analyzed.
    • If any new URLs are found, these will be crawled as well.
  • Resume (fix errors):

    • Keeps all URLs from earlier scan.
    • Will test all URLs that somehow error responded during crawl.
  • Recrawl (full) - also called Refresh:

    • Keeps all URLs from earlier scan.
    • Will crawl and analyze all URLs. This includes URLs that do not include analysis required in their crawl state flags.
    • In the future, it is possible that the recrawl will prioritize URLs based on e.g. importance, when last checked, how often page changes etc.
    • If any new URLs are found, these will be crawled as well.
    • Useful in cases where you have locked content, e.g. page title for a specific URL, and want to make sure the locked data is kept. Use the Lock buttons found next to different data such as titles. For more information on how to lock page titles and other data across recrawls, read about editing page titles and descriptions.
  • Recrawl (listed only):

    • Like Recrawl, but will not analyze or include any new URLs in scan results.
  • None of the above options checked:

    • The default and recommended in most cases.