Scan or re-crawl

Started by wairds, February 27, 2018, 10:11:55 AM

wairds

What is the difference between scan and re-crawl?

Webhelpforums

Hi,

From https://www.microsystools.com/products/sitemap-generator/help/sitemap-generator-resume-scan/

QuoteResume Full Versus Resume Fix Errors Versus Recrawl

  • Resume (full):

    • Keeps all URLs from earlier scan.
    • Will crawl and analyze all URLs that are not flagged as fully analyzed.
    • If any new URLs are found, these will be crawled as well.
  • Resume (fix errors):

    • Keeps all URLs from earlier scan.
    • Will test all URLs that somehow error responded during crawl.
  • Recrawl (full) - also called Refresh:

    • Keeps all URLs from earlier scan.
    • Will crawl and analyze all URLs. This includes URLs that do not include analysis required in their crawl state flags.
    • In the future, it is possible that the recrawl will prioritize URLs based on e.g. importance, when last checked, how often page changes etc.
    • If any new URLs are found, these will be crawled as well.
    • Useful in cases where you have locked content, e.g. page title for a specific URL, and want to make sure the locked data is kept. Use the Lock buttons found next to different data such as titles. For more information on how to lock page titles and other data across recrawls, read about editing page titles and descriptions.
  • Recrawl (listed only):

    • Like Recrawl, but will not analyze or include any new URLs in scan results.
  • None of the above options checked:

    • The default and recommended in most cases.
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper