24 hours and still analysing

Started by steviem, May 17, 2011, 10:14:11 AM

steviem

I am currently using A1 sitemap to build a sitemap for my site. Its quite a big site, but I cannot believe it is so big that it is presently taking over 24 hours to analyse. It has been running for the last 24 hours and is currently sitting at 134000 urls and counting. I am beginning to think something must be wrong here. I don't know whether to stop it and lose all the data, or else persist until god knows when it finishes. 

I have read other similar posts, but I am just looking for some advice, on whether I should perhaps stop the scan now?  I cannot believe there are 134,000 urls on my site 

Webhelpforums

Most other posts here have been due to configurations or indeed websites that indeed were so big :)

Anyways, just stop your website scan. (I *always* do the same if I encounter something seems odd.)

You can resume later:
http://www.microsystools.com/products/sitemap-generator/help/sitemap-generator-resume-scan/

Do note that *with default settings* any URLs that were noindex or otherwise through e.g. robots.txt excluded gets removed from the visible results when you stop the scan. (For some websites this can be a very high number of URLs. However, the scanning engine "remembers" all URLs during a website scan, so it know which it has already encountered. This includes e.g. noindex URLs.)

If you have lots of URLs / planning on using stop/resume I highly recommend you check above article. It explains a lot about the different options you can apply.

If you don't see the various options, disable "Simplified easy mode":
http://www.microsystools.com/products/sitemap-generator/help/easy-sitemap-generator-mode/

If you continue to have problems, please email your project to support:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper