24 hours and still analysing

  • 1 Replies
  • 1821 Views
*

steviem

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
24 hours and still analysing
« on: May 17, 2011, 10:14:11 AM »
I am currently using A1 sitemap to build a sitemap for my site. Its quite a big site, but I cannot believe it is so big that it is presently taking over 24 hours to analyse. It has been running for the last 24 hours and is currently sitting at 134000 urls and counting. I am beginning to think something must be wrong here. I don't know whether to stop it and lose all the data, or else persist until god knows when it finishes. 

I have read other similar posts, but I am just looking for some advice, on whether I should perhaps stop the scan now?  I cannot believe there are 134,000 urls on my site 

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1406
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: 24 hours and still analysing
« Reply #1 on: May 17, 2011, 12:55:09 PM »
Most other posts here have been due to configurations or indeed websites that indeed were so big :)

Anyways, just stop your website scan. (I *always* do the same if I encounter something seems odd.)

You can resume later:
http://www.microsystools.com/products/sitemap-generator/help/sitemap-generator-resume-scan/

Do note that *with default settings* any URLs that were noindex or otherwise through e.g. robots.txt excluded gets removed from the visible results when you stop the scan. (For some websites this can be a very high number of URLs. However, the scanning engine "remembers" all URLs during a website scan, so it know which it has already encountered. This includes e.g. noindex URLs.)

If you have lots of URLs / planning on using stop/resume I highly recommend you check above article. It explains a lot about the different options you can apply.

If you don't see the various options, disable "Simplified easy mode":
http://www.microsystools.com/products/sitemap-generator/help/easy-sitemap-generator-mode/

If you continue to have problems, please email your project to support:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper