XML Sitemap for more than 50k pages.

  • 4 Replies
  • 2186 Views
*

Black Ninja

  • Die Hard
  • Full Member
  • ***
  • 203
  • +0/-0
  • “Don't cry because it's over,smile bcoz it happene
    • View Profile
    • Great Journal
XML Sitemap for more than 50k pages.
« on: February 20, 2012, 03:18:27 AM »
 Hi Everyone,

 Actually, my site has more than 50k pages and all pages are dynamic.  I want to create xml sitemap. Can somebody tell me any XML sitemap generator tools that can create sitemap more than 50k pages?  Please, please… suggest me, if you know any tools.

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1408
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: XML Sitemap for more than 50k pages.
« Reply #1 on: February 20, 2012, 03:46:14 AM »
Note: This is the A1 Sitemap Generator help forum which is for discussion about this product only.

XML sitemaps are automatically split into multiple sitemap files at latest when passing 50k URLs, see help:
http://www.microsystools.com/products/sitemap-generator/help/xml-sitemaps-page-limit/

However, if your website is over e.g. half million URLs, you may want to wait for 64bit version which is coming soon I believe.
« Last Edit: February 20, 2012, 03:51:40 AM by Webhelpforums »
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

*

Black Ninja

  • Die Hard
  • Full Member
  • ***
  • 203
  • +0/-0
  • “Don't cry because it's over,smile bcoz it happene
    • View Profile
    • Great Journal
Re: XML Sitemap for more than 50k pages.
« Reply #2 on: February 21, 2012, 06:03:23 AM »
Thanks for your feedback, I have used A1 sitemap, But it,s works very slow. Its take 5-6 hours to create sitemap for 30k pages.  Is there any other tools?

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1408
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: XML Sitemap for more than 50k pages.
« Reply #3 on: February 21, 2012, 06:21:36 AM »
Hi,

If it takes 5-6 hours for 30k pages, it is most likely a server issue since A1SG can crawl much higher number of pages. Remember A1SG is not a database solution, i.e. something that just reads a database, it actually crawls your website. (And if you are using e.g. a video sitemap preset, it will also have to crawl some external pages as well.)

A rough speed example using default settings with 5 simultaneous threads;
http://www.computergameplayer.com is done 427 (analyzed and listed) pages in 58 seconds

A rough speed example increasing the count to 31 simultaneous threads:
http://www.computergameplayer.com is 427 (analyzed and listed) pages in 33 seconds

(And the website is hosted other side of the Atlantic)

...

I suggest you try switch of "Easy mode"
http://www.microsystools.com/products/sitemap-generator/help/easy-sitemap-generator-mode/

Then you can try some of things listed here:
http://www.microsystools.com/products/sitemap-generator/help/creating-sitemaps-large-websites/

Most important thing to try is increasing crawler count:
Scan website - Crawler engine - Max simultaneous connections
(But unless your server/db/etc. can handle it, the benefit will be limited.)
« Last Edit: February 25, 2012, 07:08:48 AM by Webhelpforums »
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1408
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: XML Sitemap for more than 50k pages.
« Reply #4 on: March 03, 2012, 11:53:06 AM »
I am closing this thread. If you would like further help, please email support:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper