URGENT : A1 Sitemap Output Blank

Started by naumanahmad786, September 23, 2016, 03:34:29 AM

naumanahmad786

Dear Gents,

I am trying to create sitemap for my website with A1 Sitemap version 7 . Once the A1 Sitemap completes its "scanning " , on clicking the  " Build Now" the Xml file is empty. Then i press " build all" and use "Web.sitemap" which is Dotnet Sitemap file and covert it into normal xml using another tool. in some cases this web.sitemap is also empty

If i stop scan before completing the scan , then it gives all URLS in XML which it has scanned till that time.

can someone please help :-[ :-[ :-[ :-[




Webhelpforums

Please email your project file to info@microsystools.com

Incase that is not possible:

1)
If you are trying to generate image or video sitemaps - be sure to use the relevant scan presets (or do the configurations yourself), so e.g. images and videos are colleced.

2)
Check you are have not excluded all urls with robots.txt / noindex

3)
Check your pages do not contain "canonical" instruction all pointing to another single page (internal or externally) - this might be the most likely cause from your description

4)
Make sure you have not set up an exclude filer of any sort.

But there are even more possible reasons - will have to see the project file / test scan.
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

Webhelpforums

For reference I just tried to
1) downloaded 7.5.0 update #1 for Windows
2) used default setttings
3) scanned the domain in your email address
4) built a standard XML sitemap without problems

TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

naumanahmad786

Hi,

i did not save project file however Let me share actual URL

1. www.erpisto.com/gse1/ this is the URL where i am able to complete the scan but at the end the XML file is empty but WEB.Sitemap has all URLs which i convert into XML using a third party converter and then i add frequency manually. Takes me hours

2. www.erpisto.com/gse6/franchise-management-software/ this is the URL where sitemap.xml is empty and web.sitemap contains just one URL

can you please test yourself and advice me the solution

thanks in advance
Nauman :)

naumanahmad786


hi

i have sent my project file at  info@microsystools.com from my email nauman@bilytica.com

subject is same

regards

Nauman

Webhelpforums

#5
For those interested what the solution was:

The way to force A1 Sitemap Generator to include 301 / permanent redirect URLs in XML sitemaps is explained here:

http://www.microsystools.com/products/sitemap-generator/help/sitemap-builder-exclude-urls/

Section
Exclude URLs by Response Code in Sitemap Builder

Normally you will not want to include URLs that redirect in XML sitemaps - but it is possible to force A1SG to do so :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

naumanahmad786

hi,

I am confused, is this reply for me ?

I could not found 301 on my pages. it seems you posted in wrong window

Webhelpforums

#7
I replied in email as well! :)

All the URLs listed in the project file+project data you sent me has 301 redirect response code pointing to the root domain (I sample tested them as well using an internet browser) - hence for XML sitemaps, A1 Sitemap Generator will not included them when using default settings.

It is possible there is some IP address server handling going on, but in the project file you sent me, all the URLs had response code 301 (permanent redirect) - and such URLs will not be included by default in XML sitemaps built by A1 Sitemap Generator. (And any sitemapper that does so is seriously flawed)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

naumanahmad786

Hi,

this is great support but i want to clear something before i use this for my company.

On my page http://www.erpisto.com/gse6/franchise-management-software/ as per software output all urls are 301 however for example i opened first link http://www.erpisto.com/gse6/franchise-management-software-in-afghanistan/ and tested it at http://www.redirect-checker.org/index.php and got the status code 200 which is OK

i just want to make sure why A1 is considering it 301

Thanks in advance

Regards
Nauman

naumanahmad786

Hi Gents,

I have added 301 in document options and generated the sitemap but the sitemap is very odd and all URL structures are incorrect.

i can see correct URLs myself when i see pagesource of http://www.erpisto.com/gse6/franchise-management-software/

below are some sample

<url>
    <loc>http://www.erpisto.com/gse6/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-Pennsylvania/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-Sweden/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-Washington/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-aaba-lebanon/</loc>
  </url>

nothing like exist in my page source

I have already sent you projectfile you can test yourself

Webhelpforums

#10
Quote from: naumanahmad786 on September 23, 2016, 11:56:20 AM
Hi,

this is great support but i want to clear something before i use this for my company.

On my page http://www.erpisto.com/gse6/franchise-management-software/ as per software output all urls are 301 however for example i opened first link http://www.erpisto.com/gse6/franchise-management-software-in-afghanistan/ and tested it at http://www.redirect-checker.org/index.php and got the status code 200 which is OK

i just want to make sure why A1 is considering it 301

Thanks in advance

Regards
Nauman

That specific URL you mention is also reported as response code 200 in A1 Sitemap Generator. That is the root in your project file. Every other URL returns 301 - including in the tool you reference. I have emailed you some screenshots, so you can see.
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

Webhelpforums

Quote from: naumanahmad786 on September 24, 2016, 03:54:58 PM
Hi Gents,

I have added 301 in document options and generated the sitemap but the sitemap is very odd and all URL structures are incorrect.

i can see correct URLs myself when i see pagesource of http://www.erpisto.com/gse6/franchise-management-software/

below are some sample

<url>
    <loc>http://www.erpisto.com/gse6/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-Pennsylvania/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-Sweden/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-Washington/</loc>
  </url>
  <url>
    <loc>http://www.erpisto.com/gse6/-in-aaba-lebanon/</loc>
  </url>

nothing like exist in my page source

I have already sent you projectfile you can test yourself

My guess is you have done an additional change after the scan finished.

Using your project file where the site and crawl root is
http://www.erpisto.com/gse6/franchise-management-software/

then the url http://www.erpisto.com/gse6/
would normally never get included in generated sitemaps

I just tested the project again by allowing force allowing 301 redirected URLs in generated XML sitemap files - and I do no get the results you reference. (You are welcome to send your project file again though, so i can verify with your exact settings)

By he way: To find out where an URL was linked from see:
http://www.microsystools.com/products/sitemap-generator/help/sitemaps-generator-analyze-links/

TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper