Not indexinf blog

Started by pvkid, March 30, 2010, 11:09:41 AM

pvkid

I am using A1 sitemap generator to make a Google sitemap for http://www.puerto-vallarta-rentals.com  it does not seem to pick up the files in my blog folder, it only comes back with 1 item. I know there are 100's of posts there. Does anyone have any ideas?
Jeff

Webhelpforums

Hi,


I will take a look and write here at latest tomorrow, probably sooner :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

Webhelpforums

#2
Hi,

Okay, this issue is actually a combination of mixing www and non-www links and A1SG trying to be "smart" :)


First try scan
"http://puerto-vallarta-rentals.com/"
You will see entire blog gets included in scan:
"http://puerto-vallarta-rentals.com/blog/"


Then try scan (with www)
"http://www.puerto-vallarta-rentals.com/"
there the blog 301 redirects to
"http://puerto-vallarta-rentals.com/blog/"

...But A1 Sitemap Generator will actually instead show blog redirects to "http://www.puerto-vallarta-rentals.com/blog/" i.e. to itself...
The reason for this is that A1SG nowadays defaults to automatically add root aliases  to "fix" a wide range of errors such as website mixing port numbers, with-www vs non-www, http vs https etc. in their website URLs. This "auto add" of root aliases can be configered in "Crawler options" for those who wish to disable this feature.


Anyways, for a solution, either scan:

"http://puerto-vallarta-rentals.com/" (which then works fine with your blog)
or
make your blog use www
or
make your blog accept both non-www and with-www


Best solution though is that your configure your entire website to either use "www" or "non-www" to avoid duplicate URLs. This will be an advantage for link building, ranking etc. as well.


Hope this helps :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

pvkid

Thank you for your help I did make my blog www and that fixed the problem.
<<Best solution though is that your configure your entire website to either use "www" or "non-www" to avoid duplicate URLs.>>
What do you figure is the best way to do this? .htaccess ??
Jeff
http://www.puerto-vallarta-rentals.com

Webhelpforums

Yes :)


Something like this:


RewriteEngine On

RewriteCond %{HTTP_HOST} !^www\.microsystools\.com [NC]
RewriteCond %{HTTP_HOST} !^localhost [NC]
RewriteRule ^(.*) http://www.microsystools.com/$1 [R=permanent,L]
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper