Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Sitemap Generator => Topic started by: pvkid on March 30, 2010, 11:09:41 AM

Title: Not indexinf blog
Post by: pvkid on March 30, 2010, 11:09:41 AM
I am using A1 sitemap generator to make a Google sitemap for http://www.puerto-vallarta-rentals.com  it does not seem to pick up the files in my blog folder, it only comes back with 1 item. I know there are 100's of posts there. Does anyone have any ideas?
Jeff
Title: Re: Not indexinf blog
Post by: Webhelpforums on March 30, 2010, 02:12:49 PM
Hi,


I will take a look and write here at latest tomorrow, probably sooner :)
Title: Re: Not indexinf blog
Post by: Webhelpforums on March 31, 2010, 10:13:43 AM
Hi,

Okay, this issue is actually a combination of mixing www and non-www links and A1SG trying to be "smart" :)


First try scan
"http://puerto-vallarta-rentals.com/"
You will see entire blog gets included in scan:
"http://puerto-vallarta-rentals.com/blog/"


Then try scan (with www)
"http://www.puerto-vallarta-rentals.com/"
there the blog 301 redirects to
"http://puerto-vallarta-rentals.com/blog/"

...But A1 Sitemap Generator will actually instead show blog redirects to "http://www.puerto-vallarta-rentals.com/blog/" i.e. to itself...
The reason for this is that A1SG nowadays defaults to automatically add root aliases (http://www.microsystools.com/products/sitemap-generator/faq/root-aliases-start-paths/)  to "fix" a wide range of errors such as website mixing port numbers, with-www vs non-www, http vs https etc. in their website URLs. This "auto add" of root aliases can be configered in "Crawler options" for those who wish to disable this feature.


Anyways, for a solution, either scan:

"http://puerto-vallarta-rentals.com/" (which then works fine with your blog)
or
make your blog use www
or
make your blog accept both non-www and with-www


Best solution though is that your configure your entire website to either use "www" or "non-www" to avoid duplicate URLs (http://www.microsystools.com/products/sitemap-generator/faq/duplicate-content-page-urls/). This will be an advantage for link building, ranking etc. as well.


Hope this helps :)
Title: Re: Not indexinf blog
Post by: pvkid on March 31, 2010, 03:35:22 PM
Thank you for your help I did make my blog www and that fixed the problem.
<<Best solution though is that your configure your entire website to either use "www" or "non-www" to avoid duplicate URLs.>>
What do you figure is the best way to do this? .htaccess ??
Jeff
http://www.puerto-vallarta-rentals.com (http://www.puerto-vallarta-rentals.com)
Title: Re: Not indexinf blog
Post by: Webhelpforums on March 31, 2010, 05:12:41 PM
Yes :)


Something like this:


RewriteEngine On

RewriteCond %{HTTP_HOST} !^www\.microsystools\.com [NC]
RewriteCond %{HTTP_HOST} !^localhost [NC]
RewriteRule ^(.*) http://www.microsystools.com/$1 [R=permanent,L]