Crawl Only Selected Pages - Video Sitemap Creation

Started by mkv4, July 18, 2012, 02:45:43 PM

mkv4

I've been trying to figure this out for a few hours now.

I'm trying to generate a video sitemap of videos that appear only on certain pages on my website so I can submit the sitemap in Webmaster Tools. I have a list of all of the URLs where the videos appear on my site, and I want A1 Sitemap Generator to crawl and analyze ONLY that list of pages (it's about 3000 URLs). Is there a way to enter that list, crawl only those pages, and then generate a video sitemap based on that analysis? THANKS!

Webhelpforums

#1
Hi,

It should not be a problem.


1)
Switch of "easy mode"
http://www.microsystools.com/products/sitemap-generator/help/easy-sitemap-generator-mode/

2)
Follow video sitemap tutorial
http://www.microsystools.com/products/sitemap-generator/help/video-xml-sitemaps/

3)
Then read this how to import a list of URLs and crawl those:
http://www.microsystools.com/products/sitemap-generator/help/website-sitemap-pages-list/
Do make sure you don't end up excluding video and image file locations

...

Another method instead of importing would be step 1+2 and then manually create exclude analysis filters
http://www.microsystools.com/products/sitemap-generator/help/website-crawler-scanner-filters/
before scanning the website


Please write and/or email back if you can not get it working :)
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

mkv4

Hello,

Thanks for the reply. I'm still having some trouble getting this to work. I know now (I think) that it's related to my inability to prevent crawling of pages I don't want crawled.

If, for example, I wanted the crawler to crawl only example.com/examplepage/ and not follow internal/external links and then crawl those pages, how would I tell A1 to crawl only the URLs I specify and not follow any outbound links and crawl them?

Remember that I'm only using the program to generate a video sitemap. I want A1 to crawl example.com/example/ and create a sitemap that contains the embedded video on that page only. I already have the list of all of the URLs on which the videos appear; I'm simply trying to save time by having A1 generate the video sitemap instead of having to do it manually.

Any ideas? Thanks again for your help.

Webhelpforums

After importing your URL list
see http://www.microsystools.com/products/sitemap-generator/help/website-sitemap-pages-list/

you can select all your page URLs and add them all to the "limit to" list in "output filters" and "analysis filters"
(by using the green button, see help, #2 screenshot)

Then use the video sitemap preset.

And hit the "start scan" button

...

If that still does not work, please drop an email to support with the relevant files attached:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper