I have so many pages in my website is there any tool to check which pages and how many pages crawled per day?
There is not any automatic tools but if you can download google toolbar and enable page rank tool in that. In drop down menu of this tool you would get an option "Cached Snapshot of Page" clicking on this option would show you cached version of any web page.
Google Toolbar only works on Internet explorer or Firefox-4, you can also use Seo quake plugin.
You can check it manually just type your site url in Google.
You can use Google keyword tool.
A1 Website Analyzer can do it if your website is not too large. (As the process is quite slow.) You can see this support thread (http://webhelpforums.com/index.php?topic=1930.0) in A1 Website Analyzer support section. (The bottom post.)
The most common way people use to check whether a page crawled or not is to type the url in search engine. If you can see the site in search results, your site is crawled otherwise not. I dont think there is any such tool which is used to check this.
What A1 Website Analyzer can do for all URLs in the website:
* Take the page title for each URL in website
* Query the search engine selected using the exact page title
* Goes through search results looking for the URL
But it works best if the website is not too large as the process is quite slow
Here are ways to check bots visited your webpages,
- Check the last caching date of your webpage
- Check the bot's impression on your robots.txt files
- Check in your Google webmaster account ->"Statistics" -> "Crawl stats" -> "Pages Crawled Per Day Stats".
Thanks for the informative read.. I check the indexed pages of my sites by typing site:website-name in google search to know the indexed pages of google.
You can use Google webmaster toll which will help you to know about the per day crawler status as their are many helpful option on Google webmaster tool which helps to check lots of thing on your website as yo can also check the crawling errors of the website so if you have seen any crawling errors then you can remove it from your website and if their is some crawling error through your link building process then you can remove that link from Google webmaster tool so Google will not crawl that link again.
you can use the below tool.
https://ahrefs.com/
this is very good tool to see the crawled links, but first, you have to registered on this.
In my opinion You can use Google webmaster tool which will help you to know about the per day crawler statu.
It's easiest to just google your url. If it shows up in the results, then you know your site is regularly crawled. If not, then it is not being crawled. Also, the Google Toolbar is useful as well.
SEO Quake tool can be used to check crawled pages.
I used google webmaster tool.
You can use seobook toolbar to check when your website was crawled and the number of times crawled.
According to me Google Web master is best tool for crawling any new page on our website.
i have read all the post done by all members but there is not accurate answers but some had done great post. but i m still waiting for a good tool which can help us to know about crawl page on the daily basis.