what is spiders,crawlers,bots?
Spider - Spiders create a text-based summary of content and an address (URL) for each webpage.
Crawler – The program is automatically to follow the links are web page..
Robots - It had automated computer program can visit websites.
They are all the same and are search engine automated programs that are responsible to read through webpage source and provide information to search engines.