What are Spiders, Robots and Crawlers and what are their functions?

Started by astrologerhome, May 01, 2017, 12:50:52 AM

astrologerhome

Please tell me what are spiders. Robots and crawlers and their functions.

sinelogixtech

Spider - The browsers are like a program and to download the web page.

Crawler – The program is automatically to follow the links are the web page.

Robots - It had automated computer program can visit websites. It will guide by search engine algorithms.
It can combine the tasks of crawler & spider helpful of the indexing the web pages and through the search engines.

Vinod Kumar

Thanks dear @sinelogixtech but these all are same whose work is to collect information world wide and send to the database.
Quote from: sinelogixtech on May 01, 2017, 03:30:43 AM
Spider - The browsers are like a program and to download the web page.

Crawler – The program is automatically to follow the links are the web page.

Robots - It had automated computer program can visit websites. It will guide by search engine algorithms.
It can combine the tasks of crawler & spider helpful of the indexing the web pages and through the search engines.

RH-Calvin

They are all the same and are search engine automated programs that are responsible to read through webpage source to provide information to search engines.
Cheap VPS | $1 VPS Hosting
Cheap Dedicated Servers | Free Setup with IPMI

Vinod Kumar

They all are related to Search Engine and they are same.These are the automatic and mathematical program which visits worldwide  thousands of webpages.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper