Webmaster Forums - Website and SEO Help

Search Engines and Marketing => Website Crawling and Indexing => Topic started by: sneha1234 on March 10, 2012, 03:22:20 AM

Title: What is a spider?
Post by: sneha1234 on March 10, 2012, 03:22:20 AM
Spider is an robot that travels the web examining the websites in order to add them to a search engine database and rank them according to the specific ranking criteria for that search engine. The spiders will periodically come back to your site once indexed in their database. That is why it is important to constantly refresh your content, because the spiders will stop coming to your site if your content remains the same.

Title: Re: What is a spider?
Post by: AllenSantiago on March 16, 2012, 09:42:41 AM
Spider or crawler is basically algorithm/program and used find/discover new and updated content/web pages and then places such content in to the search engine result pages.
Title: Re: What is a spider?
Post by: lillianabe on March 27, 2012, 09:04:09 AM
Spider is known as search engine crawler or bot. Spider is one type of program which one use by all search engines for crawling or indexing website. Spider works to read or refers website or web page content or information and also new update and submitted to their owner or search engine data directory.
Title: Re: What is a spider?
Post by: firstservicesnevda on March 28, 2012, 08:10:14 AM
Spider or crawler is basically algorithm/program and used find/discover new and updated content/web pages and then places such content in to the search engine result pages.
Title: Re: What is a spider?
Post by: Nichole Green on April 10, 2012, 03:41:30 AM
Spider is also known as a bot, robot, or crawler. Spiders are programs used by a search engine to explore the World Wide Web in an automated manner and download the HTML content (not including graphics) from web sites, strip out whatever it considers superfluous and redundant out of the HTML, and store the rest in a database (i.e. its index).
Title: Re: What is a spider?
Post by: tarunjangra on April 10, 2012, 05:59:02 AM
Spider is known as search engine .  A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine .
Title: Re: What is a spider?
Post by: ericfox on July 24, 2012, 02:30:56 AM
 According to me a spider, also known as a robot or a crawler, is actually just a program that follows, or "crawls", links throughout the Internet, grabbing content from sites and adding it to search engine indexes. Spiders find Web pages by following links from other Web pages, but you can also submit your Web pages directly to a search engine or directory and request a visit by their spider.
Title: Re: What is a spider?
Post by: maxsamuel on August 24, 2012, 04:56:24 AM
A spider is know as automatic software which index the web pages on an interval and update it in search engine database and crawl it time to time. this help to identify search engine for ranking it.
Title: Re: What is a spider?
Post by: siyajoshi on August 29, 2012, 02:58:03 AM
Hello..
A spider is a program that a search engine uses to seek out information on the World Wide Web, as well as to index the information that it finds so that actual search results appear when a search query for a keyword is entered. The search engine spider "reads" the text on the web page or collection of web pages, and records any hyperlinks it finds. The search engine spider then follows these URLs, spiders those pages, and collects all the data by saving copies of the web pages into the index of the search engine for use by visitors.
Thnx...
Title: Re: What is a spider?
Post by: Riyaraj on August 30, 2012, 12:25:36 AM
hi,

spider is a software.
Spiders follow links from one page to another and from one site to another. That is the primary reason why links to your site are so critical. Getting links to your website from other websites will give the search engine spiders more opportunities to find and re-index your site. The more times they find links to your site, the more times they will stop by and visit.
Title: Re: What is a spider?
Post by: ruby on September 10, 2012, 05:49:08 AM
Spider or crawler is basically algorithm and used find new and updated web pages and then places such content in to the search engine result pages.
Title: Re: What is a spider?
Post by: josshray on October 03, 2012, 03:40:53 PM
Spider is a bot which crawl a site or go though our sites.
Title: Re: What is a spider?
Post by: petersmith5544 on January 04, 2013, 04:08:17 AM
A spider crawls any website or web pages throughout on the web and puts to the search engine database. It is also known as crawlers, bot and robot.
Title: Re: What is a spider?
Post by: jimmyedword on January 10, 2013, 01:27:54 AM
You can call it spider, bot, robot, crawler or a automated Google program.
Title: Re: What is a spider?
Post by: ushahm on January 11, 2013, 02:18:37 AM
spider is also called as crawler or bot.search engine bots visit your website,read the content and save it as a document and show you to the search engine results.
Title: Re: What is a spider?
Post by: icecube media on March 14, 2013, 01:27:19 AM
Hello,

A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.
Title: Re: What is a spider?
Post by: phpdevelopment on March 28, 2013, 04:58:00 AM
A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.
Title: Re: What is a spider?
Post by: Seo gurgaon on April 03, 2013, 02:39:07 AM
Spider or Crawler is the universal name of Program of Search Engines that crawl the world wide web through one link to another and fetch all the new information & index it into its Search Engine Database.
Title: Re: What is a spider?
Post by: Webhelpforums on April 06, 2013, 11:15:45 AM
Our website auditing (links, anchor text, content etc.) tool A1 Website Analyzer http://www.microsystools.com/products/website-analyzer/ (http://www.microsystools.com/products/website-analyzer/) is an example of a program containing a website crawler / website spider
Title: Re: What is a spider?
Post by: Alex Thompson on April 11, 2013, 02:59:20 AM


    Search engines gather data about a website by 'sending' the spider or bots to 'read' the site and copy its content. This content is stored in the search engine's database. As they copy and absorb content from one document, they create record links and send other bots to make copies of content on those linked documents this process goes on and on.

Title: Re: What is a spider?
Post by: jamesmiller on April 27, 2013, 08:47:44 AM
A Spider is a search engine's software, which reads the world wide websites for indexing the data of the websites into the search engines database.
Title: Re: What is a spider?
Post by: TommyBenvolio on May 20, 2013, 02:42:00 AM
Basically Spider is a bot or crawler that will crawl your website through search engine.
Title: Re: What is a spider?
Post by: roger4321 on May 26, 2013, 10:31:22 AM
spider is a crawler which comes to the site and ranks the keywords by seeing the quality of back links from the site.
Title: Re: What is a spider?
Post by: exportersindia on August 05, 2013, 09:00:12 AM
A spider is a program that visits Web sites and reads their pages to create entries for a search engine index.