Showing posts with label crawler. Show all posts
Showing posts with label crawler. Show all posts

Saturday, December 18, 2010

What is Crawler?

A web crawler or web spider is a script which surf World Wide Web in a regular manner. A web crawler is one type of bot, other names are web spider, web robot, bot, crawler, and automatic indexer.

Top Stories