Saturday, December 18, 2010

What is Crawler?

A web crawler or web spider is a script which surf World Wide Web in a regular manner. A web crawler is one type of bot, other names are web spider, web robot, bot, crawler, and automatic indexer.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.

Top Stories