A web crawler or web spider is a script which surf World Wide Web in a regular manner. A web crawler is one type of bot, other names are web spider, web robot, bot, crawler, and automatic indexer.
Showing posts with label indexer. Show all posts
Showing posts with label indexer. Show all posts
Saturday, December 18, 2010
Subscribe to:
Posts (Atom)