[larrysstyle]

A Webcrawler or as it's also known a Web Spider is a program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web.