CRAWLING THE WEB CRAWLING THE WEB CRAWLING THE WEB What do you do when you need information from the internet? Search Engines directories Open directory project (DMOZ) Meta-search…