The Nutch-UW-Crawler is part of an aacademic computer science project that is studying statistics about a large quantity of web pages. It is based on the open-source and well-documented Nutch crawler. We honor the robots exclusion standard (robots.txt). We certainly do not intend to crawl anyone who does not want to be crawled.
Please send mail to uwcrawler08@gmail.com if you would like to contact us.
Thanks!