Web Crawler

Computer Science

This was my first major project in C++. It is a web crawler. You tell it what site to crawl, and it creates a series of web pages indexing your site by word. The code I wrote for this project (especially the parser and HTML generator) was incredibly robust, and ended up serving as the foundation for the C++ based XML parser that powered my old web site for a few years.

For more information, click below:

  • Program description

  • Source code
  • Posted November 01, 1999 (09:18 PM)