Blackwidow spider engine will index your entire web server and create an ASCII output file of urls. Explores subdirectory structures. URL database is 100% compatible with exploit submission wizard and WAHOO! The script runs and creates a flatfile database of every single url on your server.

IT Search is a powerful, customizable, effective site indexing/searching engine, designed for both typical and big web sites, with number of files from 3-15 to more than 100.000 and site size more than 1GB.No Database is needed for storing index or documents. IT Search indexes and searches entire files, not first NN Kbytes of each file data. Size of Index files is very little, so search takes less disk time and space, allowing you to store more pages instead of index files and reduce hosting cost. Indexes are organized in such manner that every search involves only 2 files, each less that 1 MB.

Make money by letting your visitors bid on keywords in your search engine. Includes full admin features, signup bonuses, built in affiliate program and receive payments from your advertisers through Click Bank + Pay Pal + 2Checkout.

Douglas Thrift's Search Engine is an indexing search engine for use on small websites such as personal or small business sites. It is designed to be very similar to Google for end users and its output is customizable. For indexing, it supports both the Robots Exclusion Protocol and the Robots META Tag as specified at http://www.robotstxt.org/wc/exclusion.html.

Fastget is the system to organize a large set of information with care and accuracy without expending enormous time and resources. FASTGET is the system to browse a large amount of information in a systematic and direct manner.

Wordindex is a full text indexing suite developed using perl as the backend and PHP as the web based search utility. Any language can be used to search as long as it has access to MySQL databases. Wordindex is capable of indexing huge amounts of data, one production system has indexed over 14GB of textual, PDF, and compressed text files. Searches on that system are still less than a second on a modest server. Wordindex is clusterable, the indexing process which can take a very long time to complete on a huge dataset (meaning ~10G+) can be run over a couple nodes to spread out the load.

Blackwidow spider engine is an internal web spidering utility that will index your entire web server and create an ASCII output file of urls. Explores subdirectory structures. URL database is 100% compatible with exploit submission wizard and WAHOO.