
This search engine provides full indexing and search facilities for any web site either on the Internet or an Intranet.Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file.
|