Clone of :GoogleBot, WebCrawler
Developer :Inout Scripts
Language :PHPLicense :Commercial
Inout Spider is one of the most powerful web spider softwares available on the net which works best for small/medium and large sized search engines. This script is based on PHP, MySQL and Hypertable database under Hadoop file system. This Inout Spider is capable enough to deal with huge amount of data and concurrent queries with high level of scalability, accuracy and speed. Features include #Based on Hadoop and Hypertable #XML Search Output #Unlimited Custom Result Channel etc.

https://www.inoutscripts.com/products/inout-spider/
Demo

AboutGoogleBot
Googlebot is Google’s web crawling bot (sometimes also called a “spider”). Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index.

WebCrawler.com utilizes metasearch technology to compile results from many of the Web’s major search properties, delivering more relevant and comprehensive results every time you search.