Codecanyon Spider PHP Website Crawler CodeCanyon

This PHP script allows you to search for files in ANY website. All you have to do is specify what website you want to search, the kind of files you are looking for then click Crawl to watch spider handle the rest.
It comes packed with more than 150 file types pre-installed and multiple ways to view results, Spider is the tool at heart for people building crawlers and web scrappers.
Features
Over 150 file tpyes included
Accepts custom file types
Crawler Depth Managemment
Preview and export HTML
Saves results on server
Crawling Time Limits
Exports to SQL File
Bootstrap 3.0 Ready
Responsive Design
Excel CSV Ready
Eports to JSON
Much more
Demo
http://codecanyon.net/item/spider-php-we...er/5445643