Harman Patil (Editor)

PHP Crawler

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit
Developer(s)
  
Vlad Fedorkov

Operating system
  
Cross-platform

Written in
  
PHP

Available in
  
English

Initial release
  
9 January 2006; 11 years ago (2006-01-09)

Stable release
  
0.8 / 25 July 2007; 9 years ago (2007-07-25)

PHP-Crawler is an open source crawling script based on PHP and MySQL. Created to implement simple as possible local website search it became popular for small websites on shared hosting. Script set is distributed under the terms of BSD License.

Contents

Features

  • Full text search support via MySQL FT indexes
  • As a general PHP script it allows running crawler manually from browser, requires no SSH access to the hosting.
  • Crawling is limited by depth setting or amount
  • Following "href=" links on web page, in HTML or JavaScripts

    • Requirements

  • PHP 4.3.10+
  • MySQL 3.23.56+

    • References

    PHP-Crawler Wikipedia
    (Text) CC BY-SA