Girish Mahajan (Editor)

Jumbune

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit
Developer(s)
  
Impetus Technologies

Development status
  
Active

Operating system
  
Linux

Stable release
  
1.5.0

Written in
  
Java

Website
  
jumbune.org

Jumbune

Jumbune [juhm-b-yoon] is an open-source multi-module framework intended for Hadoop MapReduce developers and cluster administrators. It is designed to monitor, profile, analyse and validate the Hadoop job and cluster.

Contents

Jumbune provides complete view of whole Hadoop cluster and jobs at one go. This framework comprises various modules

  • Cluster Monitor -Ad-hoc monitoring hundreds of Hadoop and system parameters even on a heavily loaded production cluster from anywhere in the world, on any device with a browser.
  • Job Profiler -Profiles the various phases of MapReduce job execution with fine-grained node level analysis and a cluster level resource consumption view, all of which can be used for optimizing the job or the cluster.
  • Data Validation -Discrepancy and fault detection on the HDFS data in a cost and time effective manner using various distributed fault detection algorithms.
  • Debugger -Detailed data flow analysis for the various MapReduce code levels, which helps the developer to fine-tune the algorithm and detect faults.

    • Hadoop Cluster Administrator

    It helps the admins to monitor the cluster with node system-level fine grained statistics. They have the option to mark frequently monitored stats as favorites and fetch refreshed results at specified interval of time. Selection of trends for specific stats is also available.

    Hadoop Mapreduce Developer

    It's a simple and easy utility that helps MapReduce developers, to find discrepancies and errors in the HDFS data. User may check for data violations under various categories like: data type, null values or regular expression values. It provides developers to code level control flow statistics of MapReduce job. User may apply regex validations or its own user defined validation classes. As per the validations applied, Jumbune’s flow debugger checks the flow of <key,value> data for mapper and reducer respectively. It enables the developers to understand which resources are creating a bottleneck and the MapReduce phases thatare consuming more time than estimated and requires optimization to achieve an efficient job performance.

    References

    Jumbune Wikipedia
    (Text) CC BY-SA