Samiksha Jaiswal (Editor)

Oracle Data Mining

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit
Developer(s)
  
Oracle Corporation

Website
  
Oracle Data Mining

License
  
proprietary

Stable release
  
11gR2 / September, 2009

Type
  
data mining and analytics

Oracle Data Mining (ODM) is an option of Oracle Corporation's Relational Database Management System (RDBMS) Enterprise Edition (EE). It contains several data mining and data analysis algorithms for classification, prediction, regression, associations, feature selection, anomaly detection, feature extraction, and specialized analytics. It provides means for the creation, management and operational deployment of data mining models inside the database environment.

Contents

Overview

Oracle Corporation has implemented a variety of data mining algorithms inside the Oracle relational database. These implementations integrate directly with the Oracle database kernel and operate natively on data stored in the relational database tables. This eliminates the need for extraction or transfer of data into standalone mining/analytic servers. The relational database platform is leveraged to securely manage models and to efficiently execute SQL queries on large volumes of data. The system is organized around a few generic operations providing a general unified interface for data-mining functions. These operations include functions to create, apply, test, and manipulate data-mining models. Models are created and stored as database objects, and their management is done within the database - similar to tables, views, indexes and other database objects.

In data mining, the process of using a model to derive predictions or descriptions of behavior that is yet to occur is called "scoring". In traditional analytic workbenches, a model built in the analytic engine has to be deployed in a mission-critical system to score new data, or the data is moved from relational tables into the analytical workbench - most workbenches offer proprietary scoring interfaces. ODM simplifies model deployment by offering Oracle SQL functions to score data stored right in the database. This way, the user/application-developer can leverage the full power of Oracle SQL - in terms of the ability to pipeline and manipulate the results over several levels, and in terms of parallelizing and partitioning data access for performance.

Models can be created and managed by one of several means. Oracle Data Miner provides a graphical user interface that steps the user through the process of creating, testing, and applying models (e.g. along the lines of the CRISP-DM methodology). Application- and tools-developers can embed predictive and descriptive mining capabilities using PL/SQL or Java APIs. Business analysts can quickly experiment with, or demonstrate the power of, predictive analytics using Oracle Spreadsheet Add-In for Predictive Analytics, a dedicated Microsoft Excel adaptor interface. ODM offers a choice of well-known machine-learning approaches such as Decision Trees, Naive Bayes, Support vector machines, Generalized linear model (GLM) for predictive mining, Association rules, K-means and Orthogonal Partitioning Clustering, and Non-negative matrix factorization for descriptive mining. A minimum description length based technique to grade the relative importance of input mining attributes for a given problem is also provided. Most Oracle Data Mining functions also allow text mining by accepting text (unstructured data) attributes as input. Users do not need to configure text-mining options - the Database_options database option handles this behind the scenes.

History

Oracle Data Mining was first introduced in 2002 and its releases are named according to the corresponding Oracle database release:

  • Oracle Data Mining 9iR2 (9.2.0.1.0 - May 2002)
  • Oracle Data Mining 10gR1 (10.1.0.2.0 - February 2004)
  • Oracle Data Mining 10gR2 (10.2.0.1.0 - July 2005)
  • Oracle Data Mining 11gR1 (11.1 - September 2007)
  • Oracle Data Mining 11gR2 (11.2 - September 2009)
  • Oracle Data Mining is a logical successor of the Darwin data mining toolset developed by Thinking Machines Corporation in the mid-1990s and later distributed by Oracle after its acquisition of Thinking Machines in 1999. However, the product itself is a complete redesign and rewrite from ground-up - while Darwin was a classic GUI-based analytical workbench, ODM offers a data mining development/deployment platform integrated into the Oracle database, along with the Oracle Data Miner GUI.

    The Oracle Data Miner 11gR2 New Workflow GUI was previewed at Oracle Open World 2009. An updated Oracle Data Miner GUI was released in 2012. It is free, and is available as an extension to Oracle SQL Developer 3.1 .

    Functionality

    As of release 11gR1 Oracle Data Mining contains the following data mining functions:

  • Data transformation and model analysis:
  • Data sampling, binning, discretization, and other data transformations.
  • Model exploration, evaluation and analysis.
  • Feature selection (Attribute Importance).
  • Minimum description length (MDL).
  • Classification.
  • Naive Bayes (NB).
  • Generalized linear model (GLM) for Logistic regression.
  • Support Vector Machine (SVM).
  • Decision Trees (DT).
  • Anomaly detection.
  • One-class Support Vector Machine (SVM).
  • Regression
  • Support Vector Machine (SVM).
  • Generalized linear model (GLM) for Multiple regression
  • Clustering:
  • Enhanced k-means (EKM).
  • Orthogonal Partitioning Clustering (O-Cluster).
  • Association rule learning:
  • Itemsets and association rules (AM).
  • Feature extraction.
  • Non-negative matrix factorization (NMF).
  • Text and spatial mining:
  • Combined text and non-text columns of input data.
  • Spatial/GIS data.
  • Graphical user interface: Oracle Data Miner

    Users can access Oracle Data Mining through Oracle Data Miner, a GUI client application that provides access to the data mining functions and structured templates (called Mining Activities) that automatically prescribe the order of operations, perform required data transformations, and set model parameters. The user interface also allows the automated generation of Java and/or SQL code associated with the data-mining activities. The Java Code Generator is an extension to Oracle JDeveloper. An independent interface also exists: the Spreadsheet Add-In for Predictive Analytics which enables access to the Oracle Data Mining Predictive Analytics PL/SQL package from Microsoft Excel.

    From version 11.2 of the Oracle database, Oracle Data Miner integrates with Oracle SQL Developer.

    PL/SQL and Java interfaces

    Oracle Data Mining provides a native PL/SQL package (DBMS_DATA_MINING) to create, destroy, describe, apply, test, export and import models. The code below illustrates a typical call to build a classification model:

    where 'credit_risk_model' is the model name, built for the express purpose of classifying future customers' 'credit_risk', based on training data provided in the table 'credit_card_data', each case distinguished by a unique 'customer_id', with the rest of the model parameters specified through the table 'credit_risk_model_settings'.

    Oracle Data Mining also supports a Java API consistent with the Java Data Mining (JDM) standard for data mining (JSR-73) for enabling integration with web and Java EE applications and to facilitate portability across platforms.

    SQL scoring functions

    As of release 10gR2, Oracle Data Mining contains built-in SQL functions for scoring data mining models. These single-row functions support classification, regression, anomaly detection, clustering, and feature extraction. The code below illustrates a typical usage of a classification model:

    PMML

    In Release 11gR2 (11.2.0.2), ODM supports the import of externally created PMML for some of the data mining models. PMML is an XML-based standard for representing data mining models.

    Predictive Analytics MS Excel Add-In

    The PL/SQL package DBMS_PREDICTIVE_ANALYTICS automates the data mining process including data preprocessing, model building and evaluation, and scoring of new data. The PREDICT operation is used for predicting target values classification or regression while EXPLAIN ranks attributes in order of influence in explaining a target column feature selection. The new 11g feature PROFILE finds customer segments and their profiles, given a target attribute. These operations can be used as part of an operational pipeline providing actionable results or displayed for interpretation by end users.

    References

    Oracle Data Mining Wikipedia