WELCOME TO THE SEMINAR  ON DATA MINING By  Ujjwal Kumar MSC 635
Overview Introduction Why Data Mining? Goals of Data Mining Architecture of Data Mining Data Mining – On what kind of data? Data Mining techniques Advantages of Data Mining Data mining tools/software Conclusion References
Introduction Data Mining – extracting or “mining”   knowledge from large amounts of data. It’s also popularly referred to KDD   (Knowledge Discovery from Data) is the   automated of convenient extraction of   patterns representing knowledge implicitly   stored or captured in large databases, data   warehouse, the web, other massive   information repositories, or data streams.
Why Data mining? The explosive growth in data: from   terabytes to petabytes Data collection and data availability Major sources of abundant data   ( Business, Science, Society and   everyone) We have find a more effective way to use   these data in decision support process   than just using traditional query   languages.
Goals of Data Mining prediction : how certain attributes   within the data will behave in the   future. Identification : identify the existence of an   item, an event, an activity. Classification : partition the data into   categories. Optimization : optimize the use of limited   resources.
Architecture of Data Mining The architecture of a typical data mining   system may have the following major   components: Database, Data warehouse, WWW,   Other information repository Database or Data warehouse server Data mining engine Pattern evolution model User interface
User Interface Pattern Evolution Data Mining Engine Database or Data Warehouse Server Database Data Warehouse World Wide Web Other Info Repositories Knowledge Base Data cleaning, integration and selection
Data Mining – On what kind of data? Data Mining should be applicable to any   kind of data repository, as well as to   transient data, such as data streams. The challenges and techniques of   mining may differ for each of the   repository systems.
Data Mining – On what kind of data? Relational Databases Transactional Databases Temporal Databases Object - Relational Databases Spatial Databases Text Databases and Multimedia DB Legacy Databases
Data Mining techniques Classification Clustering Association
Classification Classification  is the process of finding   a model that describes and distinguishes   data classes or concepts Classify the new item and identify to   which class it belongs
Clustering In general, the class label are not   present in the training data simply they   are not known to begin with The objects are clustered or grouped   based on the principle of maximizing   the intraclass similarity and minimizing   the intraclass similarity. Example: Insurance company could use   clustering to group clients by their age,   location and types of insurance   purchased.
Clustering Group data in to clusters Similar data is grouped in same   cluster Dissimilar data is grouped in same   cluster
A 1% support means that 1% of all of the transactions under analysis showed that computer and software were purchased together. Association rules “ An association algorithm creates rules   that describe how often events have   occurred together.” Example: buys(X, “computer”)=>   buys(X, “software”) [support=1%,   confidence=50%] Where X is a variable representing a customer. A confidence, or certainty, of 50% means that if a customer buys a computer, there is a 50% chance that they will buy software as well.
Advantages of Data Mining Provides new knowledge from existing   data: Public databases Government sources Company Databases Old data can be used to develop new   knowledge  New knowledge can be used to improve   services or products Improvements lead to: Bigger profits  More efficient service
Uses of Data Mining Sales/ Marketing analysis Marketing strategies Advertisements Risk analysis and Management Finance and Investment Manufacturing and Production Text mining (news group, email,   documents) and web mining.
Uses of Data Mining DNA and Bio-data analysis Effectiveness of treatments Identify new drugs Fraud detection Identify people misusing the system Financial transactions Customer care Identify customer needs
Data Mining tools Intelligent Miner, IBMSPSS modeler Enterprise Miner ODM Ghost Miner Rapid Miner
Conclusion Data mining is a “Decision Support”   process in which we search for patterns   of information in data. This technique is used for many types of   data. Overlaps with machine learning,   statistics, artificial intelligence,   databases and visualization.
References “ Data Mining Concepts & Techniques” by   Jiawei Han and Micheline Kamber http://www.oracle.com/ http://www.datamininglab.com/ http://www.onlinelibrary.wiley.com http://www.cs.sjsu.edu/
Thank You

Data mining

  • 1.
    WELCOME TO THESEMINAR ON DATA MINING By Ujjwal Kumar MSC 635
  • 2.
    Overview Introduction WhyData Mining? Goals of Data Mining Architecture of Data Mining Data Mining – On what kind of data? Data Mining techniques Advantages of Data Mining Data mining tools/software Conclusion References
  • 3.
    Introduction Data Mining– extracting or “mining” knowledge from large amounts of data. It’s also popularly referred to KDD (Knowledge Discovery from Data) is the automated of convenient extraction of patterns representing knowledge implicitly stored or captured in large databases, data warehouse, the web, other massive information repositories, or data streams.
  • 4.
    Why Data mining?The explosive growth in data: from terabytes to petabytes Data collection and data availability Major sources of abundant data ( Business, Science, Society and everyone) We have find a more effective way to use these data in decision support process than just using traditional query languages.
  • 5.
    Goals of DataMining prediction : how certain attributes within the data will behave in the future. Identification : identify the existence of an item, an event, an activity. Classification : partition the data into categories. Optimization : optimize the use of limited resources.
  • 6.
    Architecture of DataMining The architecture of a typical data mining system may have the following major components: Database, Data warehouse, WWW, Other information repository Database or Data warehouse server Data mining engine Pattern evolution model User interface
  • 7.
    User Interface PatternEvolution Data Mining Engine Database or Data Warehouse Server Database Data Warehouse World Wide Web Other Info Repositories Knowledge Base Data cleaning, integration and selection
  • 8.
    Data Mining –On what kind of data? Data Mining should be applicable to any kind of data repository, as well as to transient data, such as data streams. The challenges and techniques of mining may differ for each of the repository systems.
  • 9.
    Data Mining –On what kind of data? Relational Databases Transactional Databases Temporal Databases Object - Relational Databases Spatial Databases Text Databases and Multimedia DB Legacy Databases
  • 10.
    Data Mining techniquesClassification Clustering Association
  • 11.
    Classification Classification is the process of finding a model that describes and distinguishes data classes or concepts Classify the new item and identify to which class it belongs
  • 12.
    Clustering In general,the class label are not present in the training data simply they are not known to begin with The objects are clustered or grouped based on the principle of maximizing the intraclass similarity and minimizing the intraclass similarity. Example: Insurance company could use clustering to group clients by their age, location and types of insurance purchased.
  • 13.
    Clustering Group datain to clusters Similar data is grouped in same cluster Dissimilar data is grouped in same cluster
  • 14.
    A 1% supportmeans that 1% of all of the transactions under analysis showed that computer and software were purchased together. Association rules “ An association algorithm creates rules that describe how often events have occurred together.” Example: buys(X, “computer”)=> buys(X, “software”) [support=1%, confidence=50%] Where X is a variable representing a customer. A confidence, or certainty, of 50% means that if a customer buys a computer, there is a 50% chance that they will buy software as well.
  • 15.
    Advantages of DataMining Provides new knowledge from existing data: Public databases Government sources Company Databases Old data can be used to develop new knowledge New knowledge can be used to improve services or products Improvements lead to: Bigger profits More efficient service
  • 16.
    Uses of DataMining Sales/ Marketing analysis Marketing strategies Advertisements Risk analysis and Management Finance and Investment Manufacturing and Production Text mining (news group, email, documents) and web mining.
  • 17.
    Uses of DataMining DNA and Bio-data analysis Effectiveness of treatments Identify new drugs Fraud detection Identify people misusing the system Financial transactions Customer care Identify customer needs
  • 18.
    Data Mining toolsIntelligent Miner, IBMSPSS modeler Enterprise Miner ODM Ghost Miner Rapid Miner
  • 19.
    Conclusion Data miningis a “Decision Support” process in which we search for patterns of information in data. This technique is used for many types of data. Overlaps with machine learning, statistics, artificial intelligence, databases and visualization.
  • 20.
    References “ DataMining Concepts & Techniques” by Jiawei Han and Micheline Kamber http://www.oracle.com/ http://www.datamininglab.com/ http://www.onlinelibrary.wiley.com http://www.cs.sjsu.edu/
  • 21.