Unit 5

589 views
534 views

Published on

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
589
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
14
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Unit 5

  1. 1. Management Information Systems Unit 5. Database Management Systems Data warehousing Data mining Data Definition Language Data Control Language Data Manipulation Language 2-12-10 & 3-12-10 & 4-12-10 prepared by A Sanjeev raj
  2. 2. Today we are going to discuss about.. <ul><li>Data Warehousing. </li></ul><ul><li>Data Mining. </li></ul><ul><li>Data Definition Language. </li></ul><ul><li>Data Control Language. </li></ul>5. Database Management Systems
  3. 3. Data warehousing 5. Database Management Systems
  4. 4. Data warehouse <ul><li>A collection of corporate information, derived directly from operational system & some external data sources. </li></ul><ul><li>Its specific purpose is to support business decisions, not business operations. </li></ul><ul><li>A data warehouse maintains its functions in three layers: </li></ul><ul><li>1.Staging. </li></ul><ul><li>2.Integration. </li></ul><ul><li>3.Access. </li></ul>5. Database Management Systems
  5. 5. <ul><li>Staging is used to store raw data for use by developers (analysis and support). </li></ul><ul><li>The integration layer is used to integrate data and to have a level of abstraction from users. </li></ul><ul><li>The access layer is for getting data out for users. </li></ul>5. Database Management Systems
  6. 6. Purpose <ul><li>Realize the value of data: </li></ul><ul><li>a) Data/information is an asset. </li></ul><ul><li>b) Methods to realize the value (Reporting , analysis etc). </li></ul><ul><li>Make better decision: </li></ul><ul><li>a) Turn data into information. </li></ul><ul><li>b) Create competitive advantage. </li></ul><ul><li>c) Methods to support the decision making process(EIS , DSS , etc). </li></ul>5. Database Management Systems
  7. 7. Data warehouse Components <ul><li>Staging Area: </li></ul><ul><li>- A preparatory repository where transaction data can be transformed for use in the data warehouse. </li></ul><ul><li>Data Mart: </li></ul><ul><li>-Traditional dimensionally modeled set of dimension & fact labels. </li></ul><ul><li>- Per Kimball , a data warehouse is the union of a set of data marts. </li></ul><ul><li>Operational Data Store(ODS): </li></ul><ul><li>- Modeled to support near real time reporting needs. </li></ul>5. Database Management Systems
  8. 8. Architecture <ul><li>One possible simple conceptualization of a data warehouse architecture consists of the following interconnected layers: </li></ul><ul><li>a) Operational Database Layer : </li></ul><ul><li>The source data for the data warehouse — An organization ‘ s Enterprise resource planning systems fall into this layer. </li></ul><ul><li>b) Data Access Layer : </li></ul><ul><li>The interface between the operational and informational access layer — Tools to extract , transform, load data into the warehouse fall into this layer. </li></ul>5. Database Management Systems
  9. 9. <ul><li>c) Metadata layer : </li></ul><ul><li>I ) The data directory — This is usually more detailed than an operational system data directory. </li></ul><ul><li>II )There are dictionaries for the entire warehouse and sometimes dictionaries for the data that can be accessed by a particular reporting and analysis tool. </li></ul>5. Database Management Systems
  10. 10. <ul><li>d) Informational access layer : </li></ul><ul><li>I )The data accessed for reporting and analyzing and the tools for reporting and analyzing data — Business intelligence tools fall into this layer. </li></ul><ul><li>II ) The Inmon-Kimball differences about design methodology, discussed later in this article, have to do with this layer. </li></ul>5. Database Management Systems
  11. 11. Evolution in organization use <ul><li>Organizations generally start off with relatively simple use of data warehousing. </li></ul><ul><li>Over time, more sophisticated use of data warehousing evolves. </li></ul><ul><li>The following general stages of use of the data warehouse can be distinguished: </li></ul><ul><li>-> Offline Operational Data Warehouse : </li></ul><ul><li>Data warehouses in this initial stage are developed by simply copying the data off of an operational system to another server where the processing load of reporting against the copied data does not impact the operational system's performance. </li></ul>5. Database Management Systems
  12. 12. <ul><li>-> Offline Data Warehouse : </li></ul><ul><li>Data warehouses at this stage are updated from data in the operational systems on a regular basis and the data warehouse data are stored in a data structure designed to facilitate reporting. </li></ul><ul><li>-> Real Time Data Warehouse : </li></ul><ul><li>Data warehouses at this stage are updated every time an operational system performs a transaction (e.g. an order or a delivery or a booking). </li></ul><ul><li>-> Integrated Data Warehouse  : </li></ul><ul><li>These data warehouses assemble data from different areas of business, so users can look up the information they need across other systems. </li></ul>5. Database Management Systems
  13. 13. The Advantages of Data Warehousing <ul><li>Data warehouses tend to have a very high query success as they have complete control over the four main areas of data management systems. </li></ul><ul><li>-> Clean data. </li></ul><ul><li>->Indexes: Multiple Types </li></ul><ul><li>->Query processing: Multiple Options </li></ul><ul><li>->Security: Data and Access. </li></ul><ul><li>->Easy report creation. </li></ul><ul><li>->Enhanced access to data and information. </li></ul>5. Database Management Systems
  14. 14. Disadvantages of Data Warehousing <ul><li>There are considerable disadvantages involved in moving data from multiple, often highly disparate, data sources to one data warehouse that translate into long implementation time, high cost, lack of flexibility, dated information, and limited capabilities. </li></ul><ul><li>-> Preparation may be time consuming. </li></ul><ul><li>-> Compatibility with existing systems. </li></ul><ul><li>-> Security issues. </li></ul><ul><li>-> Long initial implementation time and associated high cost. </li></ul><ul><li>-> Limited flexibility of use and types of users. </li></ul><ul><li>-> Difficult to accommodate changes in data types and ranges, data source schema, indexes and queries. </li></ul>5. Database Management Systems
  15. 15. Data Mining
  16. 16. Introduction <ul><li>With the increased and widespread use of technologies, interest in data mining has increased rapidly. </li></ul><ul><li>Companies are now utilized data mining techniques to exam their database looking for trends, relationships, and outcomes to enhance their overall operations and discover new patterns that may allow them to better serve their customers. </li></ul>5. Database Management Systems
  17. 17. <ul><li>Data mining provides numerous benefits to businesses, government, society as well as individual persons. </li></ul><ul><li>An ethical analysis about data mining is provided in the figure shows as </li></ul>5. Database Management Systems
  18. 18. What is Data Mining? <ul><li>Data Mining, also known as Knowledge-Discovery in Databases (KDD), is the process of automatically searching large volumes of data for patterns. </li></ul><ul><li>Data Mining applies many older computational techniques from statistics, machine learning and pattern recognition. </li></ul>5. Database Management Systems
  19. 19. <ul><li>With data mining, the information obtained from the bankers, credit card companies, and department stores can be put to good use.  </li></ul>5. Database Management Systems
  20. 20. Data mining consists of five major elements: <ul><li>Extract, transform, and load transaction data onto the data warehouse system. </li></ul><ul><li>Store and manage the data in a multidimensional database system. </li></ul><ul><li>Provide data access to business analysts and information technology professionals. </li></ul><ul><li>Analyze the data by application software. </li></ul><ul><li>Present the data in a useful format, such as a graph or table. </li></ul>5. Database Management Systems
  21. 21. Data Mining Goal <ul><li>The ultimate goal of data mining is prediction - and predictive data mining is the most common type of data mining and one that has the most direct business applications. </li></ul>5. Database Management Systems
  22. 22. How Data mining works <ul><li>Data mining is a component of a wider process called “knowledge discovery from database”.  </li></ul><ul><li>It involves scientists and statisticians, as well as those working in other fields such as machine learning, artificial intelligence, information retrieval and pattern recognition. </li></ul><ul><li>How data mining can assist bankers in enhancing their businesses is illustrated in this example. </li></ul><ul><li>Records include information such as age, sex, marital status, occupation, number of children, and etc. of the bank’s customers over the years are used in the mining process. </li></ul>5. Database Management Systems
  23. 23. 3 Steps Data Mining Process <ul><li>Stage 1: Exploration. This stage usually starts with data preparation which may involve cleaning data, data transformations, selecting subsets of records. </li></ul><ul><li>Stage 2: Model building and validation. This stage involves considering various models and choosing the best one based on their predictive performance. </li></ul><ul><li>Stage 3: Deployment. That final stage involves using the model selected as best in the previous stage and applying it to new data in order to generate predictions or estimates of the expected outcome. </li></ul>5. Database Management Systems
  24. 24. Tools used for data mining <ul><li>Artificial neural networks - Non-linear predictive models that learn through training and resemble biological neural networks in structure. </li></ul><ul><li>Decision trees - Tree-shaped structures that represent sets of decisions. These decisions generate rules for the classification of a dataset. </li></ul><ul><li>Genetic algorithms - Optimization techniques based on the concepts of genetic combination, mutation, and natural selection. </li></ul>5. Database Management Systems
  25. 25. Reasons for the growing popularity of Data Mining <ul><li>Growing Data Volume. </li></ul><ul><li>Limitations of Human Analysis. </li></ul><ul><li>Low Cost of Machine Learning. </li></ul>5. Database Management Systems
  26. 26. ADVANTAGES OF DATA MINING <ul><li>Marking/Retailing : Data mining can aid direct marketers by providing them with useful and accurate trends about their customers’ purchasing behavior. </li></ul><ul><li>Banking/Crediting: Data mining can assist financial institutions in areas such as credit reporting and loan information.      </li></ul>5. Database Management Systems
  27. 27. DISADVANTAGES OF DATA MINING <ul><li>Privacy Issues : For example, according to Washington Post, in 1998, CVS had sold their patient’s prescription purchases to a different company. American Express also sold their customers’ credit card purchases to another company. </li></ul><ul><li>Security issues. </li></ul><ul><li>Misuse of information. </li></ul>5. Database Management Systems
  28. 28. Data Definition language
  29. 29. <ul><li>Data Definition Language (DDL) is a standard for commands that define the different structures in a database. </li></ul><ul><li>DDL statements create, modify, and remove database objects such as tables, indexes, and users. Common DDL statements are </li></ul><ul><li>-> CREATE </li></ul><ul><li>-> ALTER </li></ul><ul><li>-> DROP </li></ul>Data Definition language 5. Database Management Systems
  30. 30. <ul><li>Create - To make a new database, table, index, or stored query. </li></ul><ul><li>A CREATE statement in SQL creates an object inside of a relational database management system(RDBMS). </li></ul><ul><li>The types of objects that can be created depends on which RDBMS is being used, but most support the creation of tables, indexes, users, synonyms and databases. </li></ul><ul><li>Syntax: </li></ul><ul><li>CREATE [TEMPORARY] TABLE [table name] ( [column definitions] ) [table parameters] </li></ul>Create 5. Database Management Systems
  31. 31. <ul><li>CREATE TABLE employees ( </li></ul><ul><li>id INTEGER PRIMARY KEY, </li></ul><ul><li>first_name CHAR(50) NULL, </li></ul><ul><li>last_name CHAR(75) NOT NULL, </li></ul><ul><li>Date of birth DATE NULL </li></ul><ul><li>) </li></ul>Example 5. Database Management Systems
  32. 32. <ul><li>Drop - To destroy an existing database, table, index, or view. </li></ul><ul><li>Syntax : </li></ul><ul><li>DROP object type object name . </li></ul><ul><li>Example: </li></ul><ul><li>The command to drop a table named employees would be: </li></ul><ul><li>DROP TABLE employees; </li></ul><ul><li>The DROP statement is distinct from the Delete and truncate statements, in that they do not remove the table itself. </li></ul>Drop 5. Database Management Systems
  33. 33. <ul><li>Alter - To modify an existing database object. </li></ul><ul><li>Syntax: </li></ul><ul><li>ALTER object type object name parameters </li></ul><ul><li>Example: </li></ul><ul><li>The command to add (then remove) a column named bubbles for an existing table named sink would be: </li></ul><ul><li>ALTER TABLE sink ADD bubbles INTEGER; </li></ul><ul><li>ALTER TABLE sink DROP COLUMN bubbles; </li></ul>Alter statement 5. Database Management Systems
  34. 34. Data Control Language 5. Database Management Systems
  35. 35. Introduction <ul><li>A Data Control Language or DCL is a part Structured Query Language (SQL) used to control the access to data in a database. </li></ul><ul><li>For any in-house or outsource software development process, Data Control Language plays the critical role of setting authorization mechanism of the database. </li></ul><ul><li>DCL Commands: </li></ul><ul><li>GRANT: To grant users the right to access the database or perform certain tasks. </li></ul><ul><li>REVOKE: To cancel any previously granted or denied permission. </li></ul>5. Database Management Systems
  36. 36. <ul><li>The GRANT and REVOKE commands can be used with the following privileges for a database user: </li></ul><ul><li>INSERT (To insert records) </li></ul><ul><li>SELECT (To return a result set from a table) </li></ul><ul><li>DELETE (To delete specific records) </li></ul><ul><li>EXECUTE (To execute a procedure) </li></ul><ul><li>USAGE (To modify the maximum number of records allowed) </li></ul><ul><li>CONNECT (To set a database connection) </li></ul><ul><li>UPDATE (To modify a record in a table) </li></ul>5. Database Management Systems
  37. 37. <ul><li>GRANT command: </li></ul><ul><li> The GRANT command sets permissions (for INSERT, SELECT, UPDATE etc.) on any specific or all tables to different users using the database. </li></ul><ul><li>Syntax: GRANT {ALL/SPECIFIC PERMISSIONS} ON {TABLENAME} TO {USER ACCOUNT} [WITH GRANT OPTION] </li></ul><ul><li>Example: </li></ul><ul><li>In a real-world database-driven environment (such as in an Offshore Software Development Company ) any user getting the permission on a specific object (such as a table) from another user &quot;with GRANT option&quot;, then that user has the privilege to set permission on that same table to a different user acting as an owner. </li></ul>5. Database Management Systems
  38. 38. <ul><li>REVOKE Command: </li></ul><ul><li>The REVOKE command revokes or cancels permissions (for INSERT, SELECT, UPDATE etc.) on any specific or all tables from different users using the database. </li></ul><ul><li>Syntax: </li></ul><ul><li>REVOKE {ALL/SPECIFIC PERMISSIONS} ON {TABLENAME} FROM {USER ACCOUNT} [CASCADE] </li></ul><ul><li>The CASCADE option revokes the permissions from the user as well as the main user who initiated the permission. Be it for professionals engaged in Software Development Services in India, the United States or elsewhere, the correct permission settings are of paramount importance through DCL. </li></ul>5. Database Management Systems
  39. 39. Data Manipulation Language 5. Database Management Systems
  40. 40. <ul><li>Introduction: </li></ul><ul><li>Data Manipulation Language ( DML ) is a family of computer languages used by computer programs and/or database users to insert, delete and update data in a database. </li></ul><ul><li>Read-only querying, i.e. SELECT, of this data may be considered to be either part of DML or outside it, depending on the context. </li></ul><ul><li>Currently the most popular data manipulation language is that of SQL, which is used to retrieve and manipulate data in a Relational database. </li></ul>5. Database Management Systems
  41. 41. DML Commands <ul><li>INSERT. </li></ul><ul><li>SELECT. </li></ul><ul><li>UPDATE. </li></ul><ul><li>DELETE. </li></ul><ul><li>INSERT: The INSERT command in SQL is used to add records to an existing table. </li></ul><ul><li>Returning to the personal_info example from the previous section, let's imagine that our HR department needs to add a new employee to their database. They could use a command similar to the one shown below: INSERT INTO personal_info values('bart','simpson',12345,$45000) </li></ul>5. Database Management Systems
  42. 42. <ul><li>SELECT: The SELECT command is the most commonly used command in SQL. It allows database users to retrieve the specific information they desire from an operational database. </li></ul><ul><li>SELECT * FROM personal_info </li></ul><ul><li>This literally means &quot;Select everything from the personal_info table.&quot; </li></ul><ul><li>UPDATE: The UPDATE command can be used to modify information contained within a table, either in bulk or individually. Each year, our company gives all employees a 3% cost-of-living increase in their salary. The following SQL command could be used to quickly apply this to all of the employees stored in the database: UPDATE personal_info SET salary = salary * 1.03 </li></ul>5. Database Management Systems
  43. 43. <ul><li>DELETE: </li></ul><ul><li>The DELETE command with a WHERE clause can be used to remove his record from the personal_info table: DELETE FROM personal_info WHERE employee_id = 12345 </li></ul>5. Database Management Systems
  44. 44. Overview <ul><li>??? </li></ul><ul><li>Thank You </li></ul>5. Database Management Systems

×