Lecture 29
•Download as PPT, PDF•
0 likes•365 views
Data mining involves extracting valuable non-trivial information from large datasets. It differs from traditional data analysis by taking a knowledge-driven rather than data-driven approach. Data mining uses techniques like decision trees, neural networks, rule induction, clustering and genetic algorithms to extract patterns and relationships within data. The goal is to uncover knowledge that can be used for business purposes like increasing profits through lowering costs or raising revenues.
Report
Share
Report
Share
Recommended
Lecture 5
This document discusses types and applications of data warehouses. It describes common types including financial, telecommunications, insurance, and human resources data warehouses. It then provides examples of typical applications that leverage data warehouses like fraud detection, profitability analysis, direct marketing, credit risk prediction, yield management, and inventory management. These applications aim to streamline and maximize profitability for organizations. The document concludes with a recent application in agriculture systems.
Lecture 10
This document discusses online analytical processing (OLAP) and how it relates to data warehousing. It explains that OLAP supports ad-hoc, iterative analysis of aggregated data across multiple dimensions, enabling users to easily drill down, roll up, and pivot data. Predefining all possible queries is not feasible given the interactive nature of analysis. Instead, OLAP systems compute answers to all potential aggregates across dimensional hierarchies to enable fast, interactive exploration of data to support decision making.
Lecture 9
This document discusses issues related to data de-normalization in a data warehouse. It addresses storage issues like increased table sizes from adding redundant data. Performance can deteriorate from de-normalization due to sorts on larger tables and scans. Other issues include increased maintenance effort due to changes needing to propagate and potential information loss. The document also examines horizontal and vertical data splitting techniques and their tradeoffs for ease of use, performance and reversibility.
Python tutorialfeb152012
This document provides an overview of the Python programming language. It begins with an introduction to running Python code and output. It then covers Python's basic data types like integers, floats, strings, lists, tuples and dictionaries. The document explains input and file I/O in Python as well as common control structures like if/else statements, while loops and for loops. It also discusses functions as first-class objects in Python that can be defined and passed as parameters. The document provides examples of higher-order functions like map, filter and reduce. Finally, it notes that functions can be defined inside other functions in Python.
Python tutorial
This document provides an introduction to the Python programming language. It discusses Python versions and distributions, development environments, the Python interactive shell, basic Python data types like lists and strings, and gives examples of working with these data types through indexing, slicing and built-in methods. It also briefly introduces dictionaries and tuples. The document aims to provide newcomers to Python with essential information on the language and getting started.
Interaction design _beyond_human_computer_interaction
This document provides an overview of interaction design beyond human-computer interaction. It discusses novel forms of interactive products that are embedded with computational power, such as refrigerators that provide recipes based on stored food. It also discusses augmented reality technologies that combine virtual and physical worlds. Examples of direct manipulation virtual environments and interactive virtual worlds are provided. The document discusses how representations can be dynalinked so that changes in one are reflected in another. It provides examples of aesthetically pleasing interactive products and virtual characters. Overall, the document gives a broad introduction to emerging areas of interaction design beyond traditional human-computer interaction, using examples of novel interactive products and technologies.
Fm lecturer 13(final)
The document discusses an introduction to formal methods course. It provides biographical information about the instructor, Dr. Naveed Riaz, and outlines some of the key topics to be covered in the course, including formal languages, modeling systems using logic and set theory, and solving logic puzzles using propositional calculus and truth tables. It also gives an example of solving a logic problem about a person on an island of knights and knaves who says "If I am a knight then I will eat my hat".
Lecture slides week14-15
This document discusses distance measures and scales of measurement that are important for k-nearest neighbor classification. It covers two major classes of distance measures - Euclidean and non-Euclidean. It also describes three major scales of measurement for data - nominal, ordinal, and interval scales. It provides examples of different distance functions like Euclidean, Manhattan, cosine, and edit distances. It discusses how the choice of distance measure depends on the type of data and its scale of measurement.
Recommended
Lecture 5
This document discusses types and applications of data warehouses. It describes common types including financial, telecommunications, insurance, and human resources data warehouses. It then provides examples of typical applications that leverage data warehouses like fraud detection, profitability analysis, direct marketing, credit risk prediction, yield management, and inventory management. These applications aim to streamline and maximize profitability for organizations. The document concludes with a recent application in agriculture systems.
Lecture 10
This document discusses online analytical processing (OLAP) and how it relates to data warehousing. It explains that OLAP supports ad-hoc, iterative analysis of aggregated data across multiple dimensions, enabling users to easily drill down, roll up, and pivot data. Predefining all possible queries is not feasible given the interactive nature of analysis. Instead, OLAP systems compute answers to all potential aggregates across dimensional hierarchies to enable fast, interactive exploration of data to support decision making.
Lecture 9
This document discusses issues related to data de-normalization in a data warehouse. It addresses storage issues like increased table sizes from adding redundant data. Performance can deteriorate from de-normalization due to sorts on larger tables and scans. Other issues include increased maintenance effort due to changes needing to propagate and potential information loss. The document also examines horizontal and vertical data splitting techniques and their tradeoffs for ease of use, performance and reversibility.
Python tutorialfeb152012
This document provides an overview of the Python programming language. It begins with an introduction to running Python code and output. It then covers Python's basic data types like integers, floats, strings, lists, tuples and dictionaries. The document explains input and file I/O in Python as well as common control structures like if/else statements, while loops and for loops. It also discusses functions as first-class objects in Python that can be defined and passed as parameters. The document provides examples of higher-order functions like map, filter and reduce. Finally, it notes that functions can be defined inside other functions in Python.
Python tutorial
This document provides an introduction to the Python programming language. It discusses Python versions and distributions, development environments, the Python interactive shell, basic Python data types like lists and strings, and gives examples of working with these data types through indexing, slicing and built-in methods. It also briefly introduces dictionaries and tuples. The document aims to provide newcomers to Python with essential information on the language and getting started.
Interaction design _beyond_human_computer_interaction
This document provides an overview of interaction design beyond human-computer interaction. It discusses novel forms of interactive products that are embedded with computational power, such as refrigerators that provide recipes based on stored food. It also discusses augmented reality technologies that combine virtual and physical worlds. Examples of direct manipulation virtual environments and interactive virtual worlds are provided. The document discusses how representations can be dynalinked so that changes in one are reflected in another. It provides examples of aesthetically pleasing interactive products and virtual characters. Overall, the document gives a broad introduction to emerging areas of interaction design beyond traditional human-computer interaction, using examples of novel interactive products and technologies.
Fm lecturer 13(final)
The document discusses an introduction to formal methods course. It provides biographical information about the instructor, Dr. Naveed Riaz, and outlines some of the key topics to be covered in the course, including formal languages, modeling systems using logic and set theory, and solving logic puzzles using propositional calculus and truth tables. It also gives an example of solving a logic problem about a person on an island of knights and knaves who says "If I am a knight then I will eat my hat".
Lecture slides week14-15
This document discusses distance measures and scales of measurement that are important for k-nearest neighbor classification. It covers two major classes of distance measures - Euclidean and non-Euclidean. It also describes three major scales of measurement for data - nominal, ordinal, and interval scales. It provides examples of different distance functions like Euclidean, Manhattan, cosine, and edit distances. It discusses how the choice of distance measure depends on the type of data and its scale of measurement.
Frequent itemset mining using pattern growth method
The document discusses the FP-growth algorithm for mining frequent patterns without candidate generation. It begins with an overview of the performance bottlenecks of the Apriori algorithm and introduces the FP-growth approach. The key steps of FP-growth include compressing the transaction database into a frequent-pattern tree (FP-tree) structure, and then mining the FP-tree to find all frequent patterns. The mining process recursively constructs conditional FP-trees to decompose the problem into smaller sub-problems without candidate generation. Examples are provided to illustrate the FP-tree construction and pattern mining.
Dwh lecture slides-week15
The document discusses data mining techniques for association rule mining. It defines association rules as relationships of the form A implies B, where A and B are itemsets in transactional data. The key steps are finding frequent itemsets that meet a minimum support threshold, and generating association rules from those itemsets that meet a minimum confidence threshold. The Apriori algorithm is described as the most common approach for efficiently finding all frequent itemsets in an iterative way by pruning itemsets with subsets that are not frequent.
Dwh lecture slides-week10
The document describes a 4-step process for dimensional modeling: 1) choose a business process, 2) choose the grain, 3) choose facts, and 4) choose dimensions. It discusses important dimensional modeling concepts like grain, facts, dimensions, and hierarchies. It also covers considerations for choosing an appropriate grain like granularity, expressiveness, and hardware trade-offs. Aggregation can hide crucial facts but works for repetitive queries if the grain is justified. Dimensions should be single-valued attributes during transactions but can sometimes be multi-valued, requiring handling of problems. Dimensions must be applicable to the chosen grain.
Dwh lecture slidesweek7&8
This document discusses the need for dimensional modeling (DM) as a way to simplify complex entity-relationship (ER) data models optimized for online transaction processing (OLTP). ER modeling results in many normalized tables that are difficult for users to understand and query across. DM addresses this by collapsing dimensions into single tables and representing all data in a star schema with a central fact table linked to dimensional tables. This star schema structure is simpler for users to understand and allows for faster querying of data.
Dwh lecture slides-week5&6
This document discusses five principal techniques for de-normalizing data in a data warehouse: collapsing tables, handling many-to-many relationships, splitting tables horizontally and vertically, pre-joining tables, and adding redundant columns. It provides examples and discusses trade-offs for each technique in terms of storage, performance, ease of use, and maintenance. De-normalization can improve query performance but also increases data storage requirements and maintenance effort. Careful consideration of each case is needed to determine if de-normalization provides overall benefits.
Dwh lecture slides-week3&4
The document discusses why organizations implement data warehouses. It provides several key reasons:
1) Data recording and storage is growing exponentially in almost every industry, creating huge amounts of operational data. A data warehouse provides a platform for consolidated historical data analysis to support strategic decision making.
2) Knowledge workers want to analyze available data to extract useful information and insights to support decision making. This requires intelligent decision support capabilities.
3) In today's competitive environment, a data warehouse is a valuable marketing and business intelligence tool that can help organizations better understand customer needs and behavior to improve customer retention.
Dwh lecture slides-week2
This document outlines the approach and summary of a course on data warehousing and mining. The course aims to develop an understanding of relational database concepts and how they apply and break down in very large databases and data warehousing. It will cover topics like online analytical processing, dimensional modeling, extract-transform-load, data quality management, and data mining concepts. The course also provides an overview of important reference books on data warehousing.
Dwh lecture slides-week1
This document provides an introduction to databases, covering what a database is, what online transaction processing (OLTP) systems are and their strengths and weaknesses, an introduction to different keys used in databases, an overview of the entity-relationship (ER) model, and database normalization.
Dwh lecture slides-week 13
The document discusses the process of dimensional modeling from ER diagrams to dimensional models. It outlines a 4 step method: 1) Choose the business process, 2) Choose the grain, 3) Choose the facts, and 4) Choose the dimensions. It describes each step in detail, including choosing an appropriate grain, identifying additive vs. non-additive facts, handling slowly changing dimensions, and the tradeoffs of different approaches to modeling dimensions.
Dwh lecture slides-week 12&13
This document discusses data warehousing and online analytical processing (OLAP). It begins by explaining the relationship between data warehouses and OLAP, noting that OLAP supports analysis using data stored in a data warehouse. It then discusses different implementations of OLAP, including MOLAP (multidimensional OLAP using pre-aggregated data cubes), ROLAP (relational OLAP using relational databases), and HOLAP (hybrid OLAP combining aspects of MOLAP and ROLAP). It also addresses challenges in implementing OLAP and balancing performance and storage needs.
Data warehousing and mining furc
This document discusses data quality issues related to missing and noisy data. It introduces the concept of data imputation, which is a technique used to replace missing values in a dataset. Common imputation methods discussed include replacing missing numeric values with the mean, median, or mode of existing values for that attribute. The document also discusses different types of missing data (MCAR, MAR, NMAR) and techniques for handling missing data such as discarding records or attributes with many missing values.
Lecture 40
The document discusses the need to create a centralized data warehouse (DWH) to store student and course registration data from multiple campuses of a university. It describes issues with the current ad hoc data storage approaches. Sample data is presented from Lahore, Karachi, and Islamabad campuses stored in different formats like text files, Excel, and Access. The data shows inconsistencies in attributes and structures across campuses. It also presents data from Peshawar campus stored in text files with some missing attributes. The problem is to normalize and integrate this heterogeneous multi-source data into a single DWH for analysis.
Lecture 39
This document provides an introduction to Data Transformation Services (DTS) in Microsoft SQL Server. It discusses key DTS concepts like packages, tasks, transformations, and connections. DTS allows extracting, transforming, and consolidating data from disparate sources into a centralized location. The document demonstrates how to create, edit, and execute DTS packages using the Import/Export wizard, DTS Designer tool, and programming interfaces. It also covers tasks, transformations, connections, workflows, scheduling, versioning and other features of DTS packages.
Lecture 38
This document describes a case study of building an agricultural data warehouse. It discusses the steps taken which include data acquisition, cleansing issues, transforming the data, deploying the data warehouse and using it for various purposes like data validation, generating reports, analyzing spray dates and sowing dates. It finds that ETL is a major challenge due to issues with data collection from farmers. The data warehouse helps enable decision making down to the extension worker level.
Lecture 37
This document discusses the development of an agricultural data warehouse (Agri-DW) to store and analyze agricultural data from the Multan region of Pakistan. It describes the key players and pests/predators in the agricultural sector. It also discusses the need for using information technology and data warehousing in agriculture to help monitor factors like pest populations and economic threshold levels. Finally, it outlines a 12-step approach for developing the Agri-DW, including determining user needs, data modeling, and constructing a metadata repository.
Lecture 35
The document discusses potential pitfalls and mistakes to avoid when implementing a data warehouse. It identifies searching for a "silver bullet" solution and going to extremes with technical architecture design as two common pitfalls. Ten common mistakes are also listed such as having an unrealistic budget or timeline. Finally, the document outlines seven key steps for a smooth implementation, such as gaining executive support, establishing requirements, and testing the data warehouse.
Lecture 36
Part I of the project involves identifying a typical early adopter organization for a data warehouse (DWH) project. Part II consists of (a) identifying a large, early adopter organization and (b) conducting a life-cycle study of the organization's DWH to learn about challenges, lessons, and how the DWH aligned with the organization's adoption of innovations over time. The document also discusses contents and formatting of the project reports, the DWH adoption innovation curve, and how a DWH may develop at different stages of this curve.
Lecture 34
The document discusses Kimball's data warehouse lifecycle approach which includes 5 steps: 1) project planning, 2) requirement definition, 3) dimensional modeling, data staging and technical architecture design, 4) deployment, and 5) maintenance and growth. It focuses on steps 3 and 4, describing the technical architecture design process and its components, as well as the deployment step which implements the dimensional model and analytic applications.
Lecture 33
The document discusses the key steps in the data warehouse (DWH) lifecycle using Kimball's approach. The lifecycle includes project planning, requirements definition, dimensional modeling, data staging, technical architecture design, and product selection and installation. It focuses on the first two steps of project planning and requirements definition. Project planning establishes the core team, creates a project plan, and develops an initial project scope. Requirements definition involves collecting business requirements through interviews and workshops, prioritizing requirements, and reviewing findings to identify high priority projects.
Lecture 32
The document discusses methodologies for the data warehouse lifecycle. It covers common development methodologies like the waterfall model and spiral model. It also covers rapid application development (RAD) and keys to its successful use. The document emphasizes starting a data warehouse project by defining the specific problems it will solve, how success will be measured, managing time and money, and skills required. It presents a common data warehouse lifecycle model of design, prototype, operate, enhance, and deploy phases.
DfMAy 2024 - key insights and contributions
We have compiled the most important slides from each speaker's presentation. This year’s compilation, available for free, captures the key insights and contributions shared during the DfMAy 2024 conference.
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
As digital technology becomes more deeply embedded in power systems, protecting the communication
networks of Smart Grids (SG) has emerged as a critical concern. Distributed Network Protocol 3 (DNP3)
represents a multi-tiered application layer protocol extensively utilized in Supervisory Control and Data
Acquisition (SCADA)-based smart grids to facilitate real-time data gathering and control functionalities.
Robust Intrusion Detection Systems (IDS) are necessary for early threat detection and mitigation because
of the interconnection of these networks, which makes them vulnerable to a variety of cyberattacks. To
solve this issue, this paper develops a hybrid Deep Learning (DL) model specifically designed for intrusion
detection in smart grids. The proposed approach is a combination of the Convolutional Neural Network
(CNN) and the Long-Short-Term Memory algorithms (LSTM). We employed a recent intrusion detection
dataset (DNP3), which focuses on unauthorized commands and Denial of Service (DoS) cyberattacks, to
train and test our model. The results of our experiments show that our CNN-LSTM method is much better
at finding smart grid intrusions than other deep learning algorithms used for classification. In addition,
our proposed approach improves accuracy, precision, recall, and F1 score, achieving a high detection
accuracy rate of 99.50%.
More Related Content
More from Shani729
Frequent itemset mining using pattern growth method
The document discusses the FP-growth algorithm for mining frequent patterns without candidate generation. It begins with an overview of the performance bottlenecks of the Apriori algorithm and introduces the FP-growth approach. The key steps of FP-growth include compressing the transaction database into a frequent-pattern tree (FP-tree) structure, and then mining the FP-tree to find all frequent patterns. The mining process recursively constructs conditional FP-trees to decompose the problem into smaller sub-problems without candidate generation. Examples are provided to illustrate the FP-tree construction and pattern mining.
Dwh lecture slides-week15
The document discusses data mining techniques for association rule mining. It defines association rules as relationships of the form A implies B, where A and B are itemsets in transactional data. The key steps are finding frequent itemsets that meet a minimum support threshold, and generating association rules from those itemsets that meet a minimum confidence threshold. The Apriori algorithm is described as the most common approach for efficiently finding all frequent itemsets in an iterative way by pruning itemsets with subsets that are not frequent.
Dwh lecture slides-week10
The document describes a 4-step process for dimensional modeling: 1) choose a business process, 2) choose the grain, 3) choose facts, and 4) choose dimensions. It discusses important dimensional modeling concepts like grain, facts, dimensions, and hierarchies. It also covers considerations for choosing an appropriate grain like granularity, expressiveness, and hardware trade-offs. Aggregation can hide crucial facts but works for repetitive queries if the grain is justified. Dimensions should be single-valued attributes during transactions but can sometimes be multi-valued, requiring handling of problems. Dimensions must be applicable to the chosen grain.
Dwh lecture slidesweek7&8
This document discusses the need for dimensional modeling (DM) as a way to simplify complex entity-relationship (ER) data models optimized for online transaction processing (OLTP). ER modeling results in many normalized tables that are difficult for users to understand and query across. DM addresses this by collapsing dimensions into single tables and representing all data in a star schema with a central fact table linked to dimensional tables. This star schema structure is simpler for users to understand and allows for faster querying of data.
Dwh lecture slides-week5&6
This document discusses five principal techniques for de-normalizing data in a data warehouse: collapsing tables, handling many-to-many relationships, splitting tables horizontally and vertically, pre-joining tables, and adding redundant columns. It provides examples and discusses trade-offs for each technique in terms of storage, performance, ease of use, and maintenance. De-normalization can improve query performance but also increases data storage requirements and maintenance effort. Careful consideration of each case is needed to determine if de-normalization provides overall benefits.
Dwh lecture slides-week3&4
The document discusses why organizations implement data warehouses. It provides several key reasons:
1) Data recording and storage is growing exponentially in almost every industry, creating huge amounts of operational data. A data warehouse provides a platform for consolidated historical data analysis to support strategic decision making.
2) Knowledge workers want to analyze available data to extract useful information and insights to support decision making. This requires intelligent decision support capabilities.
3) In today's competitive environment, a data warehouse is a valuable marketing and business intelligence tool that can help organizations better understand customer needs and behavior to improve customer retention.
Dwh lecture slides-week2
This document outlines the approach and summary of a course on data warehousing and mining. The course aims to develop an understanding of relational database concepts and how they apply and break down in very large databases and data warehousing. It will cover topics like online analytical processing, dimensional modeling, extract-transform-load, data quality management, and data mining concepts. The course also provides an overview of important reference books on data warehousing.
Dwh lecture slides-week1
This document provides an introduction to databases, covering what a database is, what online transaction processing (OLTP) systems are and their strengths and weaknesses, an introduction to different keys used in databases, an overview of the entity-relationship (ER) model, and database normalization.
Dwh lecture slides-week 13
The document discusses the process of dimensional modeling from ER diagrams to dimensional models. It outlines a 4 step method: 1) Choose the business process, 2) Choose the grain, 3) Choose the facts, and 4) Choose the dimensions. It describes each step in detail, including choosing an appropriate grain, identifying additive vs. non-additive facts, handling slowly changing dimensions, and the tradeoffs of different approaches to modeling dimensions.
Dwh lecture slides-week 12&13
This document discusses data warehousing and online analytical processing (OLAP). It begins by explaining the relationship between data warehouses and OLAP, noting that OLAP supports analysis using data stored in a data warehouse. It then discusses different implementations of OLAP, including MOLAP (multidimensional OLAP using pre-aggregated data cubes), ROLAP (relational OLAP using relational databases), and HOLAP (hybrid OLAP combining aspects of MOLAP and ROLAP). It also addresses challenges in implementing OLAP and balancing performance and storage needs.
Data warehousing and mining furc
This document discusses data quality issues related to missing and noisy data. It introduces the concept of data imputation, which is a technique used to replace missing values in a dataset. Common imputation methods discussed include replacing missing numeric values with the mean, median, or mode of existing values for that attribute. The document also discusses different types of missing data (MCAR, MAR, NMAR) and techniques for handling missing data such as discarding records or attributes with many missing values.
Lecture 40
The document discusses the need to create a centralized data warehouse (DWH) to store student and course registration data from multiple campuses of a university. It describes issues with the current ad hoc data storage approaches. Sample data is presented from Lahore, Karachi, and Islamabad campuses stored in different formats like text files, Excel, and Access. The data shows inconsistencies in attributes and structures across campuses. It also presents data from Peshawar campus stored in text files with some missing attributes. The problem is to normalize and integrate this heterogeneous multi-source data into a single DWH for analysis.
Lecture 39
This document provides an introduction to Data Transformation Services (DTS) in Microsoft SQL Server. It discusses key DTS concepts like packages, tasks, transformations, and connections. DTS allows extracting, transforming, and consolidating data from disparate sources into a centralized location. The document demonstrates how to create, edit, and execute DTS packages using the Import/Export wizard, DTS Designer tool, and programming interfaces. It also covers tasks, transformations, connections, workflows, scheduling, versioning and other features of DTS packages.
Lecture 38
This document describes a case study of building an agricultural data warehouse. It discusses the steps taken which include data acquisition, cleansing issues, transforming the data, deploying the data warehouse and using it for various purposes like data validation, generating reports, analyzing spray dates and sowing dates. It finds that ETL is a major challenge due to issues with data collection from farmers. The data warehouse helps enable decision making down to the extension worker level.
Lecture 37
This document discusses the development of an agricultural data warehouse (Agri-DW) to store and analyze agricultural data from the Multan region of Pakistan. It describes the key players and pests/predators in the agricultural sector. It also discusses the need for using information technology and data warehousing in agriculture to help monitor factors like pest populations and economic threshold levels. Finally, it outlines a 12-step approach for developing the Agri-DW, including determining user needs, data modeling, and constructing a metadata repository.
Lecture 35
The document discusses potential pitfalls and mistakes to avoid when implementing a data warehouse. It identifies searching for a "silver bullet" solution and going to extremes with technical architecture design as two common pitfalls. Ten common mistakes are also listed such as having an unrealistic budget or timeline. Finally, the document outlines seven key steps for a smooth implementation, such as gaining executive support, establishing requirements, and testing the data warehouse.
Lecture 36
Part I of the project involves identifying a typical early adopter organization for a data warehouse (DWH) project. Part II consists of (a) identifying a large, early adopter organization and (b) conducting a life-cycle study of the organization's DWH to learn about challenges, lessons, and how the DWH aligned with the organization's adoption of innovations over time. The document also discusses contents and formatting of the project reports, the DWH adoption innovation curve, and how a DWH may develop at different stages of this curve.
Lecture 34
The document discusses Kimball's data warehouse lifecycle approach which includes 5 steps: 1) project planning, 2) requirement definition, 3) dimensional modeling, data staging and technical architecture design, 4) deployment, and 5) maintenance and growth. It focuses on steps 3 and 4, describing the technical architecture design process and its components, as well as the deployment step which implements the dimensional model and analytic applications.
Lecture 33
The document discusses the key steps in the data warehouse (DWH) lifecycle using Kimball's approach. The lifecycle includes project planning, requirements definition, dimensional modeling, data staging, technical architecture design, and product selection and installation. It focuses on the first two steps of project planning and requirements definition. Project planning establishes the core team, creates a project plan, and develops an initial project scope. Requirements definition involves collecting business requirements through interviews and workshops, prioritizing requirements, and reviewing findings to identify high priority projects.
Lecture 32
The document discusses methodologies for the data warehouse lifecycle. It covers common development methodologies like the waterfall model and spiral model. It also covers rapid application development (RAD) and keys to its successful use. The document emphasizes starting a data warehouse project by defining the specific problems it will solve, how success will be measured, managing time and money, and skills required. It presents a common data warehouse lifecycle model of design, prototype, operate, enhance, and deploy phases.
More from Shani729 (20)
Frequent itemset mining using pattern growth method
Frequent itemset mining using pattern growth method
Recently uploaded
DfMAy 2024 - key insights and contributions
We have compiled the most important slides from each speaker's presentation. This year’s compilation, available for free, captures the key insights and contributions shared during the DfMAy 2024 conference.
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
As digital technology becomes more deeply embedded in power systems, protecting the communication
networks of Smart Grids (SG) has emerged as a critical concern. Distributed Network Protocol 3 (DNP3)
represents a multi-tiered application layer protocol extensively utilized in Supervisory Control and Data
Acquisition (SCADA)-based smart grids to facilitate real-time data gathering and control functionalities.
Robust Intrusion Detection Systems (IDS) are necessary for early threat detection and mitigation because
of the interconnection of these networks, which makes them vulnerable to a variety of cyberattacks. To
solve this issue, this paper develops a hybrid Deep Learning (DL) model specifically designed for intrusion
detection in smart grids. The proposed approach is a combination of the Convolutional Neural Network
(CNN) and the Long-Short-Term Memory algorithms (LSTM). We employed a recent intrusion detection
dataset (DNP3), which focuses on unauthorized commands and Denial of Service (DoS) cyberattacks, to
train and test our model. The results of our experiments show that our CNN-LSTM method is much better
at finding smart grid intrusions than other deep learning algorithms used for classification. In addition,
our proposed approach improves accuracy, precision, recall, and F1 score, achieving a high detection
accuracy rate of 99.50%.
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
学校原件一模一样【微信：741003700 】《(ANU毕业证书)澳洲国立大学毕业证》【微信：741003700 】学位证，留信认证（真实可查，永久存档）原件一模一样纸张工艺/offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原。
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
【主营项目】
一.毕业证【q微741003700】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！
二.真实使馆公证(即留学回国人员证明,不成功不收费)
三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）
四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度)
如果您处于以下几种情况：
◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【q/微741003700】
◇面对父母的压力，希望尽快拿到；
◇不清楚认证流程以及材料该如何准备；
◇回国时间很长，忘记办理；
◇回国马上就要找工作，办给用人单位看；
◇企事业单位必须要求办理的
◇需要报考公务员、购买免税车、落转户口
◇申请留学生创业基金
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
ACEP Magazine edition 4th launched on 05.06.2024
This document provides information about the third edition of the magazine "Sthapatya" published by the Association of Civil Engineers (Practicing) Aurangabad. It includes messages from current and past presidents of ACEP, memories and photos from past ACEP events, information on life time achievement awards given by ACEP, and a technical article on concrete maintenance, repairs and strengthening. The document highlights activities of ACEP and provides a technical educational article for members.
Understanding Inductive Bias in Machine Learning
This presentation explores the concept of inductive bias in machine learning. It explains how algorithms come with built-in assumptions and preferences that guide the learning process. You'll learn about the different types of inductive bias and how they can impact the performance and generalizability of machine learning models.
The presentation also covers the positive and negative aspects of inductive bias, along with strategies for mitigating potential drawbacks. We'll explore examples of how bias manifests in algorithms like neural networks and decision trees.
By understanding inductive bias, you can gain valuable insights into how machine learning models work and make informed decisions when building and deploying them.
Adaptive synchronous sliding control for a robot manipulator based on neural ...
Robot manipulators have become important equipment in production lines, medical fields, and transportation. Improving the quality of trajectory tracking for
robot hands is always an attractive topic in the research community. This is a
challenging problem because robot manipulators are complex nonlinear systems
and are often subject to fluctuations in loads and external disturbances. This
article proposes an adaptive synchronous sliding control scheme to improve trajectory tracking performance for a robot manipulator. The proposed controller
ensures that the positions of the joints track the desired trajectory, synchronize
the errors, and significantly reduces chattering. First, the synchronous tracking
errors and synchronous sliding surfaces are presented. Second, the synchronous
tracking error dynamics are determined. Third, a robust adaptive control law is
designed,the unknown components of the model are estimated online by the neural network, and the parameters of the switching elements are selected by fuzzy
logic. The built algorithm ensures that the tracking and approximation errors
are ultimately uniformly bounded (UUB). Finally, the effectiveness of the constructed algorithm is demonstrated through simulation and experimental results.
Simulation and experimental results show that the proposed controller is effective with small synchronous tracking errors, and the chattering phenomenon is
significantly reduced.
Literature Review Basics and Understanding Reference Management.pptx
Three-day training on academic research focuses on analytical tools at United Technical College, supported by the University Grant Commission, Nepal. 24-26 May 2024
一比一原版(UMich毕业证)密歇根大学|安娜堡分校毕业证成绩单专业办理
UMich毕业证原版定制【微信：176555708】【密歇根大学|安娜堡分校毕业证成绩单-学位证】【微信：176555708】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
◆◆◆◆◆ — — — — — — — — 【留学教育】留学归国服务中心 — — — — — -◆◆◆◆◆
【主营项目】
一.毕业证【微信：176555708】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！
二.真实使馆公证(即留学回国人员证明,不成功不收费)
三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）
四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度)
如果您处于以下几种情况：
◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【微信：176555708】
◇面对父母的压力，希望尽快拿到；
◇不清楚认证流程以及材料该如何准备；
◇回国时间很长，忘记办理；
◇回国马上就要找工作，办给用人单位看；
◇企事业单位必须要求办理的
◇需要报考公务员、购买免税车、落转户口
◇申请留学生创业基金
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分→ 【关于价格问题（保证一手价格）
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！
学历顾问：微信：176555708
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
The rivalry between prominent international actors for dominance over Central Asia's hydrocarbon
reserves and the ancient silk trade route, along with China's diplomatic endeavours in the area, has been
referred to as the "New Great Game." This research centres on the power struggle, considering
geopolitical, geostrategic, and geoeconomic variables. Topics including trade, political hegemony, oil
politics, and conventional and nontraditional security are all explored and explained by the researcher.
Using Mackinder's Heartland, Spykman Rimland, and Hegemonic Stability theories, examines China's role
in Central Asia. This study adheres to the empirical epistemological method and has taken care of
objectivity. This study analyze primary and secondary research documents critically to elaborate role of
china’s geo economic outreach in central Asian countries and its future prospect. China is thriving in trade,
pipeline politics, and winning states, according to this study, thanks to important instruments like the
Shanghai Cooperation Organisation and the Belt and Road Economic Initiative. According to this study,
China is seeing significant success in commerce, pipeline politics, and gaining influence on other
governments. This success may be attributed to the effective utilisation of key tools such as the Shanghai
Cooperation Organisation and the Belt and Road Economic Initiative.
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
IIT毕业证原版定制【微信：176555708】【伊利诺伊理工大学毕业证成绩单-学位证】【微信：176555708】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
◆◆◆◆◆ — — — — — — — — 【留学教育】留学归国服务中心 — — — — — -◆◆◆◆◆
【主营项目】
一.毕业证【微信：176555708】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！
二.真实使馆公证(即留学回国人员证明,不成功不收费)
三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）
四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度)
如果您处于以下几种情况：
◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【微信：176555708】
◇面对父母的压力，希望尽快拿到；
◇不清楚认证流程以及材料该如何准备；
◇回国时间很长，忘记办理；
◇回国马上就要找工作，办给用人单位看；
◇企事业单位必须要求办理的
◇需要报考公务员、购买免税车、落转户口
◇申请留学生创业基金
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分→ 【关于价格问题（保证一手价格）
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！
学历顾问：微信：176555708
Recently uploaded (20)
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
BPV-GUI-01-Guide-for-ASME-Review-Teams-(General)-10-10-2023.pdf
BPV-GUI-01-Guide-for-ASME-Review-Teams-(General)-10-10-2023.pdf
Adaptive synchronous sliding control for a robot manipulator based on neural ...
Adaptive synchronous sliding control for a robot manipulator based on neural ...
Literature Review Basics and Understanding Reference Management.pptx
Literature Review Basics and Understanding Reference Management.pptx
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
Generative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of content
Lecture 29
- 1. DWH-Ahsan AbdullahDWH-Ahsan Abdullah 11 Data WarehousingData Warehousing Lecture-29Lecture-29 Brief Intro. to Data MiningBrief Intro. to Data Mining Virtual University of PakistanVirtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research www.nu.edu.pk/cairindex.asp National University of Computers & Emerging Sciences, Islamabad Email: ahsan101@yahoo.com
- 2. DWH-Ahsan Abdullah 2 What is Data Mining?: Non technical viewWhat is Data Mining?: Non technical view ““There are things that we know that weThere are things that we know that we know…know… there are things that we know that wethere are things that we know that we don’t know…don’t know… there are things that wethere are things that we don’t knowdon’t know wewe don’t knowdon’t know.”.” Donald RumsfieldDonald Rumsfield US Secretary of DefenceUS Secretary of Defence
- 3. DWH-Ahsan Abdullah 3 What is Data Mining?: Slightly formalWhat is Data Mining?: Slightly formal
- 4. DWH-Ahsan Abdullah 4 What is Data Mining?: Formal viewWhat is Data Mining?: Formal view Data mining digs outData mining digs out valuablevaluable non-trivialnon-trivial informationinformation fromfrom largelarge multidimensionalmultidimensional apparentlyapparently unrelatedunrelated data bases(sets).data bases(sets).
- 5. DWH-Ahsan Abdullah 5 Why Data Mining? Huge volumeWhy Data Mining? Huge volume
- 6. DWH-Ahsan Abdullah 6 Claude Shannon's info. theoryClaude Shannon's info. theory More volume means less information
- 7. DWH-Ahsan Abdullah 7 Volume of Data Value vs. VolumeValue vs. Volume Value of Data Decision (Y/N)Decision (Y/N) Decision SupportDecision Support KnowledgeKnowledge InformationInformation Indexed DataIndexed Data Raw DataRaw Data
- 8. DWH-Ahsan Abdullah 8 Why Data Mining?: Supply & DemandWhy Data Mining?: Supply & Demand
- 10. DWH-Ahsan Abdullah 10 Data Mining isData Mining is HOT!HOT! 10 Hottest Jobs of year 202510 Hottest Jobs of year 2025 Time MagazineTime Magazine, 22 May, 2000, 22 May, 2000 10 emerging areas of technology10 emerging areas of technology MIT’s Magazine of Technology ReviewMIT’s Magazine of Technology Review,, Jan/Feb, 2001Jan/Feb, 2001
- 11. DWH-Ahsan Abdullah 11 How Data Mining is different? TraditionallyHow Data Mining is different? Traditionally Data WarehousesData Warehouses ((Data-driven explorationData-driven exploration)):: Data Mining (Knowledge-driven explorationKnowledge-driven exploration) Traditional Database (Transactions): Knowledge Discovery (KDD)
- 12. DWH-Ahsan Abdullah 12 Data Mining Vs StatisticsData Mining Vs Statistics
- 13. DWH-Ahsan Abdullah 13 Data Mining Vs. StatisticsData Mining Vs. Statistics
- 14. DWH-Ahsan Abdullah 14 Knowledge extraction using statisticsKnowledge extraction using statistics Inflation Vs Stock inedx increase 0 10 20 30 40 1.6 1.7 1.8 1.85 1.9 1.95 2 2.9 3 3.3 4.2 4.4 5 6 Inflation (%) Stockincrease (%) Q: What will be the stock increase when inflation is 6%? A: Model non-linear relationship using a line y = mx + c. Hence answer is 13%
- 15. DWH-Ahsan AbdullahDWH-Ahsan Abdullah 1515 0 10000 20000 30000 40000 50000 60000 70000 0 5 10 15 20 25 30 35 y = -0.0127x6 + 1.5029x5 - 63.627x4 + 1190.3x3 - 9725.3x2 + 31897x - 29263 -10000 0 10000 20000 30000 40000 50000 60000 70000 0 5 10 15 20 25 30 35 Failure of regression modelsFailure of regression models
- 16. DWH-Ahsan Abdullah 16 Data Mining is…Data Mining is… Decision TreesDecision Trees Neural NetworksNeural Networks Rule InductionRule Induction ClusteringClustering Genetic AlgorithmsGenetic Algorithms If. . . . .If. . . . . Then. . .Then. . .
- 17. DWH-Ahsan Abdullah 17 Data Mining is NOT ...Data Mining is NOT ... Data warehousingData warehousing Ad Hoc Query / ReportingAd Hoc Query / Reporting Online Analytical Processing (OLAP)Online Analytical Processing (OLAP) Data VisualizationData Visualization Software AgentsSoftware Agents
- 18. DWH-Ahsan Abdullah 18 Data Mining:Data Mining: BusinessBusiness PerspectivePerspective ““knowledge” is worth knowing if it can be used toknowledge” is worth knowing if it can be used to increase profit by lowering cost or it can be used toincrease profit by lowering cost or it can be used to increase profit by raising revenue.increase profit by raising revenue. Business questionsBusiness questions Profiling/Segmentation Cross-Service Employee retention:
Editor's Notes
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>
- <number>