This document provides an introduction to data architecture and the different types of corporate data. It discusses: 1) The basic division of corporate data into structured data (stored in databases) and unstructured data, with unstructured data further divided into repetitive and nonrepetitive data. 2) Nonrepetitive "big data" has a fundamentally different form than repetitive unstructured data, with the differences between the two called the "great divide." 3) As a rule, nonrepetitive big data has much greater business value than repetitive big data.

1. Introduction to Data
Architecture
Lecture # 1
Dr. Saif Ur Rehman Malik

2. Introduction (cont…)
• Corporate data include everything found in the corporation in the way of
data.
• The most basic division of corporate data is by structured data and
unstructured data.
• As a rule, there are much more unstructured data than structured data.
• Unstructured data have two basic divisions—
• repetitive data and nonrepetitive data.
• Big data is made up of unstructured data.

3. Introduction (cont…)
• Nonrepetitive big data has a fundamentally different form than repetitive
unstructured big data.
• The differences between nonrepetitive big data and repetitive big data are
so large that they can be called the boundaries of the “great divide.”
• As a rule, nonrepetitive big data has MUCH greater business value than
repetitive big data.

4. Data Architecture
• Data architecture is about the larger picture of data and how it fits together in a typical organization.

5. Subdividing Data
Corporate Data

6. Structured Data
• Structured data is when data is in a standardized format, has a well-
defined structure, complies to a data model, follows a persistent
order, and is easily accessed by humans and programs. This data type
is generally stored in
z a database.
• Examples: SQL, Excel, or any relational database.

7. Unstructured Data
Unstructured data is information that is not arranged according to a preset data model or schema, and
therefore cannot be stored in a traditional relational database or RDBMS. Text and multimedia are two
common types of unstructured content.

8. Repetitive Unstructured
• A typical form of repetitive unstructured data in the corporation might be the data generated by an
analog machine.
• For example, a farmer has a machine that reads the identification of railroad cars as the railroad
cars pass through the farmer's property. Trains pass through the property night and day. The
electronic eye reads and records the passage of each car on the track.

9. Nonrepetitive Unstructured Data
• Nonrepetitive unstructured data are data that are nonrepetitive, such as e-mails.
• Each email can be long or short. The e-mail can be in English or Spanish (or some other
languages.) The author of the e-mail can say anything that he/she pleases. It is only a pure accident
if the contents of any e-mail are identical to the contents of any other email.
• And there are many forms of nonrepetitive unstructured data. There are voice recordings, there are
contracts, there are customer feedback messages, etc.

10. The Great Divide of Data

11. The Great Divide of Data
It is hardly obvious why there should be this great divide of data.
But there are some very
• good reasons for the divide:
• Repetitive data usually have very limited business value, while
nonrepetitive data are rich in business value.
• Repetitive data can be handled one way; nonrepetitive data are
handled very differently.
• Repetitive data can be analyzed one way, while nonrepetitive
data can be analyzed in a very different manner.

12. Textual/Nontextual Data
• Nonrepetitive unstructured data can be divided into textual and nontextual data.

13. Business Value

14. The Data Infrastructure