This document discusses data management trends from the 1990s to present day and looks ahead to the future. It addresses the rise of big data, cloud computing, and diverse data solutions. Specifically, it examines how databases have evolved from mostly using relational database models to also incorporating NoSQL databases like key-value, document, columnar, and graph models. It analyzes what types of databases are best suited for different use cases like transactions, analytics, and unknown or hierarchical data. Finally, it provides examples of how the web is becoming a large linked database, with the potential to query structured data on topics like luxury cars or people from a specific place and time.

1. PLM and Data Management in 21st Century
Oleg Shilovitsky

2. Database selection back in 1990s…
Yes
Start
Use Microsoft
Office
Looks like
Document?
No
End
Use RDBMS

3. 2010s….
Big Data
Concurrency
Data connectivity
Cloud scale
Solution diversity
Network of data

4. New buzz is coming - NoSQL

5. Data management eras..
Data
warehouse
RDBMS
RDBMS
Data
warehouse
RDBMS
NoSQL
Transactions
1990s
Transactions + Analytics
2000s
Transactions + Analytics + ?
2010s

6. Single Node RDBMS problem
response
time
transaction
size
•
•
•
•
•
•
•
Large data sets
Social networks
Schema free
Linked data
Document data
Reliability
BI / OLAP

7. What is behind “NoSQL” buzzword?
Columnar / Table
Key-value
Relational
Document
Graph

8. Data model: size vs. complexity
complexity
● Cambrian explosion of DM options
Graph
● Database moved from solution to tools
● Next dominance is problematic
Document
● Specialized databases (tools)
Columnar
● Focus on specific problem space
Key-value
size

9. PLM and Database genres specialty
Good For...
Not Good For...
PLM use idea...
Relational
Known data layout
Variable and hierarchical
data
Transactional data. Specific
models
Key-value
Little or no need for
indexes
CRUD and other queries
Vaulting, Media
Columnar
Horizontal scale, cluster
Undefined data usage
pattern
Suppliers access, Design
collaboration
Document
Unknow data layout
Joins
Vaulting, Media
Graph
Flexible typed
relationships
Limited scale, query-ability
Configurations, Product
structure

10. The evolution of web as a database
web 1.0 > web 2.0 > web 3.0
Evolution of web
Web as set of structured data
Linked Data
Graph model
RDF / OWL / SPARQL
Lots of data published in RDF
Size of ~30B entities for 2011
Lots of open sources tools
Example: DBPedia is
Wikipedia converted to Web
database

11. Example: All luxury cars

12. Example: Audi A8 DBPedia

13. Example:
All people born in Boston before 1700

14. Thank you!