AWS Community Day CPH - Three problems of Terraform
The Evolving Role of DBA
1. The Evolving Role of the DBA
Prepared by:
Michael J Corey, Ntirety
Don Sullivan, VMware
2. Don Sullivan VMware Solution Architect/Database Specialist
■ Selected VMware Chief Technology Office Ambassador
■ Started Working with Oracle Version 7,8.X,9.X,10.x .….
■ Co-Author Oracle Certified Master Practicum
■ Frequent speaker at VMworld, EMCworld, VMug & IOUG
■ Principal Oracle University Instructor (Oracle 7 through 10g)
▪ Backup and Recovery, Performance Tuning, OracleNet
▪ RMAN, Partitioning, SQL Tuning, OPS/RAC,
▪ Oracle Internals classes:(Advanced Recovery, Space and Transaction
Management, Optimizer Internals, Datatypes and Storage Internals)
3. Michael J Corey
Oracle Press Books Include:
Oracle Database 12c: Install,
Configure & Maintain like A
Professional
Oracle 11g A Beginner’s Guide
Oracle 10g A Beginner’s Guide
Oracle 9i - A Beginner's Guide
Oracle8i - Data Warehousing
Oracle8i - A Beginner's Guide
Oracle8 - Data Warehousing
Oracle8 – Tuning
Oracle8 - A Beginner's Guide
Oracle - Data Warehousing
Oracle - A Beginner's Guide
Tuning Oracle
Started Working with Oracle Version 3.0 Beta Tested Oracle 5,6,6.2,7,8.X,9.X.….
Presented on Technology & Business Topics from Brazil to Australia Worked
with Oracle on UNIX, Linux, Windows, MVS,VM, VMS,..
Key Past/Current Affiliations:
Past President of the IOUG
Founding Board IOUG Virtualization SIG
Past Member IOUG Board of Directors
Past Director of Education IOUG
Founder Professional Association of SQL Server
Talkin’Cloud Top 200 Channel Partner Experts Cloud
Past Member Microsoft Data Warehouse Council
Past Member Oracle Educational Advisory Council
Past Director of Conferences IOUG Alive
Executive Board Massachusetts Robert H. Goddard
Council on Science, Technology, Engineering &
Mathematics
MSP Alliance Board
6. The Relational Model Solved Lot of Problems
“Imagine What Would Happen
If You Changed Your Name”
“You Would Have To Update
Each System Independently”
Your Name Would Only
Be Right in one
location?
“Lot’s Of Great Reasons, Why The Relational Model Took Off”
7. The Relational Model Solved Lot of Problems
Analyze Lots of Data Quickly
“Lot’s Of Great Reasons, Why The Relational Model Took Off”
9. In the Beginning….
There Were No DBA’s
■ Applications Were Simple
■ No Cost Based Optimizer
■ No Row Level Locking
■ No Stored Procedures
■ No Hot Backups
Oracle Ran with Only
64K of RAM
15. Can You Name The 3 Oracle Founders
Ed Oates
Bruce Scott**
Bob Miner
Larry Ellison
** First Employee
16. In the Beginning….
■ There were no DBA’s
■ Databases we Small
■ Applications Were Simple
■ No Cost Based Optimizer
■ No Row Level Locking
■ No Stored Procedures
■ SQL Was Called UFI
■ No Hot Backups
Oracle Ran with 64K or RAM
17. Think About SQL Server, MySQL
■ Early On….
▪ Databases Were Small
▪ Applications Simple
▪ Functionality Limited
▪ Developers Did It All !
“Many SQL Server/MySQL
Shops Don’t Have DBA’s
Today”
Starting to Change Now
19. So As The Database Capabilities Grew
DBA’s Became A Databases Best Friend
■ Row Level Locking
■ Stored Procedures
■ Hot Backups
■ Partitioning
■ Cost Based Optimizer
■ Security
21. Reason #1: Database Proliferation &
Expansion
“Customer facing applications that rely on
databases are Growing at an alarming rate”
Increasing in Number Increasing in Size Broader Range of Data
Database Proliferation and Expansion
3-5x size increase
In the past 3 Years 3
years
Documents, unstructured
data, voice, video….
Customer facing
applications that rely on
databases are growing at
an alarming rate
22. How About business that owns
few ski resorts…
■ You Buy a Lift Ticket, Good for a week at any of the
resorts
■ “This Means Databases Talking To Databases”
■ “Without this Type of Functionality the Business Would
Not be competitive
23. Imagine a Retail Web Site That Could
Not Talk To Back-End Database….
Could Not Tell You
■ Color, Size
■ Cost, In-Stock
■ Shipping Charges
“Business Need This
Functionality to Be Competitive”
24. If you asked me 5 Years Ago if I would
need 3 Terabyte of Storage in the home
“I would have Told you that
you were crazy”
25. Database Proliferation & Expansion….
Database GROWTH
Studies Show..
Databases
Growing 3X to
5X Every 3
Years
26. Database Proliferation & Expansion….
Database GROWTH
“Sixteen
percent of
companies are
experiencing
data growth at a
clip exceeding
50 percent a
year.”
27. Database Proliferation & Expansion….
Database GROWTH
“More than one-third report that data growth
affects their operations “most” or “all” of the
time.”
28. Database Proliferation & Expansion….
Database GROWTH
“Many companies feel compelled to retain data for
extended periods of time—forever in some
cases—and are having difficulty making
it accessible to end users.”
29. Database Proliferation & Expansion….
Database GROWTH
“Ever Try To Put In A Purging Mechanism?
Ever Try To Put Data Offline? ”
31. Database Proliferation & Expansion….
Database GROWTH
“Estimates put the amount of data in existence at
this time at more than a zettabyte (or a trillion
gigabytes), which would be the equivalent of 75
billion fully loaded iPads
Source: 2010 IOUG Database Growth Survey
32. Reason #2 Management Complexity
Surrounding the Database
“Database Complexity Is At An All Time High”
Comprehensive Mission Critical Expanding Technology
Management Complexity
Managing the
database means
understanding the
entire infrastructure
No room for failure
Global 100% 7x24
uptime required
No one single tool
is enough
Limitation of Tools
Database
complexity is at
an all time high
36. Now Lets Add the Other Layers
Database Complexity Is At An All Time High
37. In Today's Internet World The Stakes Are
Even Higher…
■Small Companies
Need Functionality
Like Big Companies
■If your Not
Competitive, The
Competition is a click
away
■Information is key to
being competitive.
*Representation of Internet by Researchers
at Bar Ilan University, Israel
38. Reason #3: The Human Capital Challenge
Strain Cost of Resources Scarcity of Resources
The Human Capital Challenge
Complex applications are
putting a strain on internal
IT resources that lack
depth and breadth
Not just salary – but
constant training
Highly-specialized, in-
demand resources
“Complex Applications are putting a strain on internal IT
Resources that lack depth & breadth”
39. Complex Applications are Putting a Strain on those
Internal IT Resources that lack Depth and Breadth
A chicken in every pot and a car in every garage
– Herbert Hoover (1928)
Enterprise Class Applications Are
Everywhere!
40. Complex Applications are Putting a Strain on those
Internal IT Resources that lack Depth and Breadth
A chicken in every pot and a car in every garage
– Herbert Hoover (1928)
Midsize companies have the same
critical need, but do not have the same
internal resources to support it all.
47. Other Meanings for DBA….
■ Data Base Administrator Does Bugger All
■ Don't be assertive Do Be Accurate
■ Doing business after-hours Determined Best Always
■ Don't bother asking Default Blame Acceptor
■ Don't be afraid
■ Don't beg anymore
■ Dumb But Adorable
■ Driven By Aggression
■ Deaf But Astute
■ Drinking Beer Allday
■ Drugs Beer and Alcohol
■ Deep Brain Activity
■ Deaf But Astute
■ Dubious Business Acronyms
48. 3 Recent Trends
■ Modern Architectures Including Hyper-converge Architecture
▪ Hyper-converge is an all in one
49. Database As A Service
What Happens When We Can’t Give Our Users
What They When They Need It
50. Database As A Service
■ Self Service/Removes bureaucracy of Administration
■ Pay for What You Use/Charge Back
■ Meet the Business Needs in a Timely Manner (Instantly)
■ Flexible & Dynamic Resource Allocation
■ VCAC – vCloud Automation Center – Make Above Possible
Today
53. 3 Recent Trends
■ Hyper-Converged Architectures
■ Database as a Service (DBaaS)
■ Advance Data Management Techniques
“become fluent in these ideas
or risk becoming obsolete”
54. “It is not the
strongest of the
species that
survives, nor the
most intelligent,
but the one most
responsive to
change”
― Charles Darwin
55. Database Administration 20+ Year Trends
Increasing in Number Increasing in Size Broader Range of Data
Database Proliferation and Expansion
Comprehensive Mission Critical Expanding Technology
Management Complexity
Strain Cost of Resources Scarcity of Resources
The Human Capital Challenge
3-5x size increase
In the past 3 years
Documents, unstructured
data, voice, video….
Customer facing applications
that rely on databases are
growing at an alarming rate
Managing the
database means
understanding the
entire infrastructure
No room for failure
Global 100% 7x24
uptime required
No one single tool
is enough
Complex applications are
putting a strain on internal IT
resources that lack depth and
breadth
Not just salary – but constant
training
Highly-specialized, in-
demand resources
Limitation of Tools
Database complexity
is at an all time high
65. DBA’s Are In Demand…..
Database
administration
is expected to
evolve and
grow more
rapidly than
the average for
all other
occupations
through 2018.
66. DBA Jobs Are In Demand
#5 in U.S. News Best Jobs
http://money.usnews.com/careers/best-jobs/database-administrator
67. DBA’s Are In Demand…..
Employment of
database
administrators is
projected to grow
15 percent from
2012 to 2022,
faster than the
average for all
occupations.
Growth in this
occupation will
be driven by the
increased data
needs of
companies across
the economy.
73. As Application Outsourcing Gains Acceptance,
its no wonder the trend in the industry to Outsource or out-
tasking the Database Administration will continue
74. Think About The Many DBA Silo’s
■ How Does a Mid-Size Company Deal With The Many Silo’s of
DBA’s When they only have 1 or 2 FTE’s
■ How Do you Deal With Half A DBA Need?
75. What Are Companies Looking To Do ?
“What Would You Add Today ? Big DATA ?”
77. DBA Skills have moved from totally database-
centric to business centric
78. Can You Say …..
You Can No Longer Just Be A
DBA
79. Business Needs Information To Stay Competitive,
Which Means at the Center of your Business is….
Last New Horizon of Computing - the Dataverse By
Don Sullivan and Michael Corey
80. Lots Of Business Drivers Why These Database Grew
Bigger and More Complex…
It’s Not About The
Technology
Its About the Business
Technology Is A Business
Enabler
81. To Quote IOUG Salary Survey…
"Technology for technology’s sake is no
longer important. Technology that has a positive
business impact is important and the DBA is
relied upon to understand it if it's database
related.”
82. “Now Requires DBA’s To Learn
Many Functions OF
Data Warehouse Architect.”
“Can You Say Business
Ability”
83. Three: The personal cloud replaces the notion of personal
computer.
The cloud will house all aspects of one's life, Gartner said.
Because it's so vast, and capable of marshaling infinite
resources, "no one platform, form factor, technology or
vendor will dominate" it, Gartner says. It also means that IT
will have to support almost everything.
DBA’s – The World of the Future extends Beyond Your Relational Database
84. DBA’s – The World of the Future extends Beyond Your Relational Database
Five: Cloud computing.
As cloud adoption expands, IT departments will have to create
"cloud services brokerages" to serve as a central focus for
managing access to external services.
85. DBA’s – The World of the Future extends Beyond Your Relational Database
Six: Strategic Big Data.
It's becoming more economical, thanks in part to low cost servers and
CPUs, for organizations to tackle big data projects. By strategic big
data, Gartner believes that users will be moving beyond isolated
projects and incorporating big data analysis in more and more of what
they do.
86. DBA’s – The World of the
Future extends Beyond Your
Relational Database
Eight: In-memory Computing.
In-memory Computing, says Gartner, can be transformational. It allows
hours-long batch processes to be squeezed into processes that only
take minutes or seconds. In-memory Computing will become a
mainstream platform over the next year or two, as users seek more
real-time analytical queries.
88. If As Managers We Want DBA’s To Be In Sync with the
Business, then we need to development Compensation
Plans Accordingly
Business Need DBA’s to be more Business Focused, Yet Line
DBA’s Are Not Give Business Objectives Like “Saving Money”
89. Think of the Effect these factors are having
on DBA’s
■ Global 100% 7 X 24 required - or the business suffers !
■ Silo’s Of Expertise, But being asked to do it all
■ Shift from Database-centric to Business-centric
■ Always on call, very long hours !
■ Bigger and bigger (3X-5X) DBs
■ More and more complexity
90. Here Is What We Know
"Technology for technology’s
sake is no longer important.
Technology that has a positive
business impact is important
and the DBA is relied upon to
understand it if it's database
related.”
To Quote Gartners Top TEN
“that IT will have to support
almost everything” – INSERT
DBA For IT
91. Last New Horizon of Computing - the Dataverse
http://www.dbta.com/Articles/Columns/My-View/Last-New-
Horizon-of-Computing---the-Dataverse-82638.aspx
92. ■ Merger of Business &
Technology
■ Pools of existing
resources can be used
when and where they
are needed
■ Enables Business
Flexibility/Agility
“Virtualization (Common Denominator) of
Business & Technology”
94. Why Big Data Is Like Teenage Sex
everyone talks about it, nobody really
knows how to do it, everyone thinks
everyone else is doing it, so everyone
claims they are doing it...
(Not Sure Who Source of this is)
95. Each Dataset Has A Unique Personality
…Spanning the Dataverse with a Unified Data Strategy and Data Persona Analytics
The amount of data being generated, captured and analyzed worldwide is increasing at a rate that was
inconceivable a few years ago. Exciting new technologies and methodologies are evolving to address this
phenomenon of science and culture creating huge new opportunities. These new technologies are also
fundamentally changing the way we look at and use data. The rush to monetize "big data" makes the appeal
of various "solutions" undeniable.
Posted 27 Jun 2013 / June 2013 - UPDATE Issue
21st Century Data Organization - Business Function Comes First
In the realm of 21st century data organization, the business function comes first. The form of the data and
the tools to manage that data will be created and maintained for the singular purpose of maximizing a
business's capability of leveraging its data. Initially, this seems like an obvious statement but when
examining the manner in which IT has treated data over the past four decades it becomes painfully obvious
that the opposite idea has been predominant.
Posted 09 Jul 2013 / July 2013 Issue
Data Persona Analytics: The Data-Application Matchmaker
A new science called "data persona analytics" (DPA) is emerging. DPA is defined as the science of
determining the static and dynamic attributes of a given data set so as to construct an optimized
infrastructure that manages and monitors data injection, alteration, analysis, storage and protection while
facilitating data flow. Each unique set of data both transient and permanent has a descriptive data
personality profile which can be determined through analysis using the methodologies of DPA.
Posted 25 Jul 2013 / July 2013 - UPDATE Issue
A Call to Action and the American Pastime: Data
Consider a professional baseball game or any other popular professional sporting event. When a fan sits in the upper deck of
Dodger Stadium in Los Angeles, or any other sporting arena on earth, the fan is happily distracted from the real world.
Ultimately, professional sports constitutes a trillion dollar industry - an industry whose product is on the surface entertainment
but when one barely pierces that thin veneer it quickly becomes clear that the more significant product produced is data. A fan
96. “It is not the strongest of the species that
survives, nor the most intelligent, but the one
most responsive to change”
― Charles Darwin
99. Trends in Database Administration….
■ Merger Business & Technology
■ Cloud Computing / Virtualization – The New Normal
■ 7X24 World
■ Corporate Pressures to do more with less
■ Ability to Leverage Technology to Enable the Business
■ Embrace the Dataverse or Face The Consequences
■ Database Augmentation/Outsourcing Solves a Business Problem
■ Database As A Service
■ Hyper-Converged Architecture
■ Modern Data Management Systems
100. Thank You
Michael Corey
Email: Michael.corey@ntirety.com
http://michaelcorey.ntirety.com/
@Michael_Corey
Don Sullivan
Email: Sullivand@vmware.com
