2. Topics
The Role of the DBA
Managing Databases
Dealing with Problems
Monitoring Operations
Dealing with day-to-day tasks
SmartDBA
Performance
Administration
Recovery
Business Service Management
Integration of SmartDBA and BSM
3. What is a DBA?
0010
001010100
101011101011
101011010010101
01001001101010111000011
11001010100100101000100101
4. The DBA is a “Jack of all Trades”
Oracle
database schema
DNS
SQL
application code
Java
operating system
network software
ISP
bridge/router/hub
HTTP
network cabling
hardware
CGI
connection ZPARMs
3GL
ASP
XML
HTMLgateway
Java
appletDB2
Connect
DB2
Sybase
SQL Server
Unix
Windows
OS/390
SQL*Net
TCP/IP
V$ Tables
COBOL
VB
C++
JCL
CICS
MQ
Linux
VTAM
Z/OS
5. DBA 101
The management discipline of database administration
encompasses many complex, integrated tasks all centered on
ensuring the availability of data, databases, and applications:
› Creating the Database Environment
› Database Design
› Application Design
› Design Reviews
› Database Change Management
› Data Availability
› Performance Management
System Performance
Database Performance
Application Performance
› Data Integrity
› Database Security
› Backup and Recovery
› Disaster Planning
› Storage Management
› Distributed Database
Management
› Data Warehouse Administration
› Database Utility Management
› Database Connectivity
› Procedural DBA
› Soft Skills
6. Keep Databases up to P.A.R.
A simple definition of database
administration:
PERFORMANCE
Monitoring
Avoiding outages
SQL tuning
Space management
Optimize Performance
ADMINISTRATION
Day-to-day workload
Schema management
Database changes
High speed utilities
Automate Administration
RECOVERY
Database backup/recovery
Transaction recovery
Recovery automation
Disaster recovery
Assure Recoverability
7. What Happens
Object needs to be reorganized – DB2 Perf
Improper file used for batch run – Log Master
Need to add several new columns to tables for
regulatory compliance purposes – DBA
Test tables need to be refreshed – UNLOAD/LOAD
Change from above needed in production by Mon. –
DBA
Poorly performing system – Sys and App Perf
Request to fix data – one-off program vs. table editor in
Catalog Manager
Space failure during change on weekend – DBA
add space and automatic restart where it left off
8. But What Does it all Look Like from
the DBA’s Point of View?
Let’s take a walk in the
DBA’s shoes for a week…
9. 7:00 AM Monday Morning
DBA trudges into his office, coffee cup in hand, only to
be greeted by a ringing telephone before he can even
switch on his computer:
It’s one of the users in
the claims department
complaining that she
can’t get any work done
because the system is
so slow…
12. SmartDBA: Heterogeneous Data Management
• SmartDBA is the foundation for intelligent data management:
P-A-R for DB2, Oracle, Sybase, SQL Server, and IMS
› Single console to manage mainframe and distributed databases
› Simplifies interface to similar administrative tasks
› Built-in intelligence and automation
Application-centric where appropriate
DB2 & IMS
UDB
14. IT Optimization
2004+
Growing Management Need
Operations
Management
2000-2003+IT
Management
80s – 90s
Technology
IT
Services
Business
Contribution
Cost
Savings
Advantage &
Differentiation
Value Growth
15. Business+DBA: The Value to You
BMC Data
Management
Tools &
Utilities
BMC Data
Management
Tools &
Utilities
16. Business Service Management
IT Operations and Infrastructure
Management
› Manage your IT operations
in the context of your critical
business services
Management of the IT infrastructure
is BMC Software’s heritage
BMC tools enable you to monitor,
diagnose, advise and resolve exceptions
as well as control your IT infrastructure,
including:
Systems
Databases
Applications
Storage
Security
Networks
17. Business Service Management
IT Service and Applications Management
› Tie service-level agreements to business
needs–not just technology metrics–and
deliver the promised levels of service
› Identify and automatically respond to
IT errors, without human intervention,
before they impact the business
› Enforce Operational Consistency consistent
with critical business needs by automatically
prioritizing maintenance and operational
changes consistently with critical business
needs
› Align fully with ITIL’s best practice
guidelines using BMC Software solutions that
optimize IT efficiency through improved:
Service Delivery: availability, performance,
capacity, service-level and continuity
management
Service Support: help desk, asset, change and
configuration, incident and problem, and release
management
18. Service Impact Management
Service Impact
ManagementTM
› Define and automatically
update critical relationships
between business and IT
services, and detect
changes in your dynamic IT
environment
› Accelerate your ability to
directly connect IT
operations to business
services
› Understand and
communicate the true impact
of technology changes (such
as IT component failure) on
the business and vice versa
19. SmartDBA and BSM
“If there is no immediate need to implement SLM/BSM technologies,
companies should focus their attention during the next 12 months on
centralizing and consolidating the underlying network, systems, application
management technologies and implementing end-user response time
measurements. This will enable them to implement fully fledged SLM/BSM
projects quickly, once the vendor landscape has become more stable and
more robust best practice scenarios are available.”
Giga Information Group, Thomas Mendel
Market Overview 2003: Service-Level Management and Business Services Management
Technologies,
Start Implementing BSM today with SmartDBA
20. The Problem BSM is Solving
› SmartDBA Detects a Problem on a Managed Object, End Users May or
May Not be aware anything happened!
› Event is transmitted to DBA
Enterprise View
Phone Call
Pager/Email Alert
› Action is taken
Importance or relevance of alarm not always clear
No prioritization or scheduling
Other stakeholders not aware or informed of the situation
SmartDBA Detects and Alerts
(PATROL, Mainview)
DBA acts on Information
Manual or Automatic – Uses DBA Tools
Subjective prioritization
End Users Unhappy
What’s wrong???
21. Add BSM to the Picture
Service Impact Model
SmartDBA Detects and Alerts
(PATROL, Mainview)
DBA acts on Information
Manual or Automatic – Uses DM Tools
Fully informed as to business relevance
and impact of actions
Remedy Trouble Ticket
Prioritized by Business Relevance
Productive, Informed
End-Users
22. Business Service Management
Value Proposition
BMC Software’s BSM Strategy Delivers:
› A dynamic methodolology for aligning IT operations and services
with the needs of the business
› Clear understanding of the impact of IT events, and how they
support business-critical services
SmartDBA Linkages to BSM Provide:
› Ability to quickly identify database issues that affect the business
› Solutions for instantly preventing and resolving these issues
23. Business Service
› The process being managed
Service Impact Manager
› Automatically relates business services
to underlying IT assets
IT Service Management
› Complete service lifecycle
management of the IT environment
IT Operations and Infrastructure
Management
› The specific tools and automation
processes for administering specific
elements of the IT stack
SmartDBA Solutions - Intelligent Data Management
Optimize
PERFORMANCE
System Performance
SQL Performance
Database Performance
Simplify
ADMINISTRATION
Database Administration
Administrative Assistant
Assure
RECOVERY
Recovery Management
Recovery for SAP
Recovery for Siebel
Manage mainframe and distributed databases from a single console.Manage mainframe and distributed databases from a single console.
Oracle
IMS
DB2 UDB for Unix,
Window s and Linux
SQL Server
Sybase
DB2 UDB for z/ OS
and OS/ 390
OracleOracle
IMSIMS
DB2 UDB for Unix,
Window s and Linux
DB2 UDB for Unix,
Window s and Linux
SQL ServerSQL Server
SybaseSybase
DB2 UDB for z/ OS
and OS/ 390
DB2 UDB for z/ OS
and OS/ 390
Business Service Management -
Schematic
24. Applications
Databases
Network
Systems
Workstations
Storage
Security
Customer View of BSM
Customer / Partner
Business Executives
IT Operations
DB Administrators
Customer & Partner
Support via
Remedy
BSM Console
Patrol &
MainView
Console and
Dispatch
SmartDBA
Console
• Excellent Customer
support regarding IT
issues
• Proactive notification
(voice response)
• Real-time business
health
• High Business
Availability
• Prioritization of Tasks
• Timely resolution
• Historic trends supports
preventative maint.
• Prioritization of Tasks
• 99.999% Business
AvailabilityLif
Business
Service
Management
25. SmartDBA and BSM in Action –
A Case Study
The Scenario: Trading Floor Application
› Processing an order requires customer, quote, order_type, and
order detail information
› Business must process thousands of orders a day within trading
guidelines to meet service goals… Failure to meet SLA results in
lost revenue, upset customers, and damaged reputation
The Challenge
› Deep in the infrastructure, a key table
in the order detail database is filling
up, with the potential of halting
processing during the most active
trading period
› Let’s see how BSM and SmartDBA can
keep the business running!
26. How SmartDBA Works for Business
!
Deep in the infrastructure, a key
table in the order_detail database
is filling up, which could potentially
halt trading!
This event is automatically
detected and routed to the service
model and the DBA.
27. Business Priorities are Pre-defined
Business
relevance criteria
is proactively
identified in
advance to ensure
that issues will be
resolved
seamlessly, based
on the priority of
the business
service that is
affected.
!
28. Business Impact is Assessed
The business service impact of the database event is assessed by the
service model.
The service model
ensures that the
appropriate action
is scheduled and
prioritized,
updating
management
systems.
!
29. Tasks are Assigned
A work ticket is
automatically
generated and
tasks are
assigned to the
Database and
Storage
Administrators
with HIGH
priority.
!
30. Action is Taken
then the Database
Administrator adds
more storage to
the problem table.
The Storage
Administrator
allocates the
space,
!
31. The Result
Bottom-Line:
The Trading Floor Application DID NOT MISS A BEAT!
› The database condition was detected before the outage occurred
› The operations team immediately recognized the potential impact to
a key business service
› The help desk and support groups reacted to ensure a work ticket
was generated and work scheduled and prioritized
› The database administration team had the information and tools to
address the problem right away
› The ticket was closed, the system kept running, and the entire IT
team was aligned on the highest priority work, ensuring the high
availability of a mission critical business service
32. › SmartDBA Solutions provide a source of rich, intelligent database
events today (mainframe and distributed), accessible to BSM
through PATROL and MAINVIEW.
› The Service Impact Manager provides a robust toolkit for building
models relating IT assets to Business Services.
› Remedy provides a suite of process management tools including
Help Desk, Asset Management, and Change Management.
› BMC SIM provides business oriented monitoring and alerting based
on events in the infrastructure.
Business Service Management -
The Complete Picture
33. Business Service Management -
The Complete Picture
BMC Software
Heritage Solutions
PATROL
Remedy
Help Desk
Business
Relevance
SmartDBA
PATROL
Express
MAINVIEW
PATROL
Network
Management
Remedy
Change
Management
Remedy
Asset
Management
Remedy
Service Level
Agreements
Business
IT
PATROL
Enterprise
Manager
CONTROL-
M
CONTROL-SA
Performance Prediction
Analysis
Performance Metrics
Business IT
Applications
MasterCell
Remedy
PATROL
MasterCell
Remedy
Help Desk
Business
Relevance
SmartDBA
PATROL
Express
MAINVIEW
PATROL
Network
Management
Remedy
Asset
Management
Business
PATROL
Enterprise
Manager
CONTROL-
M
CONTROL-SA
Remedy
Change
Management
Remedy
Service Level
Agreements
IT
Performance Prediction
Analysis
Performance Metrics
Business IT
Applications
MasterCell
PATROL
Remedy
Help Desk
Business
Relevance
SmartDBA
PATROL
Express
MAINVIEW
PATROL
Network
Management
Remedy
Asset
Management
Business
PATROL
Enterprise
Manager
CONTROL-
M
CONTROL-SA
Remedy
Change
Management
Remedy
Service Level
Agreements
IT
Performance Prediction
Analysis
Performance Metrics
Business IT
Applications
MasterCell
PATROL
Remedy
Help Desk
Business
Relevance
SmartDBA
PATROL
Express
MAINVIEW
PATROL
Network
Management
Remedy
Change
Management
Remedy
Asset
Management
Business
PATROL
Enterprise
Manager
CONTROL-
M
CONTROL-SA
Remedy
Service Level
Agreements
IT
Performance Prediction
Analysis
Performance Metrics
Business IT
Applications
MasterCell
34. Phases of Integration
All of the Components are Available Today
› Customers can build and execute comprehensive BSM processes
today.
› Integration and automation of the processes remain the areas where
BMC is focusing its development.
Current Development Efforts
› Enhanced event integration—Direct feed of SmartDBA events and
contextual information to the SIM using an API.
› Database Environment Discovery—Direct feed of the SmartDBA
environment catalog to the SIM using an API.
Future Plans
› Automatic feed of SIM priority calculations to SmartDBA
› Automatic open/close of Remedy tickets
› Direct query of SIM information from SmartDBA (ex: determine
optimal time to run a maintenance task, etc.)
35. BSM and SmartDBA
BSM Services Ensure
› That the IT stack is managed with a clear and focused view of
its impact on the critical business services upon which the
organization depends
SmartDBA Delivers
› A rich set of information and automation tightly connected to
the BSM management process
› A complete portfolio of products to ensure that the DBA can
respond quickly and effectively to events that impact the
database
› The ability to prevent issues from occurring at all through
proactive management of the environment!
Editor's Notes
SmartDBA and BSM
This presentation is meant for internal and external audiences. It presents SmartDBA in the context of an overall BSM solution from BMC Software.
Agenda:
This presentation will briefly cover the value prop of BSM tied with SmartDBA, and then show how the solution fits together. We then have a realistic example that illustrates the products and integration points, followed by some statements about our current development plans and future goals.
This presentation is platform agnostic. The points apply equally well to both distributed and mainframe platforms. The examples and illustrations that the presenter gives can come from either area equally well.
<number>
<number>
Of course, PAR is a simplification of the many skills required of the DBA to be effective and proficient.
Most of these skills, however, are technology-focused. Being technology-savvy is required of a DBA, but marrying those technical skills to business requirements will result in a more powerful usage of database technology.
<number>
The job of the DBA boils down to keeping databases running up to PAR. In this context, PAR has dual meaning. The basic meaning for par (the word) is like it is used in golf: an amount taken as an average or norm. But for DBAs PAR can also be an acronym that defines the three primary responsibilities they have for managing databases: Performance, Administration, and Recovery.
If the DBA focuses on PAR (Performance, Administration, Recovery), then applications will be performing according to the service level agreements, databases will be administered appropriately assuring optimal design and good organization, and data will be sufficiently backed up such that it can be recovered in the event of an error or downtime. This is the essence of database administration.
BSM is all about managing and running your IT infrastructure from a business perspective. It's thinking about how what you do in the IT organization has a direct impact on the business and how that business should drive what you do in the IT organization.
Traditionally, IT has been about monitoring IT assets and responding to problems. If you think about event management at the infrastructure layer, what you're doing is trying to identify what's going wrong in your infrastructure. Is a server down? Is a database offline? Is a network switch having a problem? When you look at the alert display on your enterprise management console you might see a lot of red on the screen indicating a lot of failed components or critical events occurring. But you don't necessarily know if those events are impacting the business. So in the absence of any means of tying this back to the business, what do you do? You fix everything as quickly as you can. You treat everything as a high-priority item. But realistically speaking, you can't always do that.
With BSM, I don't just get an alert that says which server is down. I get an alert that says which business process is impacted. Then I can proactively decide whether to forward the alert to the on-call technician or hold onto it because it's not critical and could wait until later after higher-priority issues are resolved.
So BSM is the high end of this management continuum, where our actions have moved from technology-oriented thru application-oriented and finally to business process-oriented, while at the same time moving from active thru proactive to predictive. The end goal is to be able to predict an IT operational failure before it happens and resolve the issue to ensure that no outages to critical business processes are incurred.
It is important to have strong systems management infrastructure in place. Network and systems management has been a BMC Software strength since the early days of our company. Our solutions offer a depth and breadth that no other technology company can match.
Once you have your system infrastructure monitoring and management in place, you have to understand how those systems tie into the company's business activities. Interview people in the business units to gain an understanding of their business processes and the systems they use to support those processes. On the IT side, look at your asset inventory and begin to understand what components are dependent on other components in order to deliver a particular IT service. That, quite frankly, is where all the heavy lifting occurs. To really model those services you have to pull everyone together -the architect, the application developer, the database administrators, the network folks-and determine what's really dependent upon what. The key here is that you're trying to identify dependencies, not just topology. Topology tells you what's connected to what, whereas impact tells you what's dependent on what. That's really what we're trying to get to: impact, not just topology.
Once you've created a model of what the IT systems look like, you can then link those systems to the business process that requires them. And that's what we're calling a business service. It's that alignment of the business process with all the IT systems required to support that process.
With this new business service perspective of your infrastructure, you can begin to tie service level agreements to business needs, rather than technology metrics.
Infrastructure Management is the Foundation:
When discussing realistic implementations of BSM, it is important to point out that BSM requires a well instrumented, rich source of information delivered from the IT stack. In order to effectively model and manage services from a high level, the sub components need to deliver useful and relevant information in an appropriate context, else the modeling effort can be very difficult.
SmartDBA provides a powerful and effective method for centralizing and consolidating the management of a diverse, enterprise scale database environment and is an example of the kind of thing one would do to react to the advice shown above on the Giga quote. Actually, given SmartDBA is a fully participating member of the PATROL and MAINVIEW environments, one could make a broader statement about the need to instrument all of the underlying infrastructural managed objects in preparation for a full blown BSM strategy.
<number>
Speaker Notes:
Use this slide to discuss how the DBA world is essentially self contained, and it is often not obvious how the events and actions that go on around the clock effect the actual business users. While SmartDBA greatly improves the ability of the DBA to manage the system, its still a largely reactive environment in a lot of cases.
<number>
Speaker Notes:
In the BSM enabled universe, the Service Impact Model will assess the event information in terms of its relevance to the business and use the Remedy system to help schedule and prioritize maintenance activity. The DBA still has access to all of the information he had before, but he is now much more aware of the impact and priority to the users, and through the Remedy system, the users can be sure their issues are being addressed and tracked.
Value of BSM:
A key point about SmartDBA
Without BSM
While an organization may have powerful infrastructure management tools, each IT department is effectively an “island of automation” with priorities and tasks determined from the perspective of that units view of the operation.
With BSM
The efforts of each IT department are guided by a single, comprehensive view of the needs and priorities of the business, and apply their resources in lockstep for the maximum positive impact to the organization.
Schematic Overview of a Complete BSM Environment:
This slide has three builds:
The basic BSM stack – talk about the key layers and position how everything fits. The infrastructure management layer provides the key instrumentation and management capabilities to deal with a particular technology element. The service management layer provide the complete lifecycle management capabilities and process automation capabilities that allow one to consistently manage consistently across the entire IT stack. The service impact layer provides a rich model relating technology components to business services for the purpose of understanding impacts and priorities of infrastructure events, and being able to provide impact analysis of proposed corrective actions. Finally, the business service layer provides the end user view of the services and their health and welfare based on the underlying state of the technology components.
In the second built, the architectural schematic appears and you should discuss how the components link together in general.
In the final build, we now drill down to SmartDBA and discuss the functional capabilities of the DBA suite and show how it plugs into the BSM context.
Different constituents interact with BSM at different levels and using different consoles.
Partners and customers interacts with BSM thru Remedy to review and react to trouble tickets and their resolutions.
Business executives interact with the high-level BSM console for an overarching view of IT/business interaction.
IT operations interact with management specific management consoles for performance management and to deliver high availability.
DBAs interact with the SmartDBA console to deliver P-A-R for database systems and applications.
Regardless of the console and level of interaction, the BSM architecture ties these disparate pieces together into a holistic vision of the business impact of IT operations.
A CASE STUDY:
We use this hypothetical example to show how the system will work. It is meant to be very generic and not focus on a particular tool or platform.
Right data to the right people at the right time:
In this slide, there are three builds.
In the first build, we see the basic setup
Next we talk about the predicted problem of a “full” database which is flagged by the SmartDBA intelligent alarm capabilities
Finally, we point out that event information is shared simultaneously with the event management / operations people and will result in a service management view being impacted, while we also route the information to the DBA responsible for the particular system.
At this point, you can mention that DBA’s do not spend their time sitting around looking at monitors. They are generally off working with projects or users and will need to be paged or otherwise engaged. There could possibly be a delay in their reaction given the way they work, even though SmartDBA delivered them the information.
Business Context is Considered:
In this slide, we see that rules and prioritization criteria can be established in advance as a basis for automated event correlation responses. Information is also made available to both business operations and IT staff at a higher level and the resulting impact of the event on the business can be seen and considered by the operations staff, and possibly even a business process owner.
Service Impact Modeling:
In this slide, we note that the SIM (Service Impact Model) has taken the event and related it to the impacted services and gives the user a way to understand and visualize the impact to the business, so that appropriate management decisions can be made quickly and effectively, most likely as an automated process.
Action is Taken:
Based on the prioritization that has been determined via the SIM, work tickets can be opened in process management, often automatically and assigned a business relevant priority… If the resolution involves changes to the asset management records, or invokes a change management process, these too can be integrated into the reaction scenario.
In this example, the resolution will involve two work groups (Storage Admin and DBA), so multiple tickets and records must be coordinated to effect the resolution. All of this activity can be monitored and managed from the help desk or operations center via Remedy information and sent to the people who will do the work.
Problem Solved:
The appropriate people take the actions specified using the management solutions that are tightly linked to the overall BSM process to quickly and efficiently execute the management process and bring the situation to closure.
Summary:
In this case we want to emphasize how the BSM solution brought clarity and focus to a complex situation with the potential to stop a critical business service. Multiple organizations were all effectively coordinated and decisions about priority and impact were made quickly and often automatically, so that the right people were engaged and the problem resolved before an outage could occur.
By integrating SmartDBA tightly into this process, BMC provides an unmatched capability to not only do BSM reporting and analysis, it also integrates the ability to act into the overall process.
Summary:
In this slide we summarize our key messages and point out that the pieces to do this exist today. BMC has the vision and the technology to do this and our products are best of breed in their respective areas.
Backup Material:
This slide is a build that shows how the traditional BMC solutions (including SmartDBA), the Remedy solution, and the IT Masters solution are linked together.
Development Priorities:
This slide is also optional. The points to make here are that we have the key components available now. In the SmartDBA world, we are working to provide additional event information for sources that do not originate from PATROL or Mainview, and we are also working to make the load our database topology information directly available to the service model.
The “Future Plans” items are meant as examples of the kinds of things this architecture will enable and should not be presented as committed plans.
Wrap it up…
Close with a reiteration of the key points…
BSM brings organizational focus and alignment to the overall IT management process
SmartDBA instruments and automates management of the DB components and consolidates their management for effective integration into the overall BSM environment
SmartDBA capabilities bring value and ROI to the DBA and to the applications in and of themselves as best of breed management products…