SlideShare a Scribd company logo
1 of 20
Download to read offline
DBA AS PROTECTOR OF THE DATA:
NOTES FROM THE FIELD
 Speaker: Denise McInerney
 Development DBA, Intuit


                San Francisco SQL Server User Group
                         October 13, 2010




                   Mark Ginnebaugh, User Group Leader,
                         mark@designmind.com
Agenda
     g
2

       Introduction
       Goals
       Topics
         My POV
         What is “bad” data?
        D i
          Design
         Garbage in
         Transactions
         Change Management & Controls
         Partnership
         Attitude
                         Copyright © 2010 Denise McInerney
Who am I?
   SQL Server DBA since 1998
   Web-based OLTP applications
   Focus on design and performance tuning
   Development DBA www.intuitmarket.com
   PASS volunteer since 2003
       Founded Women in Tech chapter
   Contact me
       denise.mcinerney@sqlpass.org
       denise_mcinerney@intuit.com
       Twitter: @denisemc06

                          Copyright © 2010 Denise McInerney   3
www.intuitcareers.com
4


       Lead DBA                                   Openings in Menlo Park &
                                                     p    g
       Sr. Database Engineer                       Mountain View, CA and require
                                                    SQL experience
       Senior Data Quality Analyst
       Senior QA Developer                        Follow Intuit Careers on
                                                    F ll I t it C
       Software Engineer in Quality                FaceBook, Twitter and LinkedIn
       Server Side Engineer                        for updates on job openings
       Software E i
        S f       Engineer
                                                   Apply directly online at
       Architect                                   www.intuitcareers.com
       Performance Engineer
       Test Automation Engineer                   Questions on this job or any
       Systems Engineer                            others? Post, Tweet or Message
                                                    us on our Social Media ‘Intuit
       Software Tester                             Careers
                                                    Careers’ sites

                             Copyright © 2010 Denise McInerney
PASS
5



       PASS Community Summit Nov 8 11
                                  8-11
         Best   SQL Server training value
       PASS Women in Tech
         8th   Annual Women in Tech Panel @ Summit
           “Recruiting
             Recruiting,
                      Retaining & Advancing Women in Technology:
            Why Does it Matter?”
         http://wit.sqlpass.org

         #passwit   on Twitter


                            Copyright © 2010 Denise McInerney
My Goals
     y
6


       Show you how to proactively ensure that the data in
        your transactional system is clean and correct
        GOING IN
       Explain why an integrated approach is needed
       Give Real-life examples
              Real life




                        Copyright © 2010 Denise McInerney
My Point of View
         y
7


       Data protection intrinsic to the job
       Backups, security—what about quality?
       DBA s
        DBA’s approach different, complementary
                         different
       Broad exposure to the stack
       Better at your job
        B              j b
         Morehighly valued, trusted
        S
         Successful
                f l



                          Copyright © 2010 Denise McInerney
Define “bad” data
8


       Inaccurate
       Missing
       Misleading
       Causes bugs
        B
         Bugs   have consequences
                h
       Breaks reports
       Impacts customers
        I


                         Copyright © 2010 Denise McInerney
Design
9


       Have one—even in an “agile” shop
                one even          agile
       It’s a system, not a collection of tables
       Don t
        Don’t be lazy
         Re-use a column
         Just add a column

         Just add a table

       Bad design invites bad data



                         Copyright © 2010 Denise McInerney
Design
         g
10




        Always assume the data will be used by others




                        Copyright © 2010 Denise McInerney
Bad Design Examples
             g      p
11




               Copyright © 2010 Denise McInerney
Garbage In
          g
12


        Failed INSERT…the silent killer
          Order header, no detail
          Order taken, not fulfilled

          Missing records = no reconciliation

        Concatenation
          First name + last name in first name field
          Zip code 5 + 4

          Phone + phone extension
            h        h
        Duplicate orders, different order numbers

                            Copyright © 2010 Denise McInerney
Garbage In
          g
13




      Default values substituted for real data
      NULL <> ‘’ or “”




                      Copyright © 2010 Denise McInerney
Garbage In
          g
14




              Copyright © 2010 Denise McInerney
Transactions
15




        Understand them
        Don’t assume others understand them
        BEGIN TRAN…COMMIT TRAN is not enough




                      Copyright © 2010 Denise McInerney
Transactions
16




                Copyright © 2010 Denise McInerney
Change Control
         g
17


        Lots of ways data gets IN
                   y       g
        Code—application & SQL
          Version  control
          Scripts for everything!

          Change management
                g         g
        Data updates
          How   do your lookup tables get populated?
                    y         p        g p p
        People
          Who  can update data directly?
          Everyone takes short cuts
It Takes a Village
                     g
18
Summary--Pieces
     Summary--Pieces of the Puzzle
           y
19




        DBA’s job to guard data quality
        Starts with design
        Many types of “bad”
        Transactions are crucial
        Know how data gets in your database
          Implement   controls & processes
        Cultivate relationships
        Pessimism & vigilance
                            Copyright © 2010 Denise McInerney
To learn more or inquire about speaking opportunities, please contact:
 o ea     o e o qu e about spea g oppo tu t es, p ease co tact:

                Mark Ginnebaugh, User Group Leader
                      mark@designmind.com

More Related Content

Similar to Microsoft SQL Server DBA as Protector of the Data - Oct 2010

DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...
DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...
DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...DATAVERSITY
 
Data-Ed: Unlocking business value through data modeling and data architecture...
Data-Ed: Unlocking business value through data modeling and data architecture...Data-Ed: Unlocking business value through data modeling and data architecture...
Data-Ed: Unlocking business value through data modeling and data architecture...Data Blueprint
 
Make Better Decisions With Your Data 20080916
Make Better Decisions With Your Data 20080916Make Better Decisions With Your Data 20080916
Make Better Decisions With Your Data 20080916Dan English
 
Empowering the Business with Agile Analytics
Empowering the Business with Agile AnalyticsEmpowering the Business with Agile Analytics
Empowering the Business with Agile AnalyticsInside Analysis
 
Staying Productive with Social Streams
Staying Productive with Social StreamsStaying Productive with Social Streams
Staying Productive with Social StreamsLuis Benitez
 
From Beginners to Experts, Data Wrangling for All
From Beginners to Experts, Data Wrangling for AllFrom Beginners to Experts, Data Wrangling for All
From Beginners to Experts, Data Wrangling for AllDataWorks Summit
 
Cleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MD
Cleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MDCleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MD
Cleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MDClearedJobs.Net
 
Cleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, Md
Cleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, MdCleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, Md
Cleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, MdDeb Thomas
 
Information Architecture
Information ArchitectureInformation Architecture
Information ArchitectureInnoTech
 
SharePoint Information Architecture
SharePoint Information ArchitectureSharePoint Information Architecture
SharePoint Information ArchitectureCredera
 
Application Logging for fun and profit. Houston TechFest 2012
Application Logging for fun and profit.  Houston TechFest 2012Application Logging for fun and profit.  Houston TechFest 2012
Application Logging for fun and profit. Houston TechFest 2012Jane Prusakova
 
Uxd corporate presentation
Uxd corporate presentationUxd corporate presentation
Uxd corporate presentationMandar Mayekar
 
ATAAS2016 - Big data analytics – data visualization himanshu and santosh
ATAAS2016 - Big data analytics – data visualization   himanshu and santoshATAAS2016 - Big data analytics – data visualization   himanshu and santosh
ATAAS2016 - Big data analytics – data visualization himanshu and santoshAgile Testing Alliance
 
Ug apm - ca executive insight customer presentation v2.2 english
Ug  apm - ca executive insight customer presentation v2.2 englishUg  apm - ca executive insight customer presentation v2.2 english
Ug apm - ca executive insight customer presentation v2.2 englishCA Technologies Italia
 
Delivering Insights: Building the DataScience Web Application
Delivering Insights: Building the DataScience Web ApplicationDelivering Insights: Building the DataScience Web Application
Delivering Insights: Building the DataScience Web ApplicationDataScience
 

Similar to Microsoft SQL Server DBA as Protector of the Data - Oct 2010 (20)

My Resume.
My Resume.My Resume.
My Resume.
 
DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...
DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...
DataEd Webinar: Unlocking Business Value Through Data Modeling and Data Archi...
 
Data-Ed: Unlocking business value through data modeling and data architecture...
Data-Ed: Unlocking business value through data modeling and data architecture...Data-Ed: Unlocking business value through data modeling and data architecture...
Data-Ed: Unlocking business value through data modeling and data architecture...
 
Make Better Decisions With Your Data 20080916
Make Better Decisions With Your Data 20080916Make Better Decisions With Your Data 20080916
Make Better Decisions With Your Data 20080916
 
Empowering the Business with Agile Analytics
Empowering the Business with Agile AnalyticsEmpowering the Business with Agile Analytics
Empowering the Business with Agile Analytics
 
Staying Productive with Social Streams
Staying Productive with Social StreamsStaying Productive with Social Streams
Staying Productive with Social Streams
 
From Beginners to Experts, Data Wrangling for All
From Beginners to Experts, Data Wrangling for AllFrom Beginners to Experts, Data Wrangling for All
From Beginners to Experts, Data Wrangling for All
 
Cleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MD
Cleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MDCleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MD
Cleared Job Fair Job Seeker Handbook March 3, 2011, BWI, MD
 
Cleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, Md
Cleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, MdCleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, Md
Cleared Job Fair Job Seeker Handbook March 3, 2011, Bwi, Md
 
Information Architecture
Information ArchitectureInformation Architecture
Information Architecture
 
SharePoint Information Architecture
SharePoint Information ArchitectureSharePoint Information Architecture
SharePoint Information Architecture
 
bio data
bio databio data
bio data
 
Application Logging for fun and profit. Houston TechFest 2012
Application Logging for fun and profit.  Houston TechFest 2012Application Logging for fun and profit.  Houston TechFest 2012
Application Logging for fun and profit. Houston TechFest 2012
 
Uxd corporate presentation
Uxd corporate presentationUxd corporate presentation
Uxd corporate presentation
 
ATAAS2016 - Big data analytics – data visualization himanshu and santosh
ATAAS2016 - Big data analytics – data visualization   himanshu and santoshATAAS2016 - Big data analytics – data visualization   himanshu and santosh
ATAAS2016 - Big data analytics – data visualization himanshu and santosh
 
Ug apm - ca executive insight customer presentation v2.2 english
Ug  apm - ca executive insight customer presentation v2.2 englishUg  apm - ca executive insight customer presentation v2.2 english
Ug apm - ca executive insight customer presentation v2.2 english
 
dave2
dave2dave2
dave2
 
Delivering Insights: Building the DataScience Web Application
Delivering Insights: Building the DataScience Web ApplicationDelivering Insights: Building the DataScience Web Application
Delivering Insights: Building the DataScience Web Application
 
Iwill_CV[1][1][1][1]
Iwill_CV[1][1][1][1]Iwill_CV[1][1][1][1]
Iwill_CV[1][1][1][1]
 
JeremiahHolder-CV
JeremiahHolder-CVJeremiahHolder-CV
JeremiahHolder-CV
 

More from Mark Ginnebaugh

Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction
Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction
Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction Mark Ginnebaugh
 
Platfora - An Analytics Sandbox In A World Of Big Data
Platfora - An Analytics Sandbox In A World Of Big DataPlatfora - An Analytics Sandbox In A World Of Big Data
Platfora - An Analytics Sandbox In A World Of Big DataMark Ginnebaugh
 
Microsoft SQL Server Relational Databases and Primary Keys
Microsoft SQL Server Relational Databases and Primary KeysMicrosoft SQL Server Relational Databases and Primary Keys
Microsoft SQL Server Relational Databases and Primary KeysMark Ginnebaugh
 
DesignMind Microsoft Business Intelligence SQL Server
DesignMind Microsoft Business Intelligence SQL ServerDesignMind Microsoft Business Intelligence SQL Server
DesignMind Microsoft Business Intelligence SQL ServerMark Ginnebaugh
 
San Francisco Bay Area SQL Server July 2013 meetings
San Francisco Bay Area SQL Server July 2013 meetingsSan Francisco Bay Area SQL Server July 2013 meetings
San Francisco Bay Area SQL Server July 2013 meetingsMark Ginnebaugh
 
Silicon Valley SQL Server User Group June 2013
Silicon Valley SQL Server User Group June 2013Silicon Valley SQL Server User Group June 2013
Silicon Valley SQL Server User Group June 2013Mark Ginnebaugh
 
Microsoft SQL Server Continuous Integration
Microsoft SQL Server Continuous IntegrationMicrosoft SQL Server Continuous Integration
Microsoft SQL Server Continuous IntegrationMark Ginnebaugh
 
Hortonworks Big Data & Hadoop
Hortonworks Big Data & HadoopHortonworks Big Data & Hadoop
Hortonworks Big Data & HadoopMark Ginnebaugh
 
Microsoft SQL Server Physical Join Operators
Microsoft SQL Server Physical Join OperatorsMicrosoft SQL Server Physical Join Operators
Microsoft SQL Server Physical Join OperatorsMark Ginnebaugh
 
Microsoft PowerPivot & Power View in Excel 2013
Microsoft PowerPivot & Power View in Excel 2013Microsoft PowerPivot & Power View in Excel 2013
Microsoft PowerPivot & Power View in Excel 2013Mark Ginnebaugh
 
Microsoft Data Warehouse Business Intelligence Lifecycle - The Kimball Approach
Microsoft Data Warehouse Business Intelligence Lifecycle - The Kimball ApproachMicrosoft Data Warehouse Business Intelligence Lifecycle - The Kimball Approach
Microsoft Data Warehouse Business Intelligence Lifecycle - The Kimball ApproachMark Ginnebaugh
 
Fusion-io Memory Flash for Microsoft SQL Server 2012
Fusion-io Memory Flash for Microsoft SQL Server 2012Fusion-io Memory Flash for Microsoft SQL Server 2012
Fusion-io Memory Flash for Microsoft SQL Server 2012Mark Ginnebaugh
 
Microsoft Data Mining 2012
Microsoft Data Mining 2012Microsoft Data Mining 2012
Microsoft Data Mining 2012Mark Ginnebaugh
 
Microsoft SQL Server PASS News August 2012
Microsoft SQL Server PASS News August 2012Microsoft SQL Server PASS News August 2012
Microsoft SQL Server PASS News August 2012Mark Ginnebaugh
 
Microsoft Mobile Business Intelligence
Microsoft Mobile Business Intelligence Microsoft Mobile Business Intelligence
Microsoft Mobile Business Intelligence Mark Ginnebaugh
 
Microsoft SQL Server 2012 Cloud Ready
Microsoft SQL Server 2012 Cloud ReadyMicrosoft SQL Server 2012 Cloud Ready
Microsoft SQL Server 2012 Cloud ReadyMark Ginnebaugh
 
Microsoft SQL Server 2012 Master Data Services
Microsoft SQL Server 2012 Master Data ServicesMicrosoft SQL Server 2012 Master Data Services
Microsoft SQL Server 2012 Master Data ServicesMark Ginnebaugh
 
Microsoft SQL Server Testing Frameworks
Microsoft SQL Server Testing FrameworksMicrosoft SQL Server Testing Frameworks
Microsoft SQL Server Testing FrameworksMark Ginnebaugh
 
Microsoft SQL Server - How to Collaboratively Manage Excel Data
Microsoft SQL Server - How to Collaboratively Manage Excel DataMicrosoft SQL Server - How to Collaboratively Manage Excel Data
Microsoft SQL Server - How to Collaboratively Manage Excel DataMark Ginnebaugh
 
Microsoft SQL Server Flash Storage
Microsoft SQL Server Flash StorageMicrosoft SQL Server Flash Storage
Microsoft SQL Server Flash StorageMark Ginnebaugh
 

More from Mark Ginnebaugh (20)

Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction
Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction
Microsoft SQL Server Analysis Services (SSAS) - A Practical Introduction
 
Platfora - An Analytics Sandbox In A World Of Big Data
Platfora - An Analytics Sandbox In A World Of Big DataPlatfora - An Analytics Sandbox In A World Of Big Data
Platfora - An Analytics Sandbox In A World Of Big Data
 
Microsoft SQL Server Relational Databases and Primary Keys
Microsoft SQL Server Relational Databases and Primary KeysMicrosoft SQL Server Relational Databases and Primary Keys
Microsoft SQL Server Relational Databases and Primary Keys
 
DesignMind Microsoft Business Intelligence SQL Server
DesignMind Microsoft Business Intelligence SQL ServerDesignMind Microsoft Business Intelligence SQL Server
DesignMind Microsoft Business Intelligence SQL Server
 
San Francisco Bay Area SQL Server July 2013 meetings
San Francisco Bay Area SQL Server July 2013 meetingsSan Francisco Bay Area SQL Server July 2013 meetings
San Francisco Bay Area SQL Server July 2013 meetings
 
Silicon Valley SQL Server User Group June 2013
Silicon Valley SQL Server User Group June 2013Silicon Valley SQL Server User Group June 2013
Silicon Valley SQL Server User Group June 2013
 
Microsoft SQL Server Continuous Integration
Microsoft SQL Server Continuous IntegrationMicrosoft SQL Server Continuous Integration
Microsoft SQL Server Continuous Integration
 
Hortonworks Big Data & Hadoop
Hortonworks Big Data & HadoopHortonworks Big Data & Hadoop
Hortonworks Big Data & Hadoop
 
Microsoft SQL Server Physical Join Operators
Microsoft SQL Server Physical Join OperatorsMicrosoft SQL Server Physical Join Operators
Microsoft SQL Server Physical Join Operators
 
Microsoft PowerPivot & Power View in Excel 2013
Microsoft PowerPivot & Power View in Excel 2013Microsoft PowerPivot & Power View in Excel 2013
Microsoft PowerPivot & Power View in Excel 2013
 
Microsoft Data Warehouse Business Intelligence Lifecycle - The Kimball Approach
Microsoft Data Warehouse Business Intelligence Lifecycle - The Kimball ApproachMicrosoft Data Warehouse Business Intelligence Lifecycle - The Kimball Approach
Microsoft Data Warehouse Business Intelligence Lifecycle - The Kimball Approach
 
Fusion-io Memory Flash for Microsoft SQL Server 2012
Fusion-io Memory Flash for Microsoft SQL Server 2012Fusion-io Memory Flash for Microsoft SQL Server 2012
Fusion-io Memory Flash for Microsoft SQL Server 2012
 
Microsoft Data Mining 2012
Microsoft Data Mining 2012Microsoft Data Mining 2012
Microsoft Data Mining 2012
 
Microsoft SQL Server PASS News August 2012
Microsoft SQL Server PASS News August 2012Microsoft SQL Server PASS News August 2012
Microsoft SQL Server PASS News August 2012
 
Microsoft Mobile Business Intelligence
Microsoft Mobile Business Intelligence Microsoft Mobile Business Intelligence
Microsoft Mobile Business Intelligence
 
Microsoft SQL Server 2012 Cloud Ready
Microsoft SQL Server 2012 Cloud ReadyMicrosoft SQL Server 2012 Cloud Ready
Microsoft SQL Server 2012 Cloud Ready
 
Microsoft SQL Server 2012 Master Data Services
Microsoft SQL Server 2012 Master Data ServicesMicrosoft SQL Server 2012 Master Data Services
Microsoft SQL Server 2012 Master Data Services
 
Microsoft SQL Server Testing Frameworks
Microsoft SQL Server Testing FrameworksMicrosoft SQL Server Testing Frameworks
Microsoft SQL Server Testing Frameworks
 
Microsoft SQL Server - How to Collaboratively Manage Excel Data
Microsoft SQL Server - How to Collaboratively Manage Excel DataMicrosoft SQL Server - How to Collaboratively Manage Excel Data
Microsoft SQL Server - How to Collaboratively Manage Excel Data
 
Microsoft SQL Server Flash Storage
Microsoft SQL Server Flash StorageMicrosoft SQL Server Flash Storage
Microsoft SQL Server Flash Storage
 

Recently uploaded

2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 

Microsoft SQL Server DBA as Protector of the Data - Oct 2010

  • 1. DBA AS PROTECTOR OF THE DATA: NOTES FROM THE FIELD Speaker: Denise McInerney Development DBA, Intuit San Francisco SQL Server User Group October 13, 2010 Mark Ginnebaugh, User Group Leader, mark@designmind.com
  • 2. Agenda g 2  Introduction  Goals  Topics  My POV  What is “bad” data? D i Design  Garbage in  Transactions  Change Management & Controls  Partnership  Attitude Copyright © 2010 Denise McInerney
  • 3. Who am I?  SQL Server DBA since 1998  Web-based OLTP applications  Focus on design and performance tuning  Development DBA www.intuitmarket.com  PASS volunteer since 2003  Founded Women in Tech chapter  Contact me  denise.mcinerney@sqlpass.org  denise_mcinerney@intuit.com  Twitter: @denisemc06 Copyright © 2010 Denise McInerney 3
  • 4. www.intuitcareers.com 4  Lead DBA  Openings in Menlo Park & p g  Sr. Database Engineer Mountain View, CA and require SQL experience  Senior Data Quality Analyst  Senior QA Developer  Follow Intuit Careers on F ll I t it C  Software Engineer in Quality FaceBook, Twitter and LinkedIn  Server Side Engineer for updates on job openings  Software E i S f Engineer  Apply directly online at  Architect www.intuitcareers.com  Performance Engineer  Test Automation Engineer  Questions on this job or any  Systems Engineer others? Post, Tweet or Message us on our Social Media ‘Intuit  Software Tester Careers Careers’ sites Copyright © 2010 Denise McInerney
  • 5. PASS 5  PASS Community Summit Nov 8 11 8-11  Best SQL Server training value  PASS Women in Tech  8th Annual Women in Tech Panel @ Summit  “Recruiting Recruiting, Retaining & Advancing Women in Technology: Why Does it Matter?”  http://wit.sqlpass.org  #passwit on Twitter Copyright © 2010 Denise McInerney
  • 6. My Goals y 6  Show you how to proactively ensure that the data in your transactional system is clean and correct GOING IN  Explain why an integrated approach is needed  Give Real-life examples Real life Copyright © 2010 Denise McInerney
  • 7. My Point of View y 7  Data protection intrinsic to the job  Backups, security—what about quality?  DBA s DBA’s approach different, complementary different  Broad exposure to the stack  Better at your job B j b  Morehighly valued, trusted S Successful f l Copyright © 2010 Denise McInerney
  • 8. Define “bad” data 8  Inaccurate  Missing  Misleading  Causes bugs B Bugs have consequences h  Breaks reports  Impacts customers I Copyright © 2010 Denise McInerney
  • 9. Design 9  Have one—even in an “agile” shop one even agile  It’s a system, not a collection of tables  Don t Don’t be lazy  Re-use a column  Just add a column  Just add a table  Bad design invites bad data Copyright © 2010 Denise McInerney
  • 10. Design g 10  Always assume the data will be used by others Copyright © 2010 Denise McInerney
  • 11. Bad Design Examples g p 11 Copyright © 2010 Denise McInerney
  • 12. Garbage In g 12  Failed INSERT…the silent killer  Order header, no detail  Order taken, not fulfilled  Missing records = no reconciliation  Concatenation  First name + last name in first name field  Zip code 5 + 4  Phone + phone extension h h  Duplicate orders, different order numbers Copyright © 2010 Denise McInerney
  • 13. Garbage In g 13  Default values substituted for real data  NULL <> ‘’ or “” Copyright © 2010 Denise McInerney
  • 14. Garbage In g 14 Copyright © 2010 Denise McInerney
  • 15. Transactions 15  Understand them  Don’t assume others understand them  BEGIN TRAN…COMMIT TRAN is not enough Copyright © 2010 Denise McInerney
  • 16. Transactions 16 Copyright © 2010 Denise McInerney
  • 17. Change Control g 17  Lots of ways data gets IN y g  Code—application & SQL  Version control  Scripts for everything!  Change management g g  Data updates  How do your lookup tables get populated? y p g p p  People  Who can update data directly?  Everyone takes short cuts
  • 18. It Takes a Village g 18
  • 19. Summary--Pieces Summary--Pieces of the Puzzle y 19  DBA’s job to guard data quality  Starts with design  Many types of “bad”  Transactions are crucial  Know how data gets in your database  Implement controls & processes  Cultivate relationships  Pessimism & vigilance Copyright © 2010 Denise McInerney
  • 20. To learn more or inquire about speaking opportunities, please contact: o ea o e o qu e about spea g oppo tu t es, p ease co tact: Mark Ginnebaugh, User Group Leader mark@designmind.com