• Save
BO Information Steward Data Quality Advisor
Upcoming SlideShare
Loading in...5
×
 

BO Information Steward Data Quality Advisor

on

  • 1,115 views

New Feature in BO Information Steward -- Data Quality Advisor

New Feature in BO Information Steward -- Data Quality Advisor

Statistics

Views

Total Views
1,115
Views on SlideShare
1,089
Embed Views
26

Actions

Likes
0
Downloads
0
Comments
0

2 Embeds 26

https://twitter.com 25
http://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

BO Information Steward Data Quality Advisor BO Information Steward Data Quality Advisor Presentation Transcript

  • Information Steward 4.2Data Quality AdvisorKen Beutler, Product OwnerCorrie Brague, Director – Product Management
  • © 2011 SAP AG. All rights reserved. 2AgendaIntroduction and Overview of Data Quality AdvisorDetailed Walkthrough of Data Quality AdvisorQ&A
  • © 2011 SAP AG. All rights reserved. 3Information ManagementBuilding on Themes Our Customers Care About MostSmart & SimpleInformationGovernanceBig DataIntelligentIntuitiveFlexibleQuality DataAcross ProcessesFor AnalyticsVolumeVarietyVarietyEnterprise ReadyRobustness  Reliability  Performance
  • © 2011 SAP AG. All rights reserved. 4Information StewardData Quality AdvisorData Quality AdvisorData Services WorkbenchRecommend TuneData Quality Advisor guides data stewards to rapidly develop a solutionto measure and improve the quality of their information assets Data Profiling Content TypeDiscovery Validation Rules Cleansing Rules Match Rules View Before /After Results Fine Tune WithWhat-If Analysis Publish RulesAssessDeveloperData Steward
  • © 2011 SAP AG. All rights reserved. 5DQA - Content Type DiscoveryGo beyond statistical data profiling todiscover meaningful business content Content discovery for more than 20 typessuch as names, addresses, and emails Ability for software to make validation andcleansing recommendations Fully review and customize results withinData InsightData Quality AdvisorAssess Recommend Tune
  • © 2011 SAP AG. All rights reserved. 6DQA - Data ValidationGuides Data Stewards to rapidlydevelop validation rules to measurethe quality of their informationassets Advisor suggests validation rulesbased on statistical analysis andcontent type Learning system suggestsapplication of existing rules to othernew data with similar contentData Quality AdvisorAssess Recommend Tune
  • © 2011 SAP AG. All rights reserved. 7DQA - Data CleansingGuides Data Stewards to rapidly develop cleansingand matching rules to improve the quality of theirinformation assetsBy automatically suggesting business rules for… Parsing and StandardizationTo ensure consistent data Correction and EnrichmentTo ensure correct and complete data MatchingTo determine which records refer to the same entityFirst Name: BobMiddle Name: E.Last Name: OldsteadPrimary Address: 175Riviington AveSecondary Address: Ste 2City: ManhattenState: New YourkPhone: (800) 555-9875First Name: BobMiddle Name: E.Last Name: OldsteadPrimary Address: 175Rivington AveSecondary Address: Ste 2City: ManhattanState: New YorkPostal Code: 10002Phone: (800) 555-9875Bob e. oldstead175 Riviington avenue suite 2Manhatten, new yourk800-555-9875First Name: RobertLast Name: OldsteadPhone: (800) 555-9875MatchData Quality AdvisorAssess Recommend Tune
  • © 2011 SAP AG. All rights reserved. 8Data Cleansing AdvisorGuides Data Stewards to rapidly develop cleansing and matching rules to improve thequality of their information assetsBy visualizing cleansing and matching rules with an intuitive, data-driven interface Easily adjust standardization options View potential duplicates, including near matches Adjust match criteria thresholds with what-if analysisData Quality AdvisorAssess Recommend Tune
  • © 2011 SAP AG. All rights reserved. 9Data Quality Advisor Use Scenario.
  • © 2011 SAP AG. All rights reserved. 10AgendaIntroduction and Overview of Data Quality AdvisorDetailed Walkthrough of Data Quality AdvisorQ&A
  • © 2011 SAP AG. All rights reserved. 11Data Assessment - Profiling• Content type profiling• Column profiling• Reviewing results to gain further insight into the data
  • © 2011 SAP AG. All rights reserved. 12• Highest confidence content type isdisplayed• Use distribution results to gain furtherinsight into the context of the data• Customize results to better fit the needs ofyour input dataData Assessment – Reviewing Results
  • © 2011 SAP AG. All rights reserved. 13Data Assessment – Reviewing Results• Reviewing completeness, distribution andpattern profiling results• Gain insight into the data you’re workingwith, but what can be corrected?• How can I determine complexrelationships within the data source?
  • © 2011 SAP AG. All rights reserved. 14Data Assessment – Reviewing ResultsRegion Results• Reviewing completeness, distribution andpattern profiling results• Gain insight into the data you’re workingwith, but what can be corrected?• How can I determine complexrelationships within the data source?
  • © 2011 SAP AG. All rights reserved. 15Data Assessment – Reviewing ResultsCountry Results• Reviewing completeness, distribution andpattern profiling results• Gain insight into the data you’re workingwith, but what can be corrected?• How can I determine complexrelationships within the data source?
  • © 2011 SAP AG. All rights reserved. 16Data Assessment – Reviewing ResultsDate Results• Reviewing completeness, distribution andpattern profiling results• Gain insight into the data you’re workingwith, but what can be corrected?• How can I determine complexrelationships within the data source?
  • © 2011 SAP AG. All rights reserved. 17Creating a Data Cleansing SolutionLaunching the DCA Wizard Content type profiling must be performed inorder to launch the DCA wizard Flat file, database, SAP application andvirtual view Information Steward can advise what to do nextbased on profiling results
  • © 2011 SAP AG. All rights reserved. 18Creating a Data Cleansing SolutionDCA Wizard – Selecting Relevant DQ Columns Automatic validation is performed Recommends cleansing rules to beused dynamically based on thecontent Global solution:– Multi script support– Multi country support
  • © 2011 SAP AG. All rights reserved. 19Creating a Data Cleansing SolutionDCA Wizard – Selecting a Match Theme Automatically recommends a matchtheme based on input data andcontent type profiling results Themes supported: Individual,Corporate, Individual and Corporate,Family, ID-Only, Other, and No Match The match rules recommended arebased on the DQ columns that wereselected
  • © 2011 SAP AG. All rights reserved. 20Creating a Data Cleansing SolutionDCA Wizard – Basic Transformations Apply basic transformations to helpobtain better cleanse and matchresults Trim leading/trailing spaces Replace null/blanks with a value Remove double/single quotes Remove non-printable characters Search and replace
  • © 2011 SAP AG. All rights reserved. 21Reviewing a Data Cleansing SolutionDCA Overview Screen231. Solution list2. High-levelsummary3. Solutionoptions1
  • © 2011 SAP AG. All rights reserved. 22Reviewing Address Cleanse ResultsEnriching Region Data
  • © 2011 SAP AG. All rights reserved. 23Reviewing Address Cleanse ResultsViewing Enriched Region Data
  • © 2011 SAP AG. All rights reserved. 24Reviewing Address Cleanse ResultsInvalid Addresses
  • © 2011 SAP AG. All rights reserved. 25Reviewing Address Cleanse ResultsViewing Invalid Addresses
  • © 2011 SAP AG. All rights reserved. 26Reviewing Cleanse ResultsStandardizing Date Data
  • © 2011 SAP AG. All rights reserved. 27Reviewing Cleanse ResultsViewing Standardized Date Data
  • © 2011 SAP AG. All rights reserved. 28Tuning Cleanse ResultsFirm, Person and Title Data
  • © 2011 SAP AG. All rights reserved. 29Tuning Cleanse ResultsAddress Data
  • © 2011 SAP AG. All rights reserved. 30Tuning Cleanse ResultsPhone Data
  • © 2011 SAP AG. All rights reserved. 31Tuning Cleanse ResultsDate Data
  • © 2011 SAP AG. All rights reserved. 32Reviewing a Data Cleansing SolutionDCA Overview Screen
  • © 2011 SAP AG. All rights reserved. 33Tuning Match ResultsMatch Statistics and Filtering
  • © 2011 SAP AG. All rights reserved. 34Tuning Match ResultsMatch Statistics and Filtering
  • © 2011 SAP AG. All rights reserved. 35Tuning Match ResultsPerson Data – Finding More Matches
  • © 2011 SAP AG. All rights reserved. 36Tuning Match ResultsPerson Data – Finding More Matches• The tuning changetakes effectimmediately• What-if analysis showsthat there are nowmore matching records• Easily cancel or applythe tuned rules
  • © 2011 SAP AG. All rights reserved. 37Tuning Match ResultsPerson Data – Finding More Matches
  • © 2011 SAP AG. All rights reserved. 38Tuning Match ResultsFirm Data – Adjusting the Match Strictness
  • © 2011 SAP AG. All rights reserved. 39Reviewing a Data Cleansing SolutionDCA Overview Screen
  • © 2011 SAP AG. All rights reserved. 40Reviewing a Data Cleansing SolutionData Cleansing Solution Summary
  • © 2011 SAP AG. All rights reserved. 41Publishing a Data Cleansing Solution One-click publish to Data ServicesWorkbench for easy collaboration The data cleansing solution can be publishedmultiple times The ETL Developer using Data ServicesWorkbench can leverage it immediately
  • © 2011 SAP AG. All rights reserved. 42Publishing a Data Cleansing SolutionData Services Workbench – Overview1. PublishedDCAsolutions2. DCAtransformproperties3. DCAtransform123
  • © 2011 SAP AG. All rights reserved. 43Data Validation AdvisorCreating Validation Rules• Use the advisor to automatically get a recommendation of rules• Leverage profiling results to create rules on the fly• Manually create rules
  • © 2011 SAP AG. All rights reserved. 44Data Validation AdvisorCreating a Date Format Rule
  • © 2011 SAP AG. All rights reserved. 45Data Validation AdvisorCreating a Date Format Rule
  • © 2011 SAP AG. All rights reserved. 46Data Validation AdvisorRecommendation of validation rules• Automatically recommends rules:• By content type• Using statistical outlier analysis• Learns from and leverages existing validation rules
  • © 2011 SAP AG. All rights reserved. 47AgendaIntroduction and Overview of Data Quality AdvisorDetailed Walkthrough of Data Quality AdvisorQ&A
  • © 2011 SAP AG. All rights reserved. 48Enterprise Information Management with SAPRegister to Win a Free Copy!• Understand the big picture of SAP’senterprise information managementofferings• Explore step-by-step instructions forworking with SAP Data Services• Learn how to perform the mostimportant tasks in SAP InformationSteward, SAP NetWeaver InformationLifecycle Management, SAP MasterData Governance, and more• All royalties donated to Doctors WithoutBordersReviews are in!A consistent Top 10Best-seller with SAPPress!Register to win*:http://fm.sap.com/eimbooks*One winner will be randomly selected from Webinar registrants
  • Contact Information:Ken Beutler: Product Owner (Data Quality Advisor)ken.beutler@sap.comCorrie Brague: Director, Product Management (Data Quality Management)corrie.brague@sap.comThank you!