Introduction to Master Data Services in SQL Server 2012
What is Master Data Services? Why is it important? - Will discuss Master Data Services capabilities, it's underlying architecture. Will demo creating a model, using SQL Server 2012 MDS add-in for Microsoft Excel, creating hierarchies, business rules and exposing/integrating data with other interfaces (Data Warehouse)
Introduction to Master Data Services in SQL Server 2012
Master Data Services in SQL Server 2012(An Introduction)Stéphane FréchetteThursday May 30, 2013
Who am I?My name is Stéphane FréchetteI’m a Database & Business Intelligence Professional and CEO | Founder ofI have a passion for architecting, designing and building solutions that matter.Self proclaimed Open Data Hacker/Advocate I founded Gatineau Ouverte a citizen ledinitiative which aims to promote open access to civic data of the city of Gatineau.Twitter: @sfrechetteEmail: email@example.comBlog: stephanefrechette.com
Session Outline• Microsoft Business Intelligence (The Stack)• What is Master Data?• What is Master Data Management?• Do you have these issues?• SQL Server Master Data Services (MDS)• MDS - Key Capabilities• Data Steward• MDS – Models, Improving Data Quality, Moving Data, Web Service• Demo• Summary• Resources
AnalysisServicesReportingServicesIntegrationServicesMaster DataServicesSharePointCollaborationExcelWorkbooksPowerPivotApplicationsSharePointDashboards & ScorecardsData QualityServicesODataFeedsLine of BusinessApplicationsHadoop Big DataMicrosoft Business Intelligence
What is Master Data?“Master Data is data that is at the core of an organization and usedacross multiple systems, applications, and/or processes…”Requires;• Centralized curated activities and maintenance• Data Quality Management• Easy access for business users (not only IT)• Effective collaboration and sharing
What is Master Data Management?“Are sets of processes, governance, policies, standards and tools thatdefines and manage Master Data…”
Why is Master Data Management Important?• Reduces, eliminate duplicate data entry and maintenance• Improve compliance, reporting, profitability, decision making and dataquality• Enables data stewards to manage critical business data• Provide a single view of critical information funnels
Do you have these issues?• Instances or sets of invalid data impacting business processes?• Wish your business users could manage the data themselves?• IT resources fixing data and/or managing hierarchy definitions for users?• Systems which could benefit from a single source view of domain data?SQL Server Master Data Services can help you!
What type of Data are we taking about?People Things Places AbstractCustomersVendorsEmployeesPartnersPatientsProductsBusiness UnitsBill of MaterialsPartsEquipmentLocationsStoresPower LinesGeographicAreasWarehousesAccountsWarrantiesTimeMetricsContracts
SQL Server Master Data Services (MDS)SQL Server Master Data Services provides a central data hub that ensures the integrity ofinformation and consistency of data is constant across different applications. Enablescleansing, matching, standardizing and enriching data.• New in SQL Server 2012; Redesigned web interface to add, delete, and move members quickly. Excel front-end (MDS add-in) allowing business users to autonomously add and editdata in the underlying systems on their own. Improved performance, security, robustness, and scalability. Integrated with Data Quality Services (DQS) to do data matching before loading. Installation part of SQL Server.
Master Data Services – Key CapabilitiesCreate Master Data By Standardizing Data Definitions For Key Business Entities• Collect and maintain accurate and complete master data to ensure standardized datadefinitions of key business entities across all of your IT assets. Manage data consistency across different environments.(Oracle, Microsoft SQL Azure, HP, and IBM) Manage the superset of all data attributes across all systems. Create explicit hierarchies based on traditional parent-child relationships. Produce derived hierarchies from pre-existing data relationships found within masterdata models.
Master Data Services – Key CapabilitiesCreate a Master Data Hub for Your Enterprise• Implement a master data management hub to manage the master data that is stored inthe database and keep it synchronized with the transactional systems that use the masterdata. Effectively track all known attributes across the enterprise. Create versions for each model at different time intervals. Commit versions of master data only after business rules have been met.
Master Data Services – Key CapabilitiesEmpower Business Users to Manage Data Governance• Trust the experience of business-knowledgeable users, so organizations can improvemaster data maintenance and avoid the delays and mistakes that occur when non-business specialists manage and maintain data. End users can directly manage the underlying database and data warehousedimensions and hierarchies using Excel. Free IT responsibilities so they can focus on the oversight of the overall datawarehouse.
Data Steward• Key role - Is usually a Business User and not from the Information Technology side• Nutshell: Responsible for maintaining data elements in a metadata registry…• Data Steward -> MDS Client (Web based and Excel add-in)• Create and edit Models, Hierarchies, Business Rules…• Run, process and validate data continually, iteratively, improving…• Maintain high level of data qualityMDS/DQSData StewardMDS/DQSData StewardDQSSSIS DeveloperMatching CleansingCreate & Edit
Master Data Services - Type of UsersBusiness users – Datastewards - FunctionalareaAdministrators -Administrative area
Master Data Services – ModelsModels are the highest level of data organization in Master Data Services. A model definesthe structure of data in your master data management solution. A model contains thefollowing objects:• Entities• Attributes and attribute groups• Explicit and derived hierarchies• CollectionsAccounts;which could include entities such as balance sheet accounts, income statementaccounts, statistics, and account type.Customer;which could include entities such as gender, education, occupation, and marital status.Geography;which could include entities such as postal codes, cities, counties, states, provinces, regions,territories, countries, and continents.
Master Data Services – Improving Data QualityIn order to ensure the quality and accuracy of your master data these are the followingfeatures that are available to you:• Business Rules(Automatically update data, send email, start a business process or workflow)• Validation(Business rule – Data type content validations)• Versions(Audit records, prevent from making changes, lock down models)• Notifications(Send email when biz rule fails or model version status changes)• Security
Master Data Services – Moving Data• Importing Data Import data into Staging Tables and process the staged data as batcho stg_nameLeafo stg_nameConsolidatedo stg_nameRelationship• Exporting Data Subscribe systems can view data through subscription views• Deploying Models Package, XML format which contains a deployable model structureo Tools: MDSModelDeploy, Model Deployment wizard, Model Package Editor
Master Data Services – Extending with Web Services• Master Data Manager Web Service• WCF service that enables you to control MDS programmatically• Custom Workflows• A custom workflow calls code that you write, which can take whatever action yourequire to process the workflow.Developer’s Guide (Master Data Services)http://msdn.microsoft.com/en-us/library/hh230994.aspx
Enterprise Information Management (EIM)The EIM Stack as a whole is the ‘Master Data Management’ solution from Microsoft andconsist of the following:• SQL Server Data Quality Services (DQS) - Capture and record knowledge, rules, and actions• SQL Server Master Data Services (MDS) - Master Data Management repository, Dimension data• SQL Server Integration Services (SSIS) – Moves data, integrationEnterprise Information Management (EMI)‘Master Data Management’
SummaryMaster Data Management issues are pervasive within organizationsand will always exist.SQL Server Master Data Services is built to be deployed rapidly, theintent is to make it accessible for all type of organizations and enablethem to create solutions for themselves. An implementation can besuccessfully achieved by business users without any programmingknowledge.
Resources• SQL Server 2012 Master Data Services - http://bit.ly/16ei8w0• MSDN, Master Data Services - http://bit.ly/z8crur• TechNet, Master Data Services - http://bit.ly/12BfwBH• Channel 9, Master Data Services - http://bit.ly/19ab2Y4• Master Data Services Team Blog - http://bit.ly/170Ecuc• James Serra’s Blog - http://bit.ly/M3MYI2• SQL Chick’s Blog - http://bit.ly/ietII4• Amazon, Microsoft SQL Server 2012 Master Data Services -http://amzn.to/UtVHaO