Downloaded 218 times
More Related Content
![[DSC Europe 22] Lakehouse architecture with Delta Lake and Databricks - Draga...](https://cdn.slidesharecdn.com/ss_thumbnails/draganberic-lakehousearchitecturewithdeltalakeanddatabricks-221130080712-6e817e95-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to SQL Server 2019 Master Data Service
More from Kenichiro Nakamura
SQL Server 2019 Master Data Service
- 1. SQL Server 2019 MasterData Service Kenichiro Nakamura
- 2. Before starting thesession… Big thanks to Peter Myers for great content. Check out his great contents if you are interested in data. https://www.youtube.com/results?search_query= peter+myers+data
- 3. Key Takeaways After takingthe session, you can - explain what’s Master Data Management - explain what’s Master Data Service of SQL Server 2019 - install, configure and start using MDS for your projects This session doesn’t cover followings - Programming to consume master data - HA/DR/Performance related information - Migration from prior versions - Integration Scenario from other system
- 4. Agenda - Overview - MDSComponents - MDS Model Development - MDS Management - MDS Integration - MDS Administration
- 5.
- 6. What’s Master DataManagement In business, master data management (MDM) is a method used to define and manage the critical data of an organization to provide, with data integration, a single point of reference. The data that is mastered may include reference data - the set of permissible values, and the analytical data that supports decision making. https://en.wikipedia.org/wiki/Master_data_management
- 7. What are thechallenges to solve? • Master data in many different systems • Different versions of data co-exists • Duplicate data in one or many system across the organization • Different business rules and validation for same type of data Inaccurate reporting causes bad decision making via BI
- 8. SQL Server Services DatabaseEngine - Hosting Database SSAS - Analysis Service SSIS - Extract, Transform and Load SSRS - Reporting Engine ML Services - Machine Learning Services for R and Python DQS - Data Quality Management MDS - Master Data Management https://docs.microsoft.com/en-us/sql/sql-server/sql-server-technical-documentation?view=sql-server-ver15
- 9. History • Since SQLServer 2008 R2 • Improve features in SQL 2012 • Not much change in SQL 2014 • What’s new in SQL 2016 • What’s new in SQL 2017 • SQL Server 2019 - No Silverlight 10+ years product
- 10.
- 11. Master Data Manager ExcelAdd-in MDS Repository MDS Architecture Browser Notification Other system DQS
- 12. Master Data ServiceRepository • SQL Server to host MDS repository • Enterprise Edition/Developer Edition (please check latest info after GA) • Single Database • MDS system objects • User define objects https://docs.microsoft.com/en-us/sql/master-data-services/install- windows/create-a-master-data-services-database?view=sql-server-ver15
- 13. Master Data Manager(Web App) • ASP.NET Web Application (no Silverlight since SQL 2019) • IIS required • Explorer • System Administration • Integration Management • Version Management • Excel Add-in • User/Group management https://docs.microsoft.com/en-us/sql/master-data- services/install-windows/create-a-master-data-manager-web- application-master-data-services?view=sql-server-ver15
- 14. Master Data ManagerExcel Add-in • Master data CRUD operation • Create master list • Apply Business Rules • Batch operation • Offline • Support connecting to multiple MDS • Conflict resolution • Work with DQS https://docs.microsoft.com/en-us/sql/master-data-services/microsoft-excel-add- in/overview-exporting-data-to-excel-mds-add-in-for-excel?view=sql-server-ver15
- 15. Database Mail Profile •SQL Server Database Mail Profile • SMTP server required https://docs.microsoft.com/en-us/sql/master-data-services/create-database- mail-profile-and-account-dialog-box?view=sql-server-ver15
- 16. Master Data ServicesConfiguration Manage • MDS Repository Configuration • Web Configuration • DQS Integration
- 17.
- 18. MDS Development • MDSobjects • Models • Entities • Attributes/Attribute Groups • Indexes • Relationship, etc. • Creating Business Rules • Changeset • Manipulate data
- 19. Developing Models • Amodel has entities (tables) • An entity has attributes (fields) • Transaction Log type • Member – Change logs as history • None – No change logging • Compression • Approval • Code and name required attributes • Code : Unique value • Name : Description of the member Model Entities Attributes https://docs.microsoft.com/en-us/sql/master-data- services/models-master-data-services?view=sql-server-ver15 https://docs.microsoft.com/en-us/sql/master-data- services/entities-master-data-services?view=sql-server-ver15
- 20. Attribute • Free-form • Text,Numbers, Dates or Links • File • File, document, images • Domain Based Attribute • Specific set of values (Lookup) • Filter for hierarchy https://docs.microsoft.com/en-us/sql/master-data- services/attributes-master-data-services?view=sql-server-ver15
- 21. Indexes • Auto indexcreation for Code attribute • Unique Index • Non-unique indexes • Non-clustered Index at SQL level https://docs.microsoft.com/en-us/sql/master-data- services/custom-index-master-data-services?view=sql-server-ver15
- 22. Hierarchy • Explicit Hierarchies(Same Entity) • Mandatory Explicit Hierarchy • Non-Mandatory Explicit Hierarchy • Derived Hierarchies (Different Entity) • 1:N • N:N https://docs.microsoft.com/en-us/sql/master-data- services/hierarchies-master-data-services?view=sql-server-ver15
- 23. Creating Business Rules •Enforce business logic to member • Multiple business rules per attribute • Variety of options • Order matters • Notification • Custom Business Rule (extension) • User defined function for condition in usr schema • Stored procedure for action in usr schema https://docs.microsoft.com/en-us/sql/master-data-services/business-rules- master-data-services?view=sql-server-ver15
- 24. Custom Business Rules Userdefined function • Return BIT (1:true 0:false) • Take 1 input - NVarchar, Datetime2, Decimal (38/0-7) Stored procedure • Table input parameter: @MemberIdList • NVarchar input parameters: @ModelName, @VersionName, @EntityName, @BusinessRuleName https://docs.microsoft.com/en-us/sql/master-data-services/business-rules- extension-master-data-services?view=sql-server-ver15
- 25.
- 26.
- 27. Explorer • Entities • CRUDmember, Filter, Apply rules, Export to excel, history • Entity Dependencies • Hierarchies • Collections • Changesets https://docs.microsoft.com/en-us/sql/master-data-services/explorer- functional-area-master-data-manager?view=sql-server-ver15
- 28. Changeset • Approval Required •Entity level settings • Entity Admin can approve/reject • Local user change • Stage for change • Commit to reflect change
- 29. Versioning • Open • Anyonecan edit • Lock • Only admin can edit • Validate • Run validation • Commit • Cannot change anymore • Copy • Create new version
- 30. Entity Sync Synchronize datafrom source to target in different models • Sync Job as SQL Agent job • One time • On-demand • Schedule • Target limitation • Target model needs to be open status • Target entity will be locked • No business rule • Domain base attribute will be skipped
- 31. Excel Add-in • Mostfeatures are same as Data Management Web • Query • Merge Conflict • Settings • Combine Data & Data Quality https://docs.microsoft.com/en-us/sql/master-data-services/microsoft-excel-add- in/overview-exporting-data-to-excel-mds-add-in-for-excel?view=sql-server-ver15
- 32.
- 33.
- 34. Create View • SubscriptionView • mdm schema • Version Option • Data Source • Format • Leaf • History • SCD Type 2 • Vertical and horizontal filters • Use created view to consume data
- 35. Staging table • Stagingtable for each entity • stg schema • Import Type • 1: Create new members 2: Create new members. Replace existing MDS data with staged data. 3: Deactivate the member, based on the Code value. 4: Permanently delete the member, based on the Code value. • Staging Stored Procedure • stg.udp_<name>_Leaf • stg.udp_<name>_Consolidated • stg.udp_<name>_Relationship https://docs.microsoft.com/en-us/sql/master-data-services/staging- stored-procedure-master-data-services?view=sql-server-ver15
- 36.
- 37.
- 38. Model Deployment • MasterData Manager • Package Model without data • Deploy Model without data • MDSModelDeploy • Package Model with/without data • Deploy Model with/without data • ModelPackageEditor • Edit package
- 39.
- 40. Configuring MDS • MasterData Configuration Manager • MDS Repositories • MDS Management portal • DQS integration
- 41. Securing MDS • ADor local user • AD or local group • Role base security • Permissions • Grant permission • Deny permission • Granular settings • Model level • Entity level • Attribute level • Member level System Admin MDS Admin Model Admin Data Admin Consumer
- 42.
- 43. References edX : Creatinga Master Data Solution with SQL Server Master Data Services (MDS) * SQL Server 2016 https://courses.edx.org/courses/course-v1:Microsoft+DAT226x+3T2018 Microsoft Ignite New Zealand 2015 End to End SQL Server Master Data Services * SQL Server 2012 https://www.youtube.com/watch?v=ghChzpt_-FY&t=2862s
- 44.
- 45.