Successfully reported this slideshow.

Wp mdm-tech-overview


Published on

  • Be the first to comment

  • Be the first to like this

Wp mdm-tech-overview

  1. 1. Managing Master Data with Kalido ®Master Data Management ™A Technical OverviewCopyright © Kalido 2012 1
  2. 2. Executive SummaryMaster data management (MDM) is a discipline that continues to gain momentum in organizations globally. This is due to theneed for accurate data used in both operational and analytical operations of the business. Use cases where MDM is criticalinclude data harmonization for analytics, data harmonization for operations, hierarchy management for business intelligence(BI), operational data governance, systems migration and consolidation, and enterprise-wide MDM.To optimize and gain insight into corporate performance, companies make major investments in operational systems tomanage their business processes, and in analytical systems to analyze business transactions in aggregate. The contextfor these processes and transactions—master data—includes information about products, customers, suppliers, regions,employees, charts of accounts, key performance indicators, brands and more. Organizations could literally have hundreds ofdifferent types, or domains, of master data used to run and manage the business.Master data is often duplicated and managed in multiple systems. Poor master data used in operational business processescan lead to unfavorable business operating results and performance. Poor master data in Business Intelligence results ininaccurate views of corporate performance leading to millions of dollars in lost sales and cost savings opportunities annually.These problems are most acute in enterprises which regularly undergo mergers and acquisitions; which introduce, retire, buyand sell product lines; that open and close locations; and that operate under different and changing regulatory environmentsacross corporate divisions or geographic regions. This can make it nearly impossible to gain consolidated views of enterpriseperformance.The issue of managing master data is getting greater visibility due to pressure to increase corporate transparency, datagovernance, accountability, and performance on an enterprise-wide basis.This white paper describes implementing a master data management solution using Kalido® Master Data Management™,an MDM application which is available standalone and as part of the Kalido Information Engine. Kalido MDM is a workflow-driven, web-based application that enables business people to collaboratively define, consolidate, authorize, publish, governand maintain master data. Once you have developed a repository of clean and accurate master data, you can use that data tomake business processes more consistent, and analytics more accurate, and make it available to business users across yourorganization so they have access to the clean information they need to do their jobs.Copyright © Kalido 2012 2
  3. 3. Master Data Management OverviewMaster data (or reference data) represents a company’s business vocabulary—the business entities, terminology, definitionsand classifications used to describe business information. Master data provides the context for recording transaction data—facts about events in the business.Consider the following transaction:Sales rep Laurie Murphy sold 100 8 foot cherry dining tables to Rochester Furniture on May 29 for $45,000 at a profit of$15,000.Data collected from this transaction description has many different uses:Here’s how this translates into a requirements breakdown by a business analyst:The context for this transaction—the master data—includes who made the sale, what was sold, when it was sold and to whom.For accuracy in the business process of collecting this order, it is important to get the information about the product correct forinventory management reasons and accurate address information for shipping reasons, etc. And, if you lack an accurate list ofsales reps, products, time periods and customers it is impossible to accurately analyze sales performance and profitability bycustomer, by product and by sales territory.This is a hierarchical representation as seen by an architect:Copyright © Kalido 2012 3
  4. 4. Further, there are a number of other considerations related to the master data: what system – or systems – is this data storedin? What business rule determines “profit”? How is this data used in other downstream systems such as data warehouses,data marts and business intelligence tools?Master data inconsistencies can cause other problems: • Operational silos where divisions within an enterprise have different nomenclature, definitions and visibility into the business This results in misunderstandings, operational inefficiencies, weaker customer service, channel conflict and other margin- and agility-lowering effects • Inconsistent customer, supplier and product IDs across operational systems make it impossible to get a “single view” of customer and supplier relations or product performance on a global basis • 50% of enterprises surveyed maintain master data separately in 11 or more source systems • 50% of enterprises surveyed consider master data management to be a high or top priority • Over 80% of enterprises surveyed plan on centralizing master data managementAs a result, your organization could lose millions annually due to lost cross-sell and upsell opportunities to a single customer,or repeatedly manufacturing and selling unprofitable products. The real benefit of master data management is better data toimprove business outcomes.Copyright © Kalido 2012 4
  5. 5. Master Data Management ChallengesManaging enterprise master data is challenging. Consider the following scenario:A global producer of consumer food products wants to analyze profitability trends over the last two years by product, channel,customer, brand and region.Challenge #1: Master data required for this analysis (products, customers) is duplicated in multiple operational systems (CRM,ERP, etc.) that run independently in each region. It must be consolidated and inconsistencies must be eliminated.Challenge #2: Some of the master data is outside the scope of operational systems—lists of brands and channels aresupplied by business users, or necessary information comes from third party external systems not under your control.Extending operational systems to support this data enterprise-wide can be prohibitively expensive or simply not possible due tothe inherent restrictions in how some operational systems are constructed or in how the external data is delivered.Challenge #3: Definitions for some master data exist in programming logic (such as spreadsheet functions and datatransformation routines) and are therefore inaccessible to users and systems—this needs to be available and controlled bybusiness people.Challenge #4: The accuracy of this company’s profit analysis depends on associations between customers and channels,channels and regions, products and brands, etc. being correct. Master data is inter-related and hierarchical; referential integritymust be validated.Challenge #5: Business users must be integrated into the master data management process—they are best equipped toreconcile data inconsistencies, contribute missing data, ensure the validity of the data, authorize its use and maintain its validitythroughout its lifecycle.Challenge #6: Analyzing historic trends is difficult—customers merge, products are discontinued, etc., but the operationalsystems from which master data is sourced reflect the present. Historic master data views must be maintained to support trendanalysis and audits.Challenge #7: Different “views” of master data must co-exist to support different business functions. A solution must captureand map between the different master data views. Customer Success Story A consumer packaged goods company is managing hundreds of thousands of customer, supplier, financial, product and other master data items in Kalido MDM. Business data experts at the head office author and define central views of the data (including business definitions), and coworkers in other countries map their domestic views of the data into Kalido MDM to facilitate BI reporting and information exchange across divisions. The information is accessible to employees via a corporate intranet to help everyone gain greater visibility into the business.Copyright © Kalido 2012 5
  6. 6. Challenge #8: Once master data is prepared, it must be transferable, in whole or in part, to support the organization’snecessary business processes. These processes can include facilitating business analyses via a data warehouse and intransaction systems for greater operational consistency across all facets of the business: supply chain, financial, humanresources, customer relationship management and others.Challenge #9: Master data is as important to people as to systems—it should be accessible throughout the enterprise toincrease corporate transparency and help everyone understand far-reaching customer relationship implications and marketpresence of brands, etc. for efficient operational execution and reporting. Customer Success Story An international brewing company increased business transparency and operational efficiency across its brand companies by publishing 3,000 business policy and metric definitions, along with customer, product and market master data to employees via Kalido MDM.Based on common scenarios and challenges like those above, Global 2000 companies are discovering that an ideal masterdata management solution must deliver the following capabilities: • Manage all types/domains of master data • Ensure relationships between master data domains can be created and managed • Provide environment for central authoring and managing custom master data domains and entities • Manage master data through its life stages and all validation processes • Match and harmonize incoming master data from multiple sources • Model and maintain simple and complex hierarchies for reporting and analysis • Provide a simple interface for business users to use clean master data • Automate and drive the data stewardship process when people need to make decisions • Handle changes in structure with changing requirements, keeping an historical record • Provide a secure environment with an audit trail for the full lifecycle of dataKalido MDM meets these requirements, enabling companies to create a central master data repository where business andtechnical users collaboratively control, enrich and authorize master data to ensure consistency and semantic validity.Copyright © Kalido 2012 6
  7. 7. Kalido MDM Key Capabilities ®What is Kalido MDM?Kalido MDM is an agile software application for harmonizing, storing, managing and governing master data over time. Itincreases the consistency and accuracy of business processes and corporate performance reporting by enabling businesspeople to collaboratively manage, author and control master data in a workflow-driven environment. It produces a master datarepository from which “golden copy” master data can be distributed to enterprise applications and business people throughoutthe organization.Kalido MDM offers a number of key capabilities which include:Every MDM Domain SupportA large enterprise typically has hundredsof master data categories and Kalido MDMcan manage all of them—from products,customers, brands, markets and territoriesto suppliers, financial data, key performanceindicators and more. Therefore, a keyobjective which customers have come toexpect when evaluating MDM tools is tomanage all types/domains of master data.Many competing MDM solutions excel atmanaging a single domain, such as customeror product, but struggle to handle otherdomains. This is often due to the hard-codednature of those tools’ data model. Kalido’sgeneric data model means there is no inherent bias to overcome when supporting the many different master data typesneeded to drive better information in business processes. Benefits: • A flexible model allows a business to grow without code or software boundaries preventing change, while maintaining a full audit trail of events and history • A single tool can be used for all master data types • Consistency as domains are added • Easier for IT to support and maintain, instead of different tools used for each different domainCopyright © Kalido 2012 7
  8. 8. Sophisticated ModelingAs master data domains are added to anMDM repository, the number and complexity ofrelationships between the data grow exponentially.A key objective is to ensure relationshipsbetween master data domains can be createdand managed. Kalido offers a visual masterdata modeling capability that supports complexmodeling concepts such as supertyping andsubtyping which makes it possible to supportinheritance of attributes of a supertype among itssubtypes. These MDM models can be createddirectly in the Kalido Business InformationModeler, or can be imported into the Modeler fromexisting models and taxonomies. Kalido’s businessinformation model allows IT and business usersto define and manage the business rules andvalidation rules to ensure that master data is fitfor use in the business processes it supports. Additionally, the modelis easily accessible, and understandable, by both IT and non-technicalbusiness users. Benefits: • Easily handles the many complex data relationships and entities • Common understanding between IT and line of business end usersMaster Data AuthoringUnfortunately, not all data that is required for some business processes can be authored in an operational system. Additionally,it is often desirable to provide a central place to author or propose new master data – new customer records, new products,etc. – and distribute it to operational systems, especially in a heterogeneous systems landscape with different fields foreach piece of master data used across systems.The objective of data authoring is to provide anenvironment for managing custom master datadomains and entities. Kalido offers a model-driven, automatically generated user interface forauthoring data. Instead of custom screen codingand development, Kalido MDM populates screensbased on the context of the task, and validation ofauthored data is driven by the model, so you can besure that the new master data elements match therequirements. Benefits: • Enhanced data integrity when creating new master data records with data matching to ensure quality • Increased flexibility and fully exposed API • Support for user-specific requirementsCopyright © Kalido 2012 8
  9. 9. Life Cycle ManagementA piece of master data goes through many steps over time. The concept of life cycle management refers to managing masterdata through its life stages and all validation processes. Kalido MDM provides a single environment to author, load, match,validate, publish, change and archive master data. To accomplish this, and still keep the business processes running, Kalidoseparates master data into “work in progress” (WIP) and “published” contexts. If a piece of master data needs to change, thatchange is handled as WIP and only makes it to published status once the change has been approved. Kalido MDM supportsincremental update based on events for change data capture downstream data consumption. Kalido also keeps a full audit trailfor all changes, and steps through the process, and manages all the human touch-point interaction through the various steps. Benefits: • Single environment facilitates process, reduces tool integration needs • Business processes are insulated from disruption during change management • Separation of roles and responsibilities, ensuring accountabilityData MatchingIt would be ideal if master data was the same across all your systems that run your business processes, but unfortunately itis not. Master data comes from multiple sources, some of which may not be internal to your organization. Therefore a criticalrequirement is to match and harmonize incoming master data from multiple data sources. Kalido meets this need by allowingcustomers to define, test, save and execute complex data matching and mapping rules without writing any code. This capabilityallows you to match different data values across multiple sources to the central master data repository. The matching enginein Kalido MDM accurately finds matches between attributes, even for incomplete or partial similarity. Kalido offers an intuitiveuser interface for creating and previewing match results so stewards can confirm in real time if the match rules are appropriate.Combined with Kalido MDM’s workflow approval with human and system decision thresholds, true matches are automated andmanual review is only required for potential matches. Additionally, Kalido can match any type of data, not just name & address(which is often the case in other matching engines) and offers error-tolerant lookup. Benefits: • Easily manage increasing master data volumes and complexity • Vastly reduced manual effort saves costsCopyright © Kalido 2012 9
  10. 10. Hierarchy ManagementManaging hierarchies is a classic MDM use case. Typically hierarchies are managedin a data warehouse as operational systems don’t accommodate hierarchies, butbusiness users can also require many different views. The objective of this capabilityis to model and maintain the range of simple to very complex hierarchies for reportingand analysis, which will vary across an organization. Kalido MDM supports theserequirements, allowing local to global hierarchy mapping to enable departmental andregional views and allowing the business to manage standard hierarchies as well asvery complex multi-level or “ragged” hierarchies. Hierarchies are easily and visuallydesigned using the Kalido Business Information Modeler or imported from existingtaxonomies which can then be altered and enriched to meet current and changingrequirements. Benefits: • Easily accommodates the most complex aggregations and hierarchies • Allows lines-of-business and subsidiaries to manage and analyze the business to local needsMDM Consumer InterfaceOne of the important facets of master data management is engaging with your subject matter experts who can help make andmaintain clean master data – those who have the context for how master data is used, and who in turn need access to it to dotheir jobs. The objective of the MDM consumer interface is to provide a simple interface for business users to use clean masterdata, and also play a role in its stewardship. The Kalido MDM consumer interface provides a web-based capability to browseenterprise master data using the business information model, intuitive hierarchy browsing, a web search result display forfinding customer records, product records, et al, and an ability to raise a change request when they see something that needsto be updated. Benefits: • Gives business users direct access to the most accurate information they need to do their jobs • Better engagement with MDM consumers in the stewardship processWorkflowWorkflow in MDM is perhaps the most important capability in ensuring a smooth data stewardship process. Some MDMtools don’t support workflow, relying instead on the customer to integrate the MDM tool with an existing workflow engine. Inaddition to requiring on-site integration by the customer, this addsunnecessary expense and adds a new point of failure to an MDMimplementation. Kalido MDM offers embedded workflow to automateand drive and guide the data stewardship process when peopleneed to make decisions. Its flexible, robust built-in workflow routesmaster data validation actions to specific users or groups for humanresolution and approval. It is event-driven and allows you to buildflexible and comprehensive state transition steps. While externalworkflow integration is not required, sometimes it is desirable toinclude external processing before moving to the next step in aworkflow and integration into operation systems for enrichment.Kalido supports user exits via an API to external code modules tosupport these complex workflows. Taken together, the capabilities ofKalido MDM easily manage increasingly complex governance andstewardship processes for delivering accurate and consistent masterdata to your business processes. Benefits: • Automated data stewardship process saves time and effort • Focuses data stewards on only resolving exceptionsCopyright © Kalido 2012 10
  11. 11. WorklistsWorklists in Kalido MDM are used in combination with workflow when you want to process a set of master data subjects as agroup. The subjects are validated, approved, authorized and published as a unit. This is used extensively to process multiplesubjects which gather information from various sources and must be complete before publication. The worklist feature allowsmultiple subjects to move through an enrichment approval process before becoming master data, instead of having to behandled and processed individually. Benefits: • Working on multiple subjects as a group reduces processing time • Fewer workflow tasks required for handling like processesChange ManagementAs your business and business processes evolve, sowill your master data. A key requirement is thereforeto handle changes in master data structure withchanging requirements, keeping an historical recordfor cases where you need historical views. BecauseKalido MDM is model-driven, it can easily changedesign definition as your business evolves. It supportstime-variant capture and management of masterdata values by category, and supports full loggingof changes to not only the model, but also to actualmaster data values. Benefits: • Master data is always up to date with how the business is run and managed • Reduced effort and cost to maintain timely data • Easily audit historical states for more informed changesSecurity & AuditSecurity and audit are of course key requirements of any MDM implementation. For many use cases, a secure environmentwith an audit trail is a critical capability, particularly for any regulatory or statutory compliance use. Kalido supports role-basedsecurity, and the role can be assigned at any level in the data. Users can be managed in LDAP and Active Directory. For datasecurity, Kalido supports object and data-level security using ACLs. For data values, Kalido keeps track of who changed themodel and the data, and when it was changed, as well as history tracking of prior master data values. With this capability,customers have a “corporate memory” of master data as it was at any point in time. Benefits: • Bullet-proof audit trail for compliance tracking • Recreate prior model and master data views for easy historical comparison analysis.Copyright © Kalido 2012 11
  12. 12. Model-Driven API ToolkitOne of the challenges – and goals – of an MDMprogram to not only get the data clean, but also putin place processes to enable the data to stay clean.This means bringing access to MDM functions tothe business applications and business applicationusers. Kalido offers a model-driven toolkit that allowsdelivery of direct integration with existing businessapplications, including an ability to seamlessly callKalido MDM functions from them, and to generatecustom interfaces to facilitate interaction withpublished master data. With “MDM applets” likethis, clients can deploy a mobile application so fieldemployees can easily look up master data whenperforming various business tasks, which may includeproposing changes to master data as well as newmaster data elements such as new customer records.When new records are proposed, all the validationrules and governance processes are automaticallyenforced and tracked. Kalido MDM can now more easily hook into operational systems to deliver a sustained, stay-cleanenvironment. Additionally, this capability expands the participation in the master data governance process by allowing foraudience-specific interfaces that can appear not only in browsers but also mobile devices such as iPads. Benefits: • Expands master data governance participation across the enterprise • Direct integration into business applications Customer Success Story A financial services company governs changes to financial master data such as chart of account codes to ensure accurate statutory reporting and to increase visibility into data lineage. Changes to financial master data are made by users within Kalido MDM (rather than within their various financial systems), and via workflow, the information is passed to others for review and is used to drive automatic updates in financial applications. Central governance gets fast, accurate views of financial performance with less manpower spent on consolidated reporting and without the cost and delay of standardizing accounting nomenclature across the company.Copyright © Kalido 2012 12
  13. 13. Kalido MDM ArchitectureThe Kalido MDM architecture consists of three layers: • the Data layer, where the data sources reside • the Application layer, where the Kalido MDM application is installed and where tasks are run • the Presentation layer, which includes the Web Server, J2EE container and the browserKalido MDM ApplicationKalido MDM is comprised of three modules: • MDM Consumer—a Web application designed for all users who need reliable, up-to-date business information to execute their tasks and projects. It provides read-only access to all published master data. Consumers can easily raise change requests against the data and monitor the progress of the changes. • Kalido MDM—the main Web application where models are defined and deployed and all in-progress master data is stored. Two Contexts facilitate the rapid flow of large volumes of data from source systems through publication to the wide consumer audience. The Contexts represent data that has been published and is visible in the MDM Consumer (Master Context) and data that requires more work (Working Context). • Data Matching Module—a fully integrated module that allows data managers to define, test, save and execute complex data matching and mapping rules. It complements MDM’s workflow‐driven data cleansing system with powerful lookup technology that allows data stewards to overcome content errors and data inconsistencies that impair data quality and slow down typical deploymentsCopyright © Kalido 2012 13
  14. 14. Kalido MDM UsersKalido MDM has three types of user: • Administrators—Often IT workers, they define master data models, security, workflows, worklists, templates and the user interface. • Providers—Business users who collaboratively control, edit, authorize and publish master data within the context of models, workflows and worklists created by an Administrator. • Consumers—Business users who browse, search, and raise issues or change requests on published master data to gain greater visibility into and understanding of the business.Master Data ModelingMaster data models define master data structure, definitions and relationships. Models can be highly conceptual, andcommunicate rich business meaning (which is why master data can be readily browsed by Consumers) • Data can be rapidly loaded into the model from disparate IT systems, even if the incoming data does not rigidly conform to the model. As the data becomes conformant, it can be incrementally published to the Master Context where it is immediately visible to all consumers. • Data that does conform to the model is loaded and published directly into the Master Context • Models can be changed without reloading or reformatting published or in-progress master data already stored in the master data repository. Users are notified of the number of subjects that will become invalid if the modified model is deployed. Upon deployment, invalid subjects are automatically brought back into the Working Context to be enhanced until they are ready for re-publication.Models can be created within Kalido MDM or they can be generated based on models defined within an existing KalidoInformation Engine structure, which is in turn generated from a business model defined with Kalido Business InformationModeler. The data model can be changed at any time. You can also define advanced data models directly via XML and theKalido MDM Services Application Programming Interface (API), which allows you to customize and extend the Kalido MDMsolution using .Net, JAVA, and Web Services.Copyright © Kalido 2012 14
  15. 15. Integrating Kalido MDM with a data warehouseThe Kalido Information Engine includes a capability to build and operate enterprise data warehouses. Driven by businessmodels developed in Kalido Business Information Modeler, it automates tasks such as data warehouse schema design andgeneration, data loading, query definition, data mart generation and more. Thus data warehouses meet new business needsiteratively in days or weeks, not months.Kalido MDM can import model definitions and data created in a Kalido data warehouse, and export data back to it—typicallyafter the master data has been authorized and published.Kalido MDM helps assure consistent, accurate and trustworthy data is available in the Kalido Information Engine for use inbusiness intelligence applications.For non-Kalido warehouses, Kalido MDM can be accessed in many ways to fuel the analytical process through its API whichis exposed as web services, and directly from relational tables. Depending on the business requirement for reporting and adhoc analysis, master data in Kalido MDM can be mined and supplied to meet any analytical questions. Kalido MDM can act asa central place to manage and serve analytical requests for such things as multiple different views on hierarchical roll ups ortime-based MDM data reporting.Managing Master Data in Operational SystemsIn addition to supporting master data for downstream analytical uses, Kalido MDM can be used to fuel upstream operationalsystems. With its robust sophisticated modeling, it can handle multiple different business needs and systems.Once master data is accurate and consistent, Kalido MDM can export master data in CSV, fixed format, or XML for batchupdate or entry into operational systems. Kalido offers a Web services-based API that can be called in real-time from or tooperational systems for checking records against the “golden copy” held in the Kalido MDM repository or to trickle feed asystem with new authored records of master data, also mentioned earlier in this paper.A number of forms based tools such as MS InfoPath, Adobe LifeCycle, and BPM tools are frequently used as part of thisoperational master data management entry. To support this activity, Kalido MDM exposes real time matching capabilities to aidin elevating duplicate entry into the operational system using their internal Master Data as the golden standard for incomingrecords.Copyright © Kalido 2012 15
  16. 16. SummaryKalido MDM is a key data management component of the Kalido Information Engine, and it uniquely enables business peopleto collaboratively define, consolidate, manage, authorize and publish master data in a workflow-driven, web-based environment– without needing to modify operational IT systems.The benefits of managing master data with Kalido MDM and distributing it to enterprise data warehouses and employeeinformation portals include: • Highly accurate and consistent business performance reporting • Greater visibility into the business for more efficient operationsThe benefits are achieved through the unique capabilities of Kalido MDM, which include: • Manages every type of master data – a large enterprise typically has hundreds of master data categories and Kalido MDM can manage all of them – from products and customers to brands, markets, territories and more • Allows business users easy access to published master data so they can raise issues or change requests as necessary • Facilitates data governance – puts business people in control of master data quality in a collaborative, workflow-driven environment • Offers agile and flexible master data modeling via the Kalido Business Information Modeler – featuring powerful cataloging, segmenting, merging and mapping facilities • Loads non-conformant master data – instead of rejecting invalid master data, all master data is loaded even if it doesn’t conform to the master data model. Valid data is published directly to the Master Context while other data is sent to the Working Context for further manipulation. Workflows ensure that the data, or the model, is revised accordingly • Maintains master data history – historic views can be recreated to support audits and historical analysis as master data adapts to business changes over time • Handles time-variance – multiple date values are allowed over time • Allows publication of a set of data as a version – preventing further editing by users • Exchanges master data with other systems such as data warehouses, ERP and other systemsDS-MDMTECH04232012Copyright © Kalido 2012 16