Master Data Management: Extracting Value from Your Most Important Intangible ...FindWhitePapers
This SAP Insight explores the importance of master data and the barriers to achieving sound master data, describes the ideal master data management solution, and explains the value and benefits of effective management of master data.
Master Data Management: Extracting Value from Your Most Important Intangible ...FindWhitePapers
This SAP Insight explores the importance of master data and the barriers to achieving sound master data, describes the ideal master data management solution, and explains the value and benefits of effective management of master data.
Building an Effective & Extensible Data & Analytics Operating ModelCognizant
Building an effective and scalable operating model requires a strong basis in data and analytics management. Creating such an operating model is a step-by-step process, as outlined here.
Master data management (mdm) & plm in context of enterprise product managementTata Consultancy Services
The presentation discusses the classical features and advantages of Master Data Management (MDM) system along with appropriate situations to use it. How do companies apply MDM who design, manufacture and sell their products in several geographies facing challenges in making appropriate decisions on their investment in PLM & MDM space?
Another important aspect covers the comparison/relation between a MDM system (or Product Master System) and Enterprise PLM system. How can you maximize your ROI on both PLM and MDM investments? With examples from different industries the key takeaways include whether your organization requires an MDM solution or not.
Enterprise Information Management Strategy - a proven approachSam Thomsett
Access a proven approach to Enterprise Information Management Strategy - providing a framework for Digital Transformation - by a leader in Information Management Consulting - Entity Group
The Data Governance Annual Conference and International Data Quality Conference in San Diego was very good. I recommend this conference for business and IT persons responsible for data quality and data governenance. There will be a similar event in Orlando, December 2010. This is the presentation I delivered to a grateful audience.
BRIDGING DATA SILOS USING BIG DATA INTEGRATIONijmnct
With cloud computing, cheap storage and technology advancements, an enterprise uses multiple
applications to operate business functions. Applications are not limited to just transactions, customer
service, sales, finance but they also include security, application logs, marketing, engineering, operations,
HR and many more. Each business vertical uses multiple applications which generate a huge amount of
data. On top of that, social media, IoT sensors, SaaS solutions, and mobile applications record exponential
growth in data volume. In almost all enterprises, data silos exist through these applications. These
applications can produce structured, semi-structured, or unstructured data at different velocity and in
different volume. Having all data sources integrated and generating timely insights helps in overall
decision making. With recent development in Big Data Integration, data silos can be managed better and it
can generate tremendous value for enterprises. Big data integration offers flexibility, speed and scalability
for integrating large data sources. It also offers tools to generate analytical insights which can help
stakeholders to make effective decisions. This paper presents the overview on data silos, challenges with
data silos and how big data integration can help to stun them.
In business, master data management is a method used to define and manage the critical data of an organization to provide, with data integration, a single point of reference.
Reference matter data management:
Two categories of structured data :
Master data: is data associated with core business entities such as customer, product, asset, etc.
Transaction data: is the recording of business transactions such as orders in manufacturing, loan and credit card payments in banking, and product sales in retail.
Reference data: is any kind of data that is used solely to categorize other data found in a database, or solely for relating data in a database to information beyond the boundaries of the enterprise .
The opportunity of the business data lakeCapgemini
The Pivotal Business Data Lake is a new way to deliver information for the enterprise based around four simple principles:
- Store everything
- Encourage local
- Govern only the common
- Treat global as a local view
Principles that match the way business works today and now principles that can be delivered efficiently in technology using the Pivotal Business Data Lake and Capgemini's information governance and delivery methods.
Building an Effective & Extensible Data & Analytics Operating ModelCognizant
Building an effective and scalable operating model requires a strong basis in data and analytics management. Creating such an operating model is a step-by-step process, as outlined here.
Master data management (mdm) & plm in context of enterprise product managementTata Consultancy Services
The presentation discusses the classical features and advantages of Master Data Management (MDM) system along with appropriate situations to use it. How do companies apply MDM who design, manufacture and sell their products in several geographies facing challenges in making appropriate decisions on their investment in PLM & MDM space?
Another important aspect covers the comparison/relation between a MDM system (or Product Master System) and Enterprise PLM system. How can you maximize your ROI on both PLM and MDM investments? With examples from different industries the key takeaways include whether your organization requires an MDM solution or not.
Enterprise Information Management Strategy - a proven approachSam Thomsett
Access a proven approach to Enterprise Information Management Strategy - providing a framework for Digital Transformation - by a leader in Information Management Consulting - Entity Group
The Data Governance Annual Conference and International Data Quality Conference in San Diego was very good. I recommend this conference for business and IT persons responsible for data quality and data governenance. There will be a similar event in Orlando, December 2010. This is the presentation I delivered to a grateful audience.
BRIDGING DATA SILOS USING BIG DATA INTEGRATIONijmnct
With cloud computing, cheap storage and technology advancements, an enterprise uses multiple
applications to operate business functions. Applications are not limited to just transactions, customer
service, sales, finance but they also include security, application logs, marketing, engineering, operations,
HR and many more. Each business vertical uses multiple applications which generate a huge amount of
data. On top of that, social media, IoT sensors, SaaS solutions, and mobile applications record exponential
growth in data volume. In almost all enterprises, data silos exist through these applications. These
applications can produce structured, semi-structured, or unstructured data at different velocity and in
different volume. Having all data sources integrated and generating timely insights helps in overall
decision making. With recent development in Big Data Integration, data silos can be managed better and it
can generate tremendous value for enterprises. Big data integration offers flexibility, speed and scalability
for integrating large data sources. It also offers tools to generate analytical insights which can help
stakeholders to make effective decisions. This paper presents the overview on data silos, challenges with
data silos and how big data integration can help to stun them.
In business, master data management is a method used to define and manage the critical data of an organization to provide, with data integration, a single point of reference.
Reference matter data management:
Two categories of structured data :
Master data: is data associated with core business entities such as customer, product, asset, etc.
Transaction data: is the recording of business transactions such as orders in manufacturing, loan and credit card payments in banking, and product sales in retail.
Reference data: is any kind of data that is used solely to categorize other data found in a database, or solely for relating data in a database to information beyond the boundaries of the enterprise .
The opportunity of the business data lakeCapgemini
The Pivotal Business Data Lake is a new way to deliver information for the enterprise based around four simple principles:
- Store everything
- Encourage local
- Govern only the common
- Treat global as a local view
Principles that match the way business works today and now principles that can be delivered efficiently in technology using the Pivotal Business Data Lake and Capgemini's information governance and delivery methods.
Running head Database and Data Warehousing design1Database and.docxhealdkathaleen
Running head: Database and Data Warehousing design 1
Database and Data Warehousing Design 3
Database and Data Warehousing Design
Thien Thai
CIS599
Professor Wade M. Poole
Strayer University
Feb 20, 2020
Database and Data Warehousing Design
Introduction
Technology has highly revolutionized the world of business –hence presenting more challenges and opportunities for businesses. Companies which fail to embrace and incorporate technology in their operations risks being edged out of the market due to stiff competition witnessed in the market today. On the flipside, cloud-based technology allows businesses to “easily retrieve and store valuable data about their customers, products, and employees.” Data is an important component that help to support core business decisions. In today’s highly competitive and constantly evolving business world, embracing cloud-based technology business managers an opportunity to make informed and result-oriented decisions regarding day-to-day organizational operations (Dimitriu & Matei, 2015).
Notably, business growth and competitiveness depends on its ability to transform data into information. Data warehousing and adoption of relational databases are some of cloud-based technologies which have positively impacted on businesses. The two technologies have had a strategic value to companies –helping them to have the extra edge over their competitors. Both data warehousing and relational databases help businesses to “take smart decisions in a smarter manner.” However, failure to adopt these cloud-based technologies has hindered business executives’ ability to make experienced-based and fact-based decisions which are vital to business survival. Both “databases and data warehouses are relational data systems” which serve different and equally crucial roles within an organization. For instance, data warehousing helps to support management decisions while relational databases help to perform ongoing business transactions in real-time. Basically, embracing cloud-based technologies within the organization will help to give the company a competitive advantage in the market. However, the adoption and maintenance of such technologies require full support and endorsement of the business management. Organizational management must understand the feasibility, functionality, and the importance of embracing such technologies. Movement towards relational databases and data warehousing requires a lot of funding –hence the need to convince the management to support and fund them. This paper seeks to explore the concepts of data warehousing, relational databases, their importance to the business, as whey as their design.
“Importance of Data Warehousing and Relational Databases”
Today, technology has changed the market landscape. Business are striving to adopt cloud-based technology in order to improve efficiency in business functions –among them analytical queries as well as transactional operations. Both relational databases a ...
Running head Database and Data Warehousing design1Database and.docxtodd271
Running head: Database and Data Warehousing design 1
Database and Data Warehousing Design 3
Database and Data Warehousing Design
Thien Thai
CIS599
Professor Wade M. Poole
Strayer University
Feb 20, 2020
Database and Data Warehousing Design
Introduction
Technology has highly revolutionized the world of business –hence presenting more challenges and opportunities for businesses. Companies which fail to embrace and incorporate technology in their operations risks being edged out of the market due to stiff competition witnessed in the market today. On the flipside, cloud-based technology allows businesses to “easily retrieve and store valuable data about their customers, products, and employees.” Data is an important component that help to support core business decisions. In today’s highly competitive and constantly evolving business world, embracing cloud-based technology business managers an opportunity to make informed and result-oriented decisions regarding day-to-day organizational operations (Dimitriu & Matei, 2015).
Notably, business growth and competitiveness depends on its ability to transform data into information. Data warehousing and adoption of relational databases are some of cloud-based technologies which have positively impacted on businesses. The two technologies have had a strategic value to companies –helping them to have the extra edge over their competitors. Both data warehousing and relational databases help businesses to “take smart decisions in a smarter manner.” However, failure to adopt these cloud-based technologies has hindered business executives’ ability to make experienced-based and fact-based decisions which are vital to business survival. Both “databases and data warehouses are relational data systems” which serve different and equally crucial roles within an organization. For instance, data warehousing helps to support management decisions while relational databases help to perform ongoing business transactions in real-time. Basically, embracing cloud-based technologies within the organization will help to give the company a competitive advantage in the market. However, the adoption and maintenance of such technologies require full support and endorsement of the business management. Organizational management must understand the feasibility, functionality, and the importance of embracing such technologies. Movement towards relational databases and data warehousing requires a lot of funding –hence the need to convince the management to support and fund them. This paper seeks to explore the concepts of data warehousing, relational databases, their importance to the business, as whey as their design.
“Importance of Data Warehousing and Relational Databases”
Today, technology has changed the market landscape. Business are striving to adopt cloud-based technology in order to improve efficiency in business functions –among them analytical queries as well as transactional operations. Both relational databases a.
The data management procedure employed by your firm is capable of building your brand or breaking it all over. So, be wise in choosing the right strategy.
Business Intelligence (BI): Your Home Care Agency Guide to Reporting & InsightsAlayaCare
This 15-page document will inspire and guide you through WHAT business intelligence (BI) is, and WHY data analytics should be top of mind for your home care agency. Furthermore, this guide will help you answer HOW you know it’s time to consider looking into a BI tool, while providing you with a few tips and tricks to get started.
This paper presents an overview of best practices and techniques for enabling data discovery at an enterprise scale. The paper is based on real world experience implementing this type of solutions for Global 2000 companies.
The New Enterprise Blueprint featuring the Gartner Magic QuadrantLindaWatson19
Read how Solix Big Data Suite manages the entire data lifecycle without sacrificing governance, compliance, or performance. This newsletter can help you start the enterprise Hadoop journey without having to choose between operational efficiency and BI.
Learn the basics of business intelligence, including common terms, how to implement solutions, and what it can do for your company. For even more insight into how project management can benefit your work, visit: http://bit.ly/GuideToBI
To find a custom business intelligence solution that fits the specific needs of your work, visit: http://bit.ly/GetBI1
Booz Allen Hamilton uses its Cloud Analytics Reference Architecture to build technology infrastructures that can withstand the weight of massive datasets – and deliver the deep insights organizations need to drive innovation.
Data analytics can immensely impact and improve a business’s decision-making processes. From better strategies to profits, explore the full scope of analytics.
Similar to Data Integration: Creating a Trustworthy Data Foundation for Business Intelligence (20)
The state of privacy and data security complianceFindWhitePapers
With new privacy and data security regulations increasing, organizations are asking questions. Do the new regulations help or hinder the ability to protect sensitive and confidential information? With these new regulations on the march, how can you remain competitive in the global marketplace? This report provides answers and examines how compliance efforts can impact a company's bottom line.
Is your data at risk? Why physical security is insufficient for laptop computersFindWhitePapers
Evaluating the various data security options to protect your PCs can be challenging. This paper examines the options, discusses why passwords alone are not sufficient and makes the case for strong data encryption.
Closing the gaps in enterprise data security: A model for 360 degrees protectionFindWhitePapers
This paper examines the primary data threats that currently concern chief security officers (CSOs) and IT security management within enterprises, and recommends best-practice techniques to minimize and overcome risks to data security. These best practices have been successfully implemented and deployed in organizations worldwide as components of a holistic data security strategy.
Buyers Guide to Endpoint Protection PlatformsFindWhitePapers
Traditional markets for dedicated endpoint security products have been eclipsed by endpoint protection platforms. The Evolution of Endpoint Security featuring the Buyers Guide to Endpoint Protection Platforms explores how the traditional methods for endpoint security should evolve. In it, you'll learn how the lack of data protection can affect your bottom line and gain insight into the true costs involved in migrating and managing an endpoint security product. Finally, learn how Sophos's acquisition of Utimaco affects the security and data protection market.
VMware DRS: Why You Still Need Assured Application Delivery and Application D...FindWhitePapers
VMware Infrastructure products provide the next generation virtual platform for the new data center, but they don't virtualize the network or application delivery. F5 BIG-IP LTM works with VMware to provide truly virtualized Application Delivery Networking.
The ROI of Application Delivery Controllers in Traditional and Virtualized En...FindWhitePapers
How modern offload technologies in Application Delivery Controllers can drastically reduce expenses in traditional and virtualized architectures, with a fast ROI. In the following pages we won't show you how to determine if there is a compelling ROI case for Application Delivery Controllers, but how to determine how much of a compelling case there really is.
The continued expansion of file-based, business-critical information within extended enterprises is changing the storage dynamic in a wide range of industries and organizations. In a series of interviews with U.S. and European enterprises, IDC found that companies are increasing their file-based storage by 40% to 120% a year and place a high priority on boosting the efficiency and reliability of their management processes for file-based information. IDC research indicates that unstructured, filebased data drove a majority of new storage capacity in all organizations' datacenters in 2008 and projects this growth to accelerate, in spite of current economic conditions. By 2012, over 75% of new storage capacity shipped will be dedicated to the storage, organization, and protection of files.
Both business and technical stakeholders will find value and a broad range of uses for the highly accurate data available from a trusted third-party geolocation provider, especially when the data is integrated into a Unified Application and Data Delivery platform.
DNSSEC: The Antidote to DNS Cache Poisoning and Other DNS AttacksFindWhitePapers
Domain Name System (DNS) provides one of the most basic but critical functions on the Internet. If DNS isn't working, then your business likely isn't either. Secure your business and web presence with Domain Name System Security Extensions (DNSSEC).
Lean Business Intelligence - How and Why Organizations Are Moving to Self-Ser...FindWhitePapers
Learn why and how enterprises are moving to self-service business intelligence (BI). Find out how to get the right data now, while maintaining information quality and operational security. By reviewing requirements and specific use cases for a controlled self-service BI application, Forrester identifies five key findings that can transform your business.
Inventory Optimization: A Technique for Improving Operational-Inventory TargetsFindWhitePapers
This white paper will help SAP customers understand how to gain better visibility into demand, enabling planners to modify inventory to reduce carrying costs without negatively impacting customer-service levels and sacrificing product availability.
Improving Organizational Performance Through Pervasive Business IntelligenceFindWhitePapers
Explore the growing body of evidence suggesting a direct link between investment in business analytics solutions and organizational performance. This white paper highlights market trends that point toward more pervasive use of BI solutions. The recommendations presented are based on ongoing IDC coverage of the BI and analytics solutions market.
IDC Energy Insights - Enterprise Risk ManagementFindWhitePapers
Operational risk management is a rising priority for companies in asset-intensive industry segments. Disparate and disconnected efforts in safety, environmental compliance, and asset utilization at the individual facility are converging to provide better enterprise-wide control and management accountability. Companies that make substantial efforts today will not only improve risk mitigation but create an enduring competitive advantage.
How to Use Technology to Support the Lean EnterpriseFindWhitePapers
This SAP Executive Insight addresses the following questions: . What is the Lean enterprise? . What impact do Lean initiatives have on profitability? . What role does IT play in enabling Lean initiatives? . How is technology connected to the success of Lean initiatives?
Learn what is driving manufacturers to focus on creating more efficient manufacturing operations and which manufacturers are most successful in achieving these efficiency gains.
Enterprise Knowledge Workers: Understanding Risks and OpportunitiesFindWhitePapers
Examine the nature of collaboration-intensive knowledge work, challenges posed by IT, and related costs. Enterprise workers need easier access to information across disciplines and functions, better contextual information, collaboration tools, and automated provisions to protect data integrity and security.
Enterprise Information Management: In Support of Operational, Analytic, and G...FindWhitePapers
Your information can be one of your greatest assets - helping you stay on top of regulatory requirements, close to customers, and ahead of the competition. Organizations that pay attention to their data will be the ones to survive and thrive. So how do you obtain a complete view of your information when it is scattered across silos? Or integrate data from structured and unstructured data sources? Or help reduce the risk of inaccurate reporting? And how do you manage your information more effectively to help keep costs from spiraling out of control?
Enabling Strategy and Innovation: Achieving Optimized Outcomes from Planning ...FindWhitePapers
Read this study of Calearo Antennae Spa and Royal DSM, N.V., two companies that demonstrate how excellence in operations and a clear use of information technology can lead to sustained competitive advantage. (Louisiana State University)
Data Quality Strategy: A Step-by-Step ApproachFindWhitePapers
Learn about the importance of having a data quality strategy and setting the overall goals. The six factors of data are also explained in detail and how to tie it together for implementation.
Data Migration: A White Paper by Bloor ResearchFindWhitePapers
This paper is about using information management software from Business Objects, an SAP company, for SAP data migration projects, either for upgrades from one version of SAP to a newer one, or from other environments to SAP. In practice, many of the considerations that apply to SAP data migrations are no different from those that pertain generally to non-SAP environments.
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challengesHolger Mueller
Holger Mueller of Constellation Research shares his key takeaways from SAP's Sapphire confernece, held in Orlando, June 3rd till 5th 2024, in the Orange Convention Center.
Implicitly or explicitly all competing businesses employ a strategy to select a mix
of marketing resources. Formulating such competitive strategies fundamentally
involves recognizing relationships between elements of the marketing mix (e.g.,
price and product quality), as well as assessing competitive and market conditions
(i.e., industry structure in the language of economics).
Affordable Stationery Printing Services in Jaipur | Navpack n PrintNavpack & Print
Looking for professional printing services in Jaipur? Navpack n Print offers high-quality and affordable stationery printing for all your business needs. Stand out with custom stationery designs and fast turnaround times. Contact us today for a quote!
Recruiting in the Digital Age: A Social Media MasterclassLuanWise
In this masterclass, presented at the Global HR Summit on 5th June 2024, Luan Wise explored the essential features of social media platforms that support talent acquisition, including LinkedIn, Facebook, Instagram, X (formerly Twitter) and TikTok.
LA HUG - Video Testimonials with Chynna Morgan - June 2024Lital Barkan
Have you ever heard that user-generated content or video testimonials can take your brand to the next level? We will explore how you can effectively use video testimonials to leverage and boost your sales, content strategy, and increase your CRM data.🤯
We will dig deeper into:
1. How to capture video testimonials that convert from your audience 🎥
2. How to leverage your testimonials to boost your sales 💲
3. How you can capture more CRM data to understand your audience better through video testimonials. 📊
Kseniya Leshchenko: Shared development support service model as the way to ma...Lviv Startup Club
Kseniya Leshchenko: Shared development support service model as the way to make small projects with small budgets profitable for the company (UA)
Kyiv PMDay 2024 Summer
Website – www.pmday.org
Youtube – https://www.youtube.com/startuplviv
FB – https://www.facebook.com/pmdayconference
[Note: This is a partial preview. To download this presentation, visit:
https://www.oeconsulting.com.sg/training-presentations]
Sustainability has become an increasingly critical topic as the world recognizes the need to protect our planet and its resources for future generations. Sustainability means meeting our current needs without compromising the ability of future generations to meet theirs. It involves long-term planning and consideration of the consequences of our actions. The goal is to create strategies that ensure the long-term viability of People, Planet, and Profit.
Leading companies such as Nike, Toyota, and Siemens are prioritizing sustainable innovation in their business models, setting an example for others to follow. In this Sustainability training presentation, you will learn key concepts, principles, and practices of sustainability applicable across industries. This training aims to create awareness and educate employees, senior executives, consultants, and other key stakeholders, including investors, policymakers, and supply chain partners, on the importance and implementation of sustainability.
LEARNING OBJECTIVES
1. Develop a comprehensive understanding of the fundamental principles and concepts that form the foundation of sustainability within corporate environments.
2. Explore the sustainability implementation model, focusing on effective measures and reporting strategies to track and communicate sustainability efforts.
3. Identify and define best practices and critical success factors essential for achieving sustainability goals within organizations.
CONTENTS
1. Introduction and Key Concepts of Sustainability
2. Principles and Practices of Sustainability
3. Measures and Reporting in Sustainability
4. Sustainability Implementation & Best Practices
To download the complete presentation, visit: https://www.oeconsulting.com.sg/training-presentations
Buy Verified PayPal Account | Buy Google 5 Star Reviewsusawebmarket
Buy Verified PayPal Account
Looking to buy verified PayPal accounts? Discover 7 expert tips for safely purchasing a verified PayPal account in 2024. Ensure security and reliability for your transactions.
PayPal Services Features-
🟢 Email Access
🟢 Bank Added
🟢 Card Verified
🟢 Full SSN Provided
🟢 Phone Number Access
🟢 Driving License Copy
🟢 Fasted Delivery
Client Satisfaction is Our First priority. Our services is very appropriate to buy. We assume that the first-rate way to purchase our offerings is to order on the website. If you have any worry in our cooperation usually You can order us on Skype or Telegram.
24/7 Hours Reply/Please Contact
usawebmarketEmail: support@usawebmarket.com
Skype: usawebmarket
Telegram: @usawebmarket
WhatsApp: +1(218) 203-5951
USA WEB MARKET is the Best Verified PayPal, Payoneer, Cash App, Skrill, Neteller, Stripe Account and SEO, SMM Service provider.100%Satisfection granted.100% replacement Granted.
Buy Verified PayPal Account | Buy Google 5 Star Reviews
Data Integration: Creating a Trustworthy Data Foundation for Business Intelligence
1. WHITE PAPER
DAtA iNtEGrAtiON:
Creating a Trustworthy Data Foundation for Business Intelligence
CONTENTS ExECutivE SummAry
1 Executive Summary
To make sound decisions and comply with governmental reporting
2 Introduction
3 Why Is Data Integration So Important? requirements, an organization must first establish a solid data foundation.
4 Approaches for Integrating Data This foundation must combine historical data with current values from
7 Warning Signs: Does Your operational systems in order to provide a single version of the truth that can
Organization Suffer from be then used to identify trends and predict future outcomes. Data integration
Poor Data?
technology is the key to consolidating this data and delivering an information
9 The Benefits of Data Integration
14 Approaches to Implementing a infrastructure that will meet strategic business intelligence (BI) initiatives
Data Integration Solution and tactical and governmental reporting requirements. Data integration is
20 Conclusion the enabling technology for providing trustworthy information, enhancing IT
21 Appendix and end-user productivity, and helping organizations achieve and maintain a
23 About MAS Strategies
competitive edge. Data integration enables mid-size and large organizations
24 About Business Objects,
an SAP company to effectively and efficiently leverage their data resources in order to satisfy
their analysis and reporting requirements.
While a homegrown data integration effort frequently yields a quick and dirty
solution that may initially appear inexpensive, any upfront savings are often
soon lost as demands on resources and personnel change. Vendor-supported
packaged solutions, on the other hand, have withstood the test of time. Since
they include capabilities such as metadata integration, ongoing updates
and maintenance, access to a wider variety of data sources and types, and
design and debugging options rarely offered by in-house solutions, they
serve to increase the productivity of the IT organization. This is an important
advantage as few organizations have unlimited resources and most are under
constant pressure to do more with less. Additionally, most homegrown data
integration solutions are almost never integrated with an organization’s BI
tools. Such integration is, however, available with commercial offerings either
by adherence to industry standards and/or through integration with the BI
tools in the data integration vendor’s total product portfolio.
This white paper from Business Objects, an SAP company, discusses the
importance of data integration and help you identify the key challenges of
integrating data. It also provides you with an overview of data warehousing
and its variations, as well as summarizes the benefits and approaches to
integrating data.
Author: MAS Strategies
Contributors: MaryLouise Meckler, David Nguyen, Philip On
Audience: Report developers, data warehouse managers, IT director, CIO
2. iNtrODuCtiON
Imagine you work with one of your organization’s mission-critical operational
systems. Your organization considers you the go-to person for any query or
reporting request associated with this system.
What if your CEO were to ask you to modify one of your year-end reports to
compare this year’s numbers to those from the two previous years? Unfortunately,
the operational system you are reporting off of only stores current-year detail records
and prior-year summary balances. The summary balances from two years ago were
purged from the system at the beginning of this year. When you try to explain this to
the CEO, all you hear is, “So how long will it take to find the lost data?”
Your medium-sized company is publicly held and under the Sarbanes-Oxley act
your CEO and CFO must certify the accuracy of its financial statements based on
data from several internal systems and spreadsheets. In a recent conversation, the
CFO asked you to confirm the roll-ups in these reports were trustworthy; that they
were timely, auditable, and not based on “adding apples to oranges.”
Can you reference historical values?
Can you comply with the reporting requirements of Sarbanes-Oxley?
Is important data trapped inside proprietary applications?
Can you combine data from several departmental systems?
In addition to the requests from the CEO and CFO, you receive another request to
produce a report from a commercial enterprise application software package your
company has recently implemented. Unlike the production system you’ve worked
with for years, this system contains seemingly strange files that appear to contain
both system and user data. As you start to learn more about these files and try to
decipher the meaning of apparently incomprehensible acronyms, you wonder just
how you will access the necessary data to solve this request.
The chief marketing officer asks you to identify the 100 customers who produced
the most revenue for your company last year. These companies would be placed
on a “preferred customer list” and their requests given special handling and top
priority. As your company’s sales and service departments each tracked customer
revenues in their own departmental systems, you had to first match customers and
add these revenues together. When you proudly present the list to the CMO, he
gives you a strange look and asks why a company he expected to rank among the
top 25 was not even on the list.
Are these scenarios familiar to you?
Business Objects. Data Integration 2
3. Why iS DAtA
iNtEGrAtiON impOrtANt?
To be successful, your organization—large or small—must run its operations
effectively and efficiently, which requires the ability to analyze operational
performance. If you can’t see how you’re performing, how do you know you are
making the right business decisions? For an organization to thrive, or perhaps
even survive, operations and analysis must work together and reinforce each other.
This is especially important in small-to-medium size organizations, which—in order
to grow and expand—need to focus their limited resources and take appropriate
actions to build upon their successes while quickly identifying and resolving
operational problems.
Without the entire picture, it’s difficult to make sound and dependable business
decisions. That’s because good decision-making requires a complete and accurate
view of data. The ability to access and integrate all of your data sources is the start
to getting the complete picture—and the key to not compromising your decision-
making process.
To draw valid conclusions, an organization needs to be able to analyze
both current and historical data from multiple disparate sources. With a
bit of luck, the organization can consolidate the data from these disparate
sources without resorting to “desperate measures.”
Though your organization needs a complete view of operations, the data you need
often resides in a variety of application systems that do not necessarily all use the
same database management system. Furthermore, these application systems may
only contain current data values. They may not store prior data values needed to
provide historical context and to discover trends.
Data integration allows an organization to consolidate the current data contained in
its many operational or production systems and combine it with historical values. And
the creation of a data warehouse (or, on a more limited scale, a single-subject data
mart) facilitates access to this data. Collecting and consolidating the data needed to
populate a data warehouse or data mart and periodically augmenting its content with
new values while retaining the old is a practical application of data integration.
Business Objects. Data Integration 3
4. ApprOAChES fOr DAtA iNtEGrAtiON
An organization can integrate its data through a variety of methods including:
• Enterprise-class data warehouse implementations hosting massive amounts of
historical data
• Departmental or subject-level data marts focused on a single organizational unit
or functional area
• Operational data stores containing current values of data extracted from several
operational systems
• Enterprise information integration (EII) deployments that provide a direct, real-time
view of data residing in multiple operational systems
By integrating data, organizations can more effectively use
this data for analytical purposes.
Hybrid approaches are common and include, for example, departmental data marts
populated from enterprise data warehouses or an EII deployment that access a
data warehouse for historical data and operational systems for the latest values.
Most organizations use a combination of methods as part of their overall information
architecture. Whatever the form (see Appendix for additional details), the intent is
to create a data platform for analytical purposes. By consolidating, standardizing,
and, in many cases, summarizing the data contained in multiple operational systems,
an organization can analyze the combined data to achieve a “single and trustworthy
version of the truth.”
Business Objects. Data Integration 4
5. Data Warehouse
There are a multitude of benefits resulting from integrating operational data within
a data warehouse or data mart. You can build these to:
• Integrate recent and historical data values
• Combine data from disparate sources
• Create a data foundation for analytical purposes
• Improve data quality
• Establish consistency throughout the organization
• Facilitate the adoption of corporate data standards without having to modify
existing operational systems
• Provide historical breadth and enable trend analysis
Operational Data Store
Many organizations have created operational data stores to consolidate current
data from multiple operational systems. While a data warehouse typically collects
historical values, an operational data store focuses on current values. You can build
an operational data store to:
• Obtain a complete view of your customer
• Integrate current financial data for government reporting and compliance purposes
• Consolidate current information from multiple sources
Business Objects. Data Integration 5
6. Enterprise information integration (Eii)
EII allows real-time access to data in multiple systems making it appear as
if it came from a single system. While some vendors have let marketing
get ahead of reality by claiming that EII eliminates the need to build a data
warehouse, this is not usually the case. EII complements a data warehouse
and should be considered one component of an organization’s overall
enterprise information architecture.
Consider, for example, the analogy of someone with two checking accounts.
An operational data store can be used to determine the total current balance
while a data warehouse can be used to track a given expenditure over the last
several years. An EII solution would allow you to do both, assuming the data
warehouse and the operational data store were both being accessed. In the
business world, EII can be used to simultaneously query multiple inventory sites
to see if there is sufficient stock on hand to immediately satisfy an incoming
order. It could also be used to identify products with excess inventory and be
linked to a system that would send email offers, with special price incentives,
to targeted prospects to encourage additional purchases of these items.
You can use enterprise information integration to:
• Provide an integrated view across all sources—production systems,
operational data stores, data warehouses, and data marts
• Obtain a real-time view of data spread across federated (perhaps one at each
manufacturing location) operational systems
• Enable operational, or real-time, business intelligence by accessing historical
values in data warehouses or data marts and the real-time values in operational
systems
• Jump-start data integration efforts by first deploying an EII solution, perhaps
to quickly satisfy an important user requirement, and then deciding if the data
should ultimately be extracted to a data warehouse, data mart, or operational
data store
Business Objects. Data Integration 6
7. WArNiNG SiGNS: Does your Organization Suffer from poor
Data integration?
The following situations could benefit from trustworthy data integration.
• No single version of the truth. Managers are arguing about the fact that
analyses results differ—even though the data came from the same operational
system.
• inability to comply with governmental reporting requirements. The
CEO and CFO are uncomfortable signing off on the company’s financial
statements because there is no way to trace the numbers back to its
original source. The Sarbanes-Oxley Act requires isolated financial data
be integrated and that the CEO and CFO certify, subject to penalties that
include imprisonment, the accuracy of their company’s financial statements.
• incomplete data foundation. Presentations that include an analysis
prefaced by a statement such as, “…except for the data that we were unable
to obtain from…” Or worse, a presentation that begins with, “Due to the
discovery of data not included in last period’s analysis, we are reversing our
decision…”
• poor audit trail and data lineage. An analyst alerts management to a
potential problem discovered while running a query against the data in an
operational system. The analyst cannot, however, answer the follow-up
question, “How long has this problem existed?”
• inability to consolidate data from multiple sources. As a result of an
out-of-stock condition for a critical part, an organization must expedite an
order and purchase the item at a premium price. Once the order arrives, the
organization discovers another division had an excess quantity of the same
part and was trying to sell it at a discount to balance its inventory.
• poorly integrated, stovepipe operational systems. While analysts use a
variety of business intelligence tools to generate reports from application
systems, they re-enter relevant summary values into a spreadsheet for any
analyses requiring data from more than one application.
• Lack of common data definitions. With a series of very convincing charts
and graphs, an executive presents what appears to be a thorough analysis
of the cause of a particular problem. However, while the format of the
presentation qualifies as a work of art, the executive’s credibility suffers
greatly when someone says, “That’s not what that data means, where in the
world did you get that?”
Business Objects. Data Integration 7
8. • historical values not retained in a data warehouse or data mart. An
analyst runs the same report each week against an application system.
However, in order to see period-to-period comparisons, the analyst maintains
a spreadsheet. Each week, he must manually add a new column and enter
that week’s report values.
• historical values not retained in a data warehouse or data mart. An
analyst runs the same report each week against an application system.
However, in order to see period-to-period comparisons, the analyst maintains
a spreadsheet. Each week, he must manually add a new column and enter
that week’s report values.
• Lack of an integrated 360° view. The CEO of one of your largest customers
has called your company’s CEO to complain that when his people contact
your call center for support, they are not receiving the attention he believes
they deserve.
• high cost of maintaining in-house “one-time” code. Your company is in
the process of developing a new order entry system that, when deployed,
promises to provide a significant advantage over your competitors. Things
are going smoothly until, six months into the project, the lead programmer
is called away to “patch some extract code” that no longer seems to work
with the latest version of the ERP system from which the data is sourced.
Because she last modified her code three years earlier and she has not kept
up with the new version of the ERP system, this task takes much longer than
anyone anticipated and the deployment of the new order entry system is now
behind schedule.
Business Objects. Data Integration 8
9. thE BENEfitS Of DAtA iNtEGrAtiON
An organization can reap many benefits from data integration. These include
the ability to:
provide a Single view of the Organization
Historically, operational systems, especially legacy ones, were created to solve
a particular set of needs, each evolving into an independent island of information.
These needs included order entry, shipping and receiving, payroll, manufacturing
and inventory control, and customer support. In the case where a company deploys
the same operational system in several locations, each location might still have
its own database sometimes with differing value lists and even data definitions—a
separate isle of information. The islands and isles must be consolidated in order to
obtain a single view of the entire organization.
By integrating data across disparate operational systems, an organization
can increase the effectiveness of its data access and analysis capabilities.
Deliver trusted information
While the quality of any decision is highly dependent on the quality of data upon
which it was based, governmental compliance regulations and associated reporting
requirements makes the need for trustworthy data even more essential.
For data to be trustworthy it must be of the highest quality. Data profiling and data
quality tools can be used to ensure this. Data profiling can be used to identify
problems and anomalies in the source data as, for example, telephone or social
security numbers that don’t match their expected format or pattern, new orders with
requested delivery dates in the prior century, the number of unique values in a field
and a count of suspicious values such as “99999” or blank, and gender code fields
with eight different values. It can also be used to examine inter-record dependencies
such as sales orders for products not on the product master file. Data profiling and
data quality tools complement each other; once data profiling identifies an issue,
data quality tools can then be used to facilitate its resolution. Data quality tools
can be used to eliminate duplications, verify and correct addresses, standardize
data values by substituting corporate standards for departmental variations as
exemplified in the previously mentioned region code example, and even augment
records with additional data such as geocodes, credit ratings, or census and other
demographic information.
Business Objects. Data Integration 9
10. In order to be trustworthy, the lineage of the data (i.e., where it originated and
how it was transformed) must also be known and auditable. It is also important
to be able to perform impact analysis to see what reports and processes are
dependent on a given data element.When ultimately standardized, the long-
term benefits of having a common set of business rules and common set of
definitions and terms can greatly improve efficiency and effectiveness.
Analyze Current values and trends
In an operational environment, organizations deploy query and reporting tools
along with production reports to determine current status. They generally
summarize the data and only maintain historical data values for a limited time,
if at all. Though an operational system provides the most current values, these
values may not be appropriate for tracking and analyzing how something has
changed over time. A data warehouse or data mart is usually needed if access
to historical values is required.
In a production environment, values are constantly changing, as most
transactions typically update one or more data values. There is nothing more
frustrating than performing an analysis against an operational system only to
find ten minutes later, as a result of new transactions having hit the system,
you now get different results. You can avoid this problem by capturing a data
snapshot and storing it in a data warehouse. While the values stored may not
be up-to-the second, they are usually collected at well-defined, cut-off cycles
(e.g., monthly, weekly, daily, hourly). And this ensures the validity of period-to-
period comparisons.
treat Data as a Corporate Asset
While many organizations speak of their data as a corporate asset, its quantity,
unlike other assets, is not necessarily limited. Data is the one asset that can
grow and reproduce almost without limit, while often mutating in the process.
As it happens, despite the widespread use of data flow diagrams, data doesn’t
really flow from one system to another. Rather, a copy (perhaps somewhat
transformed and/or summarized) is sent to the second system while the first
system still retains the data. This can lead to inconsistent data in each system
and as a result, inconsistent decision making.
A single observation does not a trend make! Just as it takes two points
to determine a straight line, it takes a series of values collected over
a period of time to determine a trend.tegrating data across disparate
operational systems, an organization can increase the effectiveness of
its data access and analysis capabilities.
Business Objects. Data Integration 10
11. Using data integration to consolidate the data from the various operational systems
serves to create a “single version of truth” so you can treat data as the enormous
asset it is. To do this effectively, the lineage of the data, including its origin and/or
derivation, must be readily available and not lost.
Get a Complete or 360° view of your Business
To obtain a complete view of your organization it may be necessary to consolidate
data from several individual units. Consider multiple divisions of an organization.
Each division has its own purchasing system and wants to maximize the discount
it receives from its vendors. Although each of the separate divisions most likely
has the purchasing details it needs to negotiate a discount with each vendor,
the organization as a whole could likely negotiate better discounts if it were able
to aggregate the total amount it purchased from each vendor across all of its
divisions. For example, consider a three-division company. If each division places a
$1 million purchase order each year with the same vendor, it could instead base its
discount negotiations on the fact that the company as a whole spends $3 million a
year with the vendor. Because it can now determine the total amount it purchases
from the vendor, it would likely receive a higher percentage discount than each
division would have received by negotiating independently.
Integrating data from multiple systems creates an environment where the
whole is worth far more than the sum of the individual parts.
Discover and reconcile Differing Data Definitions and Business rules
Every department understands its own data. It’s the data from other departments
that always seems to be wrong and in need of reconciling to fit the individual
department’s needs.
A great benefit of any data integration effort is the discovery that different parts of
the same organization do not necessarily speak a common language or use the
same business processes. When ultimately standardized, the long-term benefits of
having a common set of business rules and common set of definitions and terms
can greatly improve efficiency and effectiveness.
For example, when determining departmental productivity using “cost per
employee” as a metric, do two part-time employees, each working a four-hour day,
count as one employee or two? The answer is likely to differ by department and
unless an organization-wide definition is established, departmental comparisons
are not meaningful.
Business Objects. Data Integration 11
12. Once an organization recognizes differing definitions and standardizes on enterprise
definitions, data integration can facilitate their implementation. It may be impractical
to modify every operational system to reflect the enterprise standard. However, it is
possible to transform the data extracted from each operational system to conform
to the enterprise standard definitions and value lists as the data is loaded into the
warehouse or, with an EII approach, in the process of accessing it.
Metadata matters! Minimize communication errors by ensuring every
department speaks the same business language and uses the same
data definitions.
Data definitions are an example of metadata. Metadata is nothing more than “data
about data” and data definitions are but one example. Other examples include
standardized field names and column headings, computations for derived data
(e.g., profit equals revenue less expenses), data element value lists (e.g., NY is the
code for New York; allowable values for region code are N for North, S for South,
E for East, W for West, and M for Mid-West), etc. In addition, to allowing the entire
organization to speak the same language and understand the algorithm behind
a computed value, it provides a valuable audit trail for compliance purposes,
especially if the data lineage or data source and associated transformations are
also captured.
take incremental Steps rather than Attempting to Do Everything
at Once
The planning and implementation of a full-scale enterprise data warehouse does
not occur overnight. While the end results will almost certainly justify the effort,
organizations can develop an effective information architecture by taking small,
incremental steps. For example, a sales data mart can be used to track and
analyze customer purchases and provide valuable insights for spotting trends
and recognizing cross-selling or up-selling opportunities. Enterprise information
integration (EII) can be used to access and combine real-time data residing
in multiple operational systems; once the data warehouse is deployed, EII can
be used to access it as well and thus, provide a historical perspective. Some
organizations have used EII to provide a quick view of operational data in order
to decide if a more formal effort should then be undertaken to add this data to an
existing data warehouse.
Business Objects. Data Integration 12
13. Create and maintain Organization-Wide reference files
All organizations have data used across the several departments. Examples of
these “reference data” files include customer data, product data, employee data,
vendor data, and even financial data such as the company’s chart-of-accounts.
In many organizations. individual departments maintain their own reference files
and problems frequently arise when different departments use different identifiers
or keys for the same customer, making it difficult, if not impossible, to accurately
combine. For example, if a customer’s revenues from both the sales and the service
departments can’t be accurately combined, the total value of that customer’s
account would be understated.
Don’t try to boil the ocean. A phased, incremental approach to an overall
enterprise information management architecture can begin with a data
mart or an enterprise information integration (EII) solution.
While the term “Master Data Management” is receiving a tremendous amount of
attention, it is simply an extension of the reference file concept, a concept behind
the use of centralized Rolodex files even before the common business use of
computers. Data integration technology, combined with data quality software, is
the underlying technology for creating organization-wide reference files and master
data management solutions.
Every organization has data, such as customer and product files, that
are used across the organization. These reference files facilitate the
organization’s ability to create a “360 degree view” of the subject
they reference.
Reference files are a subset of metadata management; for example the definition
and allowable values of the data elements collected for each customer or product
are examples of metadata.
Business Objects. Data Integration 13
14. maintain the response and performance of Operational Systems
The days of having to “submit queries and run reports against the production
databases only between noon and 1 pm or after 6 pm” are hopefully long past. Yet
running queries or reports against the database used by an online application can
still negatively impact the performance and user response time of that application.
Performance counts! If an analysis request negatively impacts the response of an
operational system, the analysis request will be deferred, perhaps permanently!
With a data warehouse or data mart, you offload the query to an environment
where the period can be optimized for this purpose.
• Deliver a complete view of a customer
• Offload the processing burden on operational systems
• Standardize business processes and data definitions
• Combine current and past values from disparate sources in order to see the
big picture
ApprOAChES tO impLEmENtiNG A DAtA iNtEGrAtiON SOLutiON
Once you recognize the benefits of and need for data integration, you have to
determine how best to move forward. The two basic approaches to data
integration are:
1. Develop and build your own in-house solution
2. Acquire a commercial offering
You should carefully consider the pros and cons of each.
in-house Development
Organizations that develop their own data integration solutions frequently do so in
a somewhat piecemeal fashion, without any overall data integration strategy. They
generally assign an analysis request that requires access to data from multiple
sources to the IT department. A programmer then writes the code necessary to
access and integrate all of the data.
If the programmer is fortunate, the source systems are well documented, the
content of the data fields conform to the documentation, and each of the individual
systems use the same value lists and code sets to represent the individual values
of common data elements. If this is not the case, the programmer’s task quickly
expands to include data value transformations. This frequently causes the schedule
to slip, especially if the data mappings are not simple one-to-one transformations.
Business Objects. Data Integration 14
15. Satisfying the initial consolidation requirement is only the beginning of the overall
integration effort. As any experienced programmer knows, the initial coding effort is
followed by ongoing support and maintenance especially if a new analysis request
requires additional data fields or the file structure of the source systems changes.
One of the givens in any applications environment is the ongoing need to respond
to change; another is that “quick and dirty” one-time coding efforts frequently
evolve into scheduled production jobs.
Moreover, a series of uncoordinated, individual integration tasks, even if each
one were successfully accomplished, ultimately result in an assortment of
uncoordinated (and usually undocumented) solutions that collectively, quickly
become unmanageable. The problem is further compounded if a different
programmer is responsible for each individual data integration solution—as most
programmers have their own individual programming idiosyncrasies and may have
even used different programming languages
Programmer turnover is another factor to consider. While programming the initial
extract program may involve creativity, future maintenance of these programs is
often a thankless task. In general, programmers prefer new challenges and the
original authors of the extract program may no longer be available to maintain
them. And even if they are, they may not go out of their way to mention their initial
involvement in the creation of the extract programs.
purchasing Commercial Data integration Solutions
While an initial data integration request can lead to an initial decision to develop
the code in-house, a commercial data integration solution, due to the need to
appeal to a broad audience, provides a wide range of capabilities generally not
incorporated into a homegrown solution. These include:
• Support for a variety of data types, sources, and targets
• Integration with many commercial application software packages
• An extensive library of data transformation functions
• Data quality functionality
• Metadata integration with the other tools
• Data lineage tracking and impact analysis
• Documentation and audit trails
• Ability to satisfy both current and future requirements
• A variety of packaging options and price points
Business Objects. Data Integration 15
16. Support for a Wide variety of Data types, Sources, and targets
With the possible exception of data integration tools available from some database
vendors, most commercial data integration software populates a wide variety of
target databases. Some database vendors have limited the scope of their data
integration software to only populate, or work best with, their own databases. Any
organization contemplating using a database vendor’s data integration offerings
should recognize the potential for platform lock-in. Data integration offerings from
non-database vendors usually offer more flexibility and will likely not constrain the
future choice of databases and/or operating systems. Many are also designed to
work, out-of-the-box, with a wide variety of data types, not just those that are SQL-
based. In addition to relational structures, these include mainframe legacy data
structures, XML data structures, and message queuing systems.
integration with Commercial Application Software packages
A commercial data integration solution that can work directly with third-party
packaged software applications minimizes, or even avoids, many of the problems
associated with continually modifying and retesting homegrown integration
programs. This retesting of an in-house developed solution is required whenever
there are changes to the packaged application software. Commercial data
integration solutions usually do this as part of their normal maintenance. Even if
your organization is currently using homegrown applications software, it is likely
to use enterprise application software sometime in the future as it grows and
expands. A good commercial data integration software offering should be able
to integrate data from these packaged applications and facilitate the population a
data warehouse or data mart. Some data integration vendors also offer easy-to-
deploy yet highly customizable data marts, designed to quickly integrate with a
wide variety of enterprise application software packages.
An Extensive Library of Data transformation functions
By including a library of pre-packaged, but extensible, data transformation
functions, leading commercial data integration products are capable of performing
data transformations and aggregations. This minimizes the need for custom
coding and code maintenance. A robust offering will have interactive debugging
facilities that allow the data integration staff to monitor the data flowing through
each transformation, establish conditional breakpoints, and view and profile live
data flows.
Business Objects. Data Integration 16
17. Data Quality functionality
As the quality of the data is a major factor in a successful data integration
implementation, it needs to be part of the overall solution. In some cases the data
integration vendor will OEM and support best-of-breed, third-party data cleansing
software as a part of its offering, making the fact that it was developed by another
vendor relatively transparent to the deploying organization.
Metadata Integration with Other Tools
Most packaged data integration solutions are also designed to leverage and integrate
metadata. This is accomplished by conforming to standards such as the Object
Management Group Common Data Warehouse Metamodel (OMG – CWM) thus
allowing the data integration software’s metadata repository to exchange metadata
with other CWM-compliant metadata repositories used by third-party design and
business intelligence tools. When a single vendor supplies a range of data integration
and business intelligence tools, it can easily share metadata across all of its products
and greatly facilitate the overall ease of integrating the individual components.
Data Lineage tracking and impact Analysis
Impact analysis, or the ability to determine how a change to a source system data
field can affect a business intelligence report or analysis, is only possible through
metadata integration and the resultant ability to track end-to-end data lineage. Data
lineage is especially important when a target field is derived from multiple source
system fields. A good commercial data integration solution facilitates change data
management by providing strong impact analysis capabilities including “what-if”
developer scenarios.
Documentation and Audit trails
An often-overlooked benefit of a commercial data integration solution is it serves
to document the underlying data transformation processes and data lineage.
This is far from a minor consideration, as many organizations initially attempting
to deploy in-house developed code have unfortunately discovered. When these
organizations later tried to ascertain how data sourced from legacy systems
was transformed prior to being integrated with other data, they discovered the
documentation, assuming it even existed, was woefully inadequate, the programmer
who wrote the original programs was no longer employed by the company, and
the production version of source code could not be found. The ability to document
the transformation processes and the data lineage is much more than a technical
issue, it is an essential element of any audit trail and is required to ensure that any
reported results are trustworthy. And trustworthiness is an absolute requirement for
complying with governmental reporting requirements.
Business Objects. Data Integration 17
18. Ability to Satisfy future Needs
A commercial data integration solution needs to meet both current and future
performance requirements. This may be accomplished through a variety of
mechanisms such as parallel processing technology and workload balancing.
Change data capture techniques can track and extract only those changes that
have occurred to relevant fields in the source data files since the prior extract.
A variety of packaging Options and price points
Ideally, a commercial data integration solution will have several editions, with
varying price points dependent on functionality (e.g., varying by number of
servers, number of supported databases) to address the economic constraints of
departmental- and enterprise-scale deployments. If multiple editions are available,
they should be upwardly compatible with each other.
Data integration Build versus Buy—the Bottom Line
As a general rule, unless the data integration task is truly a “one-time” effort,
organizations should strongly consider a packaged data integration solution. The
short-term initial costs associated with an in-house programming effort are likely to
be less than the acquisition cost of a packaged product. But on-going maintenance
costs and the indirect costs associated with an inability to respond quickly to
change will just as quickly consume the initial cost savings.
In almost all situations, a packaged solution is significantly less expensive
in the intermediate—and long-term.
In addition, the productivity resulting from the ability of most commercial data
integration packages to integrate and share metadata with other data warehouse
tools is something most in-house solutions simply do not consider or provide. Of
particular importance is the ability to share metadata with modeling and design tools
and the business intelligence tools that will access the data warehouse. Commercial
data integration packages are also likely to be integrated with or include data quality
and data profiling technology—functionality frequently overlooked by homegrown,
in-house development efforts.
When considering data integration tools offered by a database vendor, it’s important
to recognize one of the major strengths of a database vendor’s own data integration
product can also be one of its major weaknesses. That is, a vendor often optimizes
its solution for populating its own database. In fact, some offerings, with the possible
exception of also generating flat files, can only populate a vendor’s own database.
Business Objects. Data Integration 18
19. As organizations grow, their data integration needs tend to multiply and
a commercial data integration solution is usually acquired. Organizations
anticipating this should consider deploying a commercial data integration
solution early on. While it may be tempting to try and solve each data integration
challenge with an in-house band-aid approach, the deployment of a commercial
data integration solution is an investment that will yield both immediate and future
benefits for both IT and the user communities.
Business Objects. Data Integration 19
20. CONCLuSiON
Reliable data is the basis for sound decision making. And data integration is also
the key to delivering trusted information —do users of business intelligence tools feel
they are basing their decisions on trustworthy data? The best tools are of little value
if the data they analyze is not complete, accurate, and trustworthy.
Operational and analytical systems complement each other. Organizations must
effectively deploy both in order to succeed. For analytic purposes such as trend
analysis and forecasting, it’s necessary to collect time-stamped data values from
multiple sources in a data warehouse or data mart. For operational purposes, it’s
frequently necessary to have real-time access to data resident in operational systems.
Organizations can use an operational data store to consolidate current data values
from multiple operational systems. They can use an enterprise information integration
solution to combine current operational and historical data warehouse data and/or to
directly access data spread across several operational systems.
Data integration technology is used to bring this data together. In fact, data integration
and data quality solutions are the keys to achieving trusted information. While some
organizations choose to develop their own in-house data integration solutions, those
that use packaged software solutions can benefit from the vendor’s expertise and
experience in working with multiple, and sometimes esoteric data sources. This also
frees up their staffs for more productive tasks that help gain a competitive advantage.
Additionally, commercial data integration products usually provide metadata
interoperability with other tools and track data lineage and provide impact analysis.
Regardless of how obtained, data integration enables data warehouses, data marts,
and operational data stores—which all provide organizations with the means to make
reliable business decisions and comply with government reporting requirements.
Successful data integration is a key factor for an organization’s ultimate business
intelligence success. It is the cornerstone of any successful enterprise information
management architecture.
Business Objects. Data Integration 20
21. AppENDix
Many consider Bill Inmon the father of data warehousing. In his book Building the
Data Warehouse, he defined a data warehouse as, “a subject-oriented, integrated,
nonvolatile, time-variant collection of data in support of management’s decisions.”
Data Characteristic Production Application Data Warehouse
Data use Operational Analytical
Level of detail Detailed Detailed and summary
Data currency Real-time, latest value Multiple historical generations
Longevity Relatively brief “Forever”
Stability Dynamic Static
Scope of definition Application-wide Enterprise-wide
Orientation Application Subject
Data operations Captured/update Read
Data per transition Limited Large
Database optimized For update For access
Source: Updated from "Data Warehouse—Concepts and Implementation Strategies"
presentation, M. Schiff.
While these characteristics are not meant as absolutes for each environment,
they represent general statements as to what is typical of each environment. For
example, although data warehouse content is obviously updated with new values
each time a new snapshot is added, the general use of the data in the warehouse
is for read-only analysis purposes. A data warehouse typically adds new, time-
stamped values of existing data elements; a production system usually modifies
existing values. For example, a production application for payroll might contain the
salary of each employee; a data warehouse might contain the salary history for
each employee. When an employee receives a salary change, the new value would
replace the old value in the payroll system while an additional record, containing
the new salary and effective date, would be added to the data warehouse content
where it would reside along with the previous salary and quite likely all past salary
amounts (or a least a reasonable history) for each employee as well.
Business Objects. Data Integration 21
22. There are also times when an organization needs to collect data from several
operational systems for additional operational purposes such as determining
current part quantities across all of its inventory control systems. This data
warehouse variant is commonly referred to as an operational data store. While
it differs from the classic data warehouse as it stores relatively current values
and minimal history, the process of bringing this data together is another classic
example of data integration.
Bill Inmon and Claudia Imhoff highlighted this difference in their book, Building
the Operational Data Store, when they defined an operational data store as a
“subject oriented, integrated, current valued data store, containing only corporate
detailed data.”
Enterprise Information Integration or EII is a somewhat hybrid approach that directly
accesses data contained in a several operational systems in order to provide
a transparent view that makes appear as if the data resided in a single source.
Assuming that the data values are compatible, EII can be of value in operational or
real-time BI environments or to enable quick analysis of data that has not yet been
incorporated into a data warehouse. An EII solution is especially useful when it
can access both operational systems and a data warehouse, as it can then provide
both real-time and historical values.
Business Objects. Data Integration 22
23. ABOut mAS StrAtEGiES
Michael A. Schiff is the founder and principal analyst of MAS Strategies. MAS
Strategies specializes in helping vendors market and position their business
intelligence and data warehousing products in today's highly competitive market.
Typical engagements include SWOT analyses, market research, due diligence
support, technology white papers, public presentations, and helping organizations
evaluate tactical and strategic product and marketing decisions. MAS Strategies
also assists user organizations in data warehouse procurement evaluations, needs
analysis, and project implementations.
With over 30 years of industry experience as a developer, consultant, vendor,
industry analyst, and end-user, Michael, is an expert in developing, marketing,
and implementing solutions that transform operational data into useful decision-
enabling information. Michael was the Vice President of the Data Warehousing
and Business Intelligence service at Current Analysis, Inc., an industry analyst firm
where he provided tactical market intelligence and analysis while managing the
company’s E-Business analyst team.
Michael was the Executive Director—Data Warehousing and Advanced Decision
Support for Oracle Corporation's Public Sector Group and Director of Software
AG's Data Management program where he was one of the industry's earliest
proponents of the data mart concept. In 1984, while at Digital Equipment
Corporation, he formulated the architecture for one of the first successful data
warehouse implementations. In previous positions as IT Director and Systems
and Programming Manager he acquired practical, first-hand, knowledge of
the technical, business, and political realities that must be addressed for any
successful systems implementation or product launch.
Michael earned his Bachelor and Master of Science degrees from MIT's Sloan
School of Management where he specialized in operations research as an
undergraduate, and in information systems as a graduate.
For further information about MAS Strategies, visit its web site at:
www.mas-strategies.com.
Business Objects. Data Integration 23
24. ABOut BuSiNESS OBjECtS,
AN SAp COmpANy
As an independent business unit within SAP, Business Objects transforms the way
the world works by connecting people, information, and businesses. Together with
one of the industry’s strongest and most diverse partner networks, the company
delivers business performance optimization to customers worldwide across all
major industries, including financial services, retail, consumer-packaged goods,
healthcare, and public sector. With open, heterogeneous applications in the areas
of governance, risk, and compliance; enterprise performance management; and
business intelligence; and through global consulting and education services,
Business Objects enables organizations of all sizes around the globe to close the
loop between business strategy and execution.
Business Objects. Data Integration 24