Data donderdag data quality sas

1. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY IN A
BIG DATA WORLD
Jos van Dongen
SAS Nederland

2. Copyright © 2014, SAS Institute Inc. All rights reserved.

3. Copyright © 2014, SAS Institute Inc. All rights reserved.
Barcelona

4. Copyright © 2014, SAS Institute Inc. All rights reserved.

5. Copyright © 2014, SAS Institute Inc. All rights reserved.

6. Copyright © 2014, SAS Institute Inc. All rights reserved.
INCORPORATE DATA
GOVERNANCE
DEFINE RULES AND POLICIES GOVERNING DATA
Who is
responsible
to maintain
this data?
And where?
Where can I
get this
information?
Is the
quality of
data
improving?
How am I
supposed
to use this
data?
What data
quality
standards
should this
data comply
to?
Who can
approve a
change to the
business
data model or
reference
data?
Are we
compliant
with
security,
privacy and
risk
regulations
?
How to
leverage
the value of
this data?
Are we
making the
most out of
our data?

7. Copyright © 2014, SAS Institute Inc. All rights reserved.
Data Quality?

8. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA MNGT
BUILDING BLOCKS
DATA QUALITY

9. Copyright © 2014, SAS Institute Inc. All rights reserved.
BUSINESS USER BUSINESS GLOSSARY
Trace data from source
to consumer and all the
steps in between
Document what has been
done to data and how it
has been transformed
Govern who has access
to data and who has
consumed data

10. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY GOVERNANCE CYCLE
Iterative process
where Business
and IT work
together on
Data Governance

11. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY PROFILE
Interactively
quickly discover
anomalies in the
data

12. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY BUSINESS RULE VALIDATION
Validate whether the
data complies to
quality standards

13. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY DATA CLEANSING: PARSING & STANDARDIZING

14. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY REMEDIATION
Review and resolve
issues on a case by
case basis

15. Copyright © 2014, SAS Institute Inc. All rights reserved.
DATA QUALITY DASHBOARD
Real-time information
when data is out of
compliance with
established data
policies

16. Copyright © 2014, SAS Institute Inc. All rights reserved.
Conclusion
#BigData = Data (duh…)

17. Copyright © 2014, SAS Institute Inc. All rights reserved.
…or is it?
§ Most data assets come from within company
§ Focus on structured data
§ Look at data to assess what occurred in past
§ The goal is that each single record is correct
§ Good database design requires years
§ Pay attention to „data stocks“*
§ Business users have to ask IT for analysis
§ There are clearly defined information
requirements for each business process
§ A large proportion of data come from outside
§ Focus on structured and unstructured data
§ Real-time analysis to improve the outcome
§ The goal is that analytics results are accurate
§ Database as moving target, quick cycles
§ Pay attention to „data flows“*
§ Business users conduct analysis themselves
§ All internal and external data sources are
used to gain best insight in a given situation
Traditional data management Big Data Analytics World
Source: Alexander Borek, Data Quality Strategy in a Big Data Analytics World

18. Copyright © 2014, SAS Institute Inc. All rights reserved.
“By 2017, 50% of all companies
in regulated industries will have a
Chief Data Officer.”

19. Copyright © 2014, SAS Institute Inc. All rights reserved.
SAS INFORMATION MANAGEMENT
A single platform. A singular
approach to better data.

20. Copyright © 2014, SAS Institute Inc. All rights reserved.

21. Copyright © 2014, SAS Institute Inc. All rights reserved.
NOG VRAGEN???