The document discusses the challenges posed by data revolution and proposes SMART Statistics as a concept to help statistical organizations adapt. It defines SMART Statistics as data compiled through non-traditional means but equally trusted. The document outlines some key dimensions of SMART Statistics including organizational structure, business processes, and outcomes. It emphasizes the need for statistical organizations to become more innovative, responsive, and demand-driven to remain relevant in the current data landscape.
1. Statistics: Coping With Data Revolution
Data generated from respondents 2 Data generated from Devices!
“Toward SMART Responsive Statistics”
Prepared by; Sufyan Albarghouthi
SMART Statistics Expert
barghouthisufyan2016@gmail.com
November 2018
12/11/2018
Compete to Stay FIT
1
2. Contents
12/11/2018 2
Introduction
Data revolution and challenges
SMART Statistics; concept and definitions
Business model;
Impacts (Added value);
Requirements
Some take home notes
3. Accumulating Data Or Accumulating Uses!
What users expect from NSOs to fit their needs?
Are NSOs still the first choice for users?
Are NSOs pure producers, same role and power as before?
Are traditional statistics in use?
DATA grow by use
If not in use …! Then efforts in producing it had been wasted!
If not communicated - it does not exist – Not alive!
12/11/2018 3
Big Data
today;
small data
tomorrow!
4. Challenging Data Revolution
Data lifecycle is changing:
No data collection as before; Virtually (Free open online data)…!
No processing as before; Machine learning, Cloud computing..!
No dissemination as before; Tweeting…!
Bye … Bye business as usual!
Traditional stat office Techniques will no longer fit
the future SMART society!
Data revolution opens STATS Competition after Monopolistic Period
Can NSOs Business Stays as Usual in Information Open Market?
12/11/2018 4
5. Also; New Definition Come Along with Data Revolution
12/11/2018 5
Big Data
Networks
Cloud
Computin
g
New
Production
Factor
New
Infrastructure Concept
New
Public Service
Concept
6. Current Reflections of Data Revolution
12/11/2018 6
Business and
Private Sector
Government
and Public Sector
Households and
Individuals
More connected
More smart devices
per capita
More intelligent
Less welling to
cooperate in filling
questionnaires
More virtual than
before
Data privacy?
Evidence based
planning/ decisions
Future insights
Sustainable
development
International
comparability
Transparency and
good governance
Rationalization
Business becomes
information driven
More E-business
transactions
Filling questionnaires
add more burden
More insights for
comparative
advantages
7. Data Revolution Reshapes NSOs
NSO
Organization
Components
Leadership
&
Management
I T
Architecture
&
Platforms
Data
Sources
Users
Affairs
Resources
&
Process
Statistics
&
Services
Data
Revolution
is shaping
all
components
Challenge;
which
model fits
data
revolution
In Data Revolution Era:
Its not big fish eating small fish! Its fast ones eating slow ones!!
SNSO or SNSA?Adapt 2 Change Office Authority
12/11/2018 7
8. Change is a Process not an Event;
12/11/2018 8
It takes time, but may be faster than you expect!!!
9. Change May be Associated with New Types of Risks!!! Stay Alert!
12/11/2018 9
10. 12/11/2018 10
Even you try you stay far;
Data revolution is changing
all!!
Power of (Change + to change)
Decision Willingness
11. Big Questions … Big Challenges
What to Innovate in Official Statistics?
How to develop a responsive statistical
system?
12/11/2018 11
12. Data Revolution creates new Routs for NSOs
How to:
Modernize statistical production processes?
(common statistical business model /architecture)
Introduce Innovation in data lifecycle?
collection/dissemination/analytics / outcomes
Develop Integrated statistical systems?
Harmonization, Standardization, consistency
12/11/2018 12
13. Data Revolution Assumes creative leadership!
To lead the shift and migrate traditional techniques
3Ps
People
ProductsProcess
New
people!
Do
products
fit well?
How to
process
business?
12/11/2018 13
Old generation:
Talks about the history,
No future!
Young generation:
Talks about the future,
No history!
Change
2
Change
14. To Cope; Future NSOs Should be;
SMART Innovative
Responsive
12/11/2018 14
15. What is SMART Statistics?
In this context, SMART statistics;
Will refer to all the data and
information generated (compiled) by
non-traditional means.
But they are equally trusted and reliable.
12/11/2018 15
Note: Integrated INPUTS are prerequisite for SMART statistics
16. Future Data = SMART Data
Data Characteristics in Competitive Open Market Era!
12/11/2018 16
innovative integrated
intelligence informative
Future
Data…
How is your data characterized?
17. SMART Statistics: Scope and Dimensions;
Organizational Structure
Business Process
Outcomes
Tools
IT continuous
changes
Information
Market needs
Competitors
Responding to
Users Affairs
SMART on
SupplySide
SMART on
DemandSide
12/11/2018 17
18. SMART Statistics: Innovation Tracks;
Technical Domain
Statistical Products
and Tools
Statistical Services
Non-Technical Domain
Organization
Development
User’s Impacts
Innovation Tracks within NSO
12/11/2018 18
19. What is Innovation?
“The innovation system is made
up of organizations that, through their
resources and activities, affect the
speed and direction of the innovation
process; it also includes the
relationships and interactions between
these organizations.
The system can be characterized by its
specialization, its institutional set up
and its connections to the
environment” (Lundvall, 1992)
Innovation: Provide a new
product, service or process, a
new marketing method, or a
new organizational method in
business practices or external
relationships. (innovation in
products and services, or in
the way they are produced and
made available to users).
(GCCstat Innovation strategy 2018).
12/11/2018 19
20. What is a Responsive NSO?
Readiness to insure best Fit for Purpose
12/11/2018 20
21. Services Oriented Organization: Demand Responsive Organization
NSOs Golden role: Relevancy is the core stone
On key stakeholder (partners) level: Get engaged with policy,
decision makers, Academia, and strategic partners:
To insure that official statistics are involved in identifying
demands / policy needs, from the early beginning of
planning cycle;
To insure that official statistics have the full role to
establish standards, definitions and classifications
according to scientific criteria;
To balance new and existing needs for all users, ensuring
that official statistics provide a comprehensive and up-
to-date picture of the economy and the society,
12/11/2018 21
22. Relevancy is USERS practical Experience
USERS
needs determine your
Responsiveness
12/11/2018 22
26. Innovative Scale Map:
Updated
versions of
STAT systems
Advanced
level of
Integrated
components
New
components /
features for
existing
STAT systems
Developing /
improving
STAT
components
New
generation of
the
STAT systems
Revolutionary
version
(SMART
version)
Partial strategic
Improving
business as usual
New to the statistical
Community
New to NSO
level
Factor
level
System
level
System theory:
A system is a set of
interrelated
components
working toward a
common objective.
Systems are made
up of components,
relationships, and
attributes.
(from Carlsson et
al. (2002), p. 234)
What's your Priority? What's your Capability? Where you stand?
12/11/2018 26
27. Push the Bottom On!
Once you diagnose where you stand,
then you can take your next step!
Draft Design
12/11/2018 27
28. Planning: Project Oriented Techniques!
Dynamic
Planning is important because of fast
changes in IT and information market!
REMEMBER
12/11/2018 28
29. SMART Statistics Responsive Generic Map;
SMART DATA – SMART
SOLUTIONS
Informing policies;
Influencing FUTURE
Outcomes
Understanding History:
Time series analysis
Fresh DATA for
USERS Daily use
Revolutionary data sources + IT technology (Solutions) = SMART statistics
Revolutionary
Data Sources
SMART Data OutcomesMachine Learning Tools
12/11/2018 29
30. Operational Business Model Components (Architecture);
Data Collection
(Internet of things initiatives)
Data Processing
(IT -Non traditional tools)
Data Dissemination
(Communicating Info VA+)
Integration to Insure SUSTAINABILITY of the SYSTEM
Differentdatasources:
Mapping Mixed Data Types:
Understanding Users needs Understanding intended purposes Producing relevant statistics Fitness for purpose
12/11/2018 30
NSOs
CBs
Admin
BD
OD
???
31. Adequate Data Governance System: Data Governance Authority!
Smart System of Data Quality / Security with Broad Scope to Insure;
12/11/2018 31
Availability Authenticity Integrity Confidentiality
Data needs to be
available when
needed
Data needs to be
available to only the
appropriate users
Need to be able to
tracking reviews
(who has access to
and who has
accessed what data)
Need to ensure that the
data has been edited by
an authorized source
Need to confirm that
users accessing the
system are who they
say they are
Need to verify that all
report requests are
from authorized users
Need to verify that any
outbound data is going
to the expected
receiver
Need to verify that any
external data has the correct
formatting and other
metadata
Need to verify that all input
data is accurate and
verifiable
Need to ensure that data is
following the correct work
flow rules
Need to be able to report on
all data changes and who
authored them to ensure
compliance with corporate
rules and privacy laws.
Need to ensure that
confidential data is only
available to correct people
Need to ensure that entire
database is security from
external and internal system
breaches
Need to provide for
reporting on who has
accessed what data and
what they have done with it
Mission critical and Legal
sensitive data must be
highly security at the
potential risk of lost
business and litigation
Source FOR THIS SLIDE: Team Mag 5
Valerie Buitron, Jaime Calahorrano, Derek Chow, Julia Marsh, Mark Zogbaum
May be the
future role
of NSOs!!!
32. Business Outcomes; Extra Added Value
What are the main strengths
of such a business model?
12/11/2018 32
33. I: SMART in Supporting Evidence Based Policies; Relevancy!
Smart data – Better decisions – Better life
12/11/2018 33
34. II: SMART in Outreach; Zero Time to Market
Needs
Assessments
Satisfaction
Trust
User Producer
Dialogue
&
online feedback
Data
Channels
Website
&
DB, Smart
Devices
Social
Media
Change
Management
Be
where users
Be
Adapt to
change
USERs
Affairs
Users spend
good time on
mobile;
Googling and
youtubeing
Attractive, Less text, more visualization
Fresh /Rich Messages
Data for
USERS
daily
use!
More closer to users = More Users
Users are on
social media;
are you there?
12/11/2018 34
35. III: SMART Automated Statistical Process System; Connectivity
Dynamic STAT Platform: Effective engagement with data sources and users
12/11/2018 35
SMART EXCHANGE= Share – Mix – and Match
36. IV: SMART Innovative Excellence Data Center
Innovative
excellence Data
Center
Partners in sharing
Knowledge
Improving the power
of Data; R&Ds
Statistics on the
spot; Applications
Data mining tools
Future insights
C
initiatives
Innovation laps
Explore Discover Act
Interactive excellence inventory platform/ Lap
Promoting / Sharing innovative experiences
12/11/2018 36
C C
C
37. Change Management Timeline
Preparation Phase Migration Phase Future Statistics
Business as usual
Strategic development
plan
Quick wins:
transformations
initiatives
Sharing experiences and
success stories
SMART
statistics
Project development
design
Transforming process
Expanding utilization of
BD, OD, IoT
Expanding new E/G-
services (Connectivity)
New partnerships
First 2 years Second 2 years 5th year
12/11/2018 37
38. Basic Requirements for Developing Future Statistics
Investments Rather than costs!
12/11/2018 38
Internal
Factors
External
Factors
39. Leadership is significant to drive and lead the shift!
Data revolution is a process not an event!
Time is important: Being late = Out of market!
Coping is a team work not a single department
action (trusting each other not only working together)
SMART Statistics is an outcome of multidimensional
project, not only a policy or a trend!
12/11/2018 39
Some concluding's: Take home notes
40. Innovative responsiveness is not straightforward road!
But: Don’t pay attention to the temptations of the road
12/11/2018 40