Implement the SDMX under the Government Data Service Framework.

1. GSIC, Thailand National Statistical Office
Implement the SDMX
under the Government Data Service Framework
Miss Taweesap Srikwan
Statistician
November 30, 2022

2. GSIC, Thailand National Statistical Office
2
Introduction the Thai NSO
The Government Data Service Framework
Implement the SDMX under the Government Data Service Framework
Challenges
Next Steps
Contents

3. GSIC, Thailand National Statistical Office
3
Introduction the Thai NSO
National Statistical System of Thailand Decentralized Statistical System
(1) standardized statistical production,
(2) efficient management of the national
statistical system, and
(3) promotion of statistical data services.
TNSO MISSION Under the 2007 Statistical Act
• Managing the country’s statistical system
• Administering the Statistical Master Plan
 The 3rd Statistical Master Plan
The Structure of TNSO
 Central Administration
 8 Divisions 2 Centers
 Local Administration
 76 Provincial Statistical Offices
Challenges Next Steps
SDMX Implement
GDF
Introduction
Manpower : 2,098 people

4. GSIC, Thailand National Statistical Office
4
Introduction the Thai NSO
o 2008 TNSO developed “statXML” to exchange statistical data
among ministry in Thailand
o 2011 Using SDMX to exchange MDG under UNSD-DFID project
(http://data.un.org/CountryData)
o 2013-2017 The Implement SDMX under the Thailand Statistical
System Master Plan
 Lacked cooperation from the Line Ministries in providing
data to TNSO system.
o 2019 Considering the best solution for using SDMX standard
with the open-source SDMX tools.
o 2020 – now Implement SDMX under the Government Data Service
Framework
Implementation of SDMX standard
Challenges Next Steps
SDMX Implement
GDF
Introduction

5. GSIC, Thailand National Statistical Office
5
Introduction the Thai NSO
TNSO
Data Governance Framework
Data Governance Structure
Definition and Rules
Data Governance Council Data Steward Team Data Stakeholders
Data Governance Processes
Plan
Continual Improvement
Check, Measure & Report
Do
Data Governance
Metrics / Success Measures
Data
Governance
Environment
Data
Definition
Data Rule/
Data Policy
Consultant: Director General
Head: Chief Data Officer
Vice-Head: Deputy Director
Business Data Stewards Team
Quality Data Stewards Team
Technical Data Stewards Team
TNSO Data Governance Policy
 Section 1 General
 Section 2 Data Archive & Destroy
 Section 3 Data Processing & Usage
 Section 4 Data Disclosure
 Section 5 Data Exchange & Sharing
• the Digitalization of Public Administration and
Services Delivery Act, B.E. 2562 (2019)
or The Digital government Act
• Thailand Digital Development Plan (2020-2022)
TNSO Data Governance Council
Definition
and
Rules
Data
Governance
Structure
Data
Governance
Process
Do
Check
Act
Plan
Challenges Next Steps
SDMX Implement
GDF
Introduction
FPOS, GSBPM, CoP, DQAF, DDI, SDMX
Encourage all the government
agencies to comply with Data
Governance Framework
Source : https://www.dga.or.th/wp-content/uploads/2021/09/สรุปสาระสาคัญแผนพัฒนารัฐบาลดิจิทัล-พ.ศ.-2563-2565-ภาษาอังกฤษ.pdf
Important Message

6. GSIC, Thailand National Statistical Office
6
Introduction the Thai NSO
Challenges Next Steps
SDMX Implement
GDF
Introduction
SDMX?
 SDMX is an ISO standard (ISO 17369)
that is compatible with FPOS and GSBPM
 UN Statistical Commission recognized
SDMX as the preferred standard.
 Many open-source and user-friendly
application
 Reducing IT development and
maintenance costs
 Reducing the reporting burden on the
subject matters.
 SDMX is an important mechanism for
data sharing
 SDMX improves coherence,
 using Content Oriented Guidelines
Data Governance defines the rights, duties and
responsibilities of every stakeholder and defines the policies and
standards for creating, using and managing data such as the
data value cycle, quality of information and metadata
Source : Thailand Digital Government Development Commission
 What will be the role of TNSO in the society?
 How will TNSO respond to the new data ecosystem?
 How to build trust in producing statistics?
 How can we co-ordinate work between statistical units?
 How can we become more user-centric (with real-time need)
and ensure that the society maintain great trust in us?

7. GSIC, Thailand National Statistical Office
7
The Government Data Service Framework
The Government Data Service Framework
National Data Center, Cloud, and Big Data Platform
HR Development, Training Programs (Data Scientists,
Data Engineers, Business Analysts)
Common Services
• ID Verification
• Access control
• Data Linkage
• Transaction logging
• Digital Signature
• Service Statue Tracking
Data Governance
• Data accuracy, consistency,
completeness, freshness
• Data security
• Data availability
Government Data Catalog
and Directory services
Smart Government and
Open Government
• Citizen Services
• Ease of doing business
• Efficient Government
Law and Regulations
• Legal alignment
• Data protection
• Cyber security






Source : https://gbdi.depa.or.th/SL-Bigdata-framework-book
https://www.oecd-ilibrary.org/sites/2ab0c605-en/index.html?itemId=/content/component/2ab0c605-en#section-d1e14508
The Steering Committee for
Policy Implementation to
utilize Big Data, Data Centers,
and Cloud Computing.
Legislation
Architecture and
government Information
integration system
Human Resource
Development
Ministry of Digital Economy and Society as a secretary
Cabinet Resolution
on May 7, 2019
Challenges Next Steps
SDMX Implement
GDF
Introduction

8. GSIC, Thailand National Statistical Office
8
Implement the SDMX under the Government Data Service Framework
Agency Data Catalog
76 provinces and Bangkok
156 Government Agencies
GD Catalog Services
https://gdcatalog.go.th/
https://directory.gdcatalog.go.th/
https://api.gdcatalog.go.th/v1/api
https://app.powerbi.com/view?r=eyJrIjoiMzA3YmI5MTItYmJlYi00MDYxLWI0NjEtNDE4MDVmZ
GFlNDY1IiwidCI6IjQzZDNlNWRmLTU2ZDItNGI3NS05MDI4LTE3ZDM0NzY0ZDFhMCIsImMiOjE
wfQ%3D%3D&pageName=ReportSection92987602c22527106949
https://sdmx.nso.go.th/FusionMetadataRegistry/
Dashboard &
Visualization Services
https://vmcatalog.nso.go.th/
Using Microsoft Power BI
.Stat Suite enhances functionalities
By connecting various programs
CKAN API SDMX API
SDMX-CSV
https://stathub.nso.go.th/
Statistics Sharing Hub
TNSO has supported government
agencies in developing their data
catalog.
TNSO has developed the Government
Data Catalog Platform for collecting
the list of data and metadata from
all Agency Data Catalogs.
For the utilization of GD Catalog,
TNSO use SDMX in converting
statistical data files from various
formats into SDMX format
Challenges Next Steps
SDMX Implement
GDF
Introduction
  


9. GSIC, Thailand National Statistical Office
9
Source : https://gdcatalog.go.th
SDMX-CSV Format
Matrix Sheet
Challenges Next Steps
SDMX Implement
GDF
Introduction
GD Catalog Data type
Record
Statistical data
GIS format
On-demand data
Unstructured data
Statistical Data Format
Most of the files from the GD
Catalog are statistical data files,
which come in a variety of formats
from 156 Agency Data Catalog and
76 Provincial Data catalog.
Implement the SDMX under the Government Data Service Framework

10. GSIC, Thailand National Statistical Office
10
https://stathub.nso.go.th
Automatically
Fusion Metadata Registry
SDMX Structure Generation SDMX Artefact Repository
Thailand Fusion Metadata Registry
https://sdmx.nso.go.th/FusionMetadataRegistry
SDMX Matrix Generator
https://dlm-oshub.nso.go.th/
Thailand Statistics Sharing Hub
by .Stat Suite
by .Stat Suite
SDMX Data Preparation => SDMX CSV
Excel2CSV
Excel Power Query
Format Data Source
Challenges Next Steps
SDMX Implement
GDF
Introduction
manually
manually
manually
manually
Implement the SDMX under the Government Data Service Framework

11. GSIC, Thailand National Statistical Office
11
Dissemination
The International indicators and 8 statistical sectors
https://stathub.nso.go.th
Statistics Sharing Hub
SDMX Artefact Repository
https://sdmx.nso.go.th/FusionMetadataRegistry/
Get data from
API Query with
SDMX link From
.Stat Suite
https://app.powerbi.com/links/_dY4sCqELf?ctid=f64d3183-769
1-4fcb-a5ef-39ebc082bff9&pbi_source=linkShare
https://app.powerbi.com/groups/me/reports/517a65bc-b9a8-4d0f-9309-68b51703a746?cti
d=f64d3183-7691-4fcb-a5ef-39ebc082bff9&pbi_source=linkShare
https://app.powerbi.com/groups/me/reports/1d42f1e9-e043-47ef-adb2-2f
5112e830ed?ctid=f64d3183-7691-4fcb-a5ef-39ebc082bff9&pbi_source=lin
kShare
https://app.powerbi.com/groups/me/reports/2fb7bdd2-a9ae-4610-b1c2-a38
7e2e83c67?ctid=f64d3183-7691-4fcb-a5ef-39ebc082bff9&pbi_source=linkSh
are
Disseminate
the SDMX
structure in
various
format
Challenges Next Steps
SDMX Implement
GDF
Introduction
Implement the SDMX under the Government Data Service Framework

12. GSIC, Thailand National Statistical Office
12
Challenges
Challenges Next Steps
SDMX Implement
GDF
Introduction
A lack of communication and public relations about SDMX's benefits
with policymakers, executives, and users about how SDMX supports
data governance.
Government agencies require easily readable documentation for
non-experts in order to promote the use of SDMX, including Thai
language documentation.
Data providers refuse to change their processes in order to use the
SDMX standard.
Personnel skill gaps and knowledge transfer
The readiness of human resources and infrastructures of statistical
units

13. GSIC, Thailand National Statistical Office
13
Next Steps
Project Data Integration (Oct 2022 – Dec 2023)
For supporting the benefit of GD Catalog
Data
Feeding
Staging
Dataset
Prepare
Dataset
Service
(SDMX-JSON,
SDMX-XML,
SDMX-CSV)
Secondary data
Primary data
Dashboard Template
Dataset
Loader
Secondary data
Sharing
Hub
Data Center
Catalog
Agency Data
Catalog
Other source
Power BI
SDMX
R-SDMX
Python
SDMX
Teria Map
Government
Data Catalog
GD Catalog Services
Dashboard & Visualization
Services
Agency Data Catalog
CKAN API SDMX API
Challenges Next Steps
SDMX Implement
GDF
Introduction
Mostly manual
at this stage

14. GSIC, Thailand National Statistical Office
14
Next Steps
The Statistical Metadata of GD Catalog (28 items) The SDMX MSD (75 items)
The 16 items
are the same
meaning
Challenges Next Steps
SDMX Implement
GDF
Introduction

15. GSIC, Thailand National Statistical Office
15
Conclusion
 SDMX is a solution for harmonizing and automating data and
metadata exchange
 SDMX improves business processes, supports modernization,
trust, and provides access to a global community
 Common statistical concepts and sharing support coordination
among government agencies
 Address data sharing needs while preserving individual data
confidentiality & ensuring used for statistical process
As part of SDMX conclusion,
SDMX has an information model and tools to support Data and Metadata Governance

16. GSIC, Thailand National Statistical Office
16
Thank you for your kind attention