Consuming Nordic Statbank data with JSON-stat

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Consuming
Nordic Statbank data
with JSON-stat
Xavier Badosa (@badosa)
Statistical Institute of Catalonia (Idescat)

Aluu
Hallå
Hallo
Halló
Hei
Hej

Consuming
Nordic Statbank data
with JSON-stat
Xavier Badosa (@badosa)
Statistical Institute of Catalonia (Idescat)

Consuming
Nordic Statbank data
with JSON-stat

JSON-stat.org
a simple light standard
for all kinds of data disseminators
}

http://www.stat2go.com

data
as an
infrastructure

API
NSO as a
platform
data
as an
infrastructure

The Software Staircase
access
processing
webpages

download
The Software Staircase
access
processing
webpages

webpages
download
API
The Software Staircase
access
processing

data
provider
developer

users
data
provider
developer

users
data
app

users
data
API
app

real
tim
e

lightweight

Statistics Sweden
AM0401DA
Population
aged 15-74
(LFS), thousands
by sex, age, labour
status and month
SDMX-ML XML
PX-JSON...

JavaScript Object Notation
JSON
http://json.org

"This is a text."
JS

666
JS

666
3.14159265
JS

666
3.14159265
-299792458
JS

666
3.14159265
-299792458
null
JS

666
3.14159265
-299792458
null true false
JS

[ 1, 2, 3 ]
JS

[ 1, 2, 3 ]
[ "one", "two", "three" ]a =
JS

[ 1, 2, 3 ]
[ "one", "two", "three" ]a =
a[1]
0 1 2
JS

[ "one", "two", "three" ]
[ 1, 2, 3 ]
[ "Men", 301784 ]
JS

[ "one", "two", "three" ]
[ 1, 2, 3 ]
[ "Men", 301784 ]
[
[ "Men", 301784 ],
[ "Women", 284434 ]
]
JS

[
[ "Men", "0-4", "2015", "Sweden", 301784 ],
[ "Women", "0-4", "2015", "Sweden", 284434 ]
]
JS

[
{ "sex": "Men", "val": 301784 }
{"sex": "Women", "value": 3800}
]
a =
JS

[
{ "sex": "Men", "val": 301784 }
{"sex": "Women", "value": 3800}
]
a =
a["val"]
a.val
JS

[
{ "sex": "Men", "val": 301784 },
{ "sex": "Women", "val": 284434 }
]
JS

[
{ "sex": "Men", "val": 301784 },
{ "sex": "Women", "val": 284434 }
]
a =
JS

[
{ "sex": "Men", "val": 301784 },
{ "sex": "Women", "val": 284434 }
]
a =
a[1]
JS

[
{ "sex": "Men", "val": 301784 },
{ "sex": "Women", "val": 284434 }
]
a =
a[1]["sex"]
a[1].sex
JS

[
{
"concept": "Population",
"sex": "Men",
"age": "0-4",
"country": "Sweden",
"year": "2015",
"value": 301784
},
{
"concep...

Abbreviation

Cubic
Model
Describe data
in dimension terms

[
{
"concept": "Population",
"sex": "Men",
"age": "0-4",
"country": "Sweden",
"year": "2015",
"value": 301784
},
{
"concep...

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

value
note/source/updated
label

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

[
] ,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

"value" : [ … ],
}
"id" : [ "country" , "year" , "age" , "concept" , "sex" ],
"size" : [ 1 , 1 , 20 , 2 , 3 ],
"role" : { ...

"value" : [ … ],
}
"id" : [ "country" , "year" , "age" , "concept" , "sex" ],
"size" : [ 1 , 1 , 20 , 2 , 3 ],
"role" : { ...

"sex" : {
"label" : "sex",
"category" : {
"index" : ["T", "M", "F"],
"label" : {
"T" : "total",
"M" : "male",
"F" : "femal...

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

function arr2num( arr, size ){
for(var i=0, num=0, mult=1, ndims=size.length; i<ndims; i++){
mult*=(i>0) ? size[ndims-i] :...

Method: Row-major order
In computing, row-major order and column-
major order describe methods for arranging
multidimensio...

users
data
API
dev

users
dev
data
tools
API

JavaScript
R
Python
Python
Java

You could not step twice into the same river.
Everything changes and nothing stands still.
Heraclitus

Responses Version
bundle
0
(set of one or more datasets)

Responses Version
bundle
1dataset
dimension
collection

Responses Version
bundle
2dataset
dimension
collection

2.0
2.0
2.0
2.0
JavaScript
R
Python
Python
Java

{
"version": "2.0", "class": "dataset",
"label": "Persons by region, sex, age and time",
"source": "Statistics Norway",
"u...

{
"your dataset id here": {
"label": "Persons by region, sex, age and time",
"source": "Statistics Norway",
"updated": "20...

{
"dataset": {
"label": "Persons by region, sex, age and time",
"source": "Statistics Norway",
"updated": "2016-06-01T19:4...

PX-Web

PX-Web

JSON-stat

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA

user
dev
prov

interface
data
logic

interface
logic
retrieve
process
build
data

process
build
retrieve
JavaScript

process
build
retrieve
JavaScript

process
build
retrieve
JSON-stat
Javascript
Toolkit
JSON-stat
Javascript
Utilities Suite
https://json-stat.com
JavaScript

process
build
JavaScript
JSONP, XHR, Fetch
JJT
jQuery…
JJT
retrieve

process
build
JavaScript
JSONP, XHR, Fetch
JJT
jQuery…
JJT
Visual
retrieve

Introducing
the
JSON-stat
Javascript
Toolkit
json-stat.com

JSON-stat Tree
Dataset
Dimension
Category
Data
1. Chainable traversing methods

Dataset
Dimension
Category
Data
Metadata Path
class
label
length
id
1. Chainable traversing methods

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Dimension(3).Category(2).label
JSONstat(obj).Dataset("dataset").D...

Dataset
Dimension
Category
Data
Data Path
value
status
1. Chainable traversing methods

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Data( {
} ).value

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Data( {
"country" : "CA",
"year" : "2012",
"concept" : "POP",
"ag...

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Data( {
"country" : "CA",
"year" : "2012",
"concept" : "POP",
"ag...

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Data( {
"country" : "CA",
"year" : "2012",
"concept" : "POP",
"ag...

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Data( {
"country" : "CA",
"year" : "2012",
"concept" : "POP",
"ag...

1. Chainable traversing methods
JSONstat(obj).Dataset(0).Data( {
country : "CA",
year : "2012",
concept : "POP",
age : "34...

2. Chainable transformation methods
Dataset
toTable
Slice

JSONstat( obj ).Dataset(0).toTable( { type : "arrobj" } );
[
{
age : "Total",
concept : "Persons (thousands)",
country : "...

json-stat.com/nsm

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Download

process
build
JavaScript
JSONP, XHR, Fetch
JJT
jQuery…
JJT
Visual
retrieve

Demo

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API Dedicated Section

http://www.scb.se/en_/About-us/Open-data-API/API-for-the-Statistical-Database-/

Demo

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API JSONP

Demo

HTTP Verbs
GET
POST Requests that the server stores
the data enclosed in the body of
the request message.
Requests a repre...

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GETJSONP

Demo

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GET SQueryJSONP

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GETJSONP SQuery

Demo

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GETJSONP SQuery

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
SBA
CORS SQuery

Cross-Origin
Resource Sharing
A web application using XHR/Fetch can
only make HTTP requests to its own domain.
Same-Origin...

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GETJSONP SQuery

Demo

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GETJSONP SQuery

Demo

Denmark
Norway
Sweden
Finland
Greenland
Iceland
Faroe Islands
ΩΩ
SBA
Down. API GET SQueryJSONP

ΩΩThank
You

Credits
“Soma” (blocks’ background)
by Dru! (CC BY-NC)
“Metal movable type”
by Willi Heidelbach (CC BY-SA)
“Portrait” (cub...

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

Share
Email

Periodisme de dades i oficines esta... by Xavier Badosa 15294 views
Difusió estadísTICa oficial by Xavier Badosa 15196 views
Idescat Visual: Gràfics i mapes by Xavier Badosa 15098 views
JSON-stat & JS: the JSON-stat Javas... by Xavier Badosa 26357 views
Reutilización de datos gracias a la... by Xavier Badosa 14819 views
Gov APIs: The Notorious Case of Off... by Xavier Badosa 14972 views

Top clipped slide

1 of 132 Ad

1 of 132 Ad