JSON-stat, a simple light standard for all kinds of data disseminators

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

JSON-stat
a simple light standard
for all kinds of data disseminators
Xavier Badosa
@badosa
http://xavierbadosa.com
http:/...

a simple light standard
for all kinds of data disseminators
Who needs to disseminate data?

Who needs to disseminate data?
Nowadays? Everybody!
Of course!
NSOs*
Central Banks
Intl. orgs
* National Statistical Offic...

How is data usually disseminated?
a simple light standard
for all kinds of data disseminators

How is data usually disseminated?
intableform

intableform

Wherever there’s data
addressed to humans
there is (usually) a table

plain old tables
Why are tables so popular?

Why are tables so popular?
a display device
Tablesare

a display device
with analytical features

an abbreviation, a compressor
a metadata saver

a cube model
that avoids
repeating
metadata
for every cell
an abbreviation, a compressor
a metadata saver

Cubic
Thinking
Describe data
in dimension terms

Simple, for everybody? How?
a simple light standard
for all kinds of data disseminators

Simple, for everybody? How?
If you managed to disseminate data
for humans in tables, you should be
able to do it for machi...

JSON is a data format used in
most APIs. It can include data
and metadata in a single doc.
Simple, for everybody? How?
In ...

Using a very simple cube model
that mimics a plain old table.
Simple, for everybody? How?
In JSON-stat.

A Canadian Example

table

data

What’s the simplest way to express these data in JSON?

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

[
] ,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

value
note/source/updated
label

dimension

age
dimension

age 20 categories
dimension
Size

age
Role
20 class
dimension
Size

age
concept
20
2
class
metric
dimension
RoleSize

age
concept
sex
20
2
3
class
metric
class
dimension
RoleSize

age
concept
sex
country
20
2
3
1
class
metric
class
geo
dimension
RoleSize

age
concept
sex
country
year
20
2
3
1
1
class
metric
class
geo
time
dimension
RoleSize

Persons (thousands)
2012
Canada

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

["country", "year", "age", "concept", "sex"]
Criterion:
What does not change, first.
To make sense of this array, dimensio...

country
year
age
concept
sex
CA CA CA CA CA CA
2012 2012 2012 2012 2012 2012
Total Total Total Total Total Total
Persons P...

"value" : [ … ]
}
{
"version" : "2.0",
"class" : "dataset",
"label" : "Population by sex and age group. Canada. 2012",
"so...

"value" : [ … ]
}
{
"id" : [ "country" , "year" , "age" , "concept" , "sex" ],
"size" : [ 1 , 1 , 20 , 2 , 3 ],
"role" : {...

country
year
age
concept
sex
CA CA CA CA CA CA
2012 2012 2012 2012 2012 2012
Total Total Total Total Total Total
Persons P...

"value" : [ … ]
}
{
"id" : [ "country" , "year" , "age" , "concept" , "sex" ],
"size" : [ 1 , 1 , 20 , 2 , 3 ],
"role" : {...

"sex" : {
"label" : "sex",
"category" : {
"index" : ["T", "M", "F"],
"label" : {
"T" : "Total",
"M" : "Male",
"F" : "Femal...

"sex" : {
"label" : "sex",
"category" : {
"index" : ["T", "M", "F"],
"label" : {
"T" : "Total",
"M" : "Male",
"F" : "Femal...

The “unflattening” problem

The “unflattening” problem
from
dimension
positions
[0,0,7,0,2]

The “unflattening” problem
from
dimension
positions
to value
position
44[0,0,7,0,2]

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

[
]
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
...

Persons (thousands)
2012
Canada
["country", "year", "age", "concept", "sex"]
0
0
0 is the first position
(first category o...

Persons (thousands)
2012
Canada
["country", "year", "age", "concept", "sex"]
0
0
0
1
2
3
4
5
6
7

Persons (thousands)
2012
Canada
["country", "year", "age", "concept", "sex"]
0
0
0 1
0

Persons (thousands)
2012
Canada
["country", "year", "age", "concept", "sex"]
0
0
0
0 1 2

Persons (thousands)
2012
Canada
["country", "year", "age", "concept", "sex"]
0
0
0
[0, 0, 7, 0, 2] → 44

2012
Canada
["country", "year", "age", "concept", "sex"]
0
0
0
[ 1, 1, 20, 2, 3 ]
Persons (thousands)
(Size)
[0, 0, 7, 0, ...

The“unflattening” problem
["country", "year", "age", "concept", "sex"]
[ 1, 1, 20, 2, 3 ]
[0, 0, 7, 0, 2] → 44

The“unflattening” problem
["country", "year", "age", "concept", "sex"]
[ 1, 1, 20, 2, 3 ]
It’s a simple
mathematical
probl...

Lost in cells?
Method: Row-major order
In computing, row-major order and column-
major order describe methods for arrangin...

Lost in cells?
There’s a Javascript library that
takes care of this.

Lost in cells?
Are you a coder? Do you want to
develop your own library?
arr2num(
[0,0,7,0,2],
[1,1,20,2,3]
)
44

Lost in cells?
Here’s a simple solution to
the “unflattening” problem.
function arr2num( arr, size ){
for(var i=0, num=0, ...

Lost in cells?
Or check the sample code section
at http://json-stat.org/tools/
function arr2num( arr, size ){
for(var i=0,...

The JSON-stat
Ecosystem
format
libs
conn.
schema

thank you

all pictures from
Blocks picture in slide 1: Soma, by Dru! (CC BY-NC)
Cubic head in slide 13: Portrait by Thomas Leth-Olse...

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

Share
Email

JSON-stat & JS: the JSON-stat Javas... by Xavier Badosa 26357 views

Top clipped slide

1 of 68 Ad

1 of 68 Ad