Standards for statistical data dissemination                                      a wish list                     Xavier B...
For humans
For humans (naked)
For humans (naked)(accessed and read by humans)
For humans (naked)(accessed and read humans)
For humans with machines(accessed by humans,but read by machines)            For humans (naked)       (accessed and read h...
For machines
For machines built by humans
For machines built by humans(accessed and read by machines)
API   D A T A
General-purpose“Apps”Third-party“Apps”that solve specific needsStatistics as platform      “O.S.”
How I stopped worrying about mywebsite and learned to love the wholeInternet     Matt McAlister     Director of Digital St...
We don’t operate in theeyeball market            maximum data                          exposure & reachWe operate in the  ...
E   A       BCHA   Big orgsNG   Stats-savvyE    B2B
E       A      BCHA      Big orgsNG      Stats-savvyE       B2B    Shared environment
D    I                SS            EM            I                N        A                    T                        ...
?
like the   ?           WWW
For machines built by humans
don’t make me think     KISS principlerespect the conventions      develop also  for the weakest link
is a platform An example
is widely used  An example
2006       is widely used2009   50,000 applications
is widely used# mashups
is widely usedhad more than1 provider
is widely used= is a standard
“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile...
KISS principle“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement ...
develop for the weakest link“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy...
provide a useful service“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to ...
get close to the end users“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy t...
langs / APIs ~ browsers / websites“these APIs are simple enough for weekendhackers to build interesting projects on, and(…...
“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile...
2              APIsREST API    100 x 1.5 = 150 pp.Streaming API    6 x 3 = 18 pp.                     < 200 pp.
208 pp.                   < 200 pp.books.google.com
The Fifteen Minute Rule        A person of reasonable       ability should be able toget from zero to ‘Hello World’  in fi...
http://lcsd05.cs.tamu.edu/slides/keynote.pdf
18 pp.1 PDF18 pp.
18 pp. 1 PDF143 pp.
161 pp. 1 PDF143 pp.
161 pp.ZIP 8 MSW
1,109 pp.ZIP 8 MSW     46 pp.   341 pp.   269 pp.     68 pp.   176 pp.     34 pp.      4 pp.     10 pp.
1,109 pp.Samples
1,278 pp.ZIP 1 PDF 169 pp.
1,327 pp.     PDF  49 pp.
1,377 pp.     PDF  50 pp.
1,408 pp.     PDF  31 pp.
1,408 pp.                   1,344 pp.books.google.com
high barrier to entry   APIdevelopers
ECHAN         SDMXGE    Shared environment
ECHAN          SDMXG       amazingly flexibleE    Shared environment
ECHAN          SDMXG       amazingly complexE    Shared environment
ECHAN          SDMXG       amazingly complexESDMX-ML is a meta-language
D    I                S           TypePad                WordPressS            EM            I                N        A  ...
The Metcalfe-Bray Law                        D                                 The value of a    I                        ...
The Metcalfe-Bray Law                        D                                       The value of a    I                  ...
D    I                                                                 Are we                S           Stats provider   ...
Are we                            so special                             that                               we        Spec...
Population Search API
Population Search API                 Atom
Population Search API      Atom OpenSearch
Population Search APIAtom OpenSearch SDMX
Population Search API
Population Search API
Rectifications API
Rectifications API    Atom OpenSearch
Rectifications API    Atom OpenSearch
Rectifications API    Atom OpenSearch
Rectifications API    Atom OpenSearch
Rectifications API    Atom OpenSearch
Rectifications API    Atom OpenSearch
AtomOpenSearchhttp://www.opensearch.orgOpen Data Protocolhttp://www.odata.orgGoogle Data Protocolhttp://code.google.com/ap...
Are we                            so special                             that                               we        Spec...
Are we                            so special           SDMX?             that                               we        Spec...
Are we                             so special           SDMX?              that                                we        S...
A Complex System That Works Is InvariablyFound To Have Evolved From A Simple System               That Worked.       “Gall...
The parallel proposition also appears to be true:  A Complex System Designed From Scratch Never Works And Cannot Be Made T...
What’s common practice  in the API space?
Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
“REST”                                                            RESTish                                                 ...
Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
<KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef>           <Series>            <SeriesKey>              <Value concept="LOCATION" ...
<KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef><KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef>             <Series>                     ...
<KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef>             "KeyFamilyRef" : "ALFS_SUMTAB" ,<Series>                             ...
"KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : {  "SeriesKey" : {    "location" : "AUS" ,    "subject" : "YGTT01L1_ST" ,    "f...
"KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : {  "SeriesKey" : {    "location" : "AUS" ,    "subject" : "YGTT01L1_ST" ,    "f...
"KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : {  "SeriesKey" : {    "location" : "AUS" ,    "subject" : "YGTT01L1_ST" ,    "f...
"KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : {  "SeriesKey" : {    "location" : "AUS" ,    "subject" : "YGTT01L1_ST" ,    "f...
"KeyFamilyRef" : "ALFS_SUMTAB" ,                         "Series" : {                           "SeriesKey" : {           ...
"KeyFamilyRef" : "ALFS_SUMTAB" ,a “data” format                   "Series" : {                                    "SeriesK...
"KeyFamilyRef" : "ALFS_SUMTAB" ,a “data” format                         "Series" : {                                      ...
"KeyFamilyRef" : "ALFS_SUMTAB" ,                         "Series" : {                           "SeriesKey" : {           ...
"KeyFamilyRef" : "ALFS_SUMTAB" ,                         "Series" : {                           "SeriesKey" : {           ...
"KeyFamilyRef" : "ALFS_SUMTAB" ,                         "Series" : {                           "SeriesKey" : {           ...
From document viewerNatural to programmers                         to application platform
Fragmented device market
Fragmented device market
Storage    Offline  GeolocationAudio and Video    Canvas Drag and Drop       …                  JS APIs
SGML / DTD   XML / XSD
JSONP               callbackJSON with padding
CORS
http://caniuse.com/#feat=cors
Date: Wed, 22 Feb 2012 17:12:52 GMTServer: ApacheExpires: Wed, 22 Feb 2012 18:12:52 GMTAccess-Control-Allow-Origin: *Conte...
XML SDMX-MLJSON SDMX-JS?
XMLJSON
XML       Xml2Json()   JSONOn-the-fly conversion
XML          Xml2Json()    JSONOn-the-fly conversion<text>Hello, World!</text>
XML          Xml2Json()    JSONOn-the-fly conversion<text>Hello, World!</text>"text": "Hello, World!"
XML          Xml2Json()    JSONOn-the-fly conversion<text>Hello, World!</text><text>Goodbye, Life!</text>"text": "Hello, W...
XML          Xml2Json()    JSONOn-the-fly conversion<text>Hello, World!</text><text>Goodbye, Life!</text>"text": ["Hello, ...
XML          Xml2Json()    JSONOn-the-fly conversion<text>Hello, World!</text>"text": ["Hello, World!"]
XML   JSONPredefined map
XML   JSONPredefined map              namespaces?        elements/attributes?                 all strings?
“XMLish” JSONPredefined map
{"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-04", "generic:ObsValue" :         “XMLish”{"@value" ...
natural-bornJSON
natural-born JSON“JSON-G”  genuine
natural-born JSON“JSON-G”“JSON-C”compact/customized
Price of an apple?Save as many bytesas possible
Price of an apple?Nutrition valueAllergiesRecipesPriceForbidden fruit inthe Garden of Eden
FlexibilityNutrition valueAllergiesRecipesPriceForbidden fruit inthe Garden of Eden
detail=fulldetail=dataonlydetail=serieskeysonlydetail=nodata
ResponseGroup=Images,Reviews
fields=id,name,picture
fields=title,teaserbyline,none
:(id,first-name,last-name,positions:(title))
fields=id,scope/type
fields=entry(id,gd:when)
fields=entry(@gd:*,id,gd:when)
fields=entry(title,link[@rel=self or @rel=edit],media:group(media:thumbnail))
fields=entry[media:group/yt:duration/@seconds<= 120 and yt:statistics/@viewCount > 20]
simple flexible                           RESTish               JSONlightweightdeveloper-centric                    mobile...
simple flexible                         RESTish               JSONlightweight              Semantic Web-ish?developer-cent...
I have a dream for the Web [in which computers] becomecapable of analyzing all the data on the Web – the content,links, an...
Statistical “Cube” Data. The group will produce avocabulary, compatible with SDMX, for expressingsome kinds of statistical...
The MainstreamRelevance “Law”The mainstreamrelevance of acommunicationenvironment isproportional tothe quantity ofrubbish ...
The MainstreamRelevance “Law”The mainstreamrelevance of acommunicationenvironment isproportional tothe quantity ofrubbish ...
The MainstreamRelevance “Law”     TV   e-mail   Twitter     ...
simple? flexible                        RESTish               JSON?lightweight?              Semantic Web-ish?developer-ce...
Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
For some web developers the need to understandthe RDF data model and associated serializations andquery language (SPARQL) ...
Simplify + JSONify SDMX?Reuse/adapt a generic data format?              semantic
Simplify + JSONify SDMX?Reuse/adapt a generic data format?              semanticCreate a new simple standard for stats?
http://json-stat.org
http://json-stat.orglightweight
http://json-stat.orgsimple
http://json-stat.orgdeveloper-centric
http://json-stat.orgflexible
http://code.google.com/p/json-stat/
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Latest population figure of Catalonia",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "time", "...
{  "label": "Population of Catalonia, January 1st, 2011",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "tim...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "tim...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "tim...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "tim...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,        "long" : 2.178389,  "dimension" : {...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "tim...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,       "index"  "dimension" : {: {    "id" ...
{  "label": “Population of Catalonia, January 1st, 2011",  "value": [7539618] ,  "dimension" : {    "id" : ["metric", "tim...
"value": [3732196, 3807422 , 7539618]
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : {  "category"...
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : {  "category"...
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : {  "category"...
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : {  "category"...
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : {  "category"...
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : {  "category"...
"value": [3732196, 3807422 , 7539618]"id"   : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex3" : {  "attribut...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [    3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, ...
"value": [3732196, 3807422 , 7539618]"sex" : {  "category" : {    "index" : {"M" : 0 , "F" : 1 , "T" : 2} ,    "label" : {...
"value": [3732196, 3807422 , 7539618]"sex" : {  "category" : {    "index" : {"M" : 0 , "F" : 1 , "T" : 2} ,    "label" : {...
"value": [3732196, 3807422 , 7539618]"sex" : {  "category" : {    "uri" : "http://jsonstat.dataprovider.org/dimension/sex....
The JSON-stat CommunityWelcomes You!
The JSON-stat CommunityWelcomes You! Needs You!
Standards for statistical data dissemination                                      a wish list                     Xavier B...
Dan Taylor                     borman818 / Daniel Borman                     Christian Cable                     Ian Mutto...
Photos of products and webpages have been taken from the respectivecompanies’ websites. 1993 Mosaic webpage, © Board of Tr...
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Standards for statistical data dissemination: a wish list
Upcoming SlideShare
Loading in...5
×

Standards for statistical data dissemination: a wish list

10,217

Published on

Presented in March 2012 at the OECD Statistical Information System Collaboration Community (SIS-CC) Workshop in Paris.

Video available at http://youtu.be/ZldhNV3Qt6c

The digitization of information exchange processes has led in many industries to define standards to be used in the B2B side of the value chain for the conversations between key partners. The agencies involved in statistical production are not an exception and need to agree on standards that can be used in the exchange of data and metadata between them. However, before these standards have been fully adopted, new needs have arisen that have stressed the importance of machine readable formats for the reuse of the public sector information. Open data initiatives have usually found a strategic ally in the statistical offices because timeliness, punctuality and accessibility are part of the code of practice in official statistics. This has increased the necessity of standards not only for data exchange between organizations specializing in statistical production but also for dissemination to third parties. The presentation will try to address the requirements that the dissemination standards should meet in this new context.

Published in: Technology
0 Comments
9 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
10,217
On Slideshare
0
From Embeds
0
Number of Embeds
16
Actions
Shares
0
Downloads
0
Comments
0
Likes
9
Embeds 0
No embeds

No notes for slide

Standards for statistical data dissemination: a wish list

  1. 1. Standards for statistical data dissemination a wish list Xavier Badosa (@badosa) Statistical Institute of Catalonia OECD Statistical Information System Collaboration Community (SIS-CC) Workshop 2012. Paris, 12-14 March
  2. 2. For humans
  3. 3. For humans (naked)
  4. 4. For humans (naked)(accessed and read by humans)
  5. 5. For humans (naked)(accessed and read humans)
  6. 6. For humans with machines(accessed by humans,but read by machines) For humans (naked) (accessed and read humans)
  7. 7. For machines
  8. 8. For machines built by humans
  9. 9. For machines built by humans(accessed and read by machines)
  10. 10. API D A T A
  11. 11. General-purpose“Apps”Third-party“Apps”that solve specific needsStatistics as platform “O.S.”
  12. 12. How I stopped worrying about mywebsite and learned to love the wholeInternet Matt McAlister Director of Digital Strategy Guardian Media Group
  13. 13. We don’t operate in theeyeball market maximum data exposure & reachWe operate in the accuracy preservationreferencemarket brand recognition
  14. 14. E A BCHA Big orgsNG Stats-savvyE B2B
  15. 15. E A BCHA Big orgsNG Stats-savvyE B2B Shared environment
  16. 16. D I SS EM I N A T IO N
  17. 17. ?
  18. 18. like the ? WWW
  19. 19. For machines built by humans
  20. 20. don’t make me think KISS principlerespect the conventions develop also for the weakest link
  21. 21. is a platform An example
  22. 22. is widely used An example
  23. 23. 2006 is widely used2009 50,000 applications
  24. 24. is widely used# mashups
  25. 25. is widely usedhad more than1 provider
  26. 26. is widely used= is a standard
  27. 27. “these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html
  28. 28. KISS principle“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html
  29. 29. develop for the weakest link“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html
  30. 30. provide a useful service“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html
  31. 31. get close to the end users“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html
  32. 32. langs / APIs ~ browsers / websites“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html
  33. 33. “these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.”
  34. 34. 2 APIsREST API 100 x 1.5 = 150 pp.Streaming API 6 x 3 = 18 pp. < 200 pp.
  35. 35. 208 pp. < 200 pp.books.google.com
  36. 36. The Fifteen Minute Rule A person of reasonable ability should be able toget from zero to ‘Hello World’ in fifteen minutes. Michael E. Driscoll Dataspore, Metamarkets
  37. 37. http://lcsd05.cs.tamu.edu/slides/keynote.pdf
  38. 38. 18 pp.1 PDF18 pp.
  39. 39. 18 pp. 1 PDF143 pp.
  40. 40. 161 pp. 1 PDF143 pp.
  41. 41. 161 pp.ZIP 8 MSW
  42. 42. 1,109 pp.ZIP 8 MSW 46 pp. 341 pp. 269 pp. 68 pp. 176 pp. 34 pp. 4 pp. 10 pp.
  43. 43. 1,109 pp.Samples
  44. 44. 1,278 pp.ZIP 1 PDF 169 pp.
  45. 45. 1,327 pp. PDF 49 pp.
  46. 46. 1,377 pp. PDF 50 pp.
  47. 47. 1,408 pp. PDF 31 pp.
  48. 48. 1,408 pp. 1,344 pp.books.google.com
  49. 49. high barrier to entry APIdevelopers
  50. 50. ECHAN SDMXGE Shared environment
  51. 51. ECHAN SDMXG amazingly flexibleE Shared environment
  52. 52. ECHAN SDMXG amazingly complexE Shared environment
  53. 53. ECHAN SDMXG amazingly complexESDMX-ML is a meta-language
  54. 54. D I S TypePad WordPressS EM I N A T I existing Twitter clientsO N
  55. 55. The Metcalfe-Bray Law D The value of a I markup language is proportional S TypePad WordPress approximatelyS to the square E of theM number of I different N software implementations A that can process T it. I Tim Bray existing Twitter clientsO Google N
  56. 56. The Metcalfe-Bray Law D The value of a I markup language is proportional S Stats provider Stats provider approximatelyS to the square E of theM number of I different N software implementations A that can process T it. I Tim Bray existing clientsO Google N
  57. 57. D I Are we S Stats provider Stats provider so specialS that E weM can’t I benefit N from A existing T libraries I and clients? existing clientsO N
  58. 58. Are we so special that we Special things can’t benefit from existing libraries and clients?Common things
  59. 59. Population Search API
  60. 60. Population Search API Atom
  61. 61. Population Search API Atom OpenSearch
  62. 62. Population Search APIAtom OpenSearch SDMX
  63. 63. Population Search API
  64. 64. Population Search API
  65. 65. Rectifications API
  66. 66. Rectifications API Atom OpenSearch
  67. 67. Rectifications API Atom OpenSearch
  68. 68. Rectifications API Atom OpenSearch
  69. 69. Rectifications API Atom OpenSearch
  70. 70. Rectifications API Atom OpenSearch
  71. 71. Rectifications API Atom OpenSearch
  72. 72. AtomOpenSearchhttp://www.opensearch.orgOpen Data Protocolhttp://www.odata.orgGoogle Data Protocolhttp://code.google.com/apis/gdata/Open Publication Distribution Systemhttp://opds-spec.org
  73. 73. Are we so special that we Special things can’t benefit from existing libraries and clients?Common things
  74. 74. Are we so special SDMX? that we Special things can’t benefit from existing libraries and clients?Common things
  75. 75. Are we so special SDMX? that we Special things can’t benefit from Simplified SDMX? existing libraries and clients?Common things
  76. 76. A Complex System That Works Is InvariablyFound To Have Evolved From A Simple System That Worked. “Gall’s Law” Systemantics How Systems Work and Especially How They Fail John Gall
  77. 77. The parallel proposition also appears to be true: A Complex System Designed From Scratch Never Works And Cannot Be Made To Work. You Have To Start Over, Beginning With A Working Simple System. “Gall’s Law” Systemantics How Systems Work and Especially How They Fail John Gall
  78. 78. What’s common practice in the API space?
  79. 79. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  80. 80. “REST” RESTish Pragmatic REST REST-inspiredOpen APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  81. 81. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  82. 82. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  83. 83. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  84. 84. <KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef> <Series> <SeriesKey> <Value concept="LOCATION" value="AUS" /> <Value concept="SUBJECT" value="YGTT01L1_ST" /> <Value concept="FREQUENCY" value="A" /> </SeriesKey> <Attributes> <Value concept="TIME_FORMAT" value="P1Y" /> </Attributes> <Obs> <Time>2000</Time> <ObsValue value="19153" /> </Obs> <Obs> <Time>2001</Time> <ObsValue value="19413" /> </Obs> <Obs> <Time>2002</Time>SDMX-ML <ObsValue value="19651" /> </Obs> <Obs> <Time>2003</Time> <ObsValue value="19895" /> </Obs> <Obs> <Time>2004</Time> <ObsValue value="20127" />fragment </Obs> <Obs> <Time>2005</Time> <ObsValue value="20395" /> </Obs> <Obs> <Time>2006</Time> <ObsValue value="20698" /> </Obs> <Obs> <Time>2007</Time> <ObsValue value="21072" /> </Obs> <Obs> <Time>2008</Time> <ObsValue value="21499" /> </Obs> <Obs> <Time>2009</Time> <ObsValue value="21955" /> </Obs> <Obs> <Time>2010</Time> <ObsValue value="22342" /> </Obs> </Series>
  85. 85. <KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef><KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef> <Series> <SeriesKey><Series> <Value concept="LOCATION" value="AUS" /> <SeriesKey> <Value concept="SUBJECT" value="YGTT01L1_ST" /> <Value concept="FREQUENCY" value="A" /> <Value concept="LOCATION" value="AUS" /> </SeriesKey> <Attributes> <Value concept="SUBJECT" value="YGTT01L1_ST" /> <Value concept="TIME_FORMAT" value="P1Y" /> </Attributes> <Value concept="FREQUENCY" value="A" /> <Obs> </SeriesKey> <Time>2000</Time> <ObsValue value="19153" /> <Attributes> </Obs> <Obs> <Value concept="TIME_FORMAT" value="P1Y" /> <Time>2001</Time> <ObsValue value="19413" /> </Attributes> </Obs> <Obs> <Obs> <Time>2002</Time> <Time>2000</Time> <ObsValue value="19651" /> </Obs> <ObsValue value="19153" /> <Obs> <Time>2003</Time> </Obs> <ObsValue value="19895" /> <Obs> </Obs> <Obs> <Time>2001</Time> <Time>2004</Time> <ObsValue value="20127" /> <ObsValue value="19413" /> </Obs> <Obs> </Obs> <Time>2005</Time> <Obs> <ObsValue value="20395" /> </Obs> <Time>2002</Time> <Obs> <Time>2006</Time> <ObsValue value="19651" /> <ObsValue value="20698" /> </Obs> </Obs> <Obs> <Obs> <Time>2007</Time> <ObsValue value="21072" /> <Time>2003</Time> </Obs> <Obs> <ObsValue value="19895" /> <Time>2008</Time> <ObsValue value="21499" /> </Obs> </Obs> <Obs> <Obs> <Time>2009</Time> <Time>2004</Time> <ObsValue value="21955" /> </Obs> <ObsValue value="20127" /> <Obs> <Time>2010</Time> </Obs> <ObsValue value="22342" /> <Obs> </Obs> </Series> <Time>2005</Time>
  86. 86. <KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef> "KeyFamilyRef" : "ALFS_SUMTAB" ,<Series> "Series" : { <SeriesKey> "SeriesKey" : { <Value concept="LOCATION" value="AUS" /> "location" : "AUS" , <Value concept="SUBJECT" value="YGTT01L1_ST" /> "subject" : "YGTT01L1_ST" , <Value concept="FREQUENCY" value="A" /> "frequency" : "A" </SeriesKey> }, <Attributes> "Attributes" : { <Value concept="TIME_FORMAT" value="P1Y" /> "time_format" : "P1Y" </Attributes> }, <Obs> "Obs" : [ <Time>2000</Time> {"2000" : 19153}, <ObsValue value="19153" /> {"2001" : 19413}, </Obs> {"2002" : 19651}, <Obs> {"2003" : 19895}, <Time>2001</Time> {"2004" : 20127}, <ObsValue value="19413" /> {"2005" : 20395}, </Obs> {"2006" : 20698}, <Obs> {"2007" : 21072}, <Time>2002</Time> {"2008" : 21499}, <ObsValue value="19651" /> {"2009" : 21955}, </Obs> {"2010" : 22342} <Obs> ] <Time>2003</Time> <ObsValue value="19895" /> </Obs> <Obs> <Time>2004</Time> <ObsValue value="20127" /> </Obs> <Obs> <Time>2005</Time>
  87. 87. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : [ {"2000" : 19153}, {"2001" : 19413}, {"2002" : 19651}, {"2003" : 19895}, {"2004" : 20127}, {"2005" : 20395}, {"2006" : 20698}, {"2007" : 21072}, {"2008" : 21499}, {"2009" : 21955}, {"2010" : 22342} ]
  88. 88. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "2000" : 19153, "2001" : 19413, "2002" : 19651, "2003" : 19895, "2004" : 20127, "2005" : 20395, "2006" : 20698, "2007" : 21072, "2008" : 21499, "2009" : 21955, "2010" : 22342 }
  89. 89. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }
  90. 90. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }
  91. 91. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { “time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }
  92. 92. "KeyFamilyRef" : "ALFS_SUMTAB" ,a “data” format "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : {string, number, bool, null “time_format" : "P1Y" },array (vector, list, sequence) "Obs" : { "time": [ "2000","2001","2002","2003",object (struct, hash table, "2004","2005","2006","2007",associative array, map, "2008","2009","2010" ],record, keyed list, dictionary) "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }
  93. 93. "KeyFamilyRef" : "ALFS_SUMTAB" ,a “data” format "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { “time_format" : "P1Y"“JSON shines as a }, "Obs" : {programming language- "time": [independent representation "2000","2001","2002","2003", "2004","2005","2006","2007",of typical programming "2008","2009","2010"language data structures.” ], "value": [ James Clark 19153,19413,19651,19895, Technical lead for the W3C XML 20127,20395,20698,21072, activity which developed 21499,21955,22342 XML 1.0 Recommendation ] }
  94. 94. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : {value[0] = 19153 “time_format" : "P1Y"value[1] = 19413 },value[2] = 19651 "Obs" : { "time": [value[3] = 19895 "2000","2001","2002","2003",value[4] = 20127 "2004","2005","2006","2007",value[5] = 20395 "2008","2009","2010" ],value[6] = 20698 "value": [value[7] = 21072 19153,19413,19651,19895,value[8] = 21499 20127,20395,20698,21072, 21499,21955,22342value[9] = 21955 ]value[10] = 22342 }
  95. 95. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }
  96. 96. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }
  97. 97. From document viewerNatural to programmers to application platform
  98. 98. Fragmented device market
  99. 99. Fragmented device market
  100. 100. Storage Offline GeolocationAudio and Video Canvas Drag and Drop … JS APIs
  101. 101. SGML / DTD XML / XSD
  102. 102. JSONP callbackJSON with padding
  103. 103. CORS
  104. 104. http://caniuse.com/#feat=cors
  105. 105. Date: Wed, 22 Feb 2012 17:12:52 GMTServer: ApacheExpires: Wed, 22 Feb 2012 18:12:52 GMTAccess-Control-Allow-Origin: *Content-Length: 697Connection: closeContent-Type: application/json;charset=utf-8200 OKhttp://api.idescat.cat/pob/v1/sug.json?q=bar
  106. 106. XML SDMX-MLJSON SDMX-JS?
  107. 107. XMLJSON
  108. 108. XML Xml2Json() JSONOn-the-fly conversion
  109. 109. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text>
  110. 110. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text>"text": "Hello, World!"
  111. 111. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text><text>Goodbye, Life!</text>"text": "Hello, World!"
  112. 112. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text><text>Goodbye, Life!</text>"text": ["Hello, World!", "Goodbye, Life!"]
  113. 113. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text>"text": ["Hello, World!"]
  114. 114. XML JSONPredefined map
  115. 115. XML JSONPredefined map namespaces? elements/attributes? all strings?
  116. 116. “XMLish” JSONPredefined map
  117. 117. {"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-04", "generic:ObsValue" : “XMLish”{"@value" : "106.56246"}, "generic:Attributes" :{"generic:Value" : {"@concept" : "OBS_STATUS","@value" : "P"}}}, {"generic:Time" : "2011-05", JSON"generic:ObsValue" : {"@value" : "113.26596"},"generic:Attributes" : {"generic:Value" :{"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-06", "generic:ObsValue" :{"@value" : "114.22037"}, "generic:Attributes" :{"generic:Value" : {"@concept" : "OBS_STATUS","@value" : "P"}}}, {"generic:Time" : "2011-07","generic:ObsValue" : {"@value" : "108.77534"},"generic:Attributes" : {"generic:Value" :{"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-08", "generic:ObsValue" :{"@value" : "116.37424"}, "generic:Attributes" :
  118. 118. natural-bornJSON
  119. 119. natural-born JSON“JSON-G” genuine
  120. 120. natural-born JSON“JSON-G”“JSON-C”compact/customized
  121. 121. Price of an apple?Save as many bytesas possible
  122. 122. Price of an apple?Nutrition valueAllergiesRecipesPriceForbidden fruit inthe Garden of Eden
  123. 123. FlexibilityNutrition valueAllergiesRecipesPriceForbidden fruit inthe Garden of Eden
  124. 124. detail=fulldetail=dataonlydetail=serieskeysonlydetail=nodata
  125. 125. ResponseGroup=Images,Reviews
  126. 126. fields=id,name,picture
  127. 127. fields=title,teaserbyline,none
  128. 128. :(id,first-name,last-name,positions:(title))
  129. 129. fields=id,scope/type
  130. 130. fields=entry(id,gd:when)
  131. 131. fields=entry(@gd:*,id,gd:when)
  132. 132. fields=entry(title,link[@rel=self or @rel=edit],media:group(media:thumbnail))
  133. 133. fields=entry[media:group/yt:duration/@seconds<= 120 and yt:statistics/@viewCount > 20]
  134. 134. simple flexible RESTish JSONlightweightdeveloper-centric mobile-friendly
  135. 135. simple flexible RESTish JSONlightweight Semantic Web-ish?developer-centric mobile-friendly
  136. 136. I have a dream for the Web [in which computers] becomecapable of analyzing all the data on the Web – the content,links, and transactions between people and computers. A‘Semantic Web’, which should make this possible, has yet toemerge, but when it does, the day-to-day mechanisms oftrade, bureaucracy and our daily lives will be handled bymachines talking to machines. The ‘intelligent agents’ peoplehave touted for ages will finally materialize. Tim Berners-Lee Director of the W3C, 1999
  137. 137. Statistical “Cube” Data. The group will produce avocabulary, compatible with SDMX, for expressingsome kinds of statistical data. This need not be asexpressive as all of SDMX, but may provide a subsetas in the RDF Data Cube vocabulary. It may also include ways toannotate data to indicate its assumptions and comparability.
  138. 138. The MainstreamRelevance “Law”The mainstreamrelevance of acommunicationenvironment isproportional tothe quantity ofrubbish in thatenvironment.
  139. 139. The MainstreamRelevance “Law”The mainstreamrelevance of acommunicationenvironment isproportional tothe quantity ofrubbish in thatenvironment.
  140. 140. The MainstreamRelevance “Law” TV e-mail Twitter ...
  141. 141. simple? flexible RESTish JSON?lightweight? Semantic Web-ish?developer-centric? mobile-friendly?
  142. 142. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  143. 143. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011
  144. 144. For some web developers the need to understandthe RDF data model and associated serializations andquery language (SPARQL) has proved a barrier toadoption of linked data. This project seeks to developAPIs, data formats and supporting tools to overcomethis barrier. Including, but not limited to, accessinglinked data via a developer-friendly JSON format.
  145. 145. Simplify + JSONify SDMX?Reuse/adapt a generic data format? semantic
  146. 146. Simplify + JSONify SDMX?Reuse/adapt a generic data format? semanticCreate a new simple standard for stats?
  147. 147. http://json-stat.org
  148. 148. http://json-stat.orglightweight
  149. 149. http://json-stat.orgsimple
  150. 150. http://json-stat.orgdeveloper-centric
  151. 151. http://json-stat.orgflexible
  152. 152. http://code.google.com/p/json-stat/
  153. 153. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1,1,1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "U" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "value": [7539618] "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}
  154. 154. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } }"id"} , : ["metric", "time", "geo"], "time" : {"size" : [1, 1, 1],// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}
  155. 155. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "index" : { "pop" : 0 } , "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} "label" : { "pop" : "Population" } } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}
  156. 156. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "index" : { "pop" : 0 } , "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} "label" : { "pop" : "Population" } } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}
  157. 157. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}
  158. 158. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text","index" : {"2011-01-01" : 0} , "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" }"label" : {"2011-01-01" : "January 1st, 2011"} } } }}
  159. 159. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text","index" : {"2011-01-01" : 0} , "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" }"label" : {"2011-01-01" : "January 1st, 2011"} } } }}
  160. 160. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text","index" : {"2011-01-01" : 0} , "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" }"label" : {"2011-01-01" : "January 1st, 2011"} } } }}
  161. 161. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  162. 162. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } ,"index" : { "ISO-3166-2:ES-CT" : 0 } ,// "time" : { "label" : "When" , "desc" : "Longer text","label" : { "ISO-3166-2:ES-CT" : "Catalonia" } "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  163. 163. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } ,"index" : { "ISO-3166-2:ES-CT" : 0 } ,// "time" : { "label" : "When" , "desc" : "Longer text","label" : { "ISO-3166-2:ES-CT" : "Catalonia" } "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  164. 164. { "label": "Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  165. 165. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  166. 166. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "type" : { "pop" : "count" } , "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "base" : { "pop" : "Person" } , "geo" : {// "symbol" : { "label" : "Where" , "desc" : "Longer text", "pop" : null } , "mult" "category" : { : { "pop" : 0 } "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  167. 167. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  168. 168. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "long" : 2.178389, "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "lat" : 41.383531 "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  169. 169. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {"index" : {"20110101" : 0} ,// "label" : "Where" , "desc" : "Longer text", "category" : {"label" : {"20110101" : "January 1st, 2011"} "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  170. 170. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "index" "dimension" : {: { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "from" : "20000101" "metric": { ,// "to" : "20110101" "label" : "What" , "desc" : "Longer text", "category" : { } "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {"index" : {"20110101" : 0} ,// "label" : "Where" , "desc" : "Longer text", "category" : {"label" : {"20110101" : "January 1st, 2011"} "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  171. 171. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}
  172. 172. "value": [3732196, 3807422 , 7539618]
  173. 173. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]
  174. 174. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } }}
  175. 175. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } } Names not predetermined!}
  176. 176. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } } value[dimension["sex"].category.index["F"]]}
  177. 177. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "id" : ["M", "F", "T"] , "label" : ["Men", "Women", "Total"] }} value[dimension["sex"].category.index["F"]]
  178. 178. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "id" : ["M", "F", "T"] , "label" : ["Men", "Women", "Total"] }} for( ; ; ){ ... } value[dimension["sex"].category.index["F"]]
  179. 179. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } }}
  180. 180. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex3" : { "attribute" : "sex" , "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } }}
  181. 181. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618]
  182. 182. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] ↓ cryptic ↑ single model
  183. 183. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] ↓ cryptic ↑ single model"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]
  184. 184. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]
  185. 185. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Male Female Total"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]
  186. 186. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Male Female “CSV revisited” Total"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]
  187. 187. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618]getDataById(ds, {"sex" : "M" , "time" : "20090101"})"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]
  188. 188. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618]"status": [ "a", "a", "a", "a", "a", "a", "a", "a", "a", "a", "p", "e", "a", "a", "a", "a", "a", "a", "a", "a", "a", "a", "p", "e", "a", "a", "a", "a", "a", "a", "a", "a", "a", "a", "p", "e"]
  189. 189. "value": [3732196, 3807422 , 7539618]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } , }}
  190. 190. "value": [3732196, 3807422 , 7539618]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } , "uri" : "http://jsonstat.dataprovider.org/dimension/sex.json", }}
  191. 191. "value": [3732196, 3807422 , 7539618]"sex" : { "category" : { "uri" : "http://jsonstat.dataprovider.org/dimension/sex.json", }}
  192. 192. The JSON-stat CommunityWelcomes You!
  193. 193. The JSON-stat CommunityWelcomes You! Needs You!
  194. 194. Standards for statistical data dissemination a wish list Xavier Badosa (@badosa) Statistical Institute of Catalonia Thank you OECD Statistical Information System Collaboration Community (SIS-CC) Workshop 2012. Paris, 12-14 March
  195. 195. Dan Taylor borman818 / Daniel Borman Christian Cable Ian Muttoo Donald Macleod Lushbunny shaggy359Wikimedia Commons http://en.wikipedia.org/wiki/File:IBM_PC_5150.jpg http://en.wikipedia.org/wiki/File:Asimo_look_new_design.jpg Richard Cyganiak
  196. 196. Photos of products and webpages have been taken from the respectivecompanies’ websites. 1993 Mosaic webpage, © Board of Trustees of theUniversity of Illinois, taken from the Computer History Museum website.Superman logo (free licence) from vectortemplates.com. Authors’pictures taken from respective websites or Twitter accounts, except TimBerners-Lee taken from a video session. HTML5 logo from W3C. Image fromStanley Kubrick’s Dr. Strangelove or: How I Learned to Stop Worrying andLove the Bomb, © Columbia Pictures. Homo erectus’ drawing taken fromrecursos.cnice.mec.es (Spanish Ministry of Education & Science). Homosapiens neanderthalis’ drawing taken from vanedf11.blogspot.com.

×