Open spending as-is 2011-06

970 views
909 views

Published on

As-is state of WDMMG/OpenSpending project, 2011-06 (OKCON2011)

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
970
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Open spending as-is 2011-06

    1. 1. OpenSpending.org Current StateStefan Urbanekstefan.urbanek@gmail.com June 2011@Stiivi
    2. 2. Data
    3. 3. Data Store
    4. 4. Collections data metadata dataset entryentity classifier dimension
    5. 5. Dimension types classifier collection entity collection string scalar field float scalar field date hash/dictionary no implicit hierarchy
    6. 6. Time■ time is a range from 
to■ compound object■ dataset specifies date for analytics■ in cubes it is split into year + manth + day■ date hierarchy is hardwired in app logic
    7. 7. amountthe only one measure
    8. 8. Extraction,Transformation, Loading
    9. 9. OpenSpending.org ETL – overview mapping wdmmg openspending pylons application paster pylons managed data CSV file csvimport store with ORM ckan-datapkg datapkg paster load "raw" data locally cached resource resource wdmmg-ext extraction modules loading loading scripts loading scripts scripts cofog still runing from here
    10. 10. classification – entity – date from to + + amntCSV file entry
    11. 11. Aggregations
    12. 12. ≈dataset* cube *still as dimension
    13. 13. roll-up is aggregated “on the fly”

    ×