Cubes - Lightweight OLAP Framework

Cubes Light-weigth Online Analytical ProcessingStefan Urbanekstefan.urbanek@gmail.com April 2011@Stiivi

Features■ logical model (metadata)■ aggregated data browsing■ OLAP HTTP server with json interface■ data and metadata localization■ multiple backends

Introductioncubes, facts and dimensions

data cell data cube

most detailed information measurable Fact examples: measure examples: • contract • contract amount • donation • revenue • spending fact • duration • invoice • price with VAT • project • ... data cell

locationtype time dimensions

dimensions type location time■ provide context for facts■ used to ﬁlter queries or reports■ control scope of aggregation of facts■ used for ordering or sorting■ deﬁne master-detail relationships ☛ [star]

region 2010 May 1st datehierarchies

subject area data mart

Summary■ fact – most detailed information for analysis■ measure – an attribute for computation■ dimension – context of facts■ hierarchy – master-detail relationship

✂✂ Slicing and Dicing

08 06 07 09 10 20 20 20 20 20locationtype time spending in 2010

contracts inlocation Estoniatype Czech Republic Slovakia Hungary Poland Estonia time

✂✂ Estonia 2010 contracts in location Estonia in 2010 type time

locationtype IT contracts time

✂✂ ✂ IT Estonia 2010 IT contracts in Estonia in 2010 location type time

spending in 2010 revenue from IT projects measures can be aggregated top 10 contractors

Drilling down

250 250∑ amount 125 0 All years drill down by date∑ 70 70 amount 35 50 40 60 30 0 2006 2007 2008 2009 2010

looking at more detailed level

250 250 top level 125 0 All years 70 70 60 35 50 year level 30 40 0 2006 2007 2008 2009 2010 7 7 5month level 3,5 3 4 3 2 0 1 1 Jan Feb Mar Apr March April May ...

Logical Modeldescription based on how you analyze data

Logical Model user’s or analyst’s perspective: how data are beingmeasured, aggregated and reportedamount ∑ amount 24% 12% 28% 20% 16%

abstraction over physical data ✶ star ❄ snowﬂake

Model Legend: "#localizable name !#required during cube creation label " description " and denormalisation $#required by browser locale Cube name Dimension label " name Hierarchy description " label " name measures description " label " details default hierarchy fact table ! Level name label " key attribute label attribute !Join ! Attribute Mapping !master name masterdetail label " detail alias description " locales !$

SlicerCubes OLAP server

Application modelHTTP request JSON reply Slicer Cell(point of view) ∑ aggregates facts (details) Aggregation Browser model

GET /model{ "cubes": { "contracts": { "measures": [ { "name": "amount", "label": "Contract amount" } ], "dimensions": ["date", "supplier", "process_type", "cpv"] } }, "dimensions": { "supplier": { ... } } ...}

GET /aggregate aggregate measures

∑ amountGET /aggregate

{ "drilldown": {}, "summary": { "record_count": 19278, "zmluva_hodnota_sum": 11222821530.12966 }} GET /aggregate

cut=...slice and dice with cut parameter

∑ amount ✂2010GET /aggregate?cut=date:2010

{ "drilldown": {}, "summary": { "date.year": 2011, "record_count": 64, "zmluva_hodnota_sum": 78717997.108 } } ✂ 2010GET /aggregate?cut=date:2010

✂ Estonia ∑ amount ✂ 2010 /aggregate?cut=date:2010|region:ee

cut=date:2010|region:es dimension points cut

date:2010 pathdimension region:ee dimension points

month level year level date:2010,12 pathdimension hierarchies

date:2010,12| category:it,sw| region:eecontracts in December 2010in Estonia for IT – Software more hierarchies

pipe separates cutsdate:2010,12|category:it,sw|region:ee comma separates levels cut

PUT /reportif you want multiple tables and charts with single request

drilldown= get more details

250 250∑ amount 125 0 All years drilldown=date∑ 70 70 amount 35 50 40 60 30 0 2006 2007 2008 2009 2010

250 250 125 0 All yearsdrilldown=date 70 70 60 35 50 40 30 0 cut=date:2010 2006 2007 2008 2009 2010&drilldown=date implicit 7 7 3,5 5 4hierarchy 0 3 2 1 3 1 Jan Feb Mar Apr March April May ...

report by year: drilldown=datereport by month: drilldown=date&cut=date:2010report by day: drilldown=date&cut=date:2010,11

more dimensions:drilldown=date,supplier for cross-tables

Atributes and Measures naming

date.year date.month region.region_name region.city_name region.region_code category.description attributedimension

hierarchical attributedependencies are implicit defined in model

there is no “date” data typedate components are normal attributes of date dimension year month day

received_amount_summeasure aggregation record_count

page=...&order= ordering and pagination

page=3&pagesize=203rd page with 20 results per page

order=region.name order by region name order=amount:descorder by amount descending

Natural Ordering attributes can have default order speciﬁed in model order=year:asc... might be omitted if model contains:{“name” = “year”, “order” = “asc”}

lang=transparent localization

Localization 12 3

+ +master translationsmodel

drilldown=type&lang=en drilldown=type&lang=skreport query is language independent

Cubesonline analytical processing github/bitbucket: Stiivi

☛ References and further reading[star] Christopher Adamson: Star Schema, 2010

http://databrewery.org	7365
http://www.databrewery.org	406
http://127.0.0.1:4000	73
http://127.0.0.1:4000	73
http://localhost:4000	24
http://coderwall.com	3
http://translate.googleusercontent.com	1

Cubes - Lightweight OLAP Framework

by Stefan Urbanek

Accessibility

Categories

Upload Details

Usage Rights

7 Embeds 7,945

Statistics

Cubes - Lightweight OLAP Framework Presentation Transcript