Scaling mondrian

780 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
780
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Scaling mondrian

  1. 1. Scaling MondrianFrom Big Data to Ludicrous Data
  2. 2. First challenge: The size of the data
  3. 3. Second challenge: Updating the dataNothing fancy here. - Apply deltas on cache - Programmatic roles
  4. 4. Third challenge: ScalabilitySynchronize without locks and blocks
  5. 5. Third challenge: ScalabilityIn-memory rollups Gender Country Sales M USA 7 M CANADA 8 F USA 4 F CANADA 2 Country Sales USA 11 CANADA 10
  6. 6. Third challenge: ScalabilityIndexing problem - Rollups are a combinatory problem with exponential growth of complexity - Huge caches of segments. - O(n) isnt good enough.
  7. 7. Third challenge: ScalabilityIndexing solution - The PartiallyOrderedSet. A hierarchical java.util.Set implementation where elements might or might not be related to one another.
  8. 8. Third challenge: ScalabilityNon collapsed snowflaked aggregates - Join at any point in a snowflake dimension
  9. 9. ResourcesPress releasehttp://www.informationweek.com/development/database/yahoo-and-hadoop-in-it-for-the-long-term/240002133

×