• Save
Scaling mondrian
Upcoming SlideShare
Loading in...5
×
 

Scaling mondrian

on

  • 534 views

 

Statistics

Views

Total Views
534
Views on SlideShare
534
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Scaling mondrian Scaling mondrian Presentation Transcript

  • Scaling MondrianFrom Big Data to Ludicrous Data
  • First challenge: The size of the data
  • Second challenge: Updating the dataNothing fancy here. - Apply deltas on cache - Programmatic roles
  • Third challenge: ScalabilitySynchronize without locks and blocks
  • Third challenge: ScalabilityIn-memory rollups Gender Country Sales M USA 7 M CANADA 8 F USA 4 F CANADA 2 Country Sales USA 11 CANADA 10
  • Third challenge: ScalabilityIndexing problem - Rollups are a combinatory problem with exponential growth of complexity - Huge caches of segments. - O(n) isnt good enough.
  • Third challenge: ScalabilityIndexing solution - The PartiallyOrderedSet. A hierarchical java.util.Set implementation where elements might or might not be related to one another.
  • Third challenge: ScalabilityNon collapsed snowflaked aggregates - Join at any point in a snowflake dimension
  • ResourcesPress releasehttp://www.informationweek.com/development/database/yahoo-and-hadoop-in-it-for-the-long-term/240002133