• Save
Hadoop World 2011: WibiData: Building Personalized Applications with HBase - Aaron Kimball & Garrett Wu, Odiago
 

Like this? Share it with your network

Share

Hadoop World 2011: WibiData: Building Personalized Applications with HBase - Aaron Kimball & Garrett Wu, Odiago

on

  • 1,690 views

WibiData is a collaborative data mining and predictive modeling platform for large-scale, multi-structured, user-centric data. It leverages HBase to combine batch analysis and real time access within ...

WibiData is a collaborative data mining and predictive modeling platform for large-scale, multi-structured, user-centric data. It leverages HBase to combine batch analysis and real time access within the same system, and integrates with existing BI, reporting and analysis tools. WibiData offers a set of libraries for common user-centric analytic tasks, and more advanced data mining libraries for personalization, recommendation, and other predictive modeling applications. Developers can write reusable libraries that are also accessible to data scientists and analysts alongside the WibiData libraries. In this talk, we will provide a technical overview of WibiData, and show how we used it to build FoneDoktor, a mobile app that collects data about device performance and app resource usage and offers personalized battery/performance improvement recommendations directly to users.

Statistics

Views

Total Views
1,690
Views on SlideShare
1,426
Embed Views
264

Actions

Likes
4
Downloads
0
Comments
0

3 Embeds 264

http://www.cloudera.com 262
http://cloudera.matt.dev 1
http://blog.cloudera.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Hadoop World 2011: WibiData: Building Personalized Applications with HBase - Aaron Kimball & Garrett Wu, Odiago Presentation Transcript

  • 1. : Building Personalized Applications with HBase Aaron Kimball – CTO Garrett Wu – Director of Engineering Odiago, Inc.Developed By:
  • 2. helps you…Developed By:
  • 3. Who uses WibiData? Backend Infrastructure Easy Integration for Web and Mobile Apps with Existing Analysis / BI Tools [data scientist] part engineer, part analyst [engineer] [analyst] Powerful Libraries for Data Mining ApplicationsDeveloped By:
  • 4. WibiData applies to…Developed By:
  • 5. Example App: MobileDeveloped By:
  • 6. Developed By:
  • 7. Developed By:
  • 8. Personalized Libraries Recommendations Device and User Analysis Reporting Workflow and Data Integration AnalysisDeveloped By:
  • 9. www.fonedoktor.com Get FoneDoktor for your Android today!Developed By:
  • 10. The rest of this talk… • Wibi architecture at a glance • Under the hood • Integrating with external systems • ConclusionsDeveloped By:
  • 11. architecture Certified Technology productDeveloped By:
  • 12. Machine learning building blocks • Production-quality algorithms included in Wibi – Recommendation – Classification – Clustering… • Helps data teams get started more quickly • Lowers end-user requirementsDeveloped By:
  • 13. WibiData: Technical Dive Garrett Wu, Director of EngineeringDeveloped By:
  • 14. An extended data model • Column families are a logical concept • Data is physically arranged in locality groupsDeveloped By:
  • 15. An extended data model • Wibi uses 3-d storage • Data is often sorted by timestampDeveloped By:
  • 16. An extended data model <column> <name>email</name> <description>Email address</description> <schema>"string"</schema> </column> • Columns or whole families have common Avro schemas for evolvable storage and retrievalDeveloped By:
  • 17. Producers and gatherers • Producers create derived column values • Gatherers aggregate data across all rows – e.g., for classifier trainingDeveloped By:
  • 18. Interactive access: REST API PUT request GET request • REST API provides interactive access • Producers can be triggered “on demand” to create fresh recommendationsDeveloped By:
  • 19. Tools and IntegrationDeveloped By:
  • 20. Tools for all usersDeveloped By:
  • 21. Data integration:Developed By:
  • 22. Data integration:Developed By:
  • 23. Self-service analyst workflow Existing databasesDeveloped By:
  • 24. Conclusions • WibiData is a new platform for user data management and analysis • The WibiData programming model enables rapid application development • …and its libraries lower the barrier to entry • Wibi UI and export tools integrate with existing analytic systemsDeveloped By:
  • 25. We have some great customers…Developed By:
  • 26. And we’d like you to join us! • Sign up for the private beta today: www.wibidata.com • If you have a compelling use case, we’d like to let you try WibiDataDeveloped By:
  • 27. www.wibidata.com / @wibidata Aaron Kimball – aaron@odiago.com Garrett Wu – gwu@odiago.comDeveloped By: