Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Accessing Data Anywhere with Unified Namespace

810 views

Published on

Bay Area Meetup presentation (6/15/16)

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Accessing Data Anywhere with Unified Namespace

  1. 1. Alluxio (formerly Tachyon): Accessing Data Anywhere with Unified Namespace Jiri Simsa June 15, 2016 @ Alluxio Meetup (hosted by Intel)
  2. 2. About Me • Software Engineer @ Alluxio, Inc. • PMC Member and Maintainer of Alluxio Open Source Project • Ph.D. from Carnegie Mellon University (Parallel Data Lab) • Worked at Google before joining Alluxio • Twitter: @jsimsa, Github: jsimsa 2
  3. 3. Outline • Motivation • Unified Namespace • Use Cases • Demo 3
  4. 4. Big Data Ecosystem 4
  5. 5. Big Data Ecosystem 5
  6. 6. Big Data Ecosystem 6
  7. 7. Alluxio Benefits • Future-proofing your applications –applications can communicate with different storage systems, both existing and new, using the same namespace and interface –seamless integration between applications and new storage systems enables faster innovation • Enabling new workloads –one-time effort to enable an application to access many different types of storage systems and a storage system to be accessed by many different types of applications 7
  8. 8. Outline • Motivation • Unified Namespace • Use Cases • Demo 8
  9. 9. Unified Namespace an abstraction that makes it possible for applications to access different storage systems through the same interface 9
  10. 10. Transparent Naming •Operations over persisted Alluxio objects mapped transparently to underlying storage •Alluxio paths are preserved in storage layer Alluxio Storage System (HDFS, S3, …) alluxio://host:port/ Data Users Reports Sales Alice Bob hdfs://host:port/ Data Users Reports Sales Alice Bob 10
  11. 11. Multiple Storage Systems •Unified namespace for multiple data sources •Sharing of data across storage systems •API for on-the-fly mounting / unmounting Alluxio Storage System A alluxio://host:port/ Data Users Alice Bob hdfs://host:port/ Users Alice Bob Storage System B s3://host/bucket Reports Sales Reports Sales 11
  12. 12. Outline • Motivation • Unified Namespace • Use Cases • Demo 12
  13. 13. Multiple Storage / Compute 13
  14. 14. Changing Storage Backend 14
  15. 15. Changing Storage Backend 15
  16. 16. Outline • Motivation • Unified Namespace • Use Cases • Demo 16
  17. 17. Resources • Alluxio Project: http://www.alluxio.org • Development: https://github.com/Alluxio/alluxio • Meet Friends: http://www.meetup.com/Alluxio • Alluxio, Inc.: http://www.alluxio.com • Contact us: info@alluxio.com 17
  18. 18. Backup Slides 18
  19. 19. Architecture Overview 19

×