Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

RADOS for Eucalyptus

4,121 views

Published on

Describing "RADOS for Eucalyptus", a distributed storage implementation for Eucalyptus based on Ceph Filesystem technology.

Published in: Technology
  • Be the first to comment

RADOS for Eucalyptus

  1. 1. RADOS for Eucalyptus <tasada@livedoor.jp>
  2. 2. RADOS for Eucalyptus • Eucalyptus IaaS •
  3. 3. IaaS • Infrastructure as a Service • Web … Web • Amazon Web Services
  4. 4. Amazon EC2 • Web Linux Solaris Windows VM • EC2 → S3 • VM S3
  5. 5. Amazon S3 • Web • REST/SOAP API • • 1020 2010/03
  6. 6. Amazon EBS • EC2 → •
  7. 7. Eucalyptus • IaaS • Amazon EC2, S3, EBS API →Amazon • • •
  8. 8. Eucalyptus Cloud Controller Walrus S3 Cluster Storage Cluster Storage Controller Controller Controller Controller Node EBS Node Node Controller Node Controller Node Controller Node Controller Controller Controller VM
  9. 9. Eucalyptus • • Walrus(S3 ) • SC(EBS )
  10. 10. Eucalyptus • • Ceph Filesystem • • S3 EBS like
  11. 11. Ceph Filesystem • • POSIX ”mount ” • Ceph Filesystem • • •
  12. 12. Ceph Filesystem
  13. 13. • • • • • etc..
  14. 14. RADOS • • Reliable, Autonomic Distributed Object Store • ≠ • • etc... •
  15. 15. RADOS OSD IO Monitor OSD OSD IO
  16. 16. ~100PG/ OSD PG OSD ” ”
  17. 17. CRUSH • PG OSD • HDD OSD → •
  18. 18. • OSD up down IP • PG • OSD Monitor • Monitor down
  19. 19. RADOS API • RADOS • pool API open_pool(), close_pool(), lookup_pool(), create_pool(), delete_pool(), list_pools(), get_pool_stats() • API create(), write(), read(), remove(), trunk(), getxattr(), setxattr(), stat(), list_objects_open(), list_objects_more(), list_objects_close() • API IO API etc...
  20. 20. RADOS API • radosgw: S3 • rbd: • S3 EBS
  21. 21. RADOS for Eucalyptus • Walrus/SC RADOS • Walrus • (radosgw, rbd...)
  22. 22. Before Cloud Walrus Controller Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller
  23. 23. After Cloud Walrus Controller Walrus Walrus Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller RADOS Cluster
  24. 24. RADOS for Walrus • • radosgw Eucalyptus • Walrus RADOS •
  25. 25. • RADOS API C/C++ Java JNI • File/FileInputStream/FileOutputStream RADOS API
  26. 26. • RADOS • • •
  27. 27. • :,( • RADOS
  28. 28. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0
  29. 29. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0 Web RADOS
  30. 30. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
  31. 31. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
  32. 32. • RADOS Walrus • Ceph Eucalyptus • rbd Eucalyptus
  33. 33. URL • Wiki: http://r4eucalyptus.wikia.com • Repository: bzr branch lp:~syuu/eucalyptus/rados4eucalyptus-2.0.0

×