RADOS for Eucalyptus

3,859 views
3,771 views

Published on

Describing "RADOS for Eucalyptus", a distributed storage implementation for Eucalyptus based on Ceph Filesystem technology.

Published in: Technology
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,859
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
102
Comments
0
Likes
5
Embeds 0
No embeds

No notes for slide































  • RADOS for Eucalyptus

    1. 1. RADOS for Eucalyptus <tasada@livedoor.jp>
    2. 2. RADOS for Eucalyptus • Eucalyptus IaaS •
    3. 3. IaaS • Infrastructure as a Service • Web … Web • Amazon Web Services
    4. 4. Amazon EC2 • Web Linux Solaris Windows VM • EC2 → S3 • VM S3
    5. 5. Amazon S3 • Web • REST/SOAP API • • 1020 2010/03
    6. 6. Amazon EBS • EC2 → •
    7. 7. Eucalyptus • IaaS • Amazon EC2, S3, EBS API →Amazon • • •
    8. 8. Eucalyptus Cloud Controller Walrus S3 Cluster Storage Cluster Storage Controller Controller Controller Controller Node EBS Node Node Controller Node Controller Node Controller Node Controller Controller Controller VM
    9. 9. Eucalyptus • • Walrus(S3 ) • SC(EBS )
    10. 10. Eucalyptus • • Ceph Filesystem • • S3 EBS like
    11. 11. Ceph Filesystem • • POSIX ”mount ” • Ceph Filesystem • • •
    12. 12. Ceph Filesystem
    13. 13. • • • • • etc..
    14. 14. RADOS • • Reliable, Autonomic Distributed Object Store • ≠ • • etc... •
    15. 15. RADOS OSD IO Monitor OSD OSD IO
    16. 16. ~100PG/ OSD PG OSD ” ”
    17. 17. CRUSH • PG OSD • HDD OSD → •
    18. 18. • OSD up down IP • PG • OSD Monitor • Monitor down
    19. 19. RADOS API • RADOS • pool API open_pool(), close_pool(), lookup_pool(), create_pool(), delete_pool(), list_pools(), get_pool_stats() • API create(), write(), read(), remove(), trunk(), getxattr(), setxattr(), stat(), list_objects_open(), list_objects_more(), list_objects_close() • API IO API etc...
    20. 20. RADOS API • radosgw: S3 • rbd: • S3 EBS
    21. 21. RADOS for Eucalyptus • Walrus/SC RADOS • Walrus • (radosgw, rbd...)
    22. 22. Before Cloud Walrus Controller Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller
    23. 23. After Cloud Walrus Controller Walrus Walrus Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller RADOS Cluster
    24. 24. RADOS for Walrus • • radosgw Eucalyptus • Walrus RADOS •
    25. 25. • RADOS API C/C++ Java JNI • File/FileInputStream/FileOutputStream RADOS API
    26. 26. • RADOS • • •
    27. 27. • :,( • RADOS
    28. 28. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0
    29. 29. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0 Web RADOS
    30. 30. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
    31. 31. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
    32. 32. • RADOS Walrus • Ceph Eucalyptus • rbd Eucalyptus
    33. 33. URL • Wiki: http://r4eucalyptus.wikia.com • Repository: bzr branch lp:~syuu/eucalyptus/rados4eucalyptus-2.0.0

    ×