Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this presentation? Why not share!

Евгений Поляков – Распределенные системы хранения данных, особенности реализации DHT в проекте Elliptics network

on

  • 1,434 views

 

Statistics

Views

Total Views
1,434
Views on SlideShare
1,372
Embed Views
62

Actions

Likes
0
Downloads
3
Comments
0

3 Embeds 62

http://webcrunch.ru 59
http://developers.rambler.ru 2
http://bizspark.webcrunch.ru 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Евгений Поляков – Распределенные системы хранения данных, особенности реализации DHT в проекте Elliptics network Евгений Поляков – Распределенные системы хранения данных, особенности реализации DHT в проекте Elliptics network Presentation Transcript

    • Elliptics Network Evgeniy Polyakov <zbr@ioremap.net> <zbr@yandex-team.ru> Distributed hash table Key/value storage
    • How to handle huge dataset? Can existing solutions scale?
    • Existing solutions
    • Distributed hash table Consistent hashing Map and routing table
    • Elliptics network architecture Frontend Core Backend
    • Frontends
    • Frontends: HTTP
    • Frontends: bindings
    • Frontends: command line
    • Frontends: POHMELFS
    • IO backends
    • Eblob random read performance: SAS ● 2 sas shelves (14 disks raid10 each, ext4) ● 1 Tb of data ● ~ 100 millions of objects ● Eblob: 5000 rps ● Eblob: 3500 rps within 100 ms ● Eblob: 4000 rps witin 200 ms ● Filesystem: 600 rps within 200 ms ● Filesystem: 800 rps within 300 ms FS contains about 30 millions of objects actually
    • Eblob random read performance: SATA ● 2 sata raids (4-disks raid10 each, ext4) ● 370 Gb of data ● 30 millions of objects ● Eblob: 1000 rps ● Eblob: 900 rps within 100-150 ms ● Filesystem: 200 rps within 200 ms
    • Elliptics network: core
    • IO models Write always succeed Multiple copy reading Eventual consistency
    • Future plans