• Like
  • Save
开源混合存储方案(Flashcache)
Upcoming SlideShare
Loading in...5
×
 

开源混合存储方案(Flashcache)

on

  • 32,647 views

开源混合存储方案: 用Flashcache绑定固态盘和磁盘,利用二者的优点,实现高性能IO存储。

开源混合存储方案: 用Flashcache绑定固态盘和磁盘,利用二者的优点,实现高性能IO存储。

Statistics

Views

Total Views
32,647
Views on SlideShare
13,009
Embed Views
19,638

Actions

Likes
35
Downloads
587
Comments
3

36 Embeds 19,638

http://rdc.taobao.com 14821
http://blog.yufeng.info 3915
http://www.bsdmap.com 367
http://csrd.aliapp.com 320
http://blog.haohtml.com 70
http://xianguo.com 31
http://www.zhuaxia.com 17
http://reader.youdao.com 15
http://8888.pumo.com.tw 10
http://cache.baidu.com 10
http://static.slidesharecdn.com 9
http://twitter.com 8
http://207.46.192.232 4
http://zhuaxia.com 4
http://www.bzcat.info 4
http://www.igaom.cn 3
http://webcache.googleusercontent.com 3
http://w3ww.bsdmap.com 2
http://httpwww.bsdmap.com 2
http://translate.googleusercontent.com 2
http://honyaku.yahoofs.jp 2
http://us-w1.rockmelt.com 2
url_unknown 2
http://trunk.ly 2
http://www.obatu.com 2
http://cncc.bingj.com 1
https://twitter.com 1
http://www.diigo.com 1
http://awww.bsdmap.com 1
http://paper.li 1
http://www.onlydoo.com 1
http://www.bsdmap.com. 1
http://wew.bsdmap.com 1
file:// 1
http://yaoge123blogwww.bsdmap.com 1
http://old.xianguo.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

13 of 3 Post a comment

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • This moudle looks greate useful .Dynamic balancing between Disk and SSD is processed by the moudle itself ?
    Are you sure you want to
    Your message goes here
    Processing…
  • just have a look
    Are you sure you want to
    Your message goes here
    Processing…
  • flashcache storage
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    开源混合存储方案(Flashcache) 开源混合存储方案(Flashcache) Presentation Transcript

    • 开源混合存储方案 Flashcache 余锋 褚霸 淘宝核心系统 mryufeng@gmail.com http://yufeng.info
    • 互联网业务特点• 人多• 请求是人发起的,天然读多写少(懒人多)• 熟人之间的关系,天然有热点
    • 数据存储的需求业务特点反应在存储上:• 数据量大• 读多写少• 有热点
    • 机械硬盘特点• 机械结构,寻道时间长,随机访问慢,高延迟时间• 顺序访问速度快• 每GB成本低,容量大• 机械故障,磨损少
    • 固态盘特点• 电子器件,无活动部件,可靠性高• 随机访问,无需寻道时间,低延迟时间• 每GB成本相对高,容量相当小• Nand芯片有擦写寿命
    • 如何利用二者的优点• 硬盘的高容量,高顺序访问,低成本• 固态盘的高随机访问,低延迟时间
    • 如何不多花钱呢?欢迎Flashcache闪亮登场!
    • Flashcache介绍作者 Mohan Srinivasan源于Facebook,初始用于加速MySQL InnoDB引擎IO现在是通用的软件方案块设备加速器内核模块,支持主流64位Linux更多访问:http://github.com/facebook/flashcache
    • Flashcache在内核的层次
    • Flashcache特性• 免费,高性能• Device Mapper层,对外服务体现方式是块设备,无需修改应 用• 支持write back和write through二种模式• 运行期状态可调整和查看
    • 我有兴趣!!!快告诉我如何用!
    • 硬件设备• PCI-E 高速Flash卡:/dev/vgca0• 硬盘: /dev/sda12
    • 安装• 准备好你的源码树• make install
    • 加载if (初次)flashcache_create cachedev /dev/vgca0 /dev/sda12elseflashcache_load cachedev /dev/vgca0 /dev/sda12请稍候...在/dev/mapper目录下看到我们的虚拟设备 cachedev我们的混合盘就绪了: /dev/mapper/cachedev
    • 使用• 裸盘使用• 安装文件系统: mkfs.ext3 /dev/mapper/cachedev
    • 微调参数# sysctl dev.flashcachedev.flashcache.cache_all = 0dev.flashcache.reclaim_policy = 0dev.flashcache.dirty_thresh_pct = 90
    • Cache管理• 预加载文件:flashcache_cacheit filename• 删除Cache中的文件:flashcache_trim filename• 添加进程名单:flashcache_addpids <device_name> w|b pid1• 删除进程名单:flashcache_delpids <device_name> w|b pid1
    • 查看状态• # dmsetup status cachedev• # dmsetup table cachedev• # dmsetup info cachedev
    • 移除设备• # dmsetup remove cachedev• 耐心等候
    • 效果呢?固态盘IO能力 * 热点百分比 还便宜!
    • 谢谢大家! Q&A