MySQL新技术研究与实践

O
MySQL新技术研究与实践,[object Object],周振兴@TaobaoDBA,[object Object],iData Forum,[object Object],2010-12-06,[object Object],1,[object Object]
关于主题,[object Object],Performance / Flashcache ...,[object Object],Hardware,[object Object],Software,[object Object],Patches,[object Object],InnoDB-SSD Online file added ......,[object Object],OSC from FB,[object Object]
Performance,[object Object],is about the Capacity,[object Object],30,0000 / s,[object Object],Cache Miss,[object Object],1,0000 / s,[object Object],Capacity20%===  1亿用户,[object Object],is also about the Cost&&Technology,[object Object]
Hardware,[object Object],Disk / Memory,[object Object],Memory,[object Object]
Why Flashcache,[object Object],SSD vs PCIe-SSD,[object Object],Winner: PCIe-ssd,[object Object]
PICe SSD,[object Object],FusionIO,[object Object],virident,[object Object],[object Object]
高 IOPS
容量较小,[object Object]
Flashcache原理,[object Object],VFS,[object Object],File System,[object Object],/dev/mapper/cachedev,[object Object],这就是Flashcache:,[object Object],将两个块设备,虚拟成一个带缓存的块设备,[object Object],/dev/sdb,[object Object],/dev/sda,[object Object],http://orczhou.com,[object Object],Sample 1.5TB SAS +  320GB Fio,[object Object]
Flashcache,[object Object]
安装,[object Object],./flashcache_create cachedev/dev/fio/dev/sda12,[object Object],mount /dev/mapper/cachedev/u01,[object Object],参考 Flashcache README,[object Object]
WB vs WT,[object Object],Write back,[object Object],High performance,[object Object],main version of flashcache,[object Object],Write through,[object Object],more safe,[object Object],Less performance,[object Object]
Another side,[object Object],Hot data distribution,[object Object],Sample 1.5TB SAS +  320GB Fio,[object Object],Keep is simple , stupid,[object Object],Maybe your are rich,[object Object]
A fixed bug,[object Object],MySQL hungs with Flashcache,[object Object],iostat  1,[object Object],sda12          0    0   0   0  0   0    0     0    0   0  0,[object Object],fio                0    0   0   0  0   0    0     0    0   0  0,[object Object],dm-0            0    0   0   0  0   0    0     0    0   0  100,[object Object],[object Object],[object Object]
MySQL Version,[object Object]
压缩特性,[object Object],SamplePage,[object Object]
压缩特性,[object Object],空间节约,[object Object],788M  sns_info.ibd,[object Object],376M  sns_info.ibd,[object Object],性能,[object Object],BP can hold more data,[object Object]
OtherFeature,[object Object],Buffer Pool,[object Object],[object Object],[object Object]
Why patch,[object Object],Should we change something?,[object Object]
Main Contributor,[object Object],林晓斌 From Taobao.com,[object Object]
Patch.1SSD,[object Object],Write Through,[object Object],读优化,[object Object]
Patch.2 No more connection,[object Object],Close the door,[object Object],Why not ,[object Object],max_connection,[object Object]
Patch.3 Online data added,[object Object],InnoDBshare table space,[object Object],You must restart your Database,[object Object],我们不想因此而降低可用性,[object Object]
Patch 4 Table dml,[object Object],开发中...,[object Object],It’s cool,[object Object]
Q  &  A,[object Object]
MySQL新技术研究与实践
1 of 26

Recommended

Offloading for Databases - Deep Dive by
Offloading for Databases - Deep DiveOffloading for Databases - Deep Dive
Offloading for Databases - Deep DiveUniFabric
654 views22 slides
IMCSummit 2016 Keynote - Benzi Galili - More Memory for In-Memory Easy by
IMCSummit 2016 Keynote - Benzi Galili - More Memory for In-Memory EasyIMCSummit 2016 Keynote - Benzi Galili - More Memory for In-Memory Easy
IMCSummit 2016 Keynote - Benzi Galili - More Memory for In-Memory EasyIn-Memory Computing Summit
255 views10 slides
UniPlex 1000 Series PCIe NVMe JBOF by
UniPlex 1000 Series PCIe NVMe JBOFUniPlex 1000 Series PCIe NVMe JBOF
UniPlex 1000 Series PCIe NVMe JBOFUniFabric
428 views8 slides
Building an open memory-centric computing architecture using intel optane by
Building an open memory-centric computing architecture using intel optaneBuilding an open memory-centric computing architecture using intel optane
Building an open memory-centric computing architecture using intel optaneUniFabric
558 views30 slides
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp... by
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...In-Memory Computing Summit
1.8K views32 slides
UniPlex T1 Storage Supercharger by
UniPlex T1 Storage SuperchargerUniPlex T1 Storage Supercharger
UniPlex T1 Storage SuperchargerUniFabric
454 views6 slides

More Related Content

What's hot

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned by
C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned
C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned DataStax Academy
2.5K views34 slides
UniPlex Desktop Memory & PCIe Expansion by
UniPlex Desktop Memory & PCIe ExpansionUniPlex Desktop Memory & PCIe Expansion
UniPlex Desktop Memory & PCIe ExpansionUniFabric
286 views6 slides
UniFabric by
UniFabricUniFabric
UniFabricUniFabric
674 views3 slides
了解Cpu by
了解Cpu了解Cpu
了解CpuFeng Yu
7.6K views22 slides
OWF14 - Plenary Session : Thibaud Besson, IBM POWER Systems Specialist by
OWF14 - Plenary Session : Thibaud Besson, IBM POWER Systems SpecialistOWF14 - Plenary Session : Thibaud Besson, IBM POWER Systems Specialist
OWF14 - Plenary Session : Thibaud Besson, IBM POWER Systems SpecialistParis Open Source Summit
653 views17 slides
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture by
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA ArchitectureCeph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA ArchitectureDanielle Womboldt
2.1K views29 slides

What's hot(20)

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned by DataStax Academy
C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned
C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned
DataStax Academy2.5K views
UniPlex Desktop Memory & PCIe Expansion by UniFabric
UniPlex Desktop Memory & PCIe ExpansionUniPlex Desktop Memory & PCIe Expansion
UniPlex Desktop Memory & PCIe Expansion
UniFabric286 views
UniFabric by UniFabric
UniFabricUniFabric
UniFabric
UniFabric674 views
了解Cpu by Feng Yu
了解Cpu了解Cpu
了解Cpu
Feng Yu7.6K views
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture by Danielle Womboldt
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA ArchitectureCeph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Danielle Womboldt2.1K views
Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a... by Danielle Womboldt
Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a...Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a...
Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a...
Danielle Womboldt533 views
インフラ野郎Azureチーム Night by Toru Makabe
インフラ野郎Azureチーム Nightインフラ野郎Azureチーム Night
インフラ野郎Azureチーム Night
Toru Makabe9.9K views
In-Memory Computing: Myths and Facts by DATAVERSITY
In-Memory Computing: Myths and FactsIn-Memory Computing: Myths and Facts
In-Memory Computing: Myths and Facts
DATAVERSITY3.1K views
SOUG_SDM_OracleDB_V3 by UniFabric
SOUG_SDM_OracleDB_V3SOUG_SDM_OracleDB_V3
SOUG_SDM_OracleDB_V3
UniFabric1.1K views
Ceph Day Beijing - Storage Modernization with Intel and Ceph by Danielle Womboldt
Ceph Day Beijing - Storage Modernization with Intel and CephCeph Day Beijing - Storage Modernization with Intel and Ceph
Ceph Day Beijing - Storage Modernization with Intel and Ceph
Danielle Womboldt200 views
Answering the Database Scale Out Problem with PCI SSDs by answers
Answering the Database Scale Out Problem with PCI SSDsAnswering the Database Scale Out Problem with PCI SSDs
Answering the Database Scale Out Problem with PCI SSDs
answers280 views
Deep Learning at Scale by Herman Wu
Deep Learning at ScaleDeep Learning at Scale
Deep Learning at Scale
Herman Wu160 views
Webinar: NVMe, NVMe over Fabrics and Beyond - Everything You Need to Know by Storage Switzerland
Webinar: NVMe, NVMe over Fabrics and Beyond - Everything You Need to KnowWebinar: NVMe, NVMe over Fabrics and Beyond - Everything You Need to Know
Webinar: NVMe, NVMe over Fabrics and Beyond - Everything You Need to Know
了解IO协议栈 by Feng Yu
了解IO协议栈了解IO协议栈
了解IO协议栈
Feng Yu13.3K views

Similar to MySQL新技术研究与实践

QCon2016--Drive Best Spark Performance on AI by
QCon2016--Drive Best Spark Performance on AIQCon2016--Drive Best Spark Performance on AI
QCon2016--Drive Best Spark Performance on AILex Yu
538 views55 slides
Ceph Day Taipei - Accelerate Ceph via SPDK by
Ceph Day Taipei - Accelerate Ceph via SPDK Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Day Taipei - Accelerate Ceph via SPDK Ceph Community
463 views44 slides
Database performance tuning for SSD based storage by
Database  performance tuning for SSD based storageDatabase  performance tuning for SSD based storage
Database performance tuning for SSD based storageAngelo Rajadurai
4.3K views28 slides
Ceph Day Beijing - SPDK in Ceph by
Ceph Day Beijing - SPDK in CephCeph Day Beijing - SPDK in Ceph
Ceph Day Beijing - SPDK in CephCeph Community
52 views35 slides
Ceph Day Beijing - SPDK for Ceph by
Ceph Day Beijing - SPDK for CephCeph Day Beijing - SPDK for Ceph
Ceph Day Beijing - SPDK for CephDanielle Womboldt
5.5K views35 slides
SSD based storage tuning for databases by
SSD based storage tuning for databasesSSD based storage tuning for databases
SSD based storage tuning for databasesAngelo Rajadurai
2.6K views28 slides

Similar to MySQL新技术研究与实践(20)

QCon2016--Drive Best Spark Performance on AI by Lex Yu
QCon2016--Drive Best Spark Performance on AIQCon2016--Drive Best Spark Performance on AI
QCon2016--Drive Best Spark Performance on AI
Lex Yu538 views
Ceph Day Taipei - Accelerate Ceph via SPDK by Ceph Community
Ceph Day Taipei - Accelerate Ceph via SPDK Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Community 463 views
Database performance tuning for SSD based storage by Angelo Rajadurai
Database  performance tuning for SSD based storageDatabase  performance tuning for SSD based storage
Database performance tuning for SSD based storage
Angelo Rajadurai4.3K views
SSD based storage tuning for databases by Angelo Rajadurai
SSD based storage tuning for databasesSSD based storage tuning for databases
SSD based storage tuning for databases
Angelo Rajadurai2.6K views
[db tech showcase Tokyo 2018] #dbts2018 #B17 『オラクル パフォーマンス チューニング - 神話、伝説と解決策』 by Insight Technology, Inc.
[db tech showcase Tokyo 2018] #dbts2018 #B17 『オラクル パフォーマンス チューニング - 神話、伝説と解決策』[db tech showcase Tokyo 2018] #dbts2018 #B17 『オラクル パフォーマンス チューニング - 神話、伝説と解決策』
[db tech showcase Tokyo 2018] #dbts2018 #B17 『オラクル パフォーマンス チューニング - 神話、伝説と解決策』
20201006_PGconf_Online_Large_Data_Processing by Kohei KaiGai
20201006_PGconf_Online_Large_Data_Processing20201006_PGconf_Online_Large_Data_Processing
20201006_PGconf_Online_Large_Data_Processing
Kohei KaiGai431 views
Stefano Doni - Achieve Superhuman Performance with Machine Learning by Neotys_Partner
Stefano Doni - Achieve Superhuman Performance with Machine LearningStefano Doni - Achieve Superhuman Performance with Machine Learning
Stefano Doni - Achieve Superhuman Performance with Machine Learning
Neotys_Partner398 views
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ... by Nagios
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios2.1K views
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw... by Red_Hat_Storage
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red_Hat_Storage414 views
Ceph Day Tokyo - Delivering cost effective, high performance Ceph cluster by Ceph Community
Ceph Day Tokyo - Delivering cost effective, high performance Ceph clusterCeph Day Tokyo - Delivering cost effective, high performance Ceph cluster
Ceph Day Tokyo - Delivering cost effective, high performance Ceph cluster
Ceph Community 233 views
Experiences with Oracle SPARC S7-2 Server by JomaSoft
Experiences with Oracle SPARC S7-2 ServerExperiences with Oracle SPARC S7-2 Server
Experiences with Oracle SPARC S7-2 Server
JomaSoft273 views
Challenges and Trends of SSD Design by Henry Chao
Challenges and Trends of SSD DesignChallenges and Trends of SSD Design
Challenges and Trends of SSD Design
Henry Chao1.5K views
2018 Infortrend All Flash Arrays Introduction (GS3025A) by infortrendgroup
2018 Infortrend All Flash Arrays Introduction (GS3025A)2018 Infortrend All Flash Arrays Introduction (GS3025A)
2018 Infortrend All Flash Arrays Introduction (GS3025A)
infortrendgroup436 views
Optimizing Oracle databases with SSD - April 2014 by Guy Harrison
Optimizing Oracle databases with SSD - April 2014Optimizing Oracle databases with SSD - April 2014
Optimizing Oracle databases with SSD - April 2014
Guy Harrison11.8K views
Ceph Day KL - Delivering cost-effective, high performance Ceph cluster by Ceph Community
Ceph Day KL - Delivering cost-effective, high performance Ceph clusterCeph Day KL - Delivering cost-effective, high performance Ceph cluster
Ceph Day KL - Delivering cost-effective, high performance Ceph cluster
Ceph Community 126 views

More from orczhou

2012 dtcc-itpub-runing-critical-data-on-mysql by
2012 dtcc-itpub-runing-critical-data-on-mysql2012 dtcc-itpub-runing-critical-data-on-mysql
2012 dtcc-itpub-runing-critical-data-on-mysqlorczhou
629 views26 slides
MySQL自动切换设计与实现 by
MySQL自动切换设计与实现MySQL自动切换设计与实现
MySQL自动切换设计与实现orczhou
2.9K views34 slides
MySQL Replication新功能介绍 by
MySQL Replication新功能介绍 MySQL Replication新功能介绍
MySQL Replication新功能介绍 orczhou
1.2K views18 slides
飞信核心库Ha设计及实现 by
飞信核心库Ha设计及实现飞信核心库Ha设计及实现
飞信核心库Ha设计及实现orczhou
503 views13 slides
海量数据迁移方案 by
海量数据迁移方案海量数据迁移方案
海量数据迁移方案orczhou
1.3K views21 slides
Manage MySQL with open source by
Manage MySQL with open sourceManage MySQL with open source
Manage MySQL with open sourceorczhou
784 views23 slides

More from orczhou(8)

2012 dtcc-itpub-runing-critical-data-on-mysql by orczhou
2012 dtcc-itpub-runing-critical-data-on-mysql2012 dtcc-itpub-runing-critical-data-on-mysql
2012 dtcc-itpub-runing-critical-data-on-mysql
orczhou629 views
MySQL自动切换设计与实现 by orczhou
MySQL自动切换设计与实现MySQL自动切换设计与实现
MySQL自动切换设计与实现
orczhou2.9K views
MySQL Replication新功能介绍 by orczhou
MySQL Replication新功能介绍 MySQL Replication新功能介绍
MySQL Replication新功能介绍
orczhou1.2K views
飞信核心库Ha设计及实现 by orczhou
飞信核心库Ha设计及实现飞信核心库Ha设计及实现
飞信核心库Ha设计及实现
orczhou503 views
海量数据迁移方案 by orczhou
海量数据迁移方案海量数据迁移方案
海量数据迁移方案
orczhou1.3K views
Manage MySQL with open source by orczhou
Manage MySQL with open sourceManage MySQL with open source
Manage MySQL with open source
orczhou784 views
MySQL Replication by orczhou
MySQL ReplicationMySQL Replication
MySQL Replication
orczhou337 views
MySQL Replication by orczhou
MySQL ReplicationMySQL Replication
MySQL Replication
orczhou362 views

MySQL新技术研究与实践

  • 1.
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.