SlideShare a Scribd company logo
1 of 18
Download to read offline
RRDtool - how to make it sit up and beg?

              Tobias Oetiker

            OETIKER+PARTNER AG


                GoOpen 09
about rrdtool




      a database with controlled memory loss
      data is only an approximation of reality
      quick setup and use
      graphics included
designed for speed
diy performance improvements




      rrd is disk bound
      striping
      nvram
      tmpfs and copy
scientific approach


      Dave Plonka, LISA’07
      vm optimization kills rrd
      fix read-ahead with fadvise random
      batch updates of a single rrd
      running 320k RRD updates every 5 Minutes
buffer cache is king
      empirical evidence shows cache helps
      no-cache: double the work
      worse: writes gets blocked by read
active buffer cache management with fadvise


      fadvise and madvise
      RANDOM - no read ahead
      DONTNEED - drop synced data from cache
      highly implementation dependent
      linux >= 2.6.18 gets it right
      keep only the hot blocks
features of RRDtool 1.3



      active buffer cache management with fadvise and madvise
      memory mapped io (bernhard fischer)
      holt winters with moving baseline (evan miller)
      cairo and pango for graphics
      pdf, svg, eps output
      inline text formatting
      anti-aliasing controllable
rrd cache daemon

      multiple updates to the same rrd are the fastest
      cache daemon batches updates
      journal replay for crash case
      remote updates (no auth)
features of RRDtool 1.4




      beta out now
      rrd cache daemon (florian forster and kevin brintnall)
      libdbi integration for instant db access (martin sperl)
      graph prediction functions (martin sperl)
      graph legend placement (melchior rabe)
      inline text formatting
features of RRDtool 1.5




      portable data format
      remote graphing through rrd cache daemon
      authentication for rrdcached
      ...
?
Tobi Oetiker <tobi@oetiker.ch>
Graph Critic - HTTP Cache Traffic




  graph by Charles Glass
Graph Critic - RTT of MPLS VPN endpoints




  graph by Bruno Ciscato
Graph Critic - System Information




   graph by kmindi
Graph Critic - Energy Mix




   graph by Lutz Schulze
Graph Critic - Thermostat Indoor / Outdoor




  graph by Andres Brownworth

More Related Content

What's hot

Spark 计算模型
Spark 计算模型Spark 计算模型
Spark 计算模型wang xing
 
State of Gluster Performance
State of Gluster PerformanceState of Gluster Performance
State of Gluster PerformanceGluster.org
 
Challenges with Gluster and Persistent Memory with Dan Lambright
Challenges with Gluster and Persistent Memory with Dan LambrightChallenges with Gluster and Persistent Memory with Dan Lambright
Challenges with Gluster and Persistent Memory with Dan LambrightGluster.org
 
DHT2 - O Brother, Where Art Thou with Shyam Ranganathan
DHT2 - O Brother, Where Art Thou with 	Shyam RanganathanDHT2 - O Brother, Where Art Thou with 	Shyam Ranganathan
DHT2 - O Brother, Where Art Thou with Shyam RanganathanGluster.org
 
Case Study - DR on Demand
Case Study - DR on DemandCase Study - DR on Demand
Case Study - DR on DemandCTRLS
 
Erasure codes and storage tiers on gluster
Erasure codes and storage tiers on glusterErasure codes and storage tiers on gluster
Erasure codes and storage tiers on glusterRed_Hat_Storage
 
NetFlow Data processing using Hadoop and Vertica
NetFlow Data processing using Hadoop and VerticaNetFlow Data processing using Hadoop and Vertica
NetFlow Data processing using Hadoop and VerticaJosef Niedermeier
 
10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...
10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...
10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...DevOpsDays Tel Aviv
 
Sharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika DhananjaySharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika DhananjayGluster.org
 
Using Ceph for Large Hadron Collider Data
Using Ceph for Large Hadron Collider DataUsing Ceph for Large Hadron Collider Data
Using Ceph for Large Hadron Collider DataRob Gardner
 
Persistent Memory Development Kit (PMDK): State of the Project
Persistent Memory Development Kit (PMDK): State of the ProjectPersistent Memory Development Kit (PMDK): State of the Project
Persistent Memory Development Kit (PMDK): State of the ProjectIntel® Software
 
Mon Acc Ccr Workshop
Mon Acc Ccr WorkshopMon Acc Ccr Workshop
Mon Acc Ccr WorkshopFNian
 
MapR Tutorial Series
MapR Tutorial SeriesMapR Tutorial Series
MapR Tutorial Seriesselvaraaju
 
Dataframes Showdown (miniConf 2022)
Dataframes Showdown (miniConf 2022)Dataframes Showdown (miniConf 2022)
Dataframes Showdown (miniConf 2022)8thLight
 
Exploring the Performance Impact of Virtualization on an HPC Cloud
Exploring the Performance Impact of Virtualization on an HPC CloudExploring the Performance Impact of Virtualization on an HPC Cloud
Exploring the Performance Impact of Virtualization on an HPC CloudRyousei Takano
 
Health Check Your DB2 UDB For Z/OS System
Health Check Your DB2 UDB For Z/OS SystemHealth Check Your DB2 UDB For Z/OS System
Health Check Your DB2 UDB For Z/OS Systemsjreese
 

What's hot (20)

Spark 计算模型
Spark 计算模型Spark 计算模型
Spark 计算模型
 
State of Gluster Performance
State of Gluster PerformanceState of Gluster Performance
State of Gluster Performance
 
Challenges with Gluster and Persistent Memory with Dan Lambright
Challenges with Gluster and Persistent Memory with Dan LambrightChallenges with Gluster and Persistent Memory with Dan Lambright
Challenges with Gluster and Persistent Memory with Dan Lambright
 
DHT2 - O Brother, Where Art Thou with Shyam Ranganathan
DHT2 - O Brother, Where Art Thou with 	Shyam RanganathanDHT2 - O Brother, Where Art Thou with 	Shyam Ranganathan
DHT2 - O Brother, Where Art Thou with Shyam Ranganathan
 
3200
32003200
3200
 
Case Study - DR on Demand
Case Study - DR on DemandCase Study - DR on Demand
Case Study - DR on Demand
 
Erasure codes and storage tiers on gluster
Erasure codes and storage tiers on glusterErasure codes and storage tiers on gluster
Erasure codes and storage tiers on gluster
 
NetFlow Data processing using Hadoop and Vertica
NetFlow Data processing using Hadoop and VerticaNetFlow Data processing using Hadoop and Vertica
NetFlow Data processing using Hadoop and Vertica
 
10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...
10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...
10 Devops-Friendly Database Must-Haves - Dor Laor, ScyllaDB - DevOpsDays Tel ...
 
Sharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika DhananjaySharding: Past, Present and Future with Krutika Dhananjay
Sharding: Past, Present and Future with Krutika Dhananjay
 
Using Ceph for Large Hadron Collider Data
Using Ceph for Large Hadron Collider DataUsing Ceph for Large Hadron Collider Data
Using Ceph for Large Hadron Collider Data
 
Persistent Memory Development Kit (PMDK): State of the Project
Persistent Memory Development Kit (PMDK): State of the ProjectPersistent Memory Development Kit (PMDK): State of the Project
Persistent Memory Development Kit (PMDK): State of the Project
 
Mon Acc Ccr Workshop
Mon Acc Ccr WorkshopMon Acc Ccr Workshop
Mon Acc Ccr Workshop
 
MapR Tutorial Series
MapR Tutorial SeriesMapR Tutorial Series
MapR Tutorial Series
 
Gluster Data Tiering
Gluster Data TieringGluster Data Tiering
Gluster Data Tiering
 
Dataframes Showdown (miniConf 2022)
Dataframes Showdown (miniConf 2022)Dataframes Showdown (miniConf 2022)
Dataframes Showdown (miniConf 2022)
 
Exploring the Performance Impact of Virtualization on an HPC Cloud
Exploring the Performance Impact of Virtualization on an HPC CloudExploring the Performance Impact of Virtualization on an HPC Cloud
Exploring the Performance Impact of Virtualization on an HPC Cloud
 
Malstone KDD 2010
Malstone KDD 2010Malstone KDD 2010
Malstone KDD 2010
 
Supporting HDF5 in GrADS
Supporting HDF5 in GrADSSupporting HDF5 in GrADS
Supporting HDF5 in GrADS
 
Health Check Your DB2 UDB For Z/OS System
Health Check Your DB2 UDB For Z/OS SystemHealth Check Your DB2 UDB For Z/OS System
Health Check Your DB2 UDB For Z/OS System
 

Viewers also liked

GoOpen 2010: Svein Erik Wilthil
GoOpen 2010: Svein Erik WilthilGoOpen 2010: Svein Erik Wilthil
GoOpen 2010: Svein Erik WilthilFriprogsenteret
 
GoOpen 2010: Daniel Kihlberg
GoOpen 2010: Daniel KihlbergGoOpen 2010: Daniel Kihlberg
GoOpen 2010: Daniel KihlbergFriprogsenteret
 
GoOpen 2010: Henrik Nore og Christian Bull
GoOpen 2010: Henrik Nore og Christian BullGoOpen 2010: Henrik Nore og Christian Bull
GoOpen 2010: Henrik Nore og Christian BullFriprogsenteret
 
GoOpen 2010: Espen Dalløkken
GoOpen 2010: Espen DalløkkenGoOpen 2010: Espen Dalløkken
GoOpen 2010: Espen DalløkkenFriprogsenteret
 
Odd Simon Simonsen: Deling av egen kode
Odd Simon Simonsen: Deling av egen kodeOdd Simon Simonsen: Deling av egen kode
Odd Simon Simonsen: Deling av egen kodeFriprogsenteret
 
GoOpen 2010: Jonny Johansen
GoOpen 2010: Jonny JohansenGoOpen 2010: Jonny Johansen
GoOpen 2010: Jonny JohansenFriprogsenteret
 
GoOpen 2010: Sandro D'Elia
GoOpen 2010: Sandro D'EliaGoOpen 2010: Sandro D'Elia
GoOpen 2010: Sandro D'EliaFriprogsenteret
 

Viewers also liked (9)

GoOpen 2010: Svein Erik Wilthil
GoOpen 2010: Svein Erik WilthilGoOpen 2010: Svein Erik Wilthil
GoOpen 2010: Svein Erik Wilthil
 
GoOpen 2010: Daniel Kihlberg
GoOpen 2010: Daniel KihlbergGoOpen 2010: Daniel Kihlberg
GoOpen 2010: Daniel Kihlberg
 
GoOpen 2010: Henrik Nore og Christian Bull
GoOpen 2010: Henrik Nore og Christian BullGoOpen 2010: Henrik Nore og Christian Bull
GoOpen 2010: Henrik Nore og Christian Bull
 
GoOpen 2010: Espen Dalløkken
GoOpen 2010: Espen DalløkkenGoOpen 2010: Espen Dalløkken
GoOpen 2010: Espen Dalløkken
 
Odd Simon Simonsen: Deling av egen kode
Odd Simon Simonsen: Deling av egen kodeOdd Simon Simonsen: Deling av egen kode
Odd Simon Simonsen: Deling av egen kode
 
GoOpen 2010: Jonny Johansen
GoOpen 2010: Jonny JohansenGoOpen 2010: Jonny Johansen
GoOpen 2010: Jonny Johansen
 
GoOpen 2010: Sandro D'Elia
GoOpen 2010: Sandro D'EliaGoOpen 2010: Sandro D'Elia
GoOpen 2010: Sandro D'Elia
 
GoOpen 2010: Tor Alvik
GoOpen 2010: Tor AlvikGoOpen 2010: Tor Alvik
GoOpen 2010: Tor Alvik
 
Marcus Ramberg: Git now
Marcus Ramberg: Git nowMarcus Ramberg: Git now
Marcus Ramberg: Git now
 

Similar to How to optimize RRDtool performance

GPU Accelerated Data Science with RAPIDS - ODSC West 2020
GPU Accelerated Data Science with RAPIDS - ODSC West 2020GPU Accelerated Data Science with RAPIDS - ODSC West 2020
GPU Accelerated Data Science with RAPIDS - ODSC West 2020John Zedlewski
 
RBD: What will the future bring? - Jason Dillaman
RBD: What will the future bring? - Jason DillamanRBD: What will the future bring? - Jason Dillaman
RBD: What will the future bring? - Jason DillamanCeph Community
 
20201006_PGconf_Online_Large_Data_Processing
20201006_PGconf_Online_Large_Data_Processing20201006_PGconf_Online_Large_Data_Processing
20201006_PGconf_Online_Large_Data_ProcessingKohei KaiGai
 
RAPIDS: GPU-Accelerated ETL and Feature Engineering
RAPIDS: GPU-Accelerated ETL and Feature EngineeringRAPIDS: GPU-Accelerated ETL and Feature Engineering
RAPIDS: GPU-Accelerated ETL and Feature EngineeringKeith Kraus
 
SFBigAnalytics_SparkRapid_20220622.pdf
SFBigAnalytics_SparkRapid_20220622.pdfSFBigAnalytics_SparkRapid_20220622.pdf
SFBigAnalytics_SparkRapid_20220622.pdfChester Chen
 
New Developments in Spark
New Developments in SparkNew Developments in Spark
New Developments in SparkDatabricks
 
Data Analytics and Machine Learning: From Node to Cluster on ARM64
Data Analytics and Machine Learning: From Node to Cluster on ARM64Data Analytics and Machine Learning: From Node to Cluster on ARM64
Data Analytics and Machine Learning: From Node to Cluster on ARM64Ganesh Raju
 
BKK16-404B Data Analytics and Machine Learning- from Node to Cluster
BKK16-404B Data Analytics and Machine Learning- from Node to ClusterBKK16-404B Data Analytics and Machine Learning- from Node to Cluster
BKK16-404B Data Analytics and Machine Learning- from Node to ClusterLinaro
 
BKK16-408B Data Analytics and Machine Learning From Node to Cluster
BKK16-408B Data Analytics and Machine Learning From Node to ClusterBKK16-408B Data Analytics and Machine Learning From Node to Cluster
BKK16-408B Data Analytics and Machine Learning From Node to ClusterLinaro
 
Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...
Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...
Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...Nagios
 
Spark Summit EU 2015: Reynold Xin Keynote
Spark Summit EU 2015: Reynold Xin KeynoteSpark Summit EU 2015: Reynold Xin Keynote
Spark Summit EU 2015: Reynold Xin KeynoteDatabricks
 
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDFGPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDFKeith Kraus
 
Multimedia hardware
Multimedia hardwareMultimedia hardware
Multimedia hardwareUtsav Roy
 
20170602_OSSummit_an_intelligent_storage
20170602_OSSummit_an_intelligent_storage20170602_OSSummit_an_intelligent_storage
20170602_OSSummit_an_intelligent_storageKohei KaiGai
 
Putting Wings on the Elephant
Putting Wings on the ElephantPutting Wings on the Elephant
Putting Wings on the ElephantDataWorks Summit
 
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...Databricks
 
Advancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio
Advancing GPU Analytics with RAPIDS Accelerator for Spark and AlluxioAdvancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio
Advancing GPU Analytics with RAPIDS Accelerator for Spark and AlluxioAlluxio, Inc.
 

Similar to How to optimize RRDtool performance (20)

GPU Accelerated Data Science with RAPIDS - ODSC West 2020
GPU Accelerated Data Science with RAPIDS - ODSC West 2020GPU Accelerated Data Science with RAPIDS - ODSC West 2020
GPU Accelerated Data Science with RAPIDS - ODSC West 2020
 
RBD: What will the future bring? - Jason Dillaman
RBD: What will the future bring? - Jason DillamanRBD: What will the future bring? - Jason Dillaman
RBD: What will the future bring? - Jason Dillaman
 
20201006_PGconf_Online_Large_Data_Processing
20201006_PGconf_Online_Large_Data_Processing20201006_PGconf_Online_Large_Data_Processing
20201006_PGconf_Online_Large_Data_Processing
 
Spark
SparkSpark
Spark
 
RAPIDS: GPU-Accelerated ETL and Feature Engineering
RAPIDS: GPU-Accelerated ETL and Feature EngineeringRAPIDS: GPU-Accelerated ETL and Feature Engineering
RAPIDS: GPU-Accelerated ETL and Feature Engineering
 
SFBigAnalytics_SparkRapid_20220622.pdf
SFBigAnalytics_SparkRapid_20220622.pdfSFBigAnalytics_SparkRapid_20220622.pdf
SFBigAnalytics_SparkRapid_20220622.pdf
 
New Developments in Spark
New Developments in SparkNew Developments in Spark
New Developments in Spark
 
Data Analytics and Machine Learning: From Node to Cluster on ARM64
Data Analytics and Machine Learning: From Node to Cluster on ARM64Data Analytics and Machine Learning: From Node to Cluster on ARM64
Data Analytics and Machine Learning: From Node to Cluster on ARM64
 
BKK16-404B Data Analytics and Machine Learning- from Node to Cluster
BKK16-404B Data Analytics and Machine Learning- from Node to ClusterBKK16-404B Data Analytics and Machine Learning- from Node to Cluster
BKK16-404B Data Analytics and Machine Learning- from Node to Cluster
 
BKK16-408B Data Analytics and Machine Learning From Node to Cluster
BKK16-408B Data Analytics and Machine Learning From Node to ClusterBKK16-408B Data Analytics and Machine Learning From Node to Cluster
BKK16-408B Data Analytics and Machine Learning From Node to Cluster
 
Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...
Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...
Nagios Conference 2012 - Andrew Widdersheim - Nagios is down boss wants to se...
 
Spark
SparkSpark
Spark
 
Spark Summit EU 2015: Reynold Xin Keynote
Spark Summit EU 2015: Reynold Xin KeynoteSpark Summit EU 2015: Reynold Xin Keynote
Spark Summit EU 2015: Reynold Xin Keynote
 
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDFGPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
 
Multimedia hardware
Multimedia hardwareMultimedia hardware
Multimedia hardware
 
20170602_OSSummit_an_intelligent_storage
20170602_OSSummit_an_intelligent_storage20170602_OSSummit_an_intelligent_storage
20170602_OSSummit_an_intelligent_storage
 
Putting Wings on the Elephant
Putting Wings on the ElephantPutting Wings on the Elephant
Putting Wings on the Elephant
 
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...
Running Apache Spark on a High-Performance Cluster Using RDMA and NVMe Flash ...
 
Dpdk applications
Dpdk applicationsDpdk applications
Dpdk applications
 
Advancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio
Advancing GPU Analytics with RAPIDS Accelerator for Spark and AlluxioAdvancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio
Advancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio
 

More from Friprogsenteret

Fri programvare + Åpne data = Hånd i hanske
Fri programvare + Åpne data = Hånd i hanskeFri programvare + Åpne data = Hånd i hanske
Fri programvare + Åpne data = Hånd i hanskeFriprogsenteret
 
Hvorfor — og hvordan satser BEKK på fri programvare?
Hvorfor — og hvordan satser BEKK på fri programvare?Hvorfor — og hvordan satser BEKK på fri programvare?
Hvorfor — og hvordan satser BEKK på fri programvare?Friprogsenteret
 
GoOpen Roadshow Trondheim - Innledning ved Friprogsenteret
GoOpen Roadshow Trondheim - Innledning ved FriprogsenteretGoOpen Roadshow Trondheim - Innledning ved Friprogsenteret
GoOpen Roadshow Trondheim - Innledning ved FriprogsenteretFriprogsenteret
 
The Norwegian approach to open source in the public sector
The Norwegian approach to open source in the public sectorThe Norwegian approach to open source in the public sector
The Norwegian approach to open source in the public sectorFriprogsenteret
 
Åpning av MSc ved UiA og HiT
Åpning av MSc ved UiA og HiTÅpning av MSc ved UiA og HiT
Åpning av MSc ved UiA og HiTFriprogsenteret
 
GoOpen 2010: David Elboth
GoOpen 2010: David ElbothGoOpen 2010: David Elboth
GoOpen 2010: David ElbothFriprogsenteret
 
Fri programvare og utfordringer i anskaffelsesprosessen
Fri programvare og utfordringer i anskaffelsesprosessenFri programvare og utfordringer i anskaffelsesprosessen
Fri programvare og utfordringer i anskaffelsesprosessenFriprogsenteret
 
GoOpen 2010: Roger Bivand
GoOpen 2010: Roger BivandGoOpen 2010: Roger Bivand
GoOpen 2010: Roger BivandFriprogsenteret
 
GoOpen 2010: Reidar Conradi
GoOpen 2010: Reidar ConradiGoOpen 2010: Reidar Conradi
GoOpen 2010: Reidar ConradiFriprogsenteret
 
GoOpen 2010: Lisbeth Bergholt
GoOpen 2010: Lisbeth BergholtGoOpen 2010: Lisbeth Bergholt
GoOpen 2010: Lisbeth BergholtFriprogsenteret
 
GoOpen 2010: Jan Rasmus Sulebak
GoOpen 2010: Jan Rasmus SulebakGoOpen 2010: Jan Rasmus Sulebak
GoOpen 2010: Jan Rasmus SulebakFriprogsenteret
 
GoOpen 2010: Erlend Øverby
GoOpen 2010: Erlend ØverbyGoOpen 2010: Erlend Øverby
GoOpen 2010: Erlend ØverbyFriprogsenteret
 
GoOpen 2010: Ann Therese Lotherington
GoOpen 2010: Ann Therese LotheringtonGoOpen 2010: Ann Therese Lotherington
GoOpen 2010: Ann Therese LotheringtonFriprogsenteret
 
GoOpen 2010: Olav Torvund
GoOpen 2010: Olav TorvundGoOpen 2010: Olav Torvund
GoOpen 2010: Olav TorvundFriprogsenteret
 
GoOpen 2010: Arne Magnus
GoOpen 2010: Arne MagnusGoOpen 2010: Arne Magnus
GoOpen 2010: Arne MagnusFriprogsenteret
 
GoOpen 2010: Anne Cathrine Frøstrup
GoOpen 2010: Anne Cathrine FrøstrupGoOpen 2010: Anne Cathrine Frøstrup
GoOpen 2010: Anne Cathrine FrøstrupFriprogsenteret
 
GoOpen 2010: Rein Amund Schultz
GoOpen 2010: Rein Amund SchultzGoOpen 2010: Rein Amund Schultz
GoOpen 2010: Rein Amund SchultzFriprogsenteret
 
GoOpen 2010: Per Einar Dybvik
GoOpen 2010: Per Einar DybvikGoOpen 2010: Per Einar Dybvik
GoOpen 2010: Per Einar DybvikFriprogsenteret
 

More from Friprogsenteret (20)

Fri programvare + Åpne data = Hånd i hanske
Fri programvare + Åpne data = Hånd i hanskeFri programvare + Åpne data = Hånd i hanske
Fri programvare + Åpne data = Hånd i hanske
 
Hvorfor — og hvordan satser BEKK på fri programvare?
Hvorfor — og hvordan satser BEKK på fri programvare?Hvorfor — og hvordan satser BEKK på fri programvare?
Hvorfor — og hvordan satser BEKK på fri programvare?
 
GoOpen Roadshow Trondheim - Innledning ved Friprogsenteret
GoOpen Roadshow Trondheim - Innledning ved FriprogsenteretGoOpen Roadshow Trondheim - Innledning ved Friprogsenteret
GoOpen Roadshow Trondheim - Innledning ved Friprogsenteret
 
The Norwegian approach to open source in the public sector
The Norwegian approach to open source in the public sectorThe Norwegian approach to open source in the public sector
The Norwegian approach to open source in the public sector
 
Åpning av MSc ved UiA og HiT
Åpning av MSc ved UiA og HiTÅpning av MSc ved UiA og HiT
Åpning av MSc ved UiA og HiT
 
Overalt, alltid
Overalt, alltidOveralt, alltid
Overalt, alltid
 
GoOpen 2010: David Elboth
GoOpen 2010: David ElbothGoOpen 2010: David Elboth
GoOpen 2010: David Elboth
 
Fri programvare og utfordringer i anskaffelsesprosessen
Fri programvare og utfordringer i anskaffelsesprosessenFri programvare og utfordringer i anskaffelsesprosessen
Fri programvare og utfordringer i anskaffelsesprosessen
 
GoOpen 2010: Roger Bivand
GoOpen 2010: Roger BivandGoOpen 2010: Roger Bivand
GoOpen 2010: Roger Bivand
 
GoOpen 2010: Reidar Conradi
GoOpen 2010: Reidar ConradiGoOpen 2010: Reidar Conradi
GoOpen 2010: Reidar Conradi
 
GoOpen 2010: Lisbeth Bergholt
GoOpen 2010: Lisbeth BergholtGoOpen 2010: Lisbeth Bergholt
GoOpen 2010: Lisbeth Bergholt
 
GoOpen 2010: Jan Rasmus Sulebak
GoOpen 2010: Jan Rasmus SulebakGoOpen 2010: Jan Rasmus Sulebak
GoOpen 2010: Jan Rasmus Sulebak
 
GoOpen 2010: Erlend Øverby
GoOpen 2010: Erlend ØverbyGoOpen 2010: Erlend Øverby
GoOpen 2010: Erlend Øverby
 
GoOpen 2010: Ann Therese Lotherington
GoOpen 2010: Ann Therese LotheringtonGoOpen 2010: Ann Therese Lotherington
GoOpen 2010: Ann Therese Lotherington
 
GoOpen 2010: Olav Torvund
GoOpen 2010: Olav TorvundGoOpen 2010: Olav Torvund
GoOpen 2010: Olav Torvund
 
GoOpen 2010: Arne Magnus
GoOpen 2010: Arne MagnusGoOpen 2010: Arne Magnus
GoOpen 2010: Arne Magnus
 
GoOpen 2010: Anne Cathrine Frøstrup
GoOpen 2010: Anne Cathrine FrøstrupGoOpen 2010: Anne Cathrine Frøstrup
GoOpen 2010: Anne Cathrine Frøstrup
 
GoOpen 2010: Tom Orvei
GoOpen 2010: Tom OrveiGoOpen 2010: Tom Orvei
GoOpen 2010: Tom Orvei
 
GoOpen 2010: Rein Amund Schultz
GoOpen 2010: Rein Amund SchultzGoOpen 2010: Rein Amund Schultz
GoOpen 2010: Rein Amund Schultz
 
GoOpen 2010: Per Einar Dybvik
GoOpen 2010: Per Einar DybvikGoOpen 2010: Per Einar Dybvik
GoOpen 2010: Per Einar Dybvik
 

Recently uploaded

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 

Recently uploaded (20)

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 

How to optimize RRDtool performance

  • 1. RRDtool - how to make it sit up and beg? Tobias Oetiker OETIKER+PARTNER AG GoOpen 09
  • 2. about rrdtool a database with controlled memory loss data is only an approximation of reality quick setup and use graphics included
  • 4. diy performance improvements rrd is disk bound striping nvram tmpfs and copy
  • 5. scientific approach Dave Plonka, LISA’07 vm optimization kills rrd fix read-ahead with fadvise random batch updates of a single rrd running 320k RRD updates every 5 Minutes
  • 6. buffer cache is king empirical evidence shows cache helps no-cache: double the work worse: writes gets blocked by read
  • 7. active buffer cache management with fadvise fadvise and madvise RANDOM - no read ahead DONTNEED - drop synced data from cache highly implementation dependent linux >= 2.6.18 gets it right keep only the hot blocks
  • 8. features of RRDtool 1.3 active buffer cache management with fadvise and madvise memory mapped io (bernhard fischer) holt winters with moving baseline (evan miller) cairo and pango for graphics pdf, svg, eps output inline text formatting anti-aliasing controllable
  • 9. rrd cache daemon multiple updates to the same rrd are the fastest cache daemon batches updates journal replay for crash case remote updates (no auth)
  • 10. features of RRDtool 1.4 beta out now rrd cache daemon (florian forster and kevin brintnall) libdbi integration for instant db access (martin sperl) graph prediction functions (martin sperl) graph legend placement (melchior rabe) inline text formatting
  • 11. features of RRDtool 1.5 portable data format remote graphing through rrd cache daemon authentication for rrdcached ...
  • 12. ?
  • 14. Graph Critic - HTTP Cache Traffic graph by Charles Glass
  • 15. Graph Critic - RTT of MPLS VPN endpoints graph by Bruno Ciscato
  • 16. Graph Critic - System Information graph by kmindi
  • 17. Graph Critic - Energy Mix graph by Lutz Schulze
  • 18. Graph Critic - Thermostat Indoor / Outdoor graph by Andres Brownworth