SlideShare a Scribd company logo
1 of 9
Go write a plugin!
THE STORY OF AN
OPEN TELEMETRY
FRAMEWORK CALLED
What snap is
snap is an open framework for metrics
snap is NOT an analytics alternative
We have a list of maintained plugins.
Curious what it requires to write one? See our Plugin Authoring
documentation.
/intel/server/cpu/load
/intel/server/cpu/ipc
/intel/server/cpu/l2cache
/intel/server/mem/free
/intel/server/mem/used
/intel/server/nic/eth0/bytes_rec
PSUtil, Facter,
CollectD, Ohai
Node, DCM,
NIC, Disk Encryption, OSLO,
Machine Learning,
Filtering
RabbitMQ, HANA,
Ceilometer, InfluxDB
Mosquito, File,
postgresSQL, mySQL
Demo.
The simple one.
Environment:
1 instance of snapd running locally
Load collectors, view metrics via snapctl
Pre-work:
gvm use go1.5.3
go get github.com/intelsdi-x/snap
make
Why this is cool
Write this plugin (or others!)
Cloud
Software
Server
Silicon
Storage
Silicon
Network
Silicon
Orchestration Software
Developer Environment
Virtualization Software
Operating System, Libraries
Cloud Software Stack
Applications & Services
Telemetry and
Datacenter Analytics
Collector
Processor
Publisher
Bayesia
n Filter Cassandr
a
Publisher
TASK
Grafana
CP
U
NIC
ME
M
Key Features
Collect
Publish
Publish
Collect
Process Publish
Process Publish
• Plugin load
• No restart
• Extends the metric catalog
• Plugin unload
• Removes metrics from catalog
• Plugin swap
• Newer version swapped in a
single transaction
LIFECYCLE MANAGEMENT FLEXIBLE DEPLOYMENT AUTOMATION
ProcessCollect Publish
TRIBE
Demo.
Administration and automate scale.
Environment:
4 instance of snapd running locally
Initiate in tribe mode
Load a collector, process & publisher
Load a task via snapctl
Watch that task via snapctl
Pre-work:
gvm use go1.5.3
go get github.com/intelsdi-x/snap
make
Why Go?
<3 this community slide.
Great toolset
• Logrus
• Gomit*
• Memberlist
Strong opinions
• fmt
• test
Datacenter Momentum
Thank You
Launch was successful because of this amazing community.
500
Trending!
Get involved
• Download, install and run snap right now
• Read the extensive documentation on GitHub
• Report your experiences (features and bugs) through GitHub
• Talk to the developers of snap on Gitter
• See the public roadmap on GitHub
• Reach out to me or any of the maintainers =>
• on Twitter|GitHub|Gitter
Thanks!
@mjbrender

More Related Content

What's hot

Spark summit2014 techtalk - testing spark
Spark summit2014 techtalk - testing sparkSpark summit2014 techtalk - testing spark
Spark summit2014 techtalk - testing spark
Anu Shetty
 
Percona XtraDB Cluster before every release: Glimpse into CI testing
Percona XtraDB Cluster before every release: Glimpse into CI testingPercona XtraDB Cluster before every release: Glimpse into CI testing
Percona XtraDB Cluster before every release: Glimpse into CI testing
Raghavendra Prabhu
 

What's hot (20)

LISA17 Container Performance Analysis
LISA17 Container Performance AnalysisLISA17 Container Performance Analysis
LISA17 Container Performance Analysis
 
Stabilising the jenga tower
Stabilising the jenga towerStabilising the jenga tower
Stabilising the jenga tower
 
Rapid Application Design in Financial Services
Rapid Application Design in Financial ServicesRapid Application Design in Financial Services
Rapid Application Design in Financial Services
 
Netflix SRE perf meetup_slides
Netflix SRE perf meetup_slidesNetflix SRE perf meetup_slides
Netflix SRE perf meetup_slides
 
[124] mit cheetah 로봇의 탄생
[124] mit cheetah 로봇의 탄생[124] mit cheetah 로봇의 탄생
[124] mit cheetah 로봇의 탄생
 
Spark summit2014 techtalk - testing spark
Spark summit2014 techtalk - testing sparkSpark summit2014 techtalk - testing spark
Spark summit2014 techtalk - testing spark
 
Beating Python's GIL to Max Out Your CPUs
Beating Python's GIL to Max Out Your CPUsBeating Python's GIL to Max Out Your CPUs
Beating Python's GIL to Max Out Your CPUs
 
Percona XtraDB Cluster before every release: Glimpse into CI testing
Percona XtraDB Cluster before every release: Glimpse into CI testingPercona XtraDB Cluster before every release: Glimpse into CI testing
Percona XtraDB Cluster before every release: Glimpse into CI testing
 
An Introduction to Prometheus (GrafanaCon 2016)
An Introduction to Prometheus (GrafanaCon 2016)An Introduction to Prometheus (GrafanaCon 2016)
An Introduction to Prometheus (GrafanaCon 2016)
 
Anatomy of an action
Anatomy of an actionAnatomy of an action
Anatomy of an action
 
Network Test Automation - Net Ops Coding 2015
Network Test Automation - Net Ops Coding 2015Network Test Automation - Net Ops Coding 2015
Network Test Automation - Net Ops Coding 2015
 
Linux BPF Superpowers
Linux BPF SuperpowersLinux BPF Superpowers
Linux BPF Superpowers
 
PyCon AU 2015 - Using benchmarks to understand how wsgi servers work
PyCon AU 2015  - Using benchmarks to understand how wsgi servers workPyCon AU 2015  - Using benchmarks to understand how wsgi servers work
PyCon AU 2015 - Using benchmarks to understand how wsgi servers work
 
Linux Performance Analysis: New Tools and Old Secrets
Linux Performance Analysis: New Tools and Old SecretsLinux Performance Analysis: New Tools and Old Secrets
Linux Performance Analysis: New Tools and Old Secrets
 
LISA2010 visualizations
LISA2010 visualizationsLISA2010 visualizations
LISA2010 visualizations
 
Broken Linux Performance Tools 2016
Broken Linux Performance Tools 2016Broken Linux Performance Tools 2016
Broken Linux Performance Tools 2016
 
Netflix: From Clouds to Roots
Netflix: From Clouds to RootsNetflix: From Clouds to Roots
Netflix: From Clouds to Roots
 
[231] the simplicity of cluster apps with circuit
[231] the simplicity of cluster apps with circuit[231] the simplicity of cluster apps with circuit
[231] the simplicity of cluster apps with circuit
 
Continuous Delivery With Containers
Continuous Delivery With ContainersContinuous Delivery With Containers
Continuous Delivery With Containers
 
Linux Systems Performance 2016
Linux Systems Performance 2016Linux Systems Performance 2016
Linux Systems Performance 2016
 

Viewers also liked

Viewers also liked (15)

Data Logging and Telemetry
Data Logging and TelemetryData Logging and Telemetry
Data Logging and Telemetry
 
Cashing in on logging and exception data
Cashing in on logging and exception dataCashing in on logging and exception data
Cashing in on logging and exception data
 
FastNetMonを試してみた
FastNetMonを試してみたFastNetMonを試してみた
FastNetMonを試してみた
 
DataEngConf SF16 - Collecting and Moving Data at Scale
DataEngConf SF16 - Collecting and Moving Data at Scale DataEngConf SF16 - Collecting and Moving Data at Scale
DataEngConf SF16 - Collecting and Moving Data at Scale
 
Ultra fast DDoS Detection with FastNetMon at Coloclue (AS 8283)
Ultra	fast	DDoS Detection	with	FastNetMon at	 Coloclue	(AS	8283)Ultra	fast	DDoS Detection	with	FastNetMon at	 Coloclue	(AS	8283)
Ultra fast DDoS Detection with FastNetMon at Coloclue (AS 8283)
 
FastNetMon - ENOG9 speech about DDoS mitigation
FastNetMon - ENOG9 speech about DDoS mitigationFastNetMon - ENOG9 speech about DDoS mitigation
FastNetMon - ENOG9 speech about DDoS mitigation
 
How to Make Norikra Perfect
How to Make Norikra PerfectHow to Make Norikra Perfect
How to Make Norikra Perfect
 
Fluentd Overview, Now and Then
Fluentd Overview, Now and ThenFluentd Overview, Now and Then
Fluentd Overview, Now and Then
 
DDoS detection at small ISP by Wardner Maia
DDoS detection at small ISP by Wardner MaiaDDoS detection at small ISP by Wardner Maia
DDoS detection at small ISP by Wardner Maia
 
WebRTCで動かす“テレイグジスタンス”ロボット
WebRTCで動かす“テレイグジスタンス”ロボットWebRTCで動かす“テレイグジスタンス”ロボット
WebRTCで動かす“テレイグジスタンス”ロボット
 
fluent-plugin-norikra #fluentdcasual
fluent-plugin-norikra #fluentdcasualfluent-plugin-norikra #fluentdcasual
fluent-plugin-norikra #fluentdcasual
 
Ripe71 FastNetMon open source DoS / DDoS mitigation
Ripe71 FastNetMon open source DoS / DDoS mitigationRipe71 FastNetMon open source DoS / DDoS mitigation
Ripe71 FastNetMon open source DoS / DDoS mitigation
 
IT Solution Architect & Architecture for Thailand 4.0
IT Solution Architect & Architecture for Thailand 4.0IT Solution Architect & Architecture for Thailand 4.0
IT Solution Architect & Architecture for Thailand 4.0
 
The Science of Fun - Data-driven Game Development
The Science of Fun - Data-driven Game DevelopmentThe Science of Fun - Data-driven Game Development
The Science of Fun - Data-driven Game Development
 
How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your Niche
 

Similar to GoSF Jan 2016 - Go Write a Plugin for Snap!

the NML project
the NML projectthe NML project
the NML project
Lei Yang
 
Varnish http accelerator
Varnish http acceleratorVarnish http accelerator
Varnish http accelerator
no no
 
Android Boot Time Optimization
Android Boot Time OptimizationAndroid Boot Time Optimization
Android Boot Time Optimization
Kan-Ru Chen
 

Similar to GoSF Jan 2016 - Go Write a Plugin for Snap! (20)

Malware analysis
Malware analysisMalware analysis
Malware analysis
 
D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)
D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)
D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)
 
the NML project
the NML projectthe NML project
the NML project
 
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
 
LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1
 
Embedded. What Why How
Embedded. What Why HowEmbedded. What Why How
Embedded. What Why How
 
Five cool ways the JVM can run Apache Spark faster
Five cool ways the JVM can run Apache Spark fasterFive cool ways the JVM can run Apache Spark faster
Five cool ways the JVM can run Apache Spark faster
 
App container rkt
App container rktApp container rkt
App container rkt
 
Varnish http accelerator
Varnish http acceleratorVarnish http accelerator
Varnish http accelerator
 
Tuning systemd for embedded
Tuning systemd for embeddedTuning systemd for embedded
Tuning systemd for embedded
 
maXbox Starter87
maXbox Starter87maXbox Starter87
maXbox Starter87
 
Linux Server Deep Dives (DrupalCon Amsterdam)
Linux Server Deep Dives (DrupalCon Amsterdam)Linux Server Deep Dives (DrupalCon Amsterdam)
Linux Server Deep Dives (DrupalCon Amsterdam)
 
Shmoocon 2013 - OpenStack Security Brief
Shmoocon 2013 - OpenStack Security BriefShmoocon 2013 - OpenStack Security Brief
Shmoocon 2013 - OpenStack Security Brief
 
Multicore
MulticoreMulticore
Multicore
 
Hacktivity2014: Virtual Machine Introspection to Detect and Protect
Hacktivity2014: Virtual Machine Introspection to Detect and ProtectHacktivity2014: Virtual Machine Introspection to Detect and Protect
Hacktivity2014: Virtual Machine Introspection to Detect and Protect
 
No[1][1]
No[1][1]No[1][1]
No[1][1]
 
Android Boot Time Optimization
Android Boot Time OptimizationAndroid Boot Time Optimization
Android Boot Time Optimization
 
OpenSCAP Overview(security scanning for docker image and container)
OpenSCAP Overview(security scanning for docker image and container)OpenSCAP Overview(security scanning for docker image and container)
OpenSCAP Overview(security scanning for docker image and container)
 
Kubernetes laravel and kubernetes
Kubernetes   laravel and kubernetesKubernetes   laravel and kubernetes
Kubernetes laravel and kubernetes
 
Os Selbak
Os SelbakOs Selbak
Os Selbak
 

More from Matthew Broberg

More from Matthew Broberg (9)

Where Do We Go From Here?
Where Do We Go From Here?Where Do We Go From Here?
Where Do We Go From Here?
 
A Geek Whisperer's Guide to Career Options
A Geek Whisperer's Guide to Career OptionsA Geek Whisperer's Guide to Career Options
A Geek Whisperer's Guide to Career Options
 
Commitmas 2016
Commitmas 2016Commitmas 2016
Commitmas 2016
 
Commitmas 2015
Commitmas 2015Commitmas 2015
Commitmas 2015
 
Be The API - VMware UserCon 2016
Be The API - VMware UserCon 2016Be The API - VMware UserCon 2016
Be The API - VMware UserCon 2016
 
Social Media Communities Explained - They're Like Puppies
Social Media Communities Explained - They're Like PuppiesSocial Media Communities Explained - They're Like Puppies
Social Media Communities Explained - They're Like Puppies
 
Social Benchmarking Training
Social Benchmarking TrainingSocial Benchmarking Training
Social Benchmarking Training
 
How to Pitch an Idea - Lessons from EMC TV & Toastmasters
How to Pitch an Idea - Lessons from EMC TV & ToastmastersHow to Pitch an Idea - Lessons from EMC TV & Toastmasters
How to Pitch an Idea - Lessons from EMC TV & Toastmasters
 
Social influence
Social influenceSocial influence
Social influence
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Recently uploaded (20)

Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 

GoSF Jan 2016 - Go Write a Plugin for Snap!

  • 1. Go write a plugin! THE STORY OF AN OPEN TELEMETRY FRAMEWORK CALLED
  • 2. What snap is snap is an open framework for metrics snap is NOT an analytics alternative We have a list of maintained plugins. Curious what it requires to write one? See our Plugin Authoring documentation. /intel/server/cpu/load /intel/server/cpu/ipc /intel/server/cpu/l2cache /intel/server/mem/free /intel/server/mem/used /intel/server/nic/eth0/bytes_rec PSUtil, Facter, CollectD, Ohai Node, DCM, NIC, Disk Encryption, OSLO, Machine Learning, Filtering RabbitMQ, HANA, Ceilometer, InfluxDB Mosquito, File, postgresSQL, mySQL
  • 3. Demo. The simple one. Environment: 1 instance of snapd running locally Load collectors, view metrics via snapctl Pre-work: gvm use go1.5.3 go get github.com/intelsdi-x/snap make
  • 4. Why this is cool Write this plugin (or others!) Cloud Software Server Silicon Storage Silicon Network Silicon Orchestration Software Developer Environment Virtualization Software Operating System, Libraries Cloud Software Stack Applications & Services Telemetry and Datacenter Analytics Collector Processor Publisher Bayesia n Filter Cassandr a Publisher TASK Grafana CP U NIC ME M
  • 5. Key Features Collect Publish Publish Collect Process Publish Process Publish • Plugin load • No restart • Extends the metric catalog • Plugin unload • Removes metrics from catalog • Plugin swap • Newer version swapped in a single transaction LIFECYCLE MANAGEMENT FLEXIBLE DEPLOYMENT AUTOMATION ProcessCollect Publish TRIBE
  • 6. Demo. Administration and automate scale. Environment: 4 instance of snapd running locally Initiate in tribe mode Load a collector, process & publisher Load a task via snapctl Watch that task via snapctl Pre-work: gvm use go1.5.3 go get github.com/intelsdi-x/snap make
  • 7. Why Go? <3 this community slide. Great toolset • Logrus • Gomit* • Memberlist Strong opinions • fmt • test Datacenter Momentum
  • 8. Thank You Launch was successful because of this amazing community. 500 Trending!
  • 9. Get involved • Download, install and run snap right now • Read the extensive documentation on GitHub • Report your experiences (features and bugs) through GitHub • Talk to the developers of snap on Gitter • See the public roadmap on GitHub • Reach out to me or any of the maintainers => • on Twitter|GitHub|Gitter Thanks! @mjbrender

Editor's Notes

  1. A powerful telemetry agent framework designed to Improve deployment model and flexibility of the telemetry tools ecosystem Provide dynamic control of collection for small or large clusters of systems Allow flexible processing of telemetry data on agent (e.g. machine learning) Simplify disseminating data to telemetry ingesting systems Provide operational innovation for collecting across cluster of machines Support emerging API consumption models
  2. Tribe. Decoupled workflow. Lifecycle management. Normalized metrics Decoupled workflow Nonblocking updates
  3. Gomit = Gomit provides facilities for defining, emitting, and handling events within a go program. - https://github.com/intelsdi-x/gomit