Overview and Opentracing in theory by Gianluca ArbezzanoGianluca Arbezzano
That is this group? How does it work? What is the CNCF? After this short introduction I am going to show you what is Opentracing what it means and why the adoption is growing so much in a short amount of time. Use cases, possible implementations and so on.
I would like to speak about what I am actually doing at InfluxData. Sharing with you some ideas about how an orchestrator should work. We will start from a bit of history about distributed system, containers, runtime and so on. Hoping to have a good chat about the future of scheduling and orchestrator.
Pull vs Push is the hot topic when you starts to evaluate a monitoring system. During this talk I showed how Prometheus and InfluxDB work and how you can get service discovery and pull mechanism with InfluxDB. The demo is linked as github repository.
Open Tracing, to order and understand your mess. - ApiConf 2017Gianluca Arbezzano
This about how many api calls your applications were doing 3-4 years ago, and think about how many integration and difference services your requests is crossing before to come back to the final destination. How do you know this step of your pipeline is taking too much time? What is taking 2 seconds to answer? Is it the authentication service? Maybe it's the invoice generation service or the notification platform. Open Tracing is a distributed tracing cross vendor and open source that help you to understand bottleneck and to profile the requests from where they arrive at the final user. In an ecosystem where microservices and as a service concept are growing this can be a real challenge. During this presentation, we will see how it works from a general point of view to land in some real implementation, examples, and demo.
Our application speaks, time series are one of their languages. During this talk I will share how to use the open source Tick Stack to spin up a modern monitoring system for your application and your infrastructure. DevOps, cloud computing and containers changed how we are writing and running our applications. This talk shows what InfluxData and the community is building to have a modern and flexible monitoring toolkit.
Overview and Opentracing in theory by Gianluca ArbezzanoGianluca Arbezzano
That is this group? How does it work? What is the CNCF? After this short introduction I am going to show you what is Opentracing what it means and why the adoption is growing so much in a short amount of time. Use cases, possible implementations and so on.
I would like to speak about what I am actually doing at InfluxData. Sharing with you some ideas about how an orchestrator should work. We will start from a bit of history about distributed system, containers, runtime and so on. Hoping to have a good chat about the future of scheduling and orchestrator.
Pull vs Push is the hot topic when you starts to evaluate a monitoring system. During this talk I showed how Prometheus and InfluxDB work and how you can get service discovery and pull mechanism with InfluxDB. The demo is linked as github repository.
Open Tracing, to order and understand your mess. - ApiConf 2017Gianluca Arbezzano
This about how many api calls your applications were doing 3-4 years ago, and think about how many integration and difference services your requests is crossing before to come back to the final destination. How do you know this step of your pipeline is taking too much time? What is taking 2 seconds to answer? Is it the authentication service? Maybe it's the invoice generation service or the notification platform. Open Tracing is a distributed tracing cross vendor and open source that help you to understand bottleneck and to profile the requests from where they arrive at the final user. In an ecosystem where microservices and as a service concept are growing this can be a real challenge. During this presentation, we will see how it works from a general point of view to land in some real implementation, examples, and demo.
Our application speaks, time series are one of their languages. During this talk I will share how to use the open source Tick Stack to spin up a modern monitoring system for your application and your infrastructure. DevOps, cloud computing and containers changed how we are writing and running our applications. This talk shows what InfluxData and the community is building to have a modern and flexible monitoring toolkit.
OpenNebula Conf 2014 | Deploying OpenNebula in a Snap using Configuration Man...NETWAYS
Configuration management and Cloud management tools are on the rage right now. Having both of them makes the life of us sysadmins a breeze which ultimately means we can spend more time doing something else rather than just tinkering around to fix a problem or deploying something new.
Welcome talk unleashing the future of open-source enterprise cloud computingNETWAYS
The OpenNebula Project has come a long way since the first “technology preview” of OpenNebula almost six years ago. During these years we’ve witnessed the rise and hype of the Cloud, the birth and decline of several virtualization technologies, but specially the encouraging and exciting growth of OpenNebula; both as a technology and as an active and engaged community. As a meeting point for OpenNebula users, developers, administrators, builders, integrators and researchers, this Conference represents an opportunity to look back at how the project has grown in the last six years, and to give a peek at what to expect from the project in the near future.
Do You Need a Service Mesh? @ London Devops, January 2019Matt Turner
Service meshes are cool, but are they useful? We'll explore what a service mesh is and what they can do for your microservices. Are the claims of observability, resiliency, and WAF features real? Are they useful during development, production, or both? Using pictures and demos, we'll find out!
In DevOps world, the responsibility of monitoring is not only for the infrastructure team but also for developers as well. In this session, developers will know how to help and make monitor better with their coding to define monitoring.
Coding Defines Monitoring for Code Mania 100 : Coding Defines Anything at Faculty of Engineering, Chulalongkorn University on November 6, 2016
Technical challenges (running on different providers (we need an overlay!!)) as well as social challenges (why are we famous in Peru?) during COVID-19 when running an opensource conference system.
The systems is based on Jitsi and run bei Freifunk Munich in Germany.
Most people will claim that this never happens, others hope it never happens, but it happened on March 10, 2021, and it was not just the 1 datacenter that got impacted, but the whole campus of the provider that got powered down. This talk will explain how our customers survived this outage, how our culture, opensource tooling and automation saved the da(y,ta). A talk about disaster recovery, business continuity plans and building cloud agnostic stacks that survive disasters.
OpenStack is a open source software for creating private and public clouds that coordinated collection of software from a few dozen related projects. This presentation give you an introduction about OpenStack community and basic how to contribute to OpenStack project
OpenStack Thailand Chapter - User and Contributor MeetUp #1 at EGA on November 30, 2016
This discussion focuses on the observability of WSO2 products, the tools for observability, and how WSO2 will make its next generation products observable by default using well-known standards like OpenTracing specification.
Patterns for Asynchronous Microservices with NATSApcera
Presentation from a talk by Raul Perez (@repejota) of R3Labs on asynchronous microservices patterns using NATS (@nats_io), the lightweight, high performance open source messaging system written in Go.
You can learn more about NATS at http://www.nats.io
OpenNebula Conf 2014 | Deploying OpenNebula in a Snap using Configuration Man...NETWAYS
Configuration management and Cloud management tools are on the rage right now. Having both of them makes the life of us sysadmins a breeze which ultimately means we can spend more time doing something else rather than just tinkering around to fix a problem or deploying something new.
Welcome talk unleashing the future of open-source enterprise cloud computingNETWAYS
The OpenNebula Project has come a long way since the first “technology preview” of OpenNebula almost six years ago. During these years we’ve witnessed the rise and hype of the Cloud, the birth and decline of several virtualization technologies, but specially the encouraging and exciting growth of OpenNebula; both as a technology and as an active and engaged community. As a meeting point for OpenNebula users, developers, administrators, builders, integrators and researchers, this Conference represents an opportunity to look back at how the project has grown in the last six years, and to give a peek at what to expect from the project in the near future.
Do You Need a Service Mesh? @ London Devops, January 2019Matt Turner
Service meshes are cool, but are they useful? We'll explore what a service mesh is and what they can do for your microservices. Are the claims of observability, resiliency, and WAF features real? Are they useful during development, production, or both? Using pictures and demos, we'll find out!
In DevOps world, the responsibility of monitoring is not only for the infrastructure team but also for developers as well. In this session, developers will know how to help and make monitor better with their coding to define monitoring.
Coding Defines Monitoring for Code Mania 100 : Coding Defines Anything at Faculty of Engineering, Chulalongkorn University on November 6, 2016
Technical challenges (running on different providers (we need an overlay!!)) as well as social challenges (why are we famous in Peru?) during COVID-19 when running an opensource conference system.
The systems is based on Jitsi and run bei Freifunk Munich in Germany.
Most people will claim that this never happens, others hope it never happens, but it happened on March 10, 2021, and it was not just the 1 datacenter that got impacted, but the whole campus of the provider that got powered down. This talk will explain how our customers survived this outage, how our culture, opensource tooling and automation saved the da(y,ta). A talk about disaster recovery, business continuity plans and building cloud agnostic stacks that survive disasters.
OpenStack is a open source software for creating private and public clouds that coordinated collection of software from a few dozen related projects. This presentation give you an introduction about OpenStack community and basic how to contribute to OpenStack project
OpenStack Thailand Chapter - User and Contributor MeetUp #1 at EGA on November 30, 2016
This discussion focuses on the observability of WSO2 products, the tools for observability, and how WSO2 will make its next generation products observable by default using well-known standards like OpenTracing specification.
Patterns for Asynchronous Microservices with NATSApcera
Presentation from a talk by Raul Perez (@repejota) of R3Labs on asynchronous microservices patterns using NATS (@nats_io), the lightweight, high performance open source messaging system written in Go.
You can learn more about NATS at http://www.nats.io
Carlos Ralli presentation at the London Campus Party Europe 2013.
One of the items presented is the Internet6 Hub collaboration site (http://www.internet6hub.com)
SwellRT is a free and open-source backend-as-a-service and API focused to ease development of apps featuring real-time collaboration. It supports the building of mobile and web apps, and aims to facilitate interoperability and federation.
Presented at the European Commission, DG-DIGIT, February 2017 in Brussels.
(This presentation is a composition of text and images; Text is released under open license CC BY 4.0 Int; Images are copyrighted and used under Fair Use).
Semantic Web Methodologies, Best Practices and Ontology Engineering Applied t...Ghislain ATEMEZING
This talk presents some best practices and ontology engineering applied to internet of things. The talk was presented during the 2nd IEEE World Forum on Internet of Things held in Milan, from December 14th to December 16th, 2015.
OpenNebulaConf2017EU: Welcome Talk State and Future of OpenNebula by Ignacio ...OpenNebula Project
We’re moving into a world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform can not be all things to all people, there will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud flows directly out of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to remind our vision, vision and commitment, to look back at how the project has grown in the last 8 years, and to give a peek at what to expect from the project in the near future.
YouTube: https://youtu.be/evzy5bLwDSM
From leading IoT Protocols to Python Dashboarding_finalLukas Ott
First i like to give an overview on common IoT Protocols:
#CoAP (Constrained Application Protocol -> Close to HTTP / REST ) #MQTT ( Message Queue Telemetry Transport -> Pub/Sub with Broker -> Well defined Quality of Service -> Newest addition Eclipse Amlem (formerly the core of IBM Watson IoT platform) -> Eclipse Sparkplug -> Standardization of the topics and payloads -> Interoperability!) , #DDS (Data Distribution Service -> Pub/Sub without Broker -> Drones / Robotics) #LwM2M (Lightweight M2M -> Runs on Top of CoAP or MQTT -> standard sets of payloads for sensors) #zenoh (https://zenoh.io/ Pub/Sub Protocol -> combines the advantages of #DDS and #MQTT) #eclipsefoundation #apache #opensource #lightweight (+ some comments that this is not complete and does not encompass Industrial and Building Automation)
Then I would like to show the leading edge IoT protocol Zenoh. Saving Zenoh Payload to Apache IoTDB. After that I would like to dive into Panel and the awesome capabilities of Apache ECharts.
Nats in action a real time microservices architecture handled by nats
NATS & IoT
1. What is NATS
And why it is good for IoT
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
2. Who am I?
Raül Pérez
Lead Software Engineer
at Carrenza Ltd.
Twitter: @repejota
Github: https://github.com/repejota
Email: repejota@gmail.com
2
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
3. Who am I?
Raül Pérez
Lead Software Engineer
at Carrenza Ltd.
Twitter: @repejota
Github: https://github.com/repejota
Email: repejota@gmail.com
3
● Almost 4 years working on devops & distributed projects.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
4. Who am I?
Raül Pérez
Lead Software Engineer
at Carrenza Ltd.
Twitter: @repejota
Github: https://github.com/repejota
Email: repejota@gmail.com
4
● Almost 4 years working on devops & distributed projects.
● Still more a dev than op dude.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
5. Who am I?
Raül Pérez
Lead Software Engineer
at Carrenza Ltd.
Twitter: @repejota
Github: https://github.com/repejota
Email: repejota@gmail.com
5
● Almost 4 years working on devops & distributed projects.
● Still more a dev than op dude.
● Proud to be a Gopher after a looong PHP/Ruby/Python/Node.js past
experience. :P
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
6. Who am I?
Raül Pérez
Lead Software Engineer
at Carrenza Ltd.
Twitter: @repejota
Github: https://github.com/repejota
Email: repejota@gmail.com
6
● Almost 4 years working on devops & distributed projects.
● Still more a dev than op dude.
● Proud to be a Gopher after a looong PHP/Ruby/Python/Node.js past
experience. :P
● Based in Barcelona.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
7. Who am I?
Raül Pérez
Lead Software Engineer
at Carrenza Ltd.
Twitter: @repejota
Github: https://github.com/repejota
Email: repejota@gmail.com
7
● Almost 4 years working on devops & distributed projects.
● Still more a dev than op dude.
● Proud to be a Gopher after a looong PHP/Ruby/Python/Node.js past
experience. :P
● Based in Barcelona.
● Love startups & love remote work!
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
9. What is NATS?
● Cloud-native message platform.
9
● Designed to natively support modern cloud architectures.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
10. What is NATS?
● Cloud-native message platform.
● Highly performant.
10
● Designed to natively support modern cloud architectures.
● It is fast! Can handle millions of messages per second.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
11. What is NATS?
● Cloud-native message platform.
● Highly performant.
● Extremely lightweight.
11
● Designed to natively support modern cloud architectures.
● It is fast! Can handle millions of messages per second.
● A single binary, easy to deploy without unnecessary complexity.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
12. What is NATS?
● Cloud-native message platform.
● Highly performant.
● Extremely lightweight.
● Support for various messaging models and use cases.
12
● Designed to natively support modern cloud architectures.
● It is fast! Can handle 10 million messages per second on a Macbook
● A single binary, easy to deploy without unnecessary complexity.
● Request/Response, Publish/Subscribe, Queues.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
13. What is NATS?
● Cloud-native message platform.
● Highly performant.
● Extremely lightweight.
● Support for various messaging models and use cases.
13
● Designed to natively support modern cloud architectures.
● It is fast! Can handle millions of messages per second.
● A single binary, easy to deploy without unnecessary complexity.
● Request/Response, Publish/Subscribe, Queues.
● Simple text based protocol.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
15. IoT
● Everything is connected.
15
● Virtual representations of objects (things) in a internet-like structure.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
16. IoT
● Everything is connected.
● Wireless connections between objects.
16
● Virtual representations of objects (things) in a internet-like structure.
● Flexible structure.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
17. IoT
● Everything is connected.
● Wireless connections between objects.
● Self configured and discoverable.
17
● Virtual representations of objects (things) in a internet-like structure.
● Flexible structure.
● Event Driven.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
18. IoT
● Everything is connected.
● Wireless connections between objects.
● Self configured and discoverable.
● Internet is no longer for people but also for machines.
18
● Virtual representations of objects (things) in a internet-like structure.
● Flexible structure.
● Event Driven.
● Multiple protocols.
● Multiple communication patterns.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
20. IoT + NATS
● Always on.
20
● Always available (dial tone), fire and forget.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
21. IoT + NATS
● Always on.
● Pure pub/sub.
21
● Always available (dial tone), fire and forget.
● Never assumes the audience.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
22. IoT + NATS
● Always on.
● Pure pub/sub.
● Clustered mode server.
22
● Always available (dial tone), fire and forget.
● Never assumes the audience.
● Distributed queueing across clusters, cluster aware clients.
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
23. IoT + NATS
● Always on.
● Pure pub/sub.
● Clustered mode server.
● Auto-pruning of subscribers.
23
● Always available (dial tone), fire and forget.
● Never assumes the audience.
● Distributed queueing across clusters, cluster aware clients.
● Slow clients are being cut off.
● Clients implement retry logic.
● Extremely low latency!
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
24. NATS Latency - basically zero!
An example vs RabbitMQ
Source: http://bravenewgeek.com/benchmarking-message-queue-latency/
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
25. NATS IoT Examples
● Talk on using Lua and NATS for IoT in the Home by Eric Pinto Garcia (https:
//github.com/DawnAngel )
○ Video: https://www.youtube.com/watch?v=SLQ9VXrByPc
○ Slides: https://github.com/DawnAngel/presentations/blob/master/Lua,%20NATS%20&%20IoT.
pdf
● Ripple - Water Conservation Device control using NATS, Artik10 boards,
Golang
○ http://devpost.com/software/ripples
● NATS Arduino Client by Josh Glendenning (https://github.
com/joshglendenning ):
○ https://github.com/joshglendenning/arduino-nats
● Example of NATS messaging with Raspberry Pi by John Lockwood:
○ https://dzone.com/articles/simple-composable-microservices-an-iot-example-usi
Raül Pérez - @repejota IoT Barcelona - 04/07/2016
