- Aidan Venn developed a system using Zabbix, Raspberry Pis, sensors, and actuators to remotely monitor and control 7 research and development sites to save energy, time, and money.
- Key objectives were to make the system scalable, have central control, be plug-and-play, have minimal overhead, be cost-effective, resilient, and prove the concept.
- Initial results showed 99% time savings from remote rebooting of frozen devices and energy savings from adjusting boiler temperatures based on sensor data.
- Challenges included passing macros to scripts for reusable commands and using macros in item keys for sensors.
Marek Isalski, Faelix.net Ltd, describes the MikroTik range of routers and their applications, gives a pros and cons summary, and recommendations for budget provider edge deployment.
With so many new line of products and features from MikroTik, choosing one might be bit confusing. This topic will cover how to choose the right devices for your network!
Multicast routing configuration and lab example in MikroTik
video multicast routing 1 router
https://www.youtube.com/watch?v=nqUlUIB93Mg
video multicast routing 2 router over wireless
https://www.youtube.com/watch?v=eYEocGYsGZ4
Konfig VLC sebagai stream server multicast
https://www.youtube.com/watch?v=Z1lthcBSSrM
Konfig VLC sebagai player
https://www.youtube.com/watch?v=s2uTs8NRQpY
How to manage internet clients of an ISP with PPPoE and MikroTik. For
centralized AAA (Authentication, Authorization and Accounting), freeRadius is used.
Marek Isalski, Faelix.net Ltd, describes the MikroTik range of routers and their applications, gives a pros and cons summary, and recommendations for budget provider edge deployment.
With so many new line of products and features from MikroTik, choosing one might be bit confusing. This topic will cover how to choose the right devices for your network!
Multicast routing configuration and lab example in MikroTik
video multicast routing 1 router
https://www.youtube.com/watch?v=nqUlUIB93Mg
video multicast routing 2 router over wireless
https://www.youtube.com/watch?v=eYEocGYsGZ4
Konfig VLC sebagai stream server multicast
https://www.youtube.com/watch?v=Z1lthcBSSrM
Konfig VLC sebagai player
https://www.youtube.com/watch?v=s2uTs8NRQpY
How to manage internet clients of an ISP with PPPoE and MikroTik. For
centralized AAA (Authentication, Authorization and Accounting), freeRadius is used.
Những bài thuốc chữa viêm xoang mũi bằng tỏi chuabenhdongduoc.comNguyen Duong
Những bài thuốc chữa viêm xoang mũi bằng tỏi cực đơn giản. Chi tiết tại: http://www.chuabenhdongduoc.com/2017/03/cac-meo-chua-viem-xoang-mui-bang-toi-ai.html
Zabbix Smart problem detection - FISL 2015 workshopZabbix
Data collection
How often execute checks?
How to detect problems in this data flow?
Triggers
How to get rid of false positives?"
Examples
How to react on problems?
Using Databases and Containers From Development to DeploymentAerospike, Inc.
We cover the following topics:
Using Docker to Orchestrate a multi container application (Flask + Aerospike)
Injecting HAProxy and other production requirements as we deploy to production
Scaling the Web and Aerospike clusters to grow to meet demand
Performance & Scalability Improvements in PerforcePerforce
Recent releases of Perforce include improvements targeting performance and scalability. The edge/commit server architecture and lockless reads are two such improvements. This presentation will detail the effect of these improvements as measured in concurrency simulations and production deployments. Some of the server internals implemented to achieve these gains in performance and scalability will also be discussed.
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...Andrejs Prokopjevs
This presentation covers the idea of logical hostname feature and its possible use case with E-Business Suite, why it is a must-have configuration for DR, how it can improve your test/dev instance cloning and lifecycle processes, especially in a cloud deployment, support overview by 11i/R12.0/R12.1, and why it is a very hot topic right now for R12.2. Additionally, we will describe possible advanced configuration scenarios like container based virtualization. The content is based on real client environment implementation experience.
OpenNebulaConf 2016 - Measuring and tuning VM performance by Boyan Krosnov, S...OpenNebula Project
In this session we'll explore measuring VM performance and evaluating changes to settings or infrastructure which can affect performance positively. We'll also share the best current practice for architecture for high performance clouds from our experience.
Picnic Software - Developing a flexible and scalable applicationNick Josevski
The team at Picnic Software giving a detailed walkthrough of their application architecture and development processes for a large Angular and .NET Event Sourcing application.
Using a revision control system that tracks changes in source code with ways to manage your code in separate branches and tag revisions as releases is a bare minimum for developers.
This presentation highlights the importance of using a version control system Subversion.
IBM Bluemix OpenWhisk: Serverless Conference 2016, London, UK: The Future of ...OpenWhisk
Learn more about the IBM Bluemix OpenWhisk, a serverless event-driven compute platform, which quickly executes application logic in response to events or direct invocations from web/mobile apps or other endpoints.
2. Bio
• Name: Aidan Venn
• Zabbix irc & Forum: avenn
• Experience: 17 years in IT - networking
• Company: ObservIT Ltd
3. Unique? site facts
• 7 R & D sites x Various sensors &
actuators
• Unique In house designed Chinese
Components
• Concept works
• Soon to come out of Beta stage v23.4
4. Background – Energy Costs
“The cost total has more than doubled over the
last 10 years. Energy price rises have been
proportionately higher for industry and have direct
impacts on costs and competitiveness…”
“There is little prospect of a sustained reversal in
these trends. It is more likely that price
increases will continue into the medium term at
least.”
Key Issues for the New Parliament 2010, Paul Bolton
5. Background – Reduce Travel
• In parallel with this was the desire to
reduce/eliminate the need to reboot
remote/local devices that had “frozen”
with out travelling “for hours” to site.
• In particular “frozen” remote routers with
the obvious question - How do we reboot
if the internet connection is gone?
7. General Objectives
• Scalable - Zabbix
– 1000s of sensors and sites
• Central control as much as possible
• As Plug ‘n’ Play as possible – less site time
• Minimal Overhead
– Network
– Processing – contradictory in certain contexts
• Cost Effective – Zabbix
• Resilient – Zabbix proxy
• Proof Of Concept – saves time & money
8. Initial Results
• Devices & Zabbix gave time savings for
remote unmanned sites as in reboot
frozen device of 99%
• Temperature monitoring allowed boilers at
various sites to be adjusted – come on
later turn off earlier – saving energy
consumption and money
9. Research
• A few off the shelf products
• Developing own to reduce long term
costs, gain Unique Selling Point and tailor
to our and customer needs. Points to
Note:
– Initial significant higher costs
– Challenging – time consuming
– Rewarding knowledge
– Correct decision in the medium to long term
10. Brainstorm
• Brainstorming led to the following devices:
• Server – Store, View and Process data
• Remote Hub – Collate data, send to sever
• Sensors – Acquire environmental data
• Actuators – Remotely switch devices
on/off
11. Why
• Proven Track record
• Continual development
• Scalable, Flexible, Reliable
• Professional & community support
• Our previous experience
ZABBIX ?
12. Pi-Fi Hub
• Raspberry Pi model B v2
• Zabbix 2.x Proxy & Agent
• 12v or Solar Power
• Encrypted Serial RF up to
2km*
Pi-Fi
Hub
www.mvdigital.co.uk
13. Sensor - PiFiMon
• 3.3v, solar or 2 year lithium
bat*
• Encrypted Serial RF up to
2km*
• temperature, humidity, light
• tilt, vibration, contact
• analog and digital reading etc.
Sleep/Active/Sleep profile
PiMon
www.mvdigital.co.uk
14. Actuator - PiFiKontrol
• 5v or Solar
• Switch 12v power
• Encrypted Serial RF up to
2km*
• Awake/Passive profile
www.mvdigital.co.uk
Pi-FiKon
17. Monitoring
• During the journey it became apparent
that Zabbix monitoring would be in three
areas:
– Research and design
– Infrastructure
– Sensors & Actuators
• 30 mins to briefly discuss each one
• One challenge from each and how we are
currently tackling/overcoming them.
20. R & D Example
• To aid R & D we needed to record various
operational events including:
• Receiving values from sensors (PiMon)
• Sending commands to actuators (PiKontrol)
• Simple reliability test example:
– Send switch OFF command
– TEST : Successful Coms or/and command
execution
21. R & D - Actuator
1. Switch OFF command sent
Zabbix sender – command sent – count key = sendOFF
2. ACK as Expected - yes or no?
Zabbix sender – expACK = yes – count key= expACKyes
Zabbix sender – expACK = no – count key = expACKno
Aim for and expect sendOFF count = expACKyes count
= COMMS AND STATUS APPEARS OK
22. R & D - Actuator
Traceback (most recent call last):
File "writeSERIALnewD.py", line 120, in <module>
Ser.write(ans[0:9] + "O")
NameError: name 'Ser' is not defined
24. Infrastructure Example - OpenVPN
ZABBIX
Agent
ZABBIX
Server
Dedicated Server running OpenVZ
Containers
OpenVPN
Use ObservIT OpenVPN setup for example of how
we monitor parts of the virtual infrastructure.
3G / ADSL Links
ZABBIX
Agent
Remote Site
25. OpenVPN
• Separate Templates for Client, Server &
Overall
• Parse Log Files for keywords –”reset” etc
• Scripts – ps aux – extract – RSS & VSZ
• Zabbix Sender
• Telnet! – OpenVPN Management Interface
– Use Comman Names (CN) and commands
such as “status”
26. OpenVPN – Challenge 1
Many
Physical
Hosts
OpenVPN
Server
One
Zabbix
Agent
ZABBIX
Agent
ZABBIX
Server
Many Physical Hosts to One Agent to Many Hosts to Many Templates
Host 1
Host 2
Host 3
One
Zabbix
Server
Client
Template
VPN
Server
Server
Template
OpenVPN
Template
OpenVZ Containers
27. OpenVPN – Challenge 1
Server Template ClientTemplate
Double the number of items for needed values
https://www.zabbix.com/forum/showthread.php?t=42265
28. OpenVPN – Challenge 1
Pass a list of clients (denoted as numbers) that we want values
for rather than one pass per client.
Back to a one to many situation
A More suitable Solution:
31. Actuator - Serial RF Command
aAVxxxxxxON
Unique PiKon
Device ID
Actuator/Switch Command
ON or OFF
32. Actuators - PiKon
• Agent on PiFiHub – Remote Command
Script – allowing the sending of serial RF
actuator/switch command to PiKon -
on/off of CONNECTED host
– Can be automated if no response in 5mins etc
the send SMS etc to reboot.
33. Challenge 2
• Each site may use many and different PiKon
device ids in commands.
• To reduce duplication we wanted to reuse
actuator switch script by passing appropriate
device id host level macro.
• Client 1 Example:
– {$DEVID} = AA
– /externalscripts/writeSERIAL.py {DEVID} ON
34. Challenge 2
The link for macro is the hostname
/externalscripts/writeSERIAL.py {DEVID} ON
Pi-Fikon: AA
35. Challenge 2
• At present it appears that the passing of host
level macros to the script is not possible.
• HOWEVER… all is not lost… Look what
Zabbix 2.2 will do:
“Starting with Zabbix 2.2, user macros are
supported in script commands.”
• https://www.zabbix.com/documentation/2.2/manual/web_inte
rface/frontend_sections/administration/scripts
36. Challenge 2
• At present we store (in a text file) the
unique site commands at the PiFiHub
(Zabbix Agent) and have “standard” script
commands with parameters Example:
Script/Remote Command Line Number Line Content
externalscripts/writeSERIAL.py 1 ON 1 AA
externalscripts/writeSERIAL.py 1 OFF 1 AA
externalscripts/writeSERIAL.py 3 ON 3 AB
externalscripts/writeSERIAL.py 4 OFF 4 Etc….
• Issue: All scripts available for all host
group – Which One to pick etc.
37. Sensor - Serial RF Value
aAVTMPA23.50
Unique
Device ID
Zabbix Key Value
Type Sensor
Number
39. Sensors - PiMon
• PiMon wakes up at programmed intervals
and sends back values to PiFiHub
• Script on PiFiHub reads every second
Serial Coms and parses for keys & values
• Zabbix Sender sends keys and values back
to the server.
40. Challenge 3
• Wanted to use host macros for:
– Device ID
– Type
– Sensor
• Then apply to PiMon/sensor template as keys for
zabbix trapper items.
• However:
“user macros (variables) are supported in item key
parameters, not as replacement for item keys themselves”
https://www.zabbix.com/forum/showthread.php?t=42239&highlight=macros+keys
41. Challenge 3
• In this instance we didn`t look for a
workaround as time was pressing so we
added each item individually.