Overview of the Zabbix monitoring system database and how to use or customize it for reporting and integration.
Originally given at Zabbix Global Conference in Riga, Latvia in Sept, 2014
Google Cloud Platform monitoring with ZabbixMax Kuzkin
This presentation describes how to configure Zabbix (https://zabbix.com/) to configure Google Cloud Platform events through its Monitoring API, using gcpmetrics (https://github.com/odin-public/gcpmetrics/) command line tool.
OSMC 2014: Interesting use cases of Zabbix improvements in latest versions | ...NETWAYS
Zabbix is used all over the world - in standard IT infrastructure monitoring and also in some not so common environments.
In this talk we will look at some common uses of Zabbix, as well as at some slightly strange environments. A brief update on the latest improvements for Zabbix will be provided as well.
Rihards Olups - Zabbix 3.0: Excited for new features?Zabbix
Rihards Olups has worked in the IT sector for more than 15 years, and in 2009 he joined Zabbix. He has had a chance to work with various systems, and most of that time has been spent with open source solutions. Exposure to Zabbix, one of the leading open source enterprise class monitoring solutions, was with the first public releases back in 2001, which has allowed to gain practical knowledge on the subject.
Zabbix Conference 2015
Zabbix is enterprise open source monitoring software for networks and applications, created by Alexei Vladishev. It is designed to monitor and track the status of various network services, servers, and other network hardware. Zabbix uses MySQL, PostgreSQL, SQLite, Oracle or IBM DB2 to store data.
Google Cloud Platform monitoring with ZabbixMax Kuzkin
This presentation describes how to configure Zabbix (https://zabbix.com/) to configure Google Cloud Platform events through its Monitoring API, using gcpmetrics (https://github.com/odin-public/gcpmetrics/) command line tool.
OSMC 2014: Interesting use cases of Zabbix improvements in latest versions | ...NETWAYS
Zabbix is used all over the world - in standard IT infrastructure monitoring and also in some not so common environments.
In this talk we will look at some common uses of Zabbix, as well as at some slightly strange environments. A brief update on the latest improvements for Zabbix will be provided as well.
Rihards Olups - Zabbix 3.0: Excited for new features?Zabbix
Rihards Olups has worked in the IT sector for more than 15 years, and in 2009 he joined Zabbix. He has had a chance to work with various systems, and most of that time has been spent with open source solutions. Exposure to Zabbix, one of the leading open source enterprise class monitoring solutions, was with the first public releases back in 2001, which has allowed to gain practical knowledge on the subject.
Zabbix Conference 2015
Zabbix is enterprise open source monitoring software for networks and applications, created by Alexei Vladishev. It is designed to monitor and track the status of various network services, servers, and other network hardware. Zabbix uses MySQL, PostgreSQL, SQLite, Oracle or IBM DB2 to store data.
Lukas Macura - Employing Zabbix to monitor OpenWrt (Beesip) devices with UciprovZabbix
Beesip (Bright Efficient Embedded Solution for IP Telephony) is platform based on OpenWrt, primarily made for IP telephony purposes. The aim of the project is the development and implementation of embedded SIP communication server with an easy integration into the computer network based on open-source solutions. Beesip uses uciprov for remote management and provisioning. Next to this, it uses Zabbix for inventory and monitoring utilizing auto-discovery and auto-registration. Even if it is used primarily for IP telephony, it is common to use Beesip build system for other purposes like monitoring probes distribution or Eduroam AP management. Talk will be practically oriented showing possibilities of provisioning and auto inventory in OpenWrt world.
Zabbix Conference 2015
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016Zabbix
For the last two years I've been working in Cambridge (US) in Novartis Institute for Biomedical Research (NIBR) on a project related to a support of HPC cluster infrastructure and users. We're using Zabbix for HPC cluster monitoring (more than 1000 nodes, 10000+ cores, GPU cores, etc). In this presentation we will cover interesting use cases of Zabbix for HPC cluster, as it's not a regular infrastructure monitoring. We will talk about some challenges we have in HPC monitoring, how Zabbix helps us to work with scientists as well as present some solutions, which might be interesting for Zabbix community.
Volker Fröhlich - How to Debug Common Agent IssuesZabbix
Probably every Zabbix user has a story of a Zabbix agent suddenly failing to work. Computers and networks are complex and diverse, and so are the causes of these problems.
This talk introduces a structured approach to debugging configuration problems, connectivity problems and problems in the execution of the agent. It will spotlight common problems, but also some rather obscure ones I met in the wild.
Zabbix Conference 2015
Rihards Olups - Zabbix at Nokia - Case StudyZabbix
We will explore a fairly complicated Zabbix environment at one division in Nokia. Having several different Zabbix versions in use and a lot of custom products monitored, it is a place one can get lost in easily. We'll discuss JMX monitoring, approaches to keep notification configuration simple and notifications useful, different usecases for the Zabbix API and a lot of other topics. The importance of the SSL compliance will be covered along with some of the many ways custom solutions are monitored.
Aaron Mildenstein - Using Logstash with ZabbixZabbix
Logstash is a terrific tool for capturing, filtering, parsing and enriching data from a number of sources—including logs, of course. But Logstash is also able to capture from many other sources, including social media streams, databases, and many more. Data streams like these are a potential gold mine for Zabbix trending and alerting of all kinds.
In this talk Aaron Mildensten will provide an overview of how to configure and integrate Logstash with Zabbix to:
* capture data
* parse data events into key/value pairs
* associate an event with the time-stamp provided by the data
* generate metrics from the data
* output these values to Zabbix, with the associated time-stamp
Zabbix Conference 2015
Trouble Ticket Integration with Zabbix in Large EnvironmentAlain Ganuchaud
Large Environments rely on TroubleTicket tool and HelpDesk for managing IT issues. Bridging Zabbix with over 5000 servers and HelpDesk manually is a painful and impossible project. In this presentation we will cover how we may integrate Zabbix with HelpDesk, the architecture and what are the issues specially in Large Environments.
As an example, we will cover the case study of Zabbix - ServiceNow integration, as it was developped for SwissLife and released as OpenSource.
Monitoring a billion kilometers of monthly ride sharing at BlaBlaCar - Zabbix...Jean Baptiste Favre
How BlaBlaCar designed and operates a Zabbix based monitoring platform, optimizing Zabbix configuration, developping & using python-protobix & jmx-zabbix for more scalability
Nagios Conference 2014 - Jeff Mendoza - Monitoring Microsoft Azure with NagiosNagios
Jeff Mendoza's presentation on Monitoring Microsoft Azure with Nagios.
The presentation was given during the Nagios World Conference North America held Oct 13th - Oct 16th, 2014 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/conference
So we're running Apache ZooKeeper. Now What? By Camille Fournier Hakka Labs
The ZooKeeper framework was originally built at Yahoo! to make it easy for the company’s applications to access configuration information in a robust and easy-to-understand way, but it has since grown to offer a lot of features that help coordinate work across distributed clusters. Apache Zookeeper became a de-facto standard for coordination service and used by Storm, Hadoop, HBase, ElasticSearch and other distributed computing frameworks.
DSLing your System For Scalability Testing Using Gatling - Dublin Scala User ...Aman Kohli
The power of Gatling is the DSL it provides to allow writing meaningful and expressive tests. We provide an overview of the framework, a description of their development environment and goals, and present their test results.
Source code available https://github.com/lawlessc/random-response-time
Nagios Conference 2011 - Michael Medin - NSClient++: Whats NewNagios
Michael Medin's presentation on NSClient++. The presentation was given during the Nagios World Conference North America held Sept 27-29th, 2011 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Container monitoring for resource and application metrics with cAdvisor. Shipping monitoring information with the container so it is monitored irrespective of the host it runs on.
Intro to monitoring in distributed systems, cAdvisor, heapster, kubedash, kubernetes
Nagios Conference 2013 - Eric Stanley and Andy Brist - API and NagiosNagios
Eric Stanley and Andy Brist's presentation on API and Nagios.
The presentation was given during the Nagios World Conference North America held Sept 20-Oct 2nd, 2013 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Lukas Macura - Employing Zabbix to monitor OpenWrt (Beesip) devices with UciprovZabbix
Beesip (Bright Efficient Embedded Solution for IP Telephony) is platform based on OpenWrt, primarily made for IP telephony purposes. The aim of the project is the development and implementation of embedded SIP communication server with an easy integration into the computer network based on open-source solutions. Beesip uses uciprov for remote management and provisioning. Next to this, it uses Zabbix for inventory and monitoring utilizing auto-discovery and auto-registration. Even if it is used primarily for IP telephony, it is common to use Beesip build system for other purposes like monitoring probes distribution or Eduroam AP management. Talk will be practically oriented showing possibilities of provisioning and auto inventory in OpenWrt world.
Zabbix Conference 2015
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016Zabbix
For the last two years I've been working in Cambridge (US) in Novartis Institute for Biomedical Research (NIBR) on a project related to a support of HPC cluster infrastructure and users. We're using Zabbix for HPC cluster monitoring (more than 1000 nodes, 10000+ cores, GPU cores, etc). In this presentation we will cover interesting use cases of Zabbix for HPC cluster, as it's not a regular infrastructure monitoring. We will talk about some challenges we have in HPC monitoring, how Zabbix helps us to work with scientists as well as present some solutions, which might be interesting for Zabbix community.
Volker Fröhlich - How to Debug Common Agent IssuesZabbix
Probably every Zabbix user has a story of a Zabbix agent suddenly failing to work. Computers and networks are complex and diverse, and so are the causes of these problems.
This talk introduces a structured approach to debugging configuration problems, connectivity problems and problems in the execution of the agent. It will spotlight common problems, but also some rather obscure ones I met in the wild.
Zabbix Conference 2015
Rihards Olups - Zabbix at Nokia - Case StudyZabbix
We will explore a fairly complicated Zabbix environment at one division in Nokia. Having several different Zabbix versions in use and a lot of custom products monitored, it is a place one can get lost in easily. We'll discuss JMX monitoring, approaches to keep notification configuration simple and notifications useful, different usecases for the Zabbix API and a lot of other topics. The importance of the SSL compliance will be covered along with some of the many ways custom solutions are monitored.
Aaron Mildenstein - Using Logstash with ZabbixZabbix
Logstash is a terrific tool for capturing, filtering, parsing and enriching data from a number of sources—including logs, of course. But Logstash is also able to capture from many other sources, including social media streams, databases, and many more. Data streams like these are a potential gold mine for Zabbix trending and alerting of all kinds.
In this talk Aaron Mildensten will provide an overview of how to configure and integrate Logstash with Zabbix to:
* capture data
* parse data events into key/value pairs
* associate an event with the time-stamp provided by the data
* generate metrics from the data
* output these values to Zabbix, with the associated time-stamp
Zabbix Conference 2015
Trouble Ticket Integration with Zabbix in Large EnvironmentAlain Ganuchaud
Large Environments rely on TroubleTicket tool and HelpDesk for managing IT issues. Bridging Zabbix with over 5000 servers and HelpDesk manually is a painful and impossible project. In this presentation we will cover how we may integrate Zabbix with HelpDesk, the architecture and what are the issues specially in Large Environments.
As an example, we will cover the case study of Zabbix - ServiceNow integration, as it was developped for SwissLife and released as OpenSource.
Monitoring a billion kilometers of monthly ride sharing at BlaBlaCar - Zabbix...Jean Baptiste Favre
How BlaBlaCar designed and operates a Zabbix based monitoring platform, optimizing Zabbix configuration, developping & using python-protobix & jmx-zabbix for more scalability
Nagios Conference 2014 - Jeff Mendoza - Monitoring Microsoft Azure with NagiosNagios
Jeff Mendoza's presentation on Monitoring Microsoft Azure with Nagios.
The presentation was given during the Nagios World Conference North America held Oct 13th - Oct 16th, 2014 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/conference
So we're running Apache ZooKeeper. Now What? By Camille Fournier Hakka Labs
The ZooKeeper framework was originally built at Yahoo! to make it easy for the company’s applications to access configuration information in a robust and easy-to-understand way, but it has since grown to offer a lot of features that help coordinate work across distributed clusters. Apache Zookeeper became a de-facto standard for coordination service and used by Storm, Hadoop, HBase, ElasticSearch and other distributed computing frameworks.
DSLing your System For Scalability Testing Using Gatling - Dublin Scala User ...Aman Kohli
The power of Gatling is the DSL it provides to allow writing meaningful and expressive tests. We provide an overview of the framework, a description of their development environment and goals, and present their test results.
Source code available https://github.com/lawlessc/random-response-time
Nagios Conference 2011 - Michael Medin - NSClient++: Whats NewNagios
Michael Medin's presentation on NSClient++. The presentation was given during the Nagios World Conference North America held Sept 27-29th, 2011 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Container monitoring for resource and application metrics with cAdvisor. Shipping monitoring information with the container so it is monitored irrespective of the host it runs on.
Intro to monitoring in distributed systems, cAdvisor, heapster, kubedash, kubernetes
Nagios Conference 2013 - Eric Stanley and Andy Brist - API and NagiosNagios
Eric Stanley and Andy Brist's presentation on API and Nagios.
The presentation was given during the Nagios World Conference North America held Sept 20-Oct 2nd, 2013 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Introduction to Zabbix - Company, Product, Services and Use CasesZabbix
About Zabbix Software:
Zabbix is an enterprise-class open source distributed monitoring solution designed to monitor and track performance and availability of network servers, devices, services and other IT resources.
Zabbix is an all-in-one monitoring solution that allows users to collect, store, manage and analyze information received from IT infrastructure, as well as display on-screen, and alert by e-mail, SMS or Jabber when thresholds are reached.
Zabbix allows administrators to recognize server and device problems within a short period of time and therefore reduces the system downtime and risk of system failure. The monitoring solution is being actively used by SMBs and large enterprises across all industries and almost in every country of the world.
Zabbix 2014 Conference : Implementing Zabbix in large Banking EnvironmentAlain Ganuchaud
CORE IT PROJECT (Alain Ganuchaud) presented during Zabbix 2014 Conference in RIGA how Zabbix was implemented in large French Banks Environments: over 14 000 servers.
Monitoring all Elements of Your Database Operations With ZabbixZabbix
In depth look into all aspects of Zabbix, from the history and origins of the software to an overview of the latest features, introduced in Zabbix 3.2 .
Presented by the founder and CEO of Zabbix, Alexei Vladishev at Percona Live 2016 Europe.
Overview of my VMware vSphere 5.1 with ESXi and vCenter class. Get an overview of the most powerful, enterprise class private cloud platform available.
Alexei Vladishev - Zabbix - Monitoring Solution for EveryoneZabbix
Paris Zabbix User Group Meetup 2016
June 23, 2016
1. Open Source
2. Zabbix Architecture
3. Data Collection
4. Problem Detection
5. Problem Forecasting / Trend Prediction
6. Lifecycle and Support Policy
ChinaNetCloud - Using Zabbix Monitoring at Scale - Zabbix Conference 2014ChinaNetCloud
Overview of how ChinaNetCloud uses the world-class Zabbi monitoring system at scale, including customizations, integrations, and hardware.
Originally given at Zabbix Global Conference in Riga, Latvia in Sept, 2014
My presentation at MWLUG 2015. I show how to build and connect a modern looking website, built with HTML, CSS, and Javascript/jQuery, to your existing IBM Domino backend data using Ajax and JSON and some simple Lotusscript code.
A language for the Internet: Why JavaScript and Node.js is right for Internet...Tom Croucher
Increasingly we want to do more with the web and Internet applications we build. We have more features, more data, more users, more devices and all of it needs to be in real-time. With all of these demands how can we keep up? The answer is choosing a language and a platform that are optimized for the kind of architecture Internet and web applications really have. The traditional approach prioritises computation, assigning server resources before they are actually needed. JavaScript and Node.js both take an event driven approach only assigning resources to events as they happen. This allows us to make dramatic gains in performance and resource utilization while still having an environment which is fun and easy to program.
Link to the full talk - https://youtu.be/2Rf5t2Eh6IQ
https://go.dok.community/slack
https://dok.community
ABSTRACT OF THE TALK
This talk will provide a high-level overview of Kubernetes, Helm charts and how they can be used to deploy Apache Druid clusters of any size.
We'll review how Kubernetes functionality enables resilience and self-healing, historical tiers through node group affinity, middle manager scaling through Kubernetes autoscaling to optimize ingestion capacity and some of the gotchas along the way.
BIO
Sergio Ferragut is a database veteran turned Developer Advocate at Imply. His experience includes 16 years at Teradata in professional services and engineering roles.
He has direct experience in building analytics applications spanning the retail, supply chain, pricing optimization and IoT spaces.
Sergio has worked at multiple technology start-ups including APL and Splice Machine where he helped guide product design and field messaging.
Sherlock Homepage - A detective story about running large web services - NDC ...Maarten Balliauw
The site was slow. CPU and memory usage everywhere! Some dead objects in the corner. Something terrible must have happened! We have some IIS logs. Some traces from a witness. But not enough to find out what was wrong. In this session, we’ll see how effective telemetry, a profiler or two as well as a refresher of how IIS runs our ASP.NET web applications can help solve this server murder mystery.
fog or: How I Learned to Stop Worrying and Love the CloudWesley Beary
Learn how to easily get started on cloud computing with fog. If you can control your infrastructure choices, you’ll make better choices in development and get what you need in production. You'll get an overview of fog and concrete examples to give you a head start on your provisioning workflow.
Bulletproof Networks provides managed hosting services to some of the largest companies in Australia. Bulletproof implements strong isolation of customer environments, and this can present unique challenges when re-using Puppet code across our customer base. Additionally, the environments range in size from small to very large, and our tools + processes need to be able to handle both uses cases equally well.
In this talk Lindsay + Mick will cover how Bulletproof's approach to these problems has evolved over the last 4 years, and some of the tools Bulletproof has developed and built upon to provide an awesome service to our customers.
Cookin’ up Hybrid Clouds: Chef and the Accenture Cloud PlatformChef Software, Inc.
Accenture is using Private Chef to be the management control point for the Accenture Cloud Platform, a cloud service broker, managing hybrid cloud environments and cloud-based applications for its clients and internal teams. In addition to broker services, the platform features tailored solutions for Infrastructure as a Services, Testing as a Service, Big Data Platforms, and various development offerings. During this presentation, Thomas Myers, the Chef lead on the project, will discuss the challenges and successes of integrating Chef into the Accenture Cloud Platform.
fog or: How I Learned to Stop Worrying and Love the Cloud (OpenStack Edition)Wesley Beary
Cloud computing scared the crap out of me - the quirks and nightmares of provisioning cloud computing, dns, storage, ... on AWS, Terremark, Rackspace, ... - I mean, where do you even start?
Since I couldn't find a good answer, I undertook the (probably insane) task of creating one. fog gives you a place to start by creating abstractions that work across many different providers, greatly reducing the barrier to entry (and the cost of switching later). The abstractions are built on top of solid wrappers for each api. So if the high level stuff doesn't cut it you can dig in and get the job done. On top of that, mocks are available to simulate what clouds will do for development and testing (saving you time and money).
You'll get a whirlwind tour of basic through advanced as we create the building blocks of a highly distributed (multi-cloud) system with some simple Ruby scripts that work nearly verbatim from provider to provider. Get your feet wet working with cloud resources or just make it easier on yourself as your usage gets more complex, either way fog makes it easy to get what you need from the cloud.
The OpenStack Edition adds my concerns about OpenStack API development, including things that have already been fixed and things that we haven't yet encountered. Hopefully this consumer perspective can help shed light on some rough spots.
Introduction of OpsStack--Integrated Operation Platform developed by ChinaNetCloud
Operations Evolution Underway
Customer Challenges
OpsStack Killer Features
ChinaNetCloud Online Lecture:Something About TsharkChinaNetCloud
On Jul 26, Cecil Han, Senior engineer of ChinaNetCloud, shared insights on the topic of “Something about Tshark” with audience of ChinaNetCloud Webinar.
What is Tshark?
Why we need Tshark even we have tcpdump?
Common parameters
ChinaNetCloud Online Lecture: Fight Against External Attacks From Different L...ChinaNetCloud
Internet makes the world brand-new, but it also put the system safety in danger— security problems such as DDOS attacks, data theft, and BotNet always bothering IT operations teams. How can we defend ourselves from these types of attack? By implementing four layers of security protection: network, system, code, and operation maintenance.
On July 5, Wang Han, senior architect of ChinaNetCloud shared our view points about “How to resist external attacks” with dozens of audience through webinar.
云中漫步 颠覆创新_创业邦春季创新峰会主题演讲 Cloud Innovation in ChinaChinaNetCloud
President of ChinaNetCloud, Yinan Gu's keynote speech at 2016 DEMO CHINA in Beijing, May 11.
Cloud Innovation in China, Speech at DEMO China in May, 2016 in Bejing by Yinan Gu, ChinaNetCloud's President (in Mandarin)
ChinaNetCloud talk on Operations-as-a-Service at AWS China Summit 2015 in Shanghai. Covers OaaS cases, technology, and AWS.
Given December 17th, 2015, in Shanghai, in Chinese by Yinan Gu.
Running Internet Systems in China - The Details You Need to Succeed in Chines...ChinaNetCloud
There are a lot of misconceptions about how the Internet actually works in China.
China’s Internet has it’s own set of unique problems such as regulatory, legal, infrastructure, connectivity, etc.
In this presentation we will examine the modern Chinese Internet, it’s structure, challenges, and how to succeed in the world’s most populous country.
Internet Cloud Operations - ChinaNetcloud & AWS Event BeijingChinaNetCloud
Internet Operations in the cloud, presented by ChinaNetCloud at joint AWS event in Beijing June, 2015.
Covers background, how clouds are different, key issues, and how OaaS (Operations as a Service) helps.
Presentation on Internet Security by @SteveMushero of @ChinaNetCloud, given in Shanghai in May, 2015.
Covers threats, risks, and solutions.
Bi-lingual English & Chinese.
Cloud Operations Challenges - Talk by ChinaNetCloud at Joint Cisco eventChinaNetCloud
Talk given by ChinaNetCloud CEO Steve Mushero at joint event with Cisco in Beijing on April 2, 2015.
Covers what's wrong with Internet Operations today and how to fix it.
ChinaNetCloud - Public Clouds in China OverviewChinaNetCloud
Overview of the Public Clouds in China, including Aliyun, AWS, Tencent plus UCloud, QingCloud, Azure, and more.
Given by Steve Mushero at BarCamp Shanghai 2014 and other events.
Multi-cluster Kubernetes Networking- Patterns, Projects and GuidelinesSanjeev Rampal
Talk presented at Kubernetes Community Day, New York, May 2024.
Technical summary of Multi-Cluster Kubernetes Networking architectures with focus on 4 key topics.
1) Key patterns for Multi-cluster architectures
2) Architectural comparison of several OSS/ CNCF projects to address these patterns
3) Evolution trends for the APIs of these projects
4) Some design recommendations & guidelines for adopting/ deploying these solutions.
This 7-second Brain Wave Ritual Attracts Money To You.!nirahealhty
Discover the power of a simple 7-second brain wave ritual that can attract wealth and abundance into your life. By tapping into specific brain frequencies, this technique helps you manifest financial success effortlessly. Ready to transform your financial future? Try this powerful ritual and start attracting money today!
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptxBrad Spiegel Macon GA
Brad Spiegel Macon GA’s journey exemplifies the profound impact that one individual can have on their community. Through his unwavering dedication to digital inclusion, he’s not only bridging the gap in Macon but also setting an example for others to follow.
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC
Ellisha Heppner, Grant Management Lead, presented an update on APNIC Foundation to the PNG DNS Forum held from 6 to 10 May, 2024 in Port Moresby, Papua New Guinea.
1.Wireless Communication System_Wireless communication is a broad term that i...JeyaPerumal1
Wireless communication involves the transmission of information over a distance without the help of wires, cables or any other forms of electrical conductors.
Wireless communication is a broad term that incorporates all procedures and forms of connecting and communicating between two or more devices using a wireless signal through wireless communication technologies and devices.
Features of Wireless Communication
The evolution of wireless technology has brought many advancements with its effective features.
The transmitted distance can be anywhere between a few meters (for example, a television's remote control) and thousands of kilometers (for example, radio communication).
Wireless communication can be used for cellular telephony, wireless access to the internet, wireless home networking, and so on.
# Internet Security: Safeguarding Your Digital World
In the contemporary digital age, the internet is a cornerstone of our daily lives. It connects us to vast amounts of information, provides platforms for communication, enables commerce, and offers endless entertainment. However, with these conveniences come significant security challenges. Internet security is essential to protect our digital identities, sensitive data, and overall online experience. This comprehensive guide explores the multifaceted world of internet security, providing insights into its importance, common threats, and effective strategies to safeguard your digital world.
## Understanding Internet Security
Internet security encompasses the measures and protocols used to protect information, devices, and networks from unauthorized access, attacks, and damage. It involves a wide range of practices designed to safeguard data confidentiality, integrity, and availability. Effective internet security is crucial for individuals, businesses, and governments alike, as cyber threats continue to evolve in complexity and scale.
### Key Components of Internet Security
1. **Confidentiality**: Ensuring that information is accessible only to those authorized to access it.
2. **Integrity**: Protecting information from being altered or tampered with by unauthorized parties.
3. **Availability**: Ensuring that authorized users have reliable access to information and resources when needed.
## Common Internet Security Threats
Cyber threats are numerous and constantly evolving. Understanding these threats is the first step in protecting against them. Some of the most common internet security threats include:
### Malware
Malware, or malicious software, is designed to harm, exploit, or otherwise compromise a device, network, or service. Common types of malware include:
- **Viruses**: Programs that attach themselves to legitimate software and replicate, spreading to other programs and files.
- **Worms**: Standalone malware that replicates itself to spread to other computers.
- **Trojan Horses**: Malicious software disguised as legitimate software.
- **Ransomware**: Malware that encrypts a user's files and demands a ransom for the decryption key.
- **Spyware**: Software that secretly monitors and collects user information.
### Phishing
Phishing is a social engineering attack that aims to steal sensitive information such as usernames, passwords, and credit card details. Attackers often masquerade as trusted entities in email or other communication channels, tricking victims into providing their information.
### Man-in-the-Middle (MitM) Attacks
MitM attacks occur when an attacker intercepts and potentially alters communication between two parties without their knowledge. This can lead to the unauthorized acquisition of sensitive information.
### Denial-of-Service (DoS) and Distributed Denial-of-Service (DDoS) Attacks
2. Running the World’s Internet Servers www.ChinaNetCloud.com
Greetings
I’m Steve
I’m from Shanghai, China
We have a big Internet there
We have a big business
We have a big monitoring system
That’s Zabbix
We love the Database
Let me tell you more about it . . .
2
Hello
3. Our System & Database
Zabbix 1.8.3 – Going to 2.2 now
1250 hosts, 300K items, 550 new values/sec
MySQL Percona 5.5 w/ very optimized config
Will go to 5.6 when 5.6 is more stable
No query cache
Main DB about 200GB in size
History is about 2 billion rows of data, 157GB size
Trends is 500 million, 37GB size
Backups take 8 hours (including compress/encrypt)
Has 48GB of Innodb Buffer (will expand to 64+ soon)
Will go to 96, 128, 256 over time
Generally runs well, except I/O bottleneck
Running the World’s Internet Servers www.ChinaNetCloud.com
3
4. Running the World’s Internet Servers www.ChinaNetCloud.com
Zabbix Database
MySQL for us
Not Postgres/Oracle – No idea about them
1.8 & 2.2 Versions
Very familiar with 1.8.3
Will try to focus on 2.2
Overall, very logical
Easy to use/query
Very powerful
Some weird things
Some complex things
Key values in defines.inc.php
I have a 2.2 ERD Model for you !
4
5. Database Overview
Running the World’s Internet Servers www.ChinaNetCloud.com
~111 Tables
Well-structured & logical
All about foreign keys for joins
All useful joins on ID
objectid, e.g. hostid, itemid
All timestamps are epoch time
Always called ‘clock’ in any table
Use MySQL unix_timestamp() and from_unixtime()
Several billion-row tables
Careful with these !
5
6. Running the World’s Internet Servers www.ChinaNetCloud.com
Key Subsystems
Hosts (& Templates)
Items (& Templates)
Functions
Triggers
Events
Users
Trends & History
Macros, Profiles, HostGroups
Graphs, Screens
Queue
6
7. Running the World’s Internet Servers www.ChinaNetCloud.com
Core Subsystems
Need to know/understand in detail
Hosts (& Templates)
Items (& Templates)
Triggers (& Functions)
Events
Trends & History
7
Core
8. Hosts, Items & Templates I
Critical to understand the relationships
Hosts & Items are the core of the system
Running the World’s Internet Servers www.ChinaNetCloud.com
Hosts have items
Items drive everything
Agent Type, Data Type, Intervals, etc.
SQL to look at a host & items:
SELECT host, key_, description, from_unixtime(lastclock), lastvalue
FROM items i JOIN hosts h ON i.hostid = h.hostid
WHERE h.status = 0
AND i.status = 0
HOST KEY_ DESCRIPTION LASTCLOCK LASTVALUE
srv-nc-webdav1 agent.ping agent-ping 2014-08-19 02:50:44 1
srv-nc-webdav1 agent.version Version of zabbix_agent(d) 2014-08-19 02:25:13 1.8.3
srv-nc-webdav1 apache[busyworkers] Apache Busy Workers 2014-08-19 02:50:16 1.000000
items.lastvalue removed in 2.2 – Pull from history table
8
9. Hosts, Items & Templates II
Templates are just special hosts (status=3)
Templated items are special items
Templateid=0 and hosts.status=3
A host’s non-template items also templateid=0 so careful
On a host, an item is from a template if templateid>0
Templateid is for an ITEM, not the template
Must join (host’s item to template’s item to template) to get template name
Running the World’s Internet Servers www.ChinaNetCloud.com
9
10. Hosts, Items & Templates III
Hosts have attached Templates
Running the World’s Internet Servers www.ChinaNetCloud.com
One or more per host
Host’s templated items are copied from Template
Template Items are COPIED to the host
VERY important to understand this relationship
Important to understand what can be changed at host level
So 10 hosts with a template of 10 items
110 items total in the system (10 + 10x10)
HOST HOST_STATUS ITEMID TEMPLATEID KEY_
NC_Template_Linux 3 24130 0 agent.version
srv-nc-webdav1 0 23110 24130 agent.version
srv-nc-dns1 0 23314 24130 agent.version
SELECT host, h.status, itemid, templateid, key_
FROM items i JOIN hosts h ON i.hostid = h.hostid
WHERE (h.status = 0 OR h.status = 3)
AND i.status = 0
AND (i.itemid = 24130 OR i.templateid = 24130)
ORDER by templateid
10
11. Triggers, Events, Functions, and Items I
Another key set of relationships
Events are Trigger status changes
Basically the alerts you see on dashboard
Drive actions, emails, dashboard
Triggers are logic that finds problems
Contain the logic Expression
Running the World’s Internet Servers www.ChinaNetCloud.com
String with fomula
Based on Functions
Functions are the Zabbix functions
11
12. Triggers, Events, Functions, and Items II
Functions contain items and the function
Running the World’s Internet Servers www.ChinaNetCloud.com
Last, avg, etc.
Items link to hosts, etc.
Triggers can be multi-host
This complicates logic
Hard to link Trigger to a Host – big SQL
Example:
TRIGGERID EXPRESSION DESCRIPTION
10048 {1003079}/{1003080}*100<10 Lack of free memory on server {HOSTNAME}
10056 {1003227}>300 Too many processes on {HOSTNAME}
FUNCTIONID ITEMID TRIGGERID FUNCTION PARAMETER
1003079 10090 10048 last 0
12
13. Now that you
understand all that
We’ll talk about some tables
Running the World’s Internet Servers www.ChinaNetCloud.com 13
14. Running the World’s Internet Servers www.ChinaNetCloud.com
Hosts
Core table
Hosts are Hosts
Templates are also Hosts
hosts.status = 3
Proxies are also Hosts
Hosts.status = 5
Don’t confuse with agent on proxy host
Hosts are Enabled/Disabled
hosts.status = 0 or 1
Hosts can be in unreachable state
hosts.status = 2
Not clear this is fully used
Join items to hosts to get host/template name
14
15. Running the World’s Internet Servers www.ChinaNetCloud.com
Hosts – SQL
List active hosts
SELECT hostid, proxy_hostid, host, ip, port, status
FROM hosts WHERE status = 0
ORDER BY host
HOSTID STATUS HOST IP PORT STATUS
10057 0 srv-nc-web1 60.139.13.43 40067 0
10058 0 srv-nc-web2 223.173.38.47 13050 0
10059 0 srv-nc-web3 223.213.91.96 20450 0
15
16. Running the World’s Internet Servers www.ChinaNetCloud.com
Items
Core table
Linked to hosts on hostid
Have Type
Agent, SNMP, Internal, Simple, IPMI, ec.
Enabled/Disabled, Error
items.status = 0 or 1
Can be in error, items.status = 3
Lastclock tells last collect time in 1.8
Very useful for pulling data, stats, issues
Not clear where this went in 2.2
LastValue has last value in 1.8
In 2.2 you must get from Trend table, annoying
16
17. Running the World’s Internet Servers www.ChinaNetCloud.com
Items
Either Host or Template Level
If from Template, COPIED from Template
Some fields can be changed at host level
- Enabled, Interval, History/Trend Retention, Application, Group
But OVERWRITTEN if you update the Template
templateid = itemid on the Template
SELECT host, h.status, itemid, templateid, key_
FROM items i JOIN hosts h ON i.hostid = h.hostid
WHERE h.status = 0
AND i.status = 0
ORDER by host, key_
HOST STATUS ITEMID TEMPLATEID KEY_
srv-nc-def1 0 227843 22934 agent.ping
srv-nc-def1 0 216864 44130 agent.version
srv-nc-def1 0 216864 0 local.thing
17
18. Running the World’s Internet Servers www.ChinaNetCloud.com
Items – Get Data
Get data from items (Ver 1.8)
/* Get small swap servers with swap used */
SELECT host, i.lastvalue AS Swap_Size, 100-ii.lastvalue as Swap_Used
FROM items i JOIN hosts h ON i.hostid = h.hostid
JOIN items ii on h.hostid = ii.hostid
WHERE i.templateid = 24172 /* Swap size */
AND i.lastvalue > (1 * 1024 * 1024 * 1024)
AND i.lastvalue < (88 * 1024 * 1024 * 1024)
AND h.status = 0
AND i.status = 0
AND ii.status = 0
AND ii.templateid = 154766 /* swap % free */
AND (100-ii.lastvalue) > 10
ORDER BY Swap_Used DESC
18
19. Running the World’s Internet Servers www.ChinaNetCloud.com
Items – Get Data
items.lastvalue & lastclock removed in 2.2 – Pull from history
VERY long query – about 5 pages (many parts removed):
SELECT (case when (i.value_type = 0)
then (select history.value from history
where (history.itemid = i.itemid)
order by history.clock desc limit 1)
when
(i.value_type = 1) …
(i.value_type = 2) …
(i.value_type = 3) …
(i.value_type = 4) …
end) AS lastvalue,
(case when (i.value_type = 0)
then (select history.clock from history
where (history.itemid = i.itemid)
order by history.clock desc limit 1)
when
(i.value_type = 1)
(i.value_type = 2)
(i.value_type = 3)
(i.value_type = 4)
end) AS lastclock
from items i where itemid = 23110
19
20. Running the World’s Internet Servers www.ChinaNetCloud.com
Zabbix Queue
Items can be in a ‘queue’
Seen on Admin|Queue screen
Not a real queue !
Just a list of late items
May change in Version 2.2
Now() > (lastclock + interval)
Max ‘queue’ is # of active items
Stuff can get stuck if error & host disabled
Hosts disabled but items enabled
Lots of good SQL for reports
Queue size, oldest items, queue by host
Queue by proxy for graphs / triggers
20
21. Running the World’s Internet Servers www.ChinaNetCloud.com
Triggers I
Core table
Linked to functions
Functions link to items
Items link to hosts
Functions
Last, min, max, sum, nodata, etc.
Enabled/Disabled, Error
triggers.status = 0 or 1
21
22. Running the World’s Internet Servers www.ChinaNetCloud.com
Triggers II
Value – OK or Problem
Also UNKNOWN in 1.8
Behavior changed in 2.0/2.2
Priority is here
URL is here
Templateid tells you if came from template
ID is of parent Trigger in the template
Dependencies are here, complicated
Trigger_up is trigger we depend on
Trigger_down is dependent trigger (this trigger?)
Trigger Level – 0 for no dependency
22
23. Running the World’s Internet Servers www.ChinaNetCloud.com
Events
The Alerts you see on Dashboard
Basically a trigger changing status
Also include auto-discovery, etc.
Triggered events
Source = 0, Object = 0
Objectid will match the trigger
Status tells you Trigger status
We tie Alert Tickets to this
Note: Server re-creates events on restart
Copies over ACKs
Very annoying if you tie things to eventid
We have special PHP to rebuild this relationship
23
24. Events – ACK & Duration
ACKs set flag in Event DB row
And ACK data in acknowledges table
Finding Event duration is HARD
Basically scan forward for next OK event
Slow and messy
Important for metrics
select distinct SUBSTRING_INDEX(from_unixtime(e.clock),' ',1) AlertDate,
SUBSTRING_INDEX(from_unixtime(e.clock),' ',-1) AlertTime, (select
floor((eb.clock-e.clock)/60) from events eb where value = 0 and eb.eventid >
e.eventid and eb.objectid=e.objectid order by eb.eventid limit 1 ) as Duration,
h.host, t.description, t.priority, from_unixtime(a.clock) ACK, u.name,
a.acknowledgeid, a.message, floor((a.clock-e.clock)/60) response_time from
triggers t join functions f on f.triggerid=t.triggerid right join items i on
f.itemid=i.itemid join hosts h on h.hostid=i.hostid right join events e on
t.triggerid=e.objectid left join acknowledges a on a.eventid=e.eventid left join
users u on u.userid=a.userid where e.value=1 and t.triggerid<>19072 and
e.clock>unix_timestamp('2010-04-01 09:00:00') and
e.clock<unix_timestamp('2010-04-01 18:00:00') order by e.clock;
Running the World’s Internet Servers www.ChinaNetCloud.com
24
25. Running the World’s Internet Servers www.ChinaNetCloud.com
History & Trends
This is the data we collect
Drives the graphs
Data first goes to History tables
By type – uint, text, double, etc.
Server moves to Trends tables
On schedule based on Item config
Summarizes each hour
Saves min, max, average
Trends table purged by Housekeeper
Can partition in DB for much faster purge
Special SQL can also purge, but I/O heavy
SQL in History/Trends painful
Lots of random I/O
Ideally data fits in server RAM or have SSD
25
26. Running the World’s Internet Servers www.ChinaNetCloud.com
Web Checks
A bit complex – 4 tables
Link into the rest of the system
Httptest
Test name, status, and interval, last check, and what seems like response time, and
error text
httpstep tables
Step name, URL, timeout, response code, required text
Httptestitem
Links to items, creates two items of type 9 for each test - Download Speed & Failed
Step (type 2 & 3 in this table)
httpstepitem
Links to items, creates 3 items of type 9 for each step - Download Speed, Response
Time, Response Code
Other
Note Item History & Trends set to 30 & 90, but can't seem to be edited anywhere
26
27. Graphs, Screens & Slideshows
Pretty part of the system
Running the World’s Internet Servers www.ChinaNetCloud.com
Basic tables
screens & screen_items
Use resourcetype to know how to link
Each type can link to underlying graph, item, etc.
Complex security
Based on item/host permissions
27
28. Users & Security - I
Running the World’s Internet Servers www.ChinaNetCloud.com
users table
alias field is the actual user name
usrgrp table
All roles/permissions tied here, API, GUI, etc.
rights table
Links usrgrp to server groups with RO, R/W permission
profiles table
Use not clear as thousands of rows per user
Think its drives dashboard and other modules settings
sessions table
Basic user session tied to cookie
mysql> update users set passwd=MD5('somepassword') where alias='Admin';
28
29. Users & Security - II
Running the World’s Internet Servers www.ChinaNetCloud.com
Enable/Disable
Seems to disable by adding to disabled group
Passwords
MD5 has WITH TRAILING CARRIAGE RETURN, so use -n on echo:
$ echo -n "somepassword" | md5sum 9c42a1346e333a770904b2a2b37fa7d3
But easier to use MySQL function:
mysql> update users set passwd=MD5('somepassword') where alias='Admin';
Refresh field – For all screens
Defaults very low, set to 0 or much higher
Otherwise heavy load on DB
29
30. Running the World’s Internet Servers www.ChinaNetCloud.com
Users & Security
Hosts a User has rights on
SELECT ug.usrgrpid, ug.name AS user_group, g.name as host_group, host FROM
users u JOIN users_groups ugl ON u.userid = ugl.userid JOIN usrgrp ug ON
ugl.usrgrpid = ug.usrgrpid JOIN rights r ON ug.usrgrpid = r.groupid JOIN groups g
ON r.id = g.groupid JOIN hosts_groups hg ON g.groupid = hg.groupid JOIN hosts
h on hg.hostid = h.hostid where u.alias = 'steve.mushero' /* userid 116 */ /*
group 15 is 24x7 user */ AND r.permission in (2,3);
30
31. Config and User Profiles
Refresh rates and DB load
Dashboard refresh rates
UPDATE profiles p JOIN users u ON p.userid = u.userid
SET p.value_int = 300
WHERE idx LIKE 'web.dahsboard.rf_rate.%'
AND u.alias not LIKE 'cust%';
Running the World’s Internet Servers www.ChinaNetCloud.com
31
32. Running the World’s Internet Servers www.ChinaNetCloud.com
Audit System
Great, but useless GUI
Data very fine-grained / detailed
audit_log & audit_log_details
Actions & Resources
See code for list of values
General SQL to get info:
SELECT alias, from_unixtime(a.clock), a.action, a.resourcetype, a.details,
a.resourceid, a.resourcename, ad.table_name, ad.field_name, CAST(ad.oldvalue
AS UNSIGNED) AS oldvalue, CAST(ad.newvalue AS UNSIGNED) AS newvalue
FROM auditlog a LEFT JOIN auditlog_details ad ON a.auditid = ad.auditid JOIN users
u ON a.userid = u.userid
WHERE resourceid = 109482 AND field_name = 'status'
AND from_unixtime(clock) > '2013-05-01'
32
33. Running the World’s Internet Servers www.ChinaNetCloud.com
Audit System
Big select to get details on hosts
SELECT alias, from_unixtime(a.clock), CASE a.action WHEN 0 THEN "Added"
WHEN 1 THEN "Updated"
WHEN 2 THEN "Deleted" ELSE CAST(a.action AS CHAR) END AS action, CASE
a.resourcetype
WHEN 4 THEN "Host"
WHEN 13 THEN "Item ?"
WHEN 15 THEN "Item"
ELSE CAST(a.resourcetype AS CHAR) END AS resource_type, a.details, a.resourceid,
a.resourcename, ad.table_name, ad.field_name, CAST(ad.oldvalue AS CHAR),
CASE ad.newvalue
WHEN 0 THEN "Enable”
WHEN 1 THEN "Disable" END as newvalue
FROM auditlog a LEFT JOIN auditlog_details ad ON a.auditid = ad.auditid JOIN users
u ON a.userid = u.userid
WHERE from_unixtime(clock) > '2012-01-01' /* AND alias LIKE 'matt%' */
AND a.resourcetype = 4 /* Host */ AND (field_name = 'status' OR field_name IS
NULL) /* AND ad.newvalue = 1 /* 1 = Disable */ /*
AND resourcename LIKE '%web17%'*/;
33
34. Running the World’s Internet Servers www.ChinaNetCloud.com
Safety Reports
We have dozens of these, such as:
Items that differ from template
Missing templates
Disable items/hosts, forget to enable
Alerts with no URL/Wiki
Hosts missing profile data
Items disabled conflict with trigger
Web alerts with no trigger
Web alerts with long/short timeouts
Hosts in wrong, duplicate, conflicting groups
Servers in Zabbix, not core system
Many are quite complex, big SQL
We will post these on-line
After updating for Ver 2.2
34
35. Running the World’s Internet Servers www.ChinaNetCloud.com
Housekeeper
Done by server every hour
Very slow – Item by Item
Thousands per second
A LOT of I/O (mostly read)
We have SQL to do in bulk
But too heavy load on I/O system
We’ll see on SSD, or all data in RAM
35
36. Running the World’s Internet Servers www.ChinaNetCloud.com
Backups
Backup, of course, but big
Ours are 8 hours
200GB of data
At 1TB this is not manageable
Need incrementals
Maybe recent data only
Do from slave
You can backup config only
Ignore history*, trends*, events, audit*, acknowledges
36
37. Running the World’s Internet Servers www.ChinaNetCloud.com
Summary
We love the Zabbix database
So should you
Learn how everything connects
Focus on key / core tables
Have fun
37
38. Thanks from ChinaNetCloud
Pioneers in OaaS – Operations as a Service
Running the World’s Internet Servers www.ChinaNetCloud.com 38
39. ChinaNetCloud
Shanghai Headquarters:
X2 Space 1-601, 1238 Xietu Lu
Shanghai, 200032 China
T: +86-21-6422-1946 F: +86-21-6422-4911
Beijing Office:
Lee World Business Building #305
57 Happiness Village Road, Chaoyang District
Beijing, 100027 China
Sales@ChinaNetCloud.com
Running the World’s Internet Servers www.ChinaNetCloud.com
www.ChinaNetCloud.com
Silicon Valley Office:
California Avenue
Palo Alto, 94123 USA