Many companies continue to manaully create and manage their cloud infrastructure via web consoles. Documenting these procedures is challenging, especially since the interfaces are always evolving. Reviewing the changes is also difficult, and it often involves having a coworker watching over your shoulder. Rolling back a bad change requires deleting your current work and attemtping to manually re-create the old infrastructure from memory. Scaling or deploying the infrastructure to new environments also often involves manually re-creating it.
Hashicorp's Terraform allows for the management of infrastructure as code. While a growing number of groups have started to utilize this tool, most are only just beginning to scratch the surface of its potential. Yes, Terraform can be used to create and manage resources in AWS and other cloud providers. However, thanks to an ever growing number of providers, it can manage resources in many other popular cloud services. At Yelp, we use Terraform to manage our AWS resources, DNS records in NS1, CDN configuration in Fastly and Cloudflare, and our charts and dashboards in SignalFx.
This setup provides us with the ability to maintain our infrastructure as code in a version control system that can be put through standard code review flows. If we discover an issue, we can revert to an older, working commit and restore our infrastructure to that point in time. Documentation can include code snippets that can be easily copied/pasted in an error free manner. Finally, resources managed by one Terraform provider can benefit from and utilize information from resources managed by another provider. This means that launching a new AWS EC2 instance can automatically update the necessary DNS records in NS1, and then create a dashboard filled with customized charts designed to monitor the instance.
Many companies continue to manaully create and manage their cloud infrastructure via web consoles. Documenting these procedures is challenging, especially since the interfaces are always evolving. Reviewing the changes is also difficult, and it often involves having a coworker watching over your shoulder. Rolling back a bad change requires deleting your current work and attemtping to manually re-create the old infrastructure from memory. Scaling or deploying the infrastructure to new environments also often involves manually re-creating it.
Hashicorp's Terraform allows for the management of infrastructure as code. While a growing number of groups have started to utilize this tool, most are only just beginning to scratch the surface of its potential. Yes, Terraform can be used to create and manage resources in AWS and other cloud providers. However, thanks to an ever growing number of providers, it can manage resources in many other popular cloud services. At Yelp, we use Terraform to manage our AWS resources, DNS records in NS1, CDN configuration in Fastly and Cloudflare, and our charts and dashboards in SignalFx.
This setup provides us with the ability to maintain our infrastructure as code in a version control system that can be put through standard code review flows. If we discover an issue, we can revert to an older, working commit and restore our infrastructure to that point in time. Documentation can include code snippets that can be easily copied/pasted in an error free manner. Finally, resources managed by one Terraform provider can benefit from and utilize information from resources managed by another provider. This means that launching a new AWS EC2 instance can automatically update the necessary DNS records in NS1, and then create a dashboard filled with customized charts designed to monitor the instance.
Leveraging parse.com for Speedy DevelopmentAndrew Kozlik
After viewing this presentation you will have a high level overview of Parse's services and understand how quick and easy it is to store and retrieve your data in the cloud. Stop wasting time building out a backend and get your MVP out the door!
This presentation was given to the combined Orlando iOS and Central Florida Android Developers Meetup on April 22, 2015.
Coolblue - Behind the Scenes Continuous Integration & DeploymentMatthew Hodgkins
Do you want to know what our process looks like from code to production? Or do you want to learn how we envision the future of deployment at Coolblue? During this evening, our Engineers will show you a peek Behind the Scenes and tell you everything about our challenges with Continuous Integration and Deployment.
MooseX::Datamodel - Barcelona Perl Workshop Lightning talkJose Luis Martínez
A lightning talk about MooseX::DataModel, an experimental module to validate and convert json into an object model, so it can be accessed in an object-like fashion.
Leveraging parse.com for Speedy DevelopmentAndrew Kozlik
After viewing this presentation you will have a high level overview of Parse's services and understand how quick and easy it is to store and retrieve your data in the cloud. Stop wasting time building out a backend and get your MVP out the door!
This presentation was given to the combined Orlando iOS and Central Florida Android Developers Meetup on April 22, 2015.
Coolblue - Behind the Scenes Continuous Integration & DeploymentMatthew Hodgkins
Do you want to know what our process looks like from code to production? Or do you want to learn how we envision the future of deployment at Coolblue? During this evening, our Engineers will show you a peek Behind the Scenes and tell you everything about our challenges with Continuous Integration and Deployment.
MooseX::Datamodel - Barcelona Perl Workshop Lightning talkJose Luis Martínez
A lightning talk about MooseX::DataModel, an experimental module to validate and convert json into an object model, so it can be accessed in an object-like fashion.
AppSec Pipelines and Event based SecurityMatt Tesauro
Presented at AppSec California 2017, this is a continuation of earlier talks about AppSec Pipelines and demonstrates 1st and 2nd Gen Pipelines, how OWASP is creating a pipeline for its projects and how several companies have benefited from combining DevOps, Agile, CI/CD and Security into an AppSec Pipeline to move beyond traditional AppSec testing.
Thinking DevOps in the era of the Cloud - Demi Ben-AriDemi Ben-Ari
The lines between Development and Operations people have gotten blurry and lots of skills needs to be held by both sides.
In the talk we'll talk about all of the considerations that are needed to be taken when creating a development and production environment, mentioning Continuous Integration, Continuous Deployment and the Buzzword "DevOps", also talking about some real implementations in the industry.
Of course how can we leave out the real enabler of the whole deal,
"The Cloud", Giving us a tool set that makes life much easier when implementing all of these practices.
During this presentation, Will covers the updates made in the Neo4j 3.0 release. He introduces Bolt (Neo4j's new binary protocol), and shows how developers can start using the Neo4j official drivers, build a stored procedure and take advantage of advanced support for cloud, container and on-premise.
Delivery Pipelines as a First Class Citizen @deliverAgile2019ciberkleid
In this talk, we will cover important elements for successful CI and CD. We will discuss how these elements make CI and CD much simpler, and hence more attainable. We will cover some best practices / recommendations to include in your application pipelines. We will look at a sample implementation of a pipeline leveraging modern tools. Finally, we will discuss some forthcoming ideas for making it even easier to declaratively enable CI and CD for applications.
Under the Hood with Cognos Analytics R5: Say Hello to Portal Tabs ReplacementSenturus
An objective review and demos of Release 5 features. Including a deep dive into role customizations to bridge the Portals Tab gap, review of geospatial mapping and navigation paths.
View the webinar video recording and download this deck: http://www.senturus.com/resources/under-the-hood-with-cognos-analytics-r5/
Senturus, a business analytics consulting firm, has a resource library with hundreds of free recorded webinars, trainings, demos and unbiased product reviews. Take a look and share them with your colleagues and friends: http://www.senturus.com/resources/.
Thinking DevOps in the Era of the Cloud - Demi Ben-AriDemi Ben-Ari
The lines between Development and Operations people have gotten blurry and lots of skills needs to be held by both sides. In the talk we'll talk about all of the considerations that are needed to be taken when creating a development and production environment, mentioning Continuous Integration, Continuous Deployment and the Buzzword "DevOps", also talking about some real implementations in the industry. Of course how can we leave out the real enabler of the whole deal, "The Cloud", Giving us a tool set that makes life much easier when implementing all of these practices.
Big query - Command line tools and Tips - (MOSG)Soshi Nemoto
BigQuery =Command line tools and Tips for business use=
Mulodo Open Study Group (MOSG) @Ho chi minh, Vietnam
http://www.meetup.com/Open-Study-Group-Saigon/events/231504491/
Continuous Deployment: The Dirty DetailsMike Brittain
Presented at ALM Summit 3 in Redmond, WA. January 2013.
Like what you've read? We're frequently hiring for a variety of engineering roles at Etsy. If you're interested, drop me a line or send me your resume: mike@etsy.com.
http://www.etsy.com/careers
Droidcon Spain 2105 - One app to rule them all: Methodologies, Tools & Tricks...Daniel Gallego Vico
This presentation shows how Android Development is carried out in a corporate environment like bq following a white label model attending to concepts like quality of software, scalability, reusability, maintainability, client personalization…
The development workflow is presented by giving details on the use of Gradle, Jenkins and additional tools created by the Android bq team in order to automate processes.
On the other hand, details about how the QA is carried out, as well as solutions to Android challenges related to our experience preinstalling apps on bq devices are revealed.
Kubernetes is making the promise of changing the datacenter from being a group of computer to "a computer" itself. This presentation outlines the new features in K8S with 1.1 and 1.2 release.
Monitoring Big Data Systems Done "The Simple Way" - Codemotion Milan 2017 - D...Demi Ben-Ari
Once you start working with distributed Big Data systems, you start discovering a whole bunch of problems you won’t find in monolithic systems.
All of a sudden to monitor all of the components becomes a big data problem itself.
In the talk we’ll mention all of the aspects that you should take in consideration when monitoring a distributed system once you’re using tools like:
Web Services, Apache Spark, Cassandra, MongoDB, Amazon Web Services.
Not only the tools, what should you monitor about the actual data that flows in the system?
And we’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.
Demi Ben-Ari - Monitoring Big Data Systems Done "The Simple Way" - Codemotion...Codemotion
Once you start working with Big Data systems, you discover a whole bunch of problems you won’t find in monolithic systems. Monitoring all of the components becomes a big data problem itself. In the talk we’ll mention all of the aspects that you should take in consideration when monitoring a distributed system using tools like: Web Services,Spark,Cassandra,MongoDB,AWS. Not only the tools, what should you monitor about the actual data that flows in the system? We’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.
The Anchor Store: Four Confluence Examples to Root Your DeploymentAtlassian
A mall is only as successful as its anchor stores. Similarly, any Confluence deployment should be anchored by one or two critical business applications. This session explores four key Confluence applications from four different deployments.
Atlassian Speaker: Per Fragemann
Customer Speakers: Rick Mazzarella of Asyst Tech, Brian Gregory of CPO Consulting, Daniel Pohl of InDorse Tech
Key Takeaways:
* Key, business critical uses of Confluence
* Deployment best practices
Monitoring Big Data Systems Done "The Simple Way" - Codemotion Berlin 2017Demi Ben-Ari
Once you start working with distributed Big Data systems, you start discovering a whole bunch of problems you won’t find in monolithic systems.
All of a sudden to monitor all of the components becomes a big data problem itself.
In the talk we’ll mention all of the aspects that you should take in consideration when monitoring a distributed system once you’re using tools like:
Web Services, Apache Spark, Cassandra, MongoDB, Amazon Web Services.
Not only the tools, what should you monitor about the actual data that flows in the system?
And we’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.
apidays LIVE Paris - Automation API Testing by Guillaume Jeannicapidays
apidays LIVE Paris - Responding to the New Normal with APIs for Business, People and Society
December 8, 9 & 10, 2020
Automation API Testing: when Postman collection are generated from OpenAPI specifications
Guillaume Jeannic, IT Architect at CBP Group
Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2M35wCo.
Jamund Ferguson talks about some of the challenges PayPal faced with their Node.js application servers and why they think the JAMStack approach improves performance for both their apps and their developers. He includes discussions around performance, security, development experience and deploy speed. Filmed at qconlondon.com.
Jamund Ferguson is a JavaScript architect at PayPal. He loves to look at how following patterns consistently can prevent bugs in applications. He’s previously contributed to the ESLint and StandardJS open-source projects and has as of late become a fan of FlowType and TypeScript.
Similar to Writing plugins for Nagios and Opsview - CAPSiDE Tech Talks (20)
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni.
📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath:
Autopilot per Studio Web
Autopilot per Studio
Autopilot per Apps
Clipboard AI
GenAI applicata alla Document Understanding
👨🏫👨💻 Speakers:
Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant
Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath
Andrei Tasca, RPA Solutions Team Lead @NTT Data
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
3. Opsview
Configures and runs Nagios for you
Presents a frendlier and more powerfull user
interface
Implements Nagios best practices
Distributed Monitoring
Datawarehouse
architects of the digital society
www.capside.com
4. Back to Nagios
Monitoring tool that doesn’t know how to monitor
anything!?!?
• The real monitoring is done by plugins
• Just external programs with a defined interface to communicate with Nagios
• Written in any language
architects of the digital society
www.capside.com
7. First rule
Is it already done?
• www.monitoring-plugins.org
• Plugins project
• www.nagiosplugins.org
• Nagios official plugins
• www.monitoringexchange.org
• User contributed
• exchange.nagios.org
• User contributed
• Google “xxx nagios”
architects of the digital society
www.capside.com
8. We’ll take a look at
Nagios::Plugin (Monitoring::Plugin)
Nagios::Plugin::DieNicely
Nagios::Plugin::WWW::Mechanize
Nagios::Plugin::SNMP
Nagios::Plugin::Differences
architects of the digital society
www.capside.com
9. Nagios::Plugin
Lots of common functionality for free!
• When writing a plugin you have to
Handle Arguments
Get and manipulate the data
Calculate state (OK, CRITICAL, …)
architects of the digital society
www.capside.com
10. Nagios::Plugin
Lots of common functionality for free!
• When writing a GREAT plugin you have to
Handle Arguments
-h –v arguments
-h has to output documentation
Get and manipulate the data
Calculate state (OK, CRITICAL, …)
In a flexible way (in f(x) of arguments)
Output performance data
architects of the digital society
www.capside.com
11. That’s a lot of work
I just wanted to monitor my app!
architects of the digital society
www.capside.com
12. Nagios::Plugin
Lots of common functionality for free!
• When writing a GREAT plugin you have to
Handle Arguments
-h –v arguments
-h has to output documentation
Get and manipulate the data
Calculate state (OK, CRITICAL, …)
In a flexible way (in f(x) of arguments)
Output performance data
architects of the digital society
www.capside.com
13. 3 Simple Steps
Setup
Data collection
State calculation
architects of the digital society
www.capside.com
14. Setup
Just make an instance of N::P
#!/usr/bin/env perl
use Nagios::Plugin;
my $np= Nagios::Plugin->new(
'usage' => 'Usage: %s'
);
$np->getopts;
You’ve just obtained
• -t option (timeout)
• -v option (verbose)
• --help option
architects of the digital society
www.capside.com
15. Setup (II) Constructor options
usage ("Usage: %s --foo --bar")
version <- Version string
url <- Help and Version
blurb <- Help description
license <- Help
extra <- Help
plugin <- overrides auto detected name
architects of the digital society
www.capside.com
16. Setup: GetOpt magic
$np->add_arg(
spec=> 'warning|w=s',
help=> "-w, --warning=RANGE",
required=> 1
);
$np->add_arg(
spec => 'user|u=s',
help => 'Username',
default => 'www-data'
);
$np->getopts;
if($np->opts->user) { … }
architects of the digital society
www.capside.com
17. Collect data
Now you have to work
architects of the digital society
www.capside.com
19. Ranges
Most plugins suppose that
• OK<WARNING<CRITICAL
But… what if…
architects of the digital society
www.capside.com
20. Ranges
Range definition
Generate alert if x…
10
Is not between 0 and 10
10:
Is not between 10 and infinity
~:10
Is not between –Inf and 10
10:20
Is not between 10 and 20
@10:20
Is between 10 and 20
$code= $np->check_threshold(
check => $value,
warning => $warning_threshold,
critical => $critical_threshold
);
$np->nagios_exit( $code, "Thresholdcheckfailed" ) if ($code!= OK);
architects of the digital society
www.capside.com
21. Output status
$np->nagios_exit(CRITICAL, “Too many
connections”);
$np->nagios_exit(OK, “Everything went fine”);
$np->nagios_exit(WARNING, “Too few
connections”);
$np->nagios_exit(UNKNOWN, “Bad options”);
architects of the digital society
www.capside.com
22. Performance Data
$np->add_perfdata(
label
=> "size",
value
=> $value,
uom
=> "kB",
warning => $warning,
critical => $critical
);
UOM Unit of measurement
Is for
No unit specified
Assume a number of things
s,ms,us
econds, miliseconds, nanoseconds
%
Percentage
B,KB,MB,TB
Bytes
c
A continuous counter
architects of the digital society
www.capside.com
27. Nagios::Plugin::DieNicely
What happened?
• Output went to STDERR
• Nagios doesn’t care
• Exit code follows Perls rules
• Nagios understands 0-3
architects of the digital society
www.capside.com
31. Nagios::Plugin::WWW::Mechanize
Again... Just create an instance. Use it as a
Nagios::Plugin object
Automatically tracks response time for you
$np->mech
$np->content
$np->get, $np->submit_form
architects of the digital society
www.capside.com
32. Nagios::Plugin::WWW::Mechanize
A couple of tricks
• Gzipped content
my $np = Nagios::Plugin::WWW::Mechanize->new(
'mech' => WWW::Mechanize::GZip->new(autocheck => 0)
);
• Proxy
my $proxy = $np->opts->proxy;
if (defined $proxy){
$np->mech->proxy(['http', 'https'], $proxy);
}
architects of the digital society
www.capside.com
34. Nagios::Plugin::SNMP
Again... Just create an instance. Use it as a
Nagios::Plugin object
Sets up a lot of arguments
Does delta between values of counters
architects of the digital society
www.capside.com
35. Any Questions?
Thanks to:
The Monitoring::Plugin module maintainers
Icanhazcheezburger for the cats
architects of the digital society
www.capside.com