This document discusses infrastructure as code and infrastructure drift. It begins with definitions and a history of how infrastructure as code started by focusing on having a single source of truth, versioning, documentation through code, testing, collaboration, immutable infrastructure, GitOps, and CI/CD practices. It then notes how infrastructure as code is currently going in reality, with changes happening outside of code, commits not capturing full scope of changes, lack of testing, and other challenges. Existing solutions to manage drift like CI/CD integration, static analysis, testing and policy/compliance tools are briefly mentioned. The document concludes with an introduction to the driftctl open source CLI tool for tracking, analyzing, prioritizing and warning of infrastructure drift.
Join this workshop and accelerate your journey to production-ready Kubernetes by learning the practical techniques for reliably operating your software lifecycle using the GitOps pattern. The Weaveworks team will be running a full-day workshop, sharing their expertise as users and contributors of Kubernetes and Prometheus, as well as followers of GitOps (operations by pull request) practices.
Using a combination of instructor led demonstrations and hands-on exercises, the workshop will enable the attendee to go into detail on the following topics:
• Developing and operating your Kubernetes microservices at scale
• DevOps best practices and the movement towards a “GitOps” approach
• Building with Kubernetes in production: caring for your apps, implementing CI/CD best practices, and utilizing the right metrics, monitoring tools, and automated alerts
• Operating Kubernetes in production: Upgrading and managing Kubernetes, managing incident response, and adhering to security best practices for Kubernetes
Developers love Git for its raw speed, distributed nature, and the fact that it was originally built by Linus Torvalds. What we don't love is the fact that, out of the box, Git has terrible support for tracking large binary files! Fortunately, developers from Atlassian and GitHub have created an open source project to solve this problem: Git LFS (Large File Support). This means researchers, web designers, game developers, multimedia producers, and all others who need to work with large data and rich media can move off legacy centralized systems and start using modern version control. This session will introduce Git LFS architecture, CLI and SourceTree usage, and how to build an effective Git LFS workflow with Bitbucket Server & Cloud for a professional software team.
Learn how Autodesk uses Git LFS at scale, how to avoid pitfalls, and how they ensure that their 4000+ engineers have Git and Git LFS properly installed and ready to use.
Products covered:
Bitbucket
If you missed the SpringOne Conference this year, don't fret! In this session you'll get the opportunity to get the highlights of the trip Jeroen and Tim made to Las Vegas and they'll show you the coolest stuff from Spring and CloudFoundry!
Swift has gone from being a closed project at Apple to an open-source language the community can help shape and evolve on many development platforms. With the support of the wider community, the evolution of Swift is looking very positive as users get ideas from a wide range of technical perspectives.
Presented by Karl Weinmeister at the Swift Summit, Nov 7th 2016
Introducing Pico - A Deep Learning Platform using Docker & IoT - Sangam Biradarsangam biradar
presented at https://events.docker.com/events/details/docker-hyderabad-presents-docker-hyderabad-meetup-19-docker-kubernetes-iot-docker101-workshop/
at MobileIron India
6th Floor, Western Pearl, Survey No. 13, Kondapur, Hitech City Rd, Kothaguda
Hyderabad, 500084
date : 14 sept 19
Triangle Devops Meetup covering Netflix open source, cloud architecture, and what Andrew did in his first year working as a senior software engineer in the cloud platform group.
Netflix and Containers: Not A Stranger Thingaspyker
Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. The Netflix streaming service had been powered by the Amazon cloud with virtual machines for over five years, blazing a trail for similar architectures. In the last year, it invested in containers for batch-style jobs and service-style applications. Andrew Spyker will explain the potential containers have to help Netflix create a more productive development experience while simultaneously deepening its control over resource management. Join Andrew to see why Netflix is moving forward with containers, how it can leverage its existing operational machinery, and how it’s running containers with a similar guarantee of high availability as current Netflix infrastructure provides.
Software Delivery at Warp Speed: Five Essential TechniquesAtlassian
The rise of microservices and containers has dramatically accelerated software delivery. With shorter release times and increased complexity, access to real-time feedback from your build pipeline can be the difference between successful and failed releases. Join Dominick from Splunk for five best practices successful teams adopt to propel software delivery to warp speed while increasing collaboration and breaking down silos. Spoiler alert: this session will include best practices for using analytics to correlate insights into a variety Atlassian tools including JIRA Service Desk, JIRA, HipChat, Bamboo, and more!
Domnick Eger, Global DevOps Practitioner, Splunk
stackconf 2021 | Why you should take care of infrastructure driftNETWAYS
As infrastructure as code (IaC) becomes widely adopted by users with heterogenous skillsets, and as IaC codebases become larger and larger, it becomes harder to track drift. Drift is a deviation between the actual infrastructure state and the IaC codebase. It causes issues for security posture management, collaborative work, and maintenance. There are a lot of juicy stories from the trenches to be told on infrastructure drift. Sure enough, we all do GitOps by the book! Or we all have the right processes in place. But we also have to interact with other teams. We also have to grant some level of access to our infrastructures to some services or tools that may eventually generate uncontrolled changes. You can’t efficiently improve what you don’t track. We track coverage for unit tests, why not infrastructure as code coverage? How can we make sure our infrastructure code matches our actual infrastructure state? In this talk, using Terraform with AWS resources, I will show how infrastructure drift can go undetected despite our best efforts or tooling and cause issues and end the talk by showing our own free and open source tool driftctl, (just released under Apache-2.0 licence) that tracks IaC coverage and warns of infrastructure drift.
Teaching Elephants to Dance (Federal Audience): A Developer's Journey to Digi...Burr Sutter
We can be brilliant developers, but we won’t succeed—and won’t lead our organizations to succeed—without a new perspective (if you will) and new assumptions about the components of the “technology ecosystem” that are fundamentally critical to our success. This includes the operators, QA team, DBAs, security folks, and even the pure business contingent—in most cases, each of these individuals and groups plays a critical role in the success of what we create and give birth to as developers. What we do in isolation might be genius, but if we insulate ourselves—especially with arrogance—from these colleagues, neither our code nor our organizations will realize their full potential, and most will fail. The bottom line is that our old ways are no longer viable, and as the elite within our industry, we will be the leaders and heroes who discard old assumptions and adopt a new perspective in this exciting journey to digital transformation—where the impossible can become reality.
Join this workshop and accelerate your journey to production-ready Kubernetes by learning the practical techniques for reliably operating your software lifecycle using the GitOps pattern. The Weaveworks team will be running a full-day workshop, sharing their expertise as users and contributors of Kubernetes and Prometheus, as well as followers of GitOps (operations by pull request) practices.
Using a combination of instructor led demonstrations and hands-on exercises, the workshop will enable the attendee to go into detail on the following topics:
• Developing and operating your Kubernetes microservices at scale
• DevOps best practices and the movement towards a “GitOps” approach
• Building with Kubernetes in production: caring for your apps, implementing CI/CD best practices, and utilizing the right metrics, monitoring tools, and automated alerts
• Operating Kubernetes in production: Upgrading and managing Kubernetes, managing incident response, and adhering to security best practices for Kubernetes
Developers love Git for its raw speed, distributed nature, and the fact that it was originally built by Linus Torvalds. What we don't love is the fact that, out of the box, Git has terrible support for tracking large binary files! Fortunately, developers from Atlassian and GitHub have created an open source project to solve this problem: Git LFS (Large File Support). This means researchers, web designers, game developers, multimedia producers, and all others who need to work with large data and rich media can move off legacy centralized systems and start using modern version control. This session will introduce Git LFS architecture, CLI and SourceTree usage, and how to build an effective Git LFS workflow with Bitbucket Server & Cloud for a professional software team.
Learn how Autodesk uses Git LFS at scale, how to avoid pitfalls, and how they ensure that their 4000+ engineers have Git and Git LFS properly installed and ready to use.
Products covered:
Bitbucket
If you missed the SpringOne Conference this year, don't fret! In this session you'll get the opportunity to get the highlights of the trip Jeroen and Tim made to Las Vegas and they'll show you the coolest stuff from Spring and CloudFoundry!
Swift has gone from being a closed project at Apple to an open-source language the community can help shape and evolve on many development platforms. With the support of the wider community, the evolution of Swift is looking very positive as users get ideas from a wide range of technical perspectives.
Presented by Karl Weinmeister at the Swift Summit, Nov 7th 2016
Introducing Pico - A Deep Learning Platform using Docker & IoT - Sangam Biradarsangam biradar
presented at https://events.docker.com/events/details/docker-hyderabad-presents-docker-hyderabad-meetup-19-docker-kubernetes-iot-docker101-workshop/
at MobileIron India
6th Floor, Western Pearl, Survey No. 13, Kondapur, Hitech City Rd, Kothaguda
Hyderabad, 500084
date : 14 sept 19
Triangle Devops Meetup covering Netflix open source, cloud architecture, and what Andrew did in his first year working as a senior software engineer in the cloud platform group.
Netflix and Containers: Not A Stranger Thingaspyker
Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. The Netflix streaming service had been powered by the Amazon cloud with virtual machines for over five years, blazing a trail for similar architectures. In the last year, it invested in containers for batch-style jobs and service-style applications. Andrew Spyker will explain the potential containers have to help Netflix create a more productive development experience while simultaneously deepening its control over resource management. Join Andrew to see why Netflix is moving forward with containers, how it can leverage its existing operational machinery, and how it’s running containers with a similar guarantee of high availability as current Netflix infrastructure provides.
Software Delivery at Warp Speed: Five Essential TechniquesAtlassian
The rise of microservices and containers has dramatically accelerated software delivery. With shorter release times and increased complexity, access to real-time feedback from your build pipeline can be the difference between successful and failed releases. Join Dominick from Splunk for five best practices successful teams adopt to propel software delivery to warp speed while increasing collaboration and breaking down silos. Spoiler alert: this session will include best practices for using analytics to correlate insights into a variety Atlassian tools including JIRA Service Desk, JIRA, HipChat, Bamboo, and more!
Domnick Eger, Global DevOps Practitioner, Splunk
stackconf 2021 | Why you should take care of infrastructure driftNETWAYS
As infrastructure as code (IaC) becomes widely adopted by users with heterogenous skillsets, and as IaC codebases become larger and larger, it becomes harder to track drift. Drift is a deviation between the actual infrastructure state and the IaC codebase. It causes issues for security posture management, collaborative work, and maintenance. There are a lot of juicy stories from the trenches to be told on infrastructure drift. Sure enough, we all do GitOps by the book! Or we all have the right processes in place. But we also have to interact with other teams. We also have to grant some level of access to our infrastructures to some services or tools that may eventually generate uncontrolled changes. You can’t efficiently improve what you don’t track. We track coverage for unit tests, why not infrastructure as code coverage? How can we make sure our infrastructure code matches our actual infrastructure state? In this talk, using Terraform with AWS resources, I will show how infrastructure drift can go undetected despite our best efforts or tooling and cause issues and end the talk by showing our own free and open source tool driftctl, (just released under Apache-2.0 licence) that tracks IaC coverage and warns of infrastructure drift.
Teaching Elephants to Dance (Federal Audience): A Developer's Journey to Digi...Burr Sutter
We can be brilliant developers, but we won’t succeed—and won’t lead our organizations to succeed—without a new perspective (if you will) and new assumptions about the components of the “technology ecosystem” that are fundamentally critical to our success. This includes the operators, QA team, DBAs, security folks, and even the pure business contingent—in most cases, each of these individuals and groups plays a critical role in the success of what we create and give birth to as developers. What we do in isolation might be genius, but if we insulate ourselves—especially with arrogance—from these colleagues, neither our code nor our organizations will realize their full potential, and most will fail. The bottom line is that our old ways are no longer viable, and as the elite within our industry, we will be the leaders and heroes who discard old assumptions and adopt a new perspective in this exciting journey to digital transformation—where the impossible can become reality.
Der Deutschen liebstes Kind ist nicht etwa der Hund oder das Auto, sondern ganz eindeutig der Tatort am Sonntagabend. Wenn man die App waipu.tv entwickelt, mit der die Kund*innen fernsehen und Aufnahmen machen können, ist diese Erkenntnis von entscheidender Bedeutung. Denn wie stellt man es an, dass sowohl das Backend als auch die Entwickler*innen während dieser Lastspitzen nicht ins Schwitzen kommen? Der Vortrag zeigt einige Best Practices aus dem realen Leben und könnte dabei Spuren von Microservices, DevOps, AWS, Monitoring, GitLab CI, Terraform etc. enthalten.
Speaker: Michael Bruns, inovex
Event: x-celerate, 09.10.2018
Mehr Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
Mehr Tech-Artikel: https://www.inovex.de/blog/
Slides of a talk given to the Seattle Chapter of the Cloud Security Alliance. Looks briefly at Architectures, Sources of Log Data, and behavioral signatures in the data and issues and observations around using Big Data products for security.
Google Cloud Kubernetes Engine (GKE) is a great and easy way to start exploring the powerful world of K8s without having to worry about creating a cluster completely on your own. We will introduce Traefik as an Ingress Controller for a freshly created cluster and show the power of it combined with the benefits of GKE.
I was asked to talk in front of Computer science students at the Bar-Ilan university about "what happens" when you don't care about writing "secured" or "safe" code. A perfect example for that, in my opinion, was the world of embedded computing AKA the IoT. I talked about the history of consumer embedded devices and showed a live demo of an 0day I found in one of the most popular routers in the country.
Deep dive nella supply chain della nostra infrastruttura cloudsparkfabrik
L'infrastruttura come codice e le applicazioni cloud-native consentono di raggiungere livelli senza precedenti di efficienza e governance dei nostri servizi cloud, rendendoci capaci di creare infrastrutture immutabili e ripetibili, di poterci operare come se fossero applicazioni quindi versionando il codice, qa e test automatici e procedure di rilascio automatiche verso gli ambienti di destinazione. Più inseriamo codice nelle nostre infrastrutture, più estendiamo la superficie di attacco. In questo talk, esaminerò gli attacchi alla catena di approvvigionamento a diversi livelli, come rilevarli e le tecniche per mitigarli e come scrivere codice IaC più sicuro.
AWS re:Invent 2016: IoT and Beyond: Building IoT Solutions for Exploring the ...Amazon Web Services
Jet Propulsion Laboratory is a well-known innovator in outer space, particularly in its search for "life out there". JPL is now innovating in the physical space to improve “life here". AWS IoT is critical to their innovations. See a re:Invent preview about how JPL, as an early adopter of AWS IoT, has prototyped voice control to ask questions of the room, the budget, or the system. They’ve also used it for controlling lights and sound to detect cyber security threats, rapid prototyping of robots, low-cost virtual windows to the outside, and much more. The results have been excellent. JPL will demonstrate and talk about these prototypes, including what worked and what didn’t. They will also share the promise integrated serverless computing holds.
The Hacking Games - Operation System Vulnerabilities Meetup 29112022lior mazor
Our technology, work processes, and activities all are depend based on Operation Systems to be safe and secure. Join us virtually for our upcoming "The Hacking Games - Operation System Vulnerabilities" Meetup to learn how hacker can compromise Operation System, bypass AntiVirus protection layer and exploiting Linux eBPF.
Smart Bombs: Mobile Vulnerability and ExploitationTom Eston
Kevin Johnson, John Sawyer and Tom Eston have spent quite a bit of time evaluating mobile applications in their respective jobs. In this presentation they will provide the audience an understanding of how to evaluate mobile applications, examples of how things have been done wrong and an understanding of how you can perform this testing within your organization.
This talk will work with applications from the top three main platforms; iOS, Android and Blackberry. Kevin, Tom and John have used a variety of the top 25 applications for each of these platforms to provide real world examples of the problems applications face.
FreeBSD: Looking forward to another 10 years by Jordan Hubbardeurobsdcon
Abstract
FreeBSD: Looking forward to another 10 years :
The FreeBSD project is now over 20 years old, and the Berkeley Software Distribution from which it originated is almost 40! The last 10 years have seen some fairly radical changes in the mobile and embedded computing markets, with the number of FreeBSD-based appliances also on the rise. What this means for FreeBSD, and what the project can learn from the various members of the Fortune 500 who have put BSD technology to good use, will be the topic of this presentation.
Similar to FOSDEM 2021 - Infrastructure as Code Drift & Driftctl (20)
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have.
For more Tendenci AMS events, check out www.tendenci.com/events
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Globus
The U.S. Geological Survey (USGS) has made substantial investments in meeting evolving scientific, technical, and policy driven demands on storing, managing, and delivering data. As these demands continue to grow in complexity and scale, the USGS must continue to explore innovative solutions to improve its management, curation, sharing, delivering, and preservation approaches for large-scale research data. Supporting these needs, the USGS has partnered with the University of Chicago-Globus to research and develop advanced repository components and workflows leveraging its current investment in Globus. The primary outcome of this partnership includes the development of a prototype enterprise repository, driven by USGS Data Release requirements, through exploration and implementation of the entire suite of the Globus platform offerings, including Globus Flow, Globus Auth, Globus Transfer, and Globus Search. This presentation will provide insights into this research partnership, introduce the unique requirements and challenges being addressed and provide relevant project progress.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
9. How It Started
A single source of truth!
Versioning!
The code is the documentation!
10. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
11. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
12. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
13. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
14. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
CI/CD!
15. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
CI/CD!
No more local stuff!
16. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
CI/CD!
No more local stuff!
Credentials under control!
17. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
CI/CD!
No more local stuff!
Credentials under control!
Multi-Cloud!
18. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
CI/CD!
No more local stuff!
Credentials under control!
Multi-Cloud!
Skills!
19. How It Started
A single source of truth!
Versioning!
The code is the documentation!
Testing!
Collaboration FTW!
Immutable Infrastructure!
GitOps!
CI/CD!
No more local stuff!
Credentials under control!
Multi-Cloud!
Skills! Time!
20. “Do not expect Plato's ideal republic”
Marcus Aurelius, Roman Emperor
(and hundreds of us in interview)
How It’s Going
21. ■ Changes happen outside of IaC (lambdas, scripts, manual…)
How It’s Going
22. ■ Changes happen outside of IaC (lambdas, scripts, manual…)
■ Commits don’t include the full scope of change
■ The code documents a partial reality (half-blind), borken processes
■ No one had time to learn & write IaC tests (and they are too costly to run anyway)
■ E_TOO_MANY_TEAMS ; async(false);
■ People still run terraform on their laptop, full CI/CD setup too complicated
■ The move to immutable infrastructure still didn’t happen last year, too bad
■ My [“boss”, “customer”, “coworker”] needs full console access for ${REASON}
■ All team members aren’t still skilled on every IaaS provider
■ Not everything that has an API is yet under IaC (GitHub etc.)
How It’s Going
23. ■ Drift!
How It’s Going
"Drift Car Demo" by iDream_in_Infrared is licensed under CC BY-NC-ND 2.0
24. ■ Drift!
How It’s Going
"Crash at St.Marys Corner - Andrew Beaumont - LDS Alfa Romeo - Glover Trophy practice - Goodwood Revival 2013 - Driver ok" by
PSParrot is licensed under CC BY 2.0
25. While we use and love Terraform (and other Hashicorp
products), Terraform is an excellent provisioner.
But it’s not a tool meant to manage what’s outside its scope!
And security / compliance tools are another type of software.
But...Terraform plan/apply!
33. driftctl
Our own open-source solution for drift management
■ AWS Support (more to come)
■ Terraform State support (local/S3)
■ Filtering & Ignore support
■ Written in Go
■ Apache 2.0 License
34. FLOSS CLI that tracks, analyzes, prioritizes, and warns of infrastructure drift
cloudskiff/driftctl
About driftctl
Take control of infrastructure drift