HashiCorp is an open-source software company based in San Francisco, California that solves development, operations, and security challenges in infrastructure so organizations can focus on business-critical tasks. HashiCorp provides a set of open source tools and commercial product offerings.
Docker at Shopify: From This-Looks-Fun to Production by Simon Eskildsen (Shop...Docker, Inc.
Since July 2014 Shopify's been serving thousands of requests per second of production web traffic from Docker containers. This was an 8 month effort, with multiple pivots of direction from the team—and we're only getting started. This talk covers the lessons learned through the trial and error of an in-flight architecture redesign, spanning hundreds of hosts, as well as the technical vision of the future of our platform.
Building a smarter application stack - service discovery and wiring for DockerTomas Doran
There are many advantages to a container based, microservices architecture - however, as always, there is no silver bullet. Any serious deployment will involve multiple host machines, and will have a pressing need to migrate containers between hosts at some point. In such a dynamic world hard coding IP addresses, or even host names is not a viable solution.
This talk will take a journey through how Yelp has solved the discovery problems using Airbnb’s SmartStack to dynamically discover service dependencies, and how this is helping unify our architecture, from traditional metal to EC2 ‘immutable’ SOA images, to Docker containers.
Docker at Shopify: From This-Looks-Fun to Production by Simon Eskildsen (Shop...Docker, Inc.
Since July 2014 Shopify's been serving thousands of requests per second of production web traffic from Docker containers. This was an 8 month effort, with multiple pivots of direction from the team—and we're only getting started. This talk covers the lessons learned through the trial and error of an in-flight architecture redesign, spanning hundreds of hosts, as well as the technical vision of the future of our platform.
Building a smarter application stack - service discovery and wiring for DockerTomas Doran
There are many advantages to a container based, microservices architecture - however, as always, there is no silver bullet. Any serious deployment will involve multiple host machines, and will have a pressing need to migrate containers between hosts at some point. In such a dynamic world hard coding IP addresses, or even host names is not a viable solution.
This talk will take a journey through how Yelp has solved the discovery problems using Airbnb’s SmartStack to dynamically discover service dependencies, and how this is helping unify our architecture, from traditional metal to EC2 ‘immutable’ SOA images, to Docker containers.
DEVNET-1144 Deploying hybrid cloud applications with HashiCorp AtlasCisco DevNet
Physical, virtual, containers. Public cloud, private cloud, hybrid cloud. IaaS, PaaS, SaaS. These are the choices that we're faced with when architecting a datacenter of today. And the choice is not one or the other; it is often a combination of many of these. How do we remain in control of our datacenters? How do we deploy and configure software, manage change across disparate systems, and enforce policy/security? How do we do this in a way that operations engineers and developers alike can rejoice in the processes and workflow? In this talk, I will discuss the problems faced by the modern datacenter, and how automation, workflows, and collaboration can be used to tame the rising complexity curve.
All the troubles you get into when setting up a production ready Kubernetes c...Jimmy Lu
Have you ever try to set up a Kubernetes cluster manually by your own? It may be a small dish to you to set one up on your laptop. However, things are getting harder and harder once you have more nodes to handle, not to mention you also want security, monitoring, auto-scaling, and federated cluster enabled in the production environments. With more features added, the situation gets even worse and more complicated. We developers in Linker Networks had put in a tremendous amount of time in investigating on how to set up Kubernetes clusters efficiently. We designed and built our own tools to automate and facilitate such the painful processes. In this talk, I'll go through all the details and pitfalls in setting up a production ready cluster. Hopefully, the experience I shared could keep you out of these troubles, saving your precious time.
No Docker? No Problem: Automating installation and config with AnsibleJeff Potts
In this talk I show how to bring stability and repeatability to your Alfresco installation by automating install and config management with Ansible.
This talk was originally given at Alfresco DevCon 2020 (virtual edition).
How HashiCorp platform tools can make the difference in development and deplo...Dmytro Mykhailov
This is slides from my talk on Kharkiv IT Weekend on May 27, 2017.
Here is link to my blog where you can find more information about the approaches:
https://devraccoon.com/2017/05/30/hashicorp-tools-on-it-weekend-kharkiv/
(Click 2nd slide for video) Deploy PHP apps faster in 2017. This talk focuses on how PHP developers can use simple Ansible scripts to rapidly configure new dev and production servers from scratch, and deploy their apps. No more "snowflake servers"!
This is a general introduction to DevOps essentials and Ansible, with a few extras for PHP developers, including some best practice tips and overview of two major Ansible-based PHP projects, Drupal-VM and Trellis (modern WordPress setup).
Kubernetes intro public - kubernetes user group 4-21-2015reallavalamp
Kubernetes Introduction - talk given by Daniel Smith at Kubenetes User Group meetup #2 in Mountain View on 4/21/2015.
Explains the basic concepts and principles of the Kubernetes container orchestration system.
A basic introduction to Kubernetes. Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.
Ansible is tool for Configuration Management. The big difference to Chef and Puppet is, that Ansible doesn't need a Master and doesn't need a special client on the servers. It works completely via SSH and the configuration is done in Yaml.
These slides give a short introduction & motivation for Ansible.
I used this slide to taking in Docker Hanoi Meetup (http://www.meetup.com/Docker-Hanoi/events/229929959/). I just want to share something about microservices and using Docker Swarm, Consul, Registrator to implement it.
How to use Ansible to automate your applications in AWS. What is Ansible and why is it different? How to control cloud deployments securely and how to control AWS resources using dynamic inventory and tags.
Ansible: How to Get More Sleep and Require Less CoffeeSarah Z
Why you need automation, configuration management and remote execution in your life. An intro to Ansible and how it can make your life in Ops infinitely easier.
DEVNET-1144 Deploying hybrid cloud applications with HashiCorp AtlasCisco DevNet
Physical, virtual, containers. Public cloud, private cloud, hybrid cloud. IaaS, PaaS, SaaS. These are the choices that we're faced with when architecting a datacenter of today. And the choice is not one or the other; it is often a combination of many of these. How do we remain in control of our datacenters? How do we deploy and configure software, manage change across disparate systems, and enforce policy/security? How do we do this in a way that operations engineers and developers alike can rejoice in the processes and workflow? In this talk, I will discuss the problems faced by the modern datacenter, and how automation, workflows, and collaboration can be used to tame the rising complexity curve.
All the troubles you get into when setting up a production ready Kubernetes c...Jimmy Lu
Have you ever try to set up a Kubernetes cluster manually by your own? It may be a small dish to you to set one up on your laptop. However, things are getting harder and harder once you have more nodes to handle, not to mention you also want security, monitoring, auto-scaling, and federated cluster enabled in the production environments. With more features added, the situation gets even worse and more complicated. We developers in Linker Networks had put in a tremendous amount of time in investigating on how to set up Kubernetes clusters efficiently. We designed and built our own tools to automate and facilitate such the painful processes. In this talk, I'll go through all the details and pitfalls in setting up a production ready cluster. Hopefully, the experience I shared could keep you out of these troubles, saving your precious time.
No Docker? No Problem: Automating installation and config with AnsibleJeff Potts
In this talk I show how to bring stability and repeatability to your Alfresco installation by automating install and config management with Ansible.
This talk was originally given at Alfresco DevCon 2020 (virtual edition).
How HashiCorp platform tools can make the difference in development and deplo...Dmytro Mykhailov
This is slides from my talk on Kharkiv IT Weekend on May 27, 2017.
Here is link to my blog where you can find more information about the approaches:
https://devraccoon.com/2017/05/30/hashicorp-tools-on-it-weekend-kharkiv/
(Click 2nd slide for video) Deploy PHP apps faster in 2017. This talk focuses on how PHP developers can use simple Ansible scripts to rapidly configure new dev and production servers from scratch, and deploy their apps. No more "snowflake servers"!
This is a general introduction to DevOps essentials and Ansible, with a few extras for PHP developers, including some best practice tips and overview of two major Ansible-based PHP projects, Drupal-VM and Trellis (modern WordPress setup).
Kubernetes intro public - kubernetes user group 4-21-2015reallavalamp
Kubernetes Introduction - talk given by Daniel Smith at Kubenetes User Group meetup #2 in Mountain View on 4/21/2015.
Explains the basic concepts and principles of the Kubernetes container orchestration system.
A basic introduction to Kubernetes. Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.
Ansible is tool for Configuration Management. The big difference to Chef and Puppet is, that Ansible doesn't need a Master and doesn't need a special client on the servers. It works completely via SSH and the configuration is done in Yaml.
These slides give a short introduction & motivation for Ansible.
I used this slide to taking in Docker Hanoi Meetup (http://www.meetup.com/Docker-Hanoi/events/229929959/). I just want to share something about microservices and using Docker Swarm, Consul, Registrator to implement it.
How to use Ansible to automate your applications in AWS. What is Ansible and why is it different? How to control cloud deployments securely and how to control AWS resources using dynamic inventory and tags.
Ansible: How to Get More Sleep and Require Less CoffeeSarah Z
Why you need automation, configuration management and remote execution in your life. An intro to Ansible and how it can make your life in Ops infinitely easier.
Whar are microservices and microservices architecture (MSA) How we reach them? Are they the same or SoA or not? When to use them? What are the key characteristics?
Slides of my talk given in #Gapand2017 in Andorra
Advanced dev ops governance with terraformJames Counts
DevOps project sprawl is real! Large organizations with many teams need to support a variety of configurations from infrastructure governance to domain-specific app deployments, all while enforcing good security practices like least privilege for each team. Maintaining these controls by hand leads to complexity, stagnation, and insecure shortcuts. In this session, you'll learn how Terraform can automate this configuration--using Terraform--and make doing the right thing easy!
You spend your precious time building the perfect application. You do everything right. You carefully craft every piece of code and rigorously follow the best practices and design patterns, you apply the most successful methodologies software engineering has to offer with discipline, and you pay attention to the most minuscule of details to produce the best user experience possible. It all pays off eventually, and you end up with a beautiful code base that is not only reliable but also performs well. You proudly watch your baby grow, as new users come in bringing more traffic your way and craving new features. You keep them happy and they keep coming back. One morning, you wake up to servers crashing under load, and data stores failing to keep up with all the demand. You panic. You throw in more hardware and try optimize, but the hungry crowd that was once your happy user base catches up to you. Your success is slipping through your fingers. You find yourself stuck between having to rewrite the whole application and a hard place. It's frustrating, dreadful, and painful to say the least. Don't be that guy! Save your soul before it's too late, and come to learn how to build, deploy, and maintain enterprise-grade Java applications that scale from day one. Topics covered include: parallelism, load distribution, state management, caching, big data, asynchronous processing, and static content delivery. Leveraging cloud computing, scaling teams and DevOps will also be discuss. P.S. This session is more technical than you might think.
http://jaxconf.com/sessions/economies-scaling-software
Hot to build continuously processing for 24/7 real-time data streaming platform?GetInData
You can read our blog post about it here: https://getindata.com/blog/how-to-build-continuously-processing-for-24-7-real-time-data-streaming-platform/
Hot to build continuously processing for 24/7 real-time data streaming platform?
The economies of scaling software - Abdel Remanijaxconf
You spend your precious time building the perfect application. You do everything right. You carefully craft every piece of code and rigorously follow the best practices and design patterns, you apply the most successful methodologies software engineering has to offer with discipline, and you pay attention to the most minuscule of details to produce the best user experience possible. It all pays off eventually, and you end up with a beautiful code base that is not only reliable but also performs well. You proudly watch your baby grow, as new users come in bringing more traffic your way and craving new features. You keep them happy and they keep coming back. One morning, you wake up to servers crashing under load, and data stores failing to keep up with all the demand. You panic. You throw in more hardware and try optimize, but the hungry crowd that was once your happy user base catches up to you. Your success is slipping through your fingers. You find yourself stuck between having to rewrite the whole application and a hard place. It's frustrating, dreadful, and painful to say the least. Don't be that guy! Save your soul before it's too late, and come to learn how to build, deploy, and maintain enterprise-grade Java applications that scale from day one. Topics covered include: parallelism, load distribution, state management, caching, big data, asynchronous processing, and static content delivery. Leveraging cloud computing, scaling teams and DevOps will also be discuss. P.S. This session is more technical than you might think.
Setting up an ONAP development environment is not easy. Development tools and practices are not collected in a single place. This project pretends to collect and standardize that process.
Having trouble managing dependencies with golang ? Here's how to resolve those issues using some of the best tools built by the community for the community.
Docker for the new Era: Introducing Docker,its components and toolsRamit Surana
Containers have been evolved from generations behind today.So what's new with Docker ? What has changed during the current scenario ? Find out more on docker and how to implement it in your environments in the above slide show.
CoreOS: The Inside and Outside of Linux ContainersRamit Surana
CoreOS is designed for security, consistency, and reliability. Instead of installing packages via yum or apt, it uses Linux containers to manage your services at a higher level of abstraction. A single service's code and all dependencies are packaged within a container that can be run on one or many CoreOS machines.
Introducing Docker Swarm - the orchestration tool by DockerRamit Surana
Swarm is native clustering for Docker containers. It pools together several Docker Engines into a single, virtual host. Point a Docker client or third party tool (e.g., Compose, Dokku, Shipyard, Jenkins, the Docker client, etc.) at Swarm and it will transparently scale to multiple hosts.
A brief study on Kubernetes and its componentsRamit Surana
Kubernetes is an open source orchestration system for Docker containers. It handles scheduling onto nodes in a compute cluster and actively manages workloads to ensure that their state matches the users declared intentions. Using the concepts of "labels" and "pods", it groups the containers which make up an application into logical units for easy management and discovery.
Sysdig - Introducing a new definition of MonitoringRamit Surana
Monitoring is an important aspect for any system.Have you been tired of using regular methods of monitoring on your systems ? With the introduction of Linux Containers solutions like Docker, are you searching for solutions that can help you to monitor container based activities ? Then sysdig is a solution that can solve all your problems.
Introducing Puppet - The faster speed of AutomationRamit Surana
Puppet IT automation is a software that uses Puppet's declarative language to manage various stages of the IT infrastructure life cycle, including the provisioning, patching, configuration, and management of operating system and application components across enterprise data centers and cloud infrastructures
Introducing Chef | An IT automation for speed and awesomenessRamit Surana
Chef turns infrastructure into code. With Chef, you can automate how you build, deploy, and manage your infrastructure.
It is a powerful automation platform that transforms complex infrastructure into code, bringing your servers and services to life.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
2. Agenda
• Introduction to Hashicorp
• Why Hashicorp
• Hashicorp projects
• Vagrant
• Packer
• Serf
• Vault
• Consul
• Terraform
• Consul
3. Who am I?
• Open source guy.
• Foodie, traveler,Explorer
• Join me on my network,
I promise I won't bite :)
• Twitter: @ramitsurana
• Github: @ramitsurana
• Linkedin: /in/ramitsurana
• Mail: ramitsurana@gmail.com
4. Who is Hashicorp ?
• Hashicorp is a Devops tools and
product building company.
• Using Hashicorp tools we can
automate & redesign the
company's infrastructure.
• Its open-source.
5. The Tao of Hashicorp
• The tao represents
• The foundation that guides the
vision, roadmap, and product
design.
• Workflows
• Immutability
• Simple, Modular, Composable
9. Vagrant
• Tool for building complete
development environments.
• Machines are provisioned on top
of VirtualBox, VMware, AWS, or
any other provider.
10. Vagrantfiles
• Used to describe the type of
machine required for a project,
and how to configure and
provision these machines.
• Vagrantfiles are portable across
every platform Vagrant supports.
• Vagrant is meant to run with one
Vagrantfile per project.
12. Packer
• Tool for creating identical
machine images for multiple
platforms from a single source
configuration.
• Packer is lightweight, runs on
every major operating system,
and is highly performant,
creating machine images for
multiple platforms in parallel.
15. Consul
• Tool for discovering and
configuring services in your
infrastructure.
• Consul makes it simple for
services to register themselves
and to discover other services
via a DNS or HTTP interface.
17. Jespen Testing
• A Jepsen test runs as a Clojure program on a control node.
• Jepsen has been used to verify everything from eventually-consistent
commutative databases to linearizable coordination systems to
distributed task schedulers.
• Check out more info on it at https://github.com/aphyr/jepsen.
19. Serf
• It is a tool for cluster
membership, failure detection,
and orchestration that is
decentralized, fault-tolerant and
highly available.
• It relies on an efficient and
lightweight gossip protocol to
communicate with nodes.
20. Gossip Protocol
• It is a tool for cluster membership,
failure detection, and orchestration
that is decentralized, fault-tolerant
and highly available.
• Modern distributed systems often
use gossip protocols to solve
problems that might be difficult to
solve in other ways, either because
the underlying network has an
inconvenient structure, is
extremely large, or because gossip
solutions are the most efficient
ones available.
22. Otto
• Otto automatically builds an
infrastructure and deploys your
application using industry
standard tooling and best
practices.
• Otto automatically fetches
dependencies, detects conflicts,
and installs and configures these
dependencies for development
and deployment.
23. Appfile
• The file that Otto uses as a
source of configuration for an
application.
• Otto takes this file and compiles
it to an internal representation
that is used by all the Otto
subcommands.
25. Terraform
• Tool for building, changing, and
versioning infrastructure safely
and efficiently.
• It can manage existing and
popular service providers as well
as custom in-house solutions.
• The manage includes low-level
components such as compute
instances, storage, and
networking, as well as high-level
components such as DNS
entries, SaaS features, etc.
26. Resource Graph
• It builds a dependency graph
from the Terraform
configurations, and walks this
graph to generate plans, refresh
state, and more.
• To walk the graph, a standard
depth-first traversal is done.
27. Resource Addressing
• It is a string that references a specific resource in a larger
infrastructure.
• It is made up of two parts:
• Module path:
• A module path addresses a module within the tree of modules.
• Resource spec:
• A resource spec addresses a specific resource in the config.
29. Vault
• It secures, stores, and tightly
controls access to tokens,
passwords, certificates, API keys,
and other secrets in modern
computing.
• Vault encrypts and provides
access to any secrets.
• Every secret in Vault is
associated with a lease. Clients
must renew their secret within
the lease period, or request a
new secret.
31. Shamir's Secret Sharing
• It is a form of secret sharing,
where a secret is divided into
parts, giving each participant its
own unique part.
• The parts or all of them are
needed in order to reconstruct
the secret.
32. 2 man rule
• Control mechanism designed to
achieve a high level of security
for especially critical material or
operations.
• Under this rule all access and
actions requires the presence of
two authorized people at all
times.
How I remember it.
P.S: Must Watch Show
34. Nomad
• Tool for managing a cluster of
machines and running
applications on them.
• It abstracts away machines and
the location of applications, and
instead enables users to declare
what they want to run and
Nomad handles where they
should run and how to run
them.
36. Consensus Protocol
• It is related to CAP Theorem.
• Built using go-raft library.
• Consists of 3 Roles :
- The Leader
- The Follower
- The Candidate
38. Atlas
• Atlas deeply integrates
HashiCorp open source tools to
provide an enterprise delivery
pipeline.
• Atlas deeply integrates
HashiCorp open source tools to
provide an enterprise delivery
pipeline.