Providing CI / CD as a Service - AWS Summit Sydney April 2015

•

8 likes•4,067 views

Peter Leschev

A Build Engineering Team’s Journey of scaling a CI/CD platform that is used within a fast growing company

Technology

PETER LESCHEV • TEAM LEAD • ATLASSIAN • @PETERLESCHEV
Build Engineering @ Atlassian:
Providing CI / CD as a Service
AWS Summit Sydney - April 2015

SCALING THE BUILD GRID
INTRODUCTION
Introduction
AWS ADVANTAGES
FUTURE STATE

Build platform & services
used internally within
Atlassian to
build, test & deliver
software

Developers expect a
reliable infrastructure &
fast CI feedback

Build Engineering today @ Atlassian
• 10 Bamboo Servers
• maven.atlassian.com / 6 Nexus instances
• Monitoring - opsview / graphite / statsd
• 1000 build agents (own hardware + EC2 instances)
• include SCM clients, JDKs, JVM build tools, databases,
headless browser testing, python builds, NodeJS, installers
& more
• Maintain 20 AMIs of various build conﬁgurations
• Nexus proxies

SCALING THE BUILD GRID
INTRODUCTION
Scaling the Build Grid
AWS ADVANTAGES
FUTURE STATE

Own Hardware
using KVM guests
+
EC2 instances

Differences between KVM
guests & elastic build agents
+
the need for
Functional Parity

Problem 1:
Network connectivity
differences

Solution:
AWS Direct Connect
+ VPC enabled EC2
instances

Problem 2:
Configuration
differences between
KVM guests & elastic
build agents

Solution:
Removing tech debt using
https://www.packer.io/ https://www.atlassian.com/software/bamboohttps://puppetlabs.com/ https://cukes.info/

SCALING THE BUILD GRID
INTRODUCTION
AWS Advantages
AWS ADVANTAGES
FUTURE STATE

Prices always decreasing
Product range expanding
https://aws.amazon.com/blogs/aws/category/price-reduction/

‘Do Not Resuscitate’
order on existing
build agent hardware

Prebake at AMI
burn time rather
than at EC2
instance startup
time

More reliable
instance startup
(+ retry on failure!)

Pre-caching of
git repositories,
docker images

“RequestLimitExceeded.
The maximum request rate
permitted by the Amazon
EC2 APIs has been exceeded
for your account”

Handle failure,
retry with backoff
& recover

“We currently do not have
sufficient m3.large capacity in
the Availability Zone you
requested”

“we are experiencing
increased error rates
and latencies for the
EC2 APIs”

SCALING THE BUILD GRID
INTRODUCTION
Future State
AWS ADVANTAGES
FUTURE STATE

Thank you!
PETER LESCHEV • TEAM LEAD • ATLASSIAN • @PETER LESCHEV

Today’s cutting-edge companies have software release cycles measured in days instead of months. This agility is enabled by the DevOps practice of continuous delivery, which automates building, testing, and deploying all code changes. This automation helps you catch bugs sooner and accelerates developer productivity. In this session, we’ll share the processes that Amazon’s engineers use to practice DevOps and discuss how you can bring these processes to your company by using a new set of AWS tools (AWS CodePipeline and AWS CodeDeploy). These services were inspired by Amazon's own internal developer tools and DevOps culture.

Agile Deployment using Git and AWS Elastic Beanstalk

Amazon Web Services

AWS Elastic Beanstalk is the fastest and simplest way to get an application up and running on Amazon Web Services. Developers can simply upload their application code and the service automatically handles all the details such as resource provisioning, load balancing, auto-scaling, and monitoring. This session shows you how to connect your Git repository with Amazon Web Services, deploy your code to AWS Elastic Beanstalk, easily enable or disable application functionality, and perform zero-downtime deployments through interactive demos and code samples.

無伺服器架構和Containers on AWS入門

Amazon Web Services

在無伺服器架構下，各位不需管理基礎架構資源，即可製作及佈建應用程式與服務，以往得預留伺服器空間與規模，才能運作應用程式碼、安裝與操作分散式資料庫、製作與運作處理API 需求的客製化軟體，如今AWS提供具備規模彈性及充分管理的服務堆疊，省去各種營運複雜事項。本場次將說明無伺服器架構的優點，以及AWS提供的無伺服器堆疊基本內容，並介紹如何將無伺服器架構用於各種需求，如資料處理及行動與網路後端。

An introduction to serverless architectures (February 2017)

Julien SIMON

基于Aws的持续集成、交付和部署代闻

Mason Mei

IaC로 AWS인프라 관리하기 - 이진성 (AUSG) :: AWS Community Day Online 2021

AWSKRUG - AWS한국사용자모임

This document discusses managing AWS infrastructure using Infrastructure as Code (IaC). It begins by describing some limitations of manually managing resources through the AWS Console, such as not being able to easily track resource history or rollback changes. It then introduces AWS Cloud Development Kit (CDK) as a framework for defining cloud infrastructure as code using templates. CDK allows infrastructure to be managed programmatically like code, enabling easier version control, testing, and multi-environment deployments compared to manual methods. Some examples of using CDK to define VPCs, security groups, and deploying Fargate tasks and RDS instances are also provided. Lastly, some limitations of CDK are discussed.

AWS Summit Seoul 2015 - 일본 AWS 게임 고객사례 - Gungho, Grani, Nintendo를 중심으로

Amazon Web Services Korea

This document discusses gaming on AWS in Japan. It begins with an introduction by Shinpei Ohtani from Amazon Data Services Japan. It then discusses typical mobile gaming architectures on AWS, including using EC2, RDS, S3, CloudFront, Route53, and ElastiCache. It provides use case examples of major Japanese gaming companies using AWS, including Nintendo's Miiverse, the browser-based game Grani, mobile game developer GungHo Online Entertainment, and Bandai Namco Studio's use of AWS OpsWorks for automation. Key benefits highlighted include the ability to scale quickly on AWS, focus on development rather than infrastructure, and leverage AWS services and support.

NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing on Amaz...

Amazon Web Services

AWS Batch is a fully-managed service that enables developers, scientists, and engineers to easily and efficiently run batch computing workloads of any scale on AWS. AWS Batch automatically provisions compute resources and optimizes the workload distribution based on the quantity and scale of the workloads. With AWS Batch, there is no need to install or manage batch computing software, allowing you to focus on analyzing results and solving problems. AWS Batch plans, schedules, and executes your batch computing workloads across the full range of AWS compute services and features, such as Amazon EC2, Spot Instances, and AWS Lambda. AWS Batch reduces operational complexities, saving time and reducing costs. In this session, Principal Product Managers Jamie Kinney and Dougal Ballantyne describe the core concepts behind AWS Batch and details of how the service functions. The presentation concludes with relevant use cases and sample code.

The document discusses AWS services for DevOps workflows including infrastructure as code (AWS CloudFormation), container management (Amazon ECS and ECR), continuous integration and delivery (AWS CodeCommit, CodeBuild, CodeDeploy, CodePipeline). It provides an overview of each service and examples of how they can be used together in a continuous deployment pipeline to develop, build, test and deploy applications on AWS.

SEC302 Becoming an AWS Policy Ninja using AWS IAM and AWS Organizations

Amazon Web Services

Are you interested in becoming an expert in managing access to your AWS resources? Have you ever wondered how to best scope down permissions for least privilege access? Do you have multiple AWS accounts and need to know how to manage access to resources centrally? In this session, we take an in-depth look at AWS Identity and Access Management (IAM) and AWS Organizations. You will learn how to quickly create IAM policies to manage fine-grained access to your resources. Throughout the session, we will cover common use cases, such as how to grant a user access to an Amazon S3 bucket or permissions to launch an Amazon EC2 instance of a specific type. You will also learn how to create and use Service Control Policies (SCPs) through Organizations to manage AWS service use across all your accounts centrally.

Getting Started with AWS IoT

Amazon Web Services

AWS IoT is a managed cloud platform that lets connected devices easily and securely interact with cloud applications and other devices. In this session, we will discuss how constrained devices can leverage AWS IoT to send data to the cloud and receive commands back to the device using the protocol of their choice. We will discuss how devices can connect securely using MQTT and HTTP protocols, and how can developers and businesses can leverage the AWS IoT Rules Engine, Thing Shadows, and accelerate prototype development using AWS IoT Device SDKs. We will cover major hardware platforms from Arduino, Marvell, Dragonboard and MediaTek.

Continuous Deployment Practices, with Production, Test and Development Enviro...

Amazon Web Services

With AWS companies now have the ability to develop and run their applications with speed and flexibility like never before. Working with an infrastructure that can be 100% API driven enables businesses to use lean methodologies and realize these benefits. This in turn leads to greater success for those who make use of these practices. In this session we'll talk about some key concepts and design patterns for Continuous Deployment and Continuous Integration, two elements of lean development of applications and infrastructures.

Container Management on AWS with ECS, Docker and Blox - Level 400

Amazon Web Services

Managing and scaling hundreds of containers is a challenging task. A container management solution takes care of these challenges for you, allowing you to focus on developing your application. We will discuss how to run well-architected container based applications at scale on ECS. We will dive deep into scaling, custom scheduling and secrets management. We will also briefly cover extending ECS using Blox and some alternative container solutions that are supported by AWS. Speakers: Richard Busby, Principal Solutions Architect Shiva Narayanaswamy, Development Team Lead, Envato

AWSの進化とSmartNewsの裏側

SmartNews, Inc.

SmartNews has evolved its use of AWS over time from a monolithic application to microservices as its scale increased. It now uses over 300 EC2 instances, 80 ELBs, and many other AWS services. Configuration management has moved from pull-style deploys to using tools like CodeDeploy, Auto Scaling Groups, and infrastructure as code. Future plans include further containerization and event aggregation to improve scalability, safety, and measureability across services.

Introduction to Amazon Lightsail

Amazon Web Services

This document provides an introduction to Amazon Lightsail, which is described as the easiest way to get started on AWS. It offers virtual private servers with SSD-based storage, networking capabilities, and access to additional AWS services through VPC peering or public endpoints. Lightsail can be used for simple websites, development/test environments, and business applications. It allows users to launch instances with one-click, attach storage, manage access control and security groups, and includes tools like SSH access, DNS management, and snapshots. The document demonstrates how Lightsail can be connected to other AWS services and grown over time to support more advanced use cases and workloads.

AWS January 2016 Webinar Series - Introduction to Deploying Applications on AWS

Amazon Web Services

Based on your specific needs and the nature of your application, AWS offers a variety of services for getting your application up and running. You may want to launch and scale a web application or you may want to host a microservices application using Docker containers. How do you decide which service to use and when? In this webinar, we will provide an overview of the AWS services that help simplify launching and running your application in the cloud. We will discuss the strengths of each service and provide a framework for understanding when to use them. Learning Objectives: Understand the primary services for deploying your application on AWS Learn the basics of AWS Elastic Beanstalk, AWS CodeDeploy, and Amazon EC2 Container Service Gain an understanding of the strengths of each service and when to use them Who Should Attend: Developers, DevOps Engineers, IT Professionals

Scaling on AWS for the First 10 Million Users

Amazon Web Services

This document provides guidance on scaling infrastructure on AWS for handling large numbers of users, from 1 user to over 10 million users. It discusses starting simply with a single EC2 instance and database, then expanding horizontally and vertically by adding more instances, separating tiers, using auto-scaling, and implementing a service-oriented architecture. As the number of users grows from thousands to millions, it recommends techniques like database read replicas, DynamoDB, ElastiCache, SQS/SNS, and database sharding or federation. Monitoring, metrics, and outsourcing management are also emphasized as critical pieces for large-scale applications.

Introduction to AWS X-Ray

Amazon Web Services

AWS X-Ray helps debug and monitor applications in production by providing visibility into requests across various services. It captures tracing data from AWS services, HTTP requests, and database operations. The tracing data can be used to visualize service graphs, identify performance bottlenecks, and pinpoint issues to specific services. AWS X-Ray is available in preview and provides free tiers for tracing and retrieval with additional charges for higher volumes.

Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심

Amazon Web Services Korea

AWS Summit Seoul 2015 - AWS 최신 서비스 살펴보기 - Aurora, Lambda, EFS, Machine Learn...

Amazon Web Services Korea

VMware and AWS together (June 2017)

Julien SIMON

VMware on AWS enables customers to run VMware workloads on AWS. It removes barriers to hybrid cloud adoption by providing consistent networking and operational experience between on-premises and AWS environments. Key services that integrate well include Amazon S3 for object storage, Amazon RDS for databases, Amazon Redshift for data warehousing, Amazon Rekognition for image recognition, and Amazon Polly for text-to-speech.

A 60-minute tour of AWS Compute (November 2016)

Julien SIMON

컴퓨팅 서비스 업데이트 - EC2, ECS, Lambda (김상필) :: re:Invent re:Cap Webinar 2015

Amazon Web Services Korea

- The document summarizes updates to Amazon EC2, EC2 Container Service, and AWS Lambda computing services. - For EC2, new X1 instances with over 100 vCPUs and 2 TB memory were announced for in-memory applications. New T2.nano instances and dedicated hosts were also mentioned. - For ECS, a new container registry service was highlighted. Scheduler improvements and expanded Docker configuration options were noted. - For Lambda, added support for Python, longer function durations, scheduled functions, and versioning were summarized.

서버리스(Serverless) 프레임웍 비교 - ClaudiaJS와 Chalice를 중심으로 (윤석찬)

AWSKRUG - AWS한국사용자모임

The document compares serverless frameworks ClaudiaJS and Chalice. ClaudiaJS is described as a simple and robust deployment utility for serverless applications on AWS, while Chalice is a Python serverless microframework for AWS. Key differences are that ClaudiaJS supports Node.js and Python runtimes, while Chalice is exclusively for Python. ClaudiaJS enables some unit testing for Lambda functions, while Chalice does not support unit testing. Both aim to simplify deploying and managing serverless applications on AWS.

AWS Deployment Best Practices

Amazon Web Services

T1 – Architecting highly available applications on aws

Amazon Web Services

The document discusses architecting highly available applications on AWS. It begins with an overview of AWS services and best practices for scalability. It then walks through scaling an application from 1 user to over 1 million users, starting with a single EC2 instance and gradually introducing services like Auto Scaling, load balancing, database read replicas, caching, and separating components. The document emphasizes loose coupling of services, automation, and monitoring to allow scalability.

AWS CloudFormation Best Practices

Amazon Web Services

Architecting on The Cloud

Amazon Web Services

Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras...

Peter Leschev

( jenkins, docker ) -> { Continuous Delivery }

Nicolas De Loof

The document discusses the use of Docker and Jenkins for continuous delivery and orchestration. It addresses how automation is key and shows the typical continuous delivery pipeline with stages for source control, testing, building, staging and production. Plugins, separation of concerns, and toolchains are mentioned. The future of Jenkins is discussed as including multi-branch workflows and integrating Docker through "pods" and combining Docker and workflow functionality.

What's hot

The AWS DevOps combo (January 2017)

Julien SIMON

SEC302 Becoming an AWS Policy Ninja using AWS IAM and AWS Organizations

Amazon Web Services

Getting Started with AWS IoT

Amazon Web Services

Continuous Deployment Practices, with Production, Test and Development Enviro...

Amazon Web Services

Container Management on AWS with ECS, Docker and Blox - Level 400

Amazon Web Services

AWSの進化とSmartNewsの裏側

SmartNews, Inc.

Introduction to Amazon Lightsail

Amazon Web Services

AWS January 2016 Webinar Series - Introduction to Deploying Applications on AWS

Amazon Web Services

Scaling on AWS for the First 10 Million Users

Amazon Web Services

Introduction to AWS X-Ray

Amazon Web Services

Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심

Amazon Web Services Korea

AWS Summit Seoul 2015 - AWS 최신 서비스 살펴보기 - Aurora, Lambda, EFS, Machine Learn...

Amazon Web Services Korea

VMware and AWS together (June 2017)

Julien SIMON

A 60-minute tour of AWS Compute (November 2016)

Julien SIMON

컴퓨팅 서비스 업데이트 - EC2, ECS, Lambda (김상필) :: re:Invent re:Cap Webinar 2015

Amazon Web Services Korea

서버리스(Serverless) 프레임웍 비교 - ClaudiaJS와 Chalice를 중심으로 (윤석찬)

AWSKRUG - AWS한국사용자모임

AWS Deployment Best Practices

Amazon Web Services

T1 – Architecting highly available applications on aws

Amazon Web Services

AWS CloudFormation Best Practices

Amazon Web Services

Architecting on The Cloud

Amazon Web Services

What's hot (20)

The AWS DevOps combo (January 2017)

SEC302 Becoming an AWS Policy Ninja using AWS IAM and AWS Organizations

Getting Started with AWS IoT

Continuous Deployment Practices, with Production, Test and Development Enviro...

Container Management on AWS with ECS, Docker and Blox - Level 400

AWSの進化とSmartNewsの裏側

Introduction to Amazon Lightsail

AWS January 2016 Webinar Series - Introduction to Deploying Applications on AWS

Scaling on AWS for the First 10 Million Users

Introduction to AWS X-Ray

Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심

AWS Summit Seoul 2015 - AWS 최신 서비스 살펴보기 - Aurora, Lambda, EFS, Machine Learn...

VMware and AWS together (June 2017)

A 60-minute tour of AWS Compute (November 2016)

컴퓨팅 서비스 업데이트 - EC2, ECS, Lambda (김상필) :: re:Invent re:Cap Webinar 2015

서버리스(Serverless) 프레임웍 비교 - ClaudiaJS와 Chalice를 중심으로 (윤석찬)

AWS Deployment Best Practices

T1 – Architecting highly available applications on aws

AWS CloudFormation Best Practices

Architecting on The Cloud

Viewers also liked

Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras...

Peter Leschev

( jenkins, docker ) -> { Continuous Delivery }

Nicolas De Loof

20161029 agile tour2016-playgame

Staff Agile66

Define Your Data (Science) Career

Data Science Thailand

This document discusses defining one's career in data and the rise of data science. It outlines the roles of data scientists and other data professionals on a data science team. The roles include data scientist, data engineer, data analyst, and others working together to extract insights from big data using tools like Hadoop and data lakes. The goal is to turn data into value through analytics, products, and visualizations.

Wongnai Engineering Story

Pattrawoot Suesatayasilp

Coding defines reality

Varokas Panusuwan

1. The document discusses principles of emergent design including contextual force, patterns, commonality variability analysis, and programming by intention. 2. Commonality variability analysis involves identifying what is common and what varies across different contexts for a given problem. 3. Programming by intention focuses on conceptualizing what you want to do at a high level before implementing technical details.

Infra for startup

Sira Sujjinanont

This document discusses the journey of Jitta in moving their infrastructure from self-managed servers to Google Cloud services. Some key points: - Jitta initially deployed their application on Heroku but faced issues with slow performance and random outages. - They then tried managing their own infrastructure but struggled to maintain all the microservices as the company grew. - Jitta eventually migrated to Google Container Engine which provides automated scaling and management of containers, allowing their engineers to focus more on development. - The document emphasizes that infrastructure choices need to match each startup's specific needs and cautions there is no single right solution, only lessons learned from mistakes.

BuzzFeed Pitch Deck

Tech in Asia ID

Contently Pitch Deck

Ryan Gum

Pendo Series B Investor Deck External

Todd Olson

Pendo is a Raleigh, NC-based company founded in 2013 that provides an integrated platform for capturing user behavior data, providing product analytics, and delivering personalized in-app guidance. The platform helps various teams across organizations like customer success, marketing, engineering, and product management. Some key customers highlighted in the presentation include Infor, Sprinklr, and Henry Schein. Pendo is targeting continued growth in annual recurring revenue and moving further upmarket towards larger enterprise customers. The company is seeking a $15 million Series B funding round in Q1 of fiscal year 2018.

Tinder Pitch Deck

Ryan Gum

Airbnb Pitch Deck From 2008

Ryan Gum

Intercom's first pitch deck!

Eoghan McCabe

Front series A deck

Mathilde Collin

Mattermark 2nd (Final) Series A Deck

Danielle Morrill

The investor presentation we used to raise 2 million dollars

Mikael Cho

Foursquare's 1st Pitch Deck

Rami Al-Karmi

Linkedin Series B Pitch Deck

Joseph Hsieh

Mixpanel - Our pitch deck that we used to raise $65M

Suhail Doshi

The slide deck we used to raise half a million dollars

Buffer

Viewers also liked (20)

Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infras...

( jenkins, docker ) -> { Continuous Delivery }

20161029 agile tour2016-playgame

Define Your Data (Science) Career

Wongnai Engineering Story

Coding defines reality

Infra for startup

BuzzFeed Pitch Deck

Contently Pitch Deck

Pendo Series B Investor Deck External

Tinder Pitch Deck

Airbnb Pitch Deck From 2008

Intercom's first pitch deck!

Front series A deck

Mattermark 2nd (Final) Series A Deck

The investor presentation we used to raise 2 million dollars

Foursquare's 1st Pitch Deck

Linkedin Series B Pitch Deck

Mixpanel - Our pitch deck that we used to raise $65M

The slide deck we used to raise half a million dollars

Similar to Providing CI / CD as a Service - AWS Summit Sydney April 2015

Day 3 - DevOps Culture - Continuous Integration & Continuous Deployment on th...

Amazon Web Services

This document discusses continuous integration (CI) and continuous deployment (CD) workflows on AWS. It provides examples of CI/CD pipelines and tools. It also demonstrates how to automate infrastructure deployment and management using AWS services like CloudFormation, containerization with Docker, and extending CI/CD tools to interact with AWS APIs. The document concludes with a discussion on how to implement best practices for innovation, quality and governance in CI/CD processes.

SRV409 Deep Dive on Microservices and Docker

Amazon Web Services

This document provides an overview of microservices architecture and how BuzzFeed uses it with Amazon ECS and Docker containers. It discusses the benefits of microservices and characteristics. It then details how BuzzFeed developed their WatchBot platform on Amazon ECS, including that they now have over 400 services deployed across 7 clusters in 2 regions, with over 180 users and 39,000 deploys. The document also discusses lessons learned in developing the platform and current challenges.

Making sense of containers, docker and Kubernetes on Azure.

Nills Franssens

This document provides an overview of Azure container services and tools for developing, deploying and managing containerized applications on Azure. It introduces Azure Container Service (AKS) for deploying and managing Kubernetes clusters, Azure Container Instances (ACI) for running containers without managing infrastructure, and Azure Container Registry for storing container images. It also discusses tools like Draft, Helm and Promitor that simplify container development, deployment and monitoring processes on Azure.

Increase Speed and Agility with Amazon Web Services

Amazon Web Services

Increase Speed and Agility with Amazon Web Services

Amazon Web Services

The document discusses how AWS services can help organizations increase speed and agility. It provides an overview of AWS services for compute, storage, databases, analytics and more. It also discusses how AWS enables continuous delivery and automation through services like CodeDeploy, CodePipeline, CloudFormation and Elastic Beanstalk. The document argues that AWS allows organizations to provision resources on demand, pay as they go, and build infrastructure as code.

Fundamentals of Cloud Computing & AWS

Bhuvaneswari Subramani

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Boaz Ziniman

Cloud Architecture: Patterns and Best Practices

Sascha Möllering

This document discusses scaling applications in the AWS cloud. It begins with an overview of AWS services like EC2, S3, RDS, and ELB. It then walks through creating a simple cloud application and database, and improving it by separating components, adding redundancy, caching, and autoscaling. A real-world example is shown using Vert.x, Kinesis, Docker, and deployment scripts to dynamically scale a streaming data application across Availability Zones.

AWS Webcast - Build Agile Applications in AWS Cloud for Government

Amazon Web Services

Aws container webinar day 2

HoseokSeo7

This document discusses infrastructure as code (IaC) tools for Amazon EKS clusters. It provides information on Terraform, AWS CDK, and eksctl for provisioning EKS infrastructure. It also covers continuous integration/continuous deployment (CI/CD) concepts and tools like Jenkins, Spinnaker, and AWS Code services. Logging tools like Sumologic, Elasticsearch, and Amazon CloudWatch Logs are compared for collecting and analyzing EKS logs. Monitoring of EKS clusters using Prometheus, Grafana, and Weave Scope is also discussed.

Amazon Container 환경의 보안 – 최인영, AWS 솔루션즈 아키텍트:: AWS 온라인 이벤트 – 클라우드 보안 특집

Amazon Web Services Korea

Managing Your Application Lifecycle on AWS: Continuous Integration and Deploy...

Amazon Web Services

In this session you’ll learn best practices for managing your application lifecycle with these tools with a particular focus on development speed and release agility. Through interactive demonstrations, this session shows you how to get an application running using AWS Elastic Beanstalk, CloudFormation and CodeDeploy. You will also see how advanced techniques such as blue/green deployment, AMI baking, customer resources and in-place deployment reduce deployment friction and rapid change in your environment.

Devops continuousintegration and deployment onaws puttingmoneybackintoyourmis...

Emerson Eduardo Rodrigues Von Staffen

DevOps, Continuous Integration & Deployment on AWS discusses practices for software development on AWS including DevOps, continuous integration, continuous delivery, and continuous deployment. It provides an overview of AWS services that can be used at different stages of the software development lifecycle such as CodeCommit for source control, CodePipeline for release automation, and CodeDeploy for deployment. National Novel Writing Month (NaNoWriMo) maintains its websites and services on AWS to support its annual writing challenge. It migrated to AWS to improve uptime and scalability. Its future goals include porting older sites to Rails, using Amazon SES for email, load balancing with ELB, implementing auto scaling, and using services like CodeDeploy, SNS

DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...

Amazon Web Services

Organizations around the globe are leveraging the cloud to accomplish world-changing missions. This session will address how AWS can help organizations put more money toward their mission and scale outreach and operations to achieve more with less. Hear some of AWS’s most advanced customers on how their organizations handle DevOps, continuous integration and deployment. Learn how these practices allow them to rapidly develop, iterate, test and deploy highly-scalable web applications and core operational systems on AWS. The discussion will focus on best practices, lessons learned, and the specific technologies and services they use.

Microservices and serverless for MegaStartups - DLD TLV 2017

Boaz Ziniman

Boaz Ziniman, a technical evangelist at AWS, presented on microservices and serverless architectures for mega startups. He discussed how monolithic architectures can limit agility and discussed how microservices help address these issues by decomposing applications into independently deployable services. He then explained how serverless computing removes the need to manage servers by allowing developers to run code without provisioning or managing servers. Examples of serverless offerings from AWS like AWS Lambda were provided. Common use cases for microservices and serverless architectures like web applications, backends, and data processing were also outlined.

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

Pahud Hsieh

This document summarizes a presentation about best practices for AWS ECS and serverless architectures. It discusses the challenges of traditional infrastructures and benefits of containerization. It provides an overview of AWS ECS for container management and auto-scaling capabilities. It also introduces AWS Lambda and API Gateway for building serverless applications, including their advantages of being cloud-native and cost-effective with minimal infrastructure to manage. Some limitations of serverless architectures are also outlined. The conclusion encourages embracing immutable infrastructure, event-driven computing, and focusing on business logic over infrastructure when possible.

ECS and Docker at Okta

Jon Todd

The value of containers is widely touted, but running them securely at scale and in long lived production environments presents new challenges. Amazon EC2 Container Service (ECS) changes the game by delivering cluster management and scheduling as a service. In this talk we’ll present how Okta uses ECS for parallelized testing in CI and for production microservices in a multi-region, always on cloud service. Learn why we chose ECS and many of the tips and tricks for securing, scaling and managing cost.

All you need for Containerized application in Microsoft Azure

Evgeny Rudinsky

Automating Security in your IaC Pipeline

Amazon Web Services

AWS Introduction By Steven Goris

Steven Goris

Similar to Providing CI / CD as a Service - AWS Summit Sydney April 2015 (20)

Day 3 - DevOps Culture - Continuous Integration & Continuous Deployment on th...

SRV409 Deep Dive on Microservices and Docker

Making sense of containers, docker and Kubernetes on Azure.

Increase Speed and Agility with Amazon Web Services

Fundamentals of Cloud Computing & AWS

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Cloud Architecture: Patterns and Best Practices

AWS Webcast - Build Agile Applications in AWS Cloud for Government

Aws container webinar day 2

Amazon Container 환경의 보안 – 최인영, AWS 솔루션즈 아키텍트:: AWS 온라인 이벤트 – 클라우드 보안 특집

Managing Your Application Lifecycle on AWS: Continuous Integration and Deploy...

Devops continuousintegration and deployment onaws puttingmoneybackintoyourmis...

DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...

Microservices and serverless for MegaStartups - DLD TLV 2017

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

ECS and Docker at Okta

All you need for Containerized application in Microsoft Azure

Automating Security in your IaC Pipeline

AWS Introduction By Steven Goris

Recently uploaded

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

shyamraj55

GraphRAG for Life Science to increase LLM accuracy

Tomaz Bratanic

GenAI Pilot Implementation in the organizations

kumardaparthi1024

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?

Speck&Tech

ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune. Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile. BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).

Ocean lotus Threat actors project by John Sitima 2024 (1).pptx

SitimaJohn

Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.

Artificial Intelligence for XMLDevelopment

Octavian Nadolu

In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject. We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup. Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved. The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring. The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise. By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.

Webinar: Designing a schema for a Data Warehouse

Federico Razzoli

Are you new to data warehouses (DWH)? Do you need to check whether your data warehouse follows the best practices for a good design? In both cases, this webinar is for you. A data warehouse is a central relational database that contains all measurements about a business or an organisation. This data comes from a variety of heterogeneous data sources, which includes databases of any type that back the applications used by the company, data files exported by some applications, or APIs provided by internal or external services. But designing a data warehouse correctly is a hard task, which requires gathering information about the business processes that need to be analysed in the first place. These processes must be translated into so-called star schemas, which means, denormalised databases where each table represents a dimension or facts. We will discuss these topics: - How to gather information about a business; - Understanding dictionaries and how to identify business entities; - Dimensions and facts; - Setting a table granularity; - Types of facts; - Types of dimensions; - Snowflakes and how to avoid them; - Expanding existing dimensions and facts.

Presentation of the OECD Artificial Intelligence Review of Germany

innovationoecd

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

Columbus Data & Analytics Wednesdays - June 2024

Jason Packer

Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...

Jeffrey Haguewood

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on integration of Salesforce with Bonterra Impact Management. Interested in deploying an integration with Salesforce for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Best 20 SEO Techniques To Improve Website Visibility In SERP

Pixlogix Infotech

National Security Agency - NSA mobile device best practices

Quotidiano Piemontese

Your One-Stop Shop for Python Success: Top 10 US Python Development Providers

akankshawande

20240609 QFM020 Irresponsible AI Reading List May 2024

Matthew Sinclair

Introduction of Cybersecurity with OSS at Code Europe 2024

Hiroshi SHIBATA

I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems. The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS. Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application. I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.

WeTestAthens: Postman's AI & Automation Techniques

Postman

How to use Firebase Data Connect For Flutter

Daiki Mogmet Ito

Digital Marketing Trends in 2024 | Guide for Staying Ahead

Wask

https://www.wask.co/ebooks/digital-marketing-trends-in-2024 Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.

Taking AI to the Next Level in Manufacturing.pdf

ssuserfac0301

Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as: 1. How quickly AI is being implemented in manufacturing. 2. Which barriers stand in the way of AI adoption. 3. How data quality and governance form the backbone of AI. 4. Organizational processes and structures that may inhibit effective AI adoption. 6. Ideas and approaches to help build your organization's AI strategy.

Recently uploaded (20)

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

GraphRAG for Life Science to increase LLM accuracy

GenAI Pilot Implementation in the organizations

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?

Ocean lotus Threat actors project by John Sitima 2024 (1).pptx

Artificial Intelligence for XMLDevelopment

Webinar: Designing a schema for a Data Warehouse

Presentation of the OECD Artificial Intelligence Review of Germany

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Columbus Data & Analytics Wednesdays - June 2024

Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...

Best 20 SEO Techniques To Improve Website Visibility In SERP

National Security Agency - NSA mobile device best practices

Your One-Stop Shop for Python Success: Top 10 US Python Development Providers

20240609 QFM020 Irresponsible AI Reading List May 2024

Introduction of Cybersecurity with OSS at Code Europe 2024

WeTestAthens: Postman's AI & Automation Techniques

How to use Firebase Data Connect For Flutter

Digital Marketing Trends in 2024 | Guide for Staying Ahead

Taking AI to the Next Level in Manufacturing.pdf

Providing CI / CD as a Service - AWS Summit Sydney April 2015

1. PETER LESCHEV • TEAM LEAD • ATLASSIAN • @PETERLESCHEV Build Engineering @ Atlassian: Providing CI / CD as a Service AWS Summit Sydney - April 2015

2. SCALING THE BUILD GRID INTRODUCTION Introduction AWS ADVANTAGES FUTURE STATE

3. Build platform & services used internally within Atlassian to build, test & deliver software

4. Developers expect a reliable infrastructure & fast CI feedback

5. Build Engineering today @ Atlassian • 10 Bamboo Servers • maven.atlassian.com / 6 Nexus instances • Monitoring - opsview / graphite / statsd • 1000 build agents (own hardware + EC2 instances) • include SCM clients, JDKs, JVM build tools, databases, headless browser testing, python builds, NodeJS, installers & more • Maintain 20 AMIs of various build conﬁgurations • Nexus proxies

6. 3 years ago: 21kBuilds per month

7. Last month: 127kBuilds per month

8. Build Engineering today @ Atlassian

10. JIRA alone has 47kAutomated tests

11. SCALING THE BUILD GRID INTRODUCTION Scaling the Build Grid AWS ADVANTAGES FUTURE STATE

12. Build Agents

13. Own Hardware using KVM guests + EC2 instances

14.

15. Differences between KVM guests & elastic build agents + the need for Functional Parity

16. 2 Problems

17. Problem 1: Network connectivity differences

18. Solution: AWS Direct Connect + VPC enabled EC2 instances

19. Problem 2: Configuration differences between KVM guests & elastic build agents

20. Solution: Removing tech debt using https://www.packer.io/ https://www.atlassian.com/software/bamboohttps://puppetlabs.com/ https://cukes.info/

21. SCALING THE BUILD GRID INTRODUCTION AWS Advantages AWS ADVANTAGES FUTURE STATE

22. Handle the waves of demand

23. Prices always decreasing Product range expanding https://aws.amazon.com/blogs/aws/category/price-reduction/

24. Hardware procurement API + Credit Card

25. ‘Do Not Resuscitate’ order on existing build agent hardware

26. Spot instances

27. Cheap!

28. Slower startup times

29. Not always available

30. Price Volatility

31. Expect Failure Embrace It

32. Prebake at AMI burn time rather than at EC2 instance startup time

33. Faster startup time

34. More reliable instance startup (+ retry on failure!)

35. Pre-caching of git repositories, docker images

36. “RequestLimitExceeded. The maximum request rate permitted by the Amazon EC2 APIs has been exceeded for your account”

37. Handle failure, retry with backoff & recover

38. “We currently do not have sufficient m3.large capacity in the Availability Zone you requested”

39. Multiple-AZ support in Bamboo 5.8

40. “we are experiencing increased error rates and latencies for the EC2 APIs”

41. SCALING THE BUILD GRID INTRODUCTION Future State AWS ADVANTAGES FUTURE STATE

42. Moving all Build Eng Infra to AWS

43. EC2 to ECS for build agents

44. Come help us!

45. Thank you! PETER LESCHEV • TEAM LEAD • ATLASSIAN • @PETER LESCHEV

Providing CI / CD as a Service - AWS Summit Sydney April 2015

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Providing CI / CD as a Service - AWS Summit Sydney April 2015

Similar to Providing CI / CD as a Service - AWS Summit Sydney April 2015 (20)

Recently uploaded

Recently uploaded (20)

Providing CI / CD as a Service - AWS Summit Sydney April 2015