How do you empower your developers to manage their own AWS infrastructure and give them the flexibility that AWS provides without compromising security? Millennium Management, a global investment management firm, did not want to limit its developers, but the company needed to ensure that they followed security best practices. In this chalk talk, AWS and Millennium professionals share, discuss, and answer your questions on how Millennium achieved this balance through the combined use of CI/CD patterns, a number of AWS services, and a component-based Python framework. Together, we review architecture, automation, security, and a number of use cases to help you achieve these same no-compromise-needed results in your organization.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Go Fast and Be Secure? How Millennium Empowers
Developers Without Compromising Security
David Chapman
Head of Cloud Enablement
Millennium
Mark Horta
Head of Cloud Engineering
Millennium
F S V 3 1 1
Quint Van Deman
Global Business Development Manager,
Identity & Directory Services
Amazon Web Services
Magnus Bjorkman
Principal Cloud Engineer
Millennium

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ORMove fast Stay secure
Before…

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ORANDMove fast Stay secure
Now…

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Chalk talks
You: DrivingPresenters: Framing
Photo by CEphoto, Uwe Aranas / via Wikimedia Commons http://denikian.blogspot.com/2012/06/long-exposure-technique.html

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Introduction
Millennium
A global investment firm
www.mlp.com
Use cases
Compute
Data engineering

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Introduction
Requirements & goals
Account structure
Go fast—Automation framework
Templates, components & use cases

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Requirements & goals
Motivation
Elasticity & time to market
Ability to innovate
Enable independent development teams
Security
Mandatory
Encrypt everything
Logging / audit
Users
Technical developers
Non-technical
Delivery
100% automated
Goals
Developer centric enablement
Architecture
Application templates
Scalable
Frameworks
Tooling

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS account structure

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS account setup—Step Function pipeline
Developer
Commit + Pull
Request
AWS
CodeCommit
AWS
CodePipeline
Pull Request
Merge
Triggers
Pipeline
Launch
Cloud
Formation
Stacks
AWS Step
Functions
AWS
Lambda
AWS Step Functions
Amazon
DynamoDB
Amazon
Simple
Notification
Service
(Amazon SNS)

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation framework—Self-service
AWS
CodeCommit
AWS
CodePipeline
AWS
CloudFormation
Developer application pipeline setup—Flexible, self-service, dynamic, secure
Millennium
framework
AWS
CodeBuild

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation—Advanced
AWS
CodeBuild
AWS
Service Catalog
AWS
CodeDeploy
Developer application pipeline setup—Flexible, self-service, dynamic, secure
Pipeline execution
AWS
CodeCommit
AWS
CodePipeline
AWS
CloudFormation
Template
Stack
Template
Deployments
Instances
Amazon
S3
Millennium
framework

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation framework—Developer’s view

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation—Multi-developer pipelines
AWS
CodePipeline
AppDevA
AppPplADev
AWS
CloudFormation
AWS
CodePipeline
AppCDDevA
AppCDPplADev
AWS
CloudFormation
WebApp
Pipeline
WebApp
CodeDeploy Pipeline
Amazon
RDS
Amazon
DynamoDB
Amazon ES
Amazon
Kinesis
Development Pipeline
AWS
CodePipeline
AppDevA
AppPplADev
AWS
CloudFormation
AWS
CodePipeline
AppCDDevA
AppCDPplADev
AWS
CloudFormation
Developer-2
AWS
CodePipeline
AppDevA
AppPplADev
AWS
CloudFormation
AWS
CodePipeline
AppCDDevA
AppCDPplADev
AWS
CloudFormation
Developer -3
AWS
CodePipeline
AppDevA
AppPplADev
AWS
CloudFormation
AWS
CodePipeline
AppCDDevA
AppCDPplADev
AWS
CloudFormation
Amazon
RDS
Amazon
DynamoDB
Amazon ES
Amazon
Kinesis
Developer -4

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation—Advanced
Dev QA UAT PROD
Non-production account Production account

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use cases—Reusable components and templates
Millennium framework
Default settings
Components
EMRS3
Shared services Template account
Template Amazon EMR
Input
bucket
Output
bucket
ETL
cluster
Template settings
Millennium framework
Default settings
Components
EMRS3
Program account
Data
catalog
Program Amazon EMR
Input
bucket
Output
bucket
ETL
cluster
Program settings
Streaming
server
Millennium framework
Default settings
Components
EMRS3
Data
catalog
Template EMR + Streaming/Query
Input
bucket
Output
bucket
ETL
cluster
Program settings
Streaming
server
Glue

20. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
David Chapman
david.chapman@mlp.com
Mark Horta
mark.horta@mlp.com
Magnus Bjorkman
magnus.bjorkman@mlp.com
Quint Van Deman

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.