Haeyoon Jo gave a presentation on a payment system craft demo at Intuit. The presentation included an introduction of Haeyoon and his achievements in DevOps and MLOps. It then demonstrated the architecture of a payment system using microservices with RabbitMQ for queuing, REST APIs, and risk engines. The demo discussed continuous integration/delivery using Jenkins and GitHub Actions to deploy to ECR. It also covered infrastructure automation with Terraform, horizontal scaling with EKS/ECS, and using Aurora MySQL for the database. The presentation concluded with a question and answer session.

1. Craft Demo at Intuit
Haeyoon Jo
INTUIT Sr. SW Developer, ML & MLOps

2. Agenda
About me
Achievements
Payment System Draft Demo
Questions & Answers

3. Haeyoon Jo
MLOps, Devops Engineer
About me
🍺 Beer company!
The
fi
rst IT Company
in Korea 🇰🇷
Ubuntu & Cloud lover ❤
Marine Corps 💂
Associated to DS team 🛰

4. Achievements - DevOps
1. Introduction of CICD Pipeline & Container Orch
Impacts & values
- Accelerated Development, Consistency
- Cost e
ff
ective, optimization. a.k.a FinOps
- Scalable, resilience workloads
Skills
- Jenkins pipeline, Github Actions, ArgoCD
- Container orchestration Framework, Docker compose, EKS, ECS
2. Strong team works
Impacts & values
- Assist customers, E
ffi
cient communications
- Architectural perspective
- Troubleshoots & SRE, DevOps, MLOps role
Skills
- Scrum, documentation, customer obsession, Ownership
- Production con
fi
dence

5. Achievements - MLOps
1. De
fi
ne MLOps work
fl
ow
Impacts & values
- De
fi
ne work
fl
ow including CICD, workloads on AWS
- Saving $8K/M AWS resource costs
- hypergrowth DS team ( 2 > 6, 1 team > 3 teams )
Skills
- Amazon EMR - spark, SageMaker inference, ECR,
- Step Functions or Air
fl
ow DAG
2. Data Governance
Impacts & values
- Deep understanding data quality ( GI-GO )
- Data Engineering, pre/post process workloads assist
Skills
- Pandas, Numpy, SQL, Regex
😄 < Stackover
fl
ow question >
Pandas split column into multiple columns by comma

6. Craft Demo - Architecture

7. Craft Demo - Payment System
1. Payment system execute
version: '3.8'
services:
rabbitmq:
image: rabbitmq:3-management
ports: # 5672, 15672
environment: # RABBITMQ_DEFAULT_USER: admin, RABBITMQ_DEFAULT_PASS: admin
volumes: # rabbitmq-data:/var/lib/rabbitmq
healthcheck: # test: ["CMD", "rabbitmqctl", "status"]
networks:
rest-api:
build: ./paymentSystemRestAPI
ports: # 5000
depends_on: # rabbitmq condition - service_healthy
environment: # RABBITMQ_HOST: rabbitmq
networks:
risk-engine:
build: ./riskEngine
depends_on: # rabbitmq condition - service_healthy
environment: # RABBITMQ_HOST: rabbitmq
networks:
networks: project # name: project, bridge net type
Compose.yml structure
2. Payment system test and verify approved or declined

8. Craft Demo - Payment System
3. CI CD
- Jenkins ( Jenkins
fi
le ) + ECR
- Github Actions - "docker compose action” + ECR
- Github Actions ( CI ) + ArgoCD ( CD )
4. Infrastructures, Scaling policy
- IaC using Terragrunt + Terraform, CloudFormation, Pulumi
- horizontal scale to handle massive tra
ffi
c
- EKS, ECS, EC2 Auto Scaling
5. Queue service, Database
- Rabbit MQ vs Kafka
- Amazon Aurora MySQL

9. Questions & Answers

10. Thank you
Thank you for joining me for this
Craft demo
Github repo: https://github.com/HaeyoonJo/intuit_MLOps_paymentSystem_craft_demo
LinkedIn: https://www.linkedin.com/in/haeyoondevops/
INTUIT Sr. SW Developer, ML & MLOps