1. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S E O U L | M A Y 4 , 2 0 2 3

2. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Neptune
Senior Software Engineer
INTEGRATION Corp.

3. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
•
• CISO, INTEGRATION corp.
•
sehwan.lee@medistream.co.kr
Hello World!

4. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. Background
2. Architecture Overview
3. NLP & ETL
4. Query with Gremlin
5. Create API
6. Wrap up
Neptune

5. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Background
: ===
TV
Q&A

6. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Background
QnA

7. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecture Overview
,

8. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecture Overview
/ → ,
[ ] [ ] The Dos( )
Entity_content Entity_product
Entity_keyword
Entity_keyword
??

9. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecture Overview
(VERTEX, EDGE)
ETL
Vertex-Edge
Neptune
NLP
TF-IDF
:[ 1, 2, …]
API
API gateway + Lambda

10. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
NLP – extracts key words
(PAIR) .
1.
2. ( 35000)
3.
4. 1 ( , ..)
5. ( mecab + )
6.
7.
8. 1
9. (TF)
10. (IDF)

11. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Vertex
ENTITY VERTEX
vertex vertex
vertex

12. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Edge
RELATION EDGE
From : vetex id ( )
To: vertex id ( )
TF-IDF score:

13. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transformation , Load
SAGEMAKER NOTEBOOK TRANSFORM, S3 UPLOAD – NEPTUNE BULK API
DATA
SAGEMAKER BULK LOAD
Vertex: Notebook
Redshift
S3 upload
Edge: NLP
s3 upload
Neptune
sagemaker notebook
instance
Neptune
SageMaker Redshift S3
Copy data
to bucket
Load
Command
IAM Role
Graph Data

14. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Query with Gremlin
ALL IN ONE! - SAGEMAKER NOTEBOOK
keyword
vertex
entity vertex

15. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Query with Gremlin
= VERTEX →
Source Entity_vertex → one of Target Entity_vertex path
1. Entity_vertex Edge .(out )
2. Edge (in ) Keyword_vertex .
3. Keyword_vertex (in ) Edge
4. Edge (out ) Entity_vertex .
5. .
6. vertex
7. Edge tf_idf score
entity word
include
Source Target
OUT
IN

16. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Create API
APACHE TINKERPOP JAVASCRIPT GREMLIN

17. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Private subnet
Create API
SERVERLESS – API GATEWAY + LAMBDA + NEPTUNE ENDPOINT
AWS Cloud
Virtual private cloud (VPC)
APP
API Gateway Lambda Neptune

18. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Wrap up
. . .
• AI ? TF_IDF
• chatGTP ?
• ,
•
•
• ! Neptune Serverless
• Neptune serverless

19. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
EKS Elastic
Site Reliability Engineer
MUSINSA

20. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MUSINSA Site Reliability Engineer
Web Developer
→ NLP Developer
→ DevOps/SRE
AWS
Kubernetes
Elasticsearch
/ Byung Woo LEE

21. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
•
•
• Elastic Cloud on Kubernetes (ECK)
• ECK

22. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elasticsearch & Kubernetes
(EKS)
, ,
Elastic Stack
Disclaimer

23. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

24. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

25. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(1)

26. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(2)

27. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Beats
&
Logstash Elasticsearch Kibana
Elastic Stack
, , ,

28. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elasticsearch on AWS
Managed vs. Self-Managed
구분 Amazon OpenSearch Service Elasticsearch on EC2/EKS 내용
Managed O X 관리형인가?
Custom Plugin X O 커스텀 플러그인을
설치할 수 있는가?
Elasticsearch 8.0 X O Elasticsearch 8.0을
지원하는가?
Index-level
Shard Allocation
Filtering
X O
인덱스 단위로
저장하는 노드를
지정할 수 있는가?

29. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

30. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(1)
-
Application Load Balancer
AWS Cloud
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
node.roles: [ master, data ]

31. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(2)
- +
Coordinating Master Data
AWS Cloud
Application
Load Balancer
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
Elasticsearch Node
node.roles: [ ] node.roles: [ master ] node.roles: [ data ]

32. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(3)
-
AWS Cloud

33. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(4)
-
AWS Cloud
…

34. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Private subnet
Public subnet
Provisioning
Elasticsearch on EC2
Search
Developer
1 hour
(per cluster)
SRE
AWS Cloud
Elasticsearch
Kibana
Application
Load Balancer
Auto Scaling
group
Instance
Instance
Instance
Auto Scaling
group
Instance
Instance
Instance
Instance
Instance
Instance
Instance Application
Load Balancer
Coordinating Master Data
request
for
provision provision
1
2
4 3
Busy…

35. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?
IaC(Infrastructure as Code) ?
?
?
AWS ?
IAM
AWS ?
Terraform, Ansible ?
Elastic Stack

36. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SRE Search Developer
SRE & Search Developer
Cloud
Engineering
Infrastructure
as
Code
Kubernetes
Elastic Stack
Software
Engineering
Kubernetes

37. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kubernetes
EKS

38. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elastic Cloud on Kubernetes

39. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kubernetes Operator
Operator
Custom
Resource
Kubernetes
Objects
…
update
watch
EKS Cluster

40. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elastic Cloud on Kubernetes (ECK)
Elastic Stack
Elasticsearch, Kibana
Elastic
Kubernetes Operator
EKS, GKE, AKS
Managed Kubernetes

41. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Installing ECK
Custom Resource Definition (CRD) & Operator
elastic-operator
deployed
EKS Cluster

42. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
elasticsearch-example
Deploying Elasticsearch
master
elastic-operator
EKS Cluster
watch
data coordinating
update
CRD Elasticsearch

43. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
kibana-example elasticsearch-example
Deploying Kibana
EKS Cluster
elasticsearchRef
CRD Kibana

44. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
elasticsearch-example
Configuring Elasticsearch
Config & Pod Template
EKS Cluster
sidecar
initContainers
elasticsearch.yml
master
…

45. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
elasticsearch-example
Configuring Elasticsearch
Volume Claim Template
Amazon
Elastic Block Store
data
EKS Cluster
AWS Cloud

46. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
elasticsearch-example
Horizontal Scaling
data
new
rebalancing
Scaling Elasticsearch
EKS Cluster
1
2

47. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
elasticsearch-example
Vertical Scaling - CPU & Memory
Scaling Elasticsearch
data
EKS Cluster
new new new

48. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Vertical Scaling – Volume Scale-Up
Scaling Elasticsearch
elasticsearch-example
data
EKS Cluster
new new new

49. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
elasticsearch-example
elasticsearch-example
Scaling Elasticsearch
Vertical Scaling – Volume Scale-Down (Workaround)
data data-small
rebalancing
new new new
new
data data-small
1
2
3

50. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ECK

51. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Private subnet
Public subnet
&
AWS Cloud
Application
Load Balancer
Client
Application
Product
Developers
(1)
EKS Cluster
Kibana
Elasicsearch
Application
Load Balancer
access
console
request
Ingress
Ingress

52. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(2)
…
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
Client
Application
Product
Developers
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
Client
Application
Product
Developers
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
Client
Application
Product
Developers
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
Client
Application
Product
Developers
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
Client
Application
Product
Developers

53. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(3)
…
Kibana
CRD
Elasticsearch
CRD
Kibana
Ingress
Elasticsearch
Ingress
Kibana
CRD
Elasticsearch
CRD
Kibana
Ingress
Elasticsearch
Ingress
Kibana
CRD
Elasticsearch
CRD
Kibana
Ingress
Elasticsearch
Ingress
Kibana
CRD
Elasticsearch
CRD
Kibana
Ingress
Elasticsearch
Ingress
Kibana
CRD
Elasticsearch
CRD
Kibana
Ingress
Elasticsearch
Ingress

54. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Provisioning
Elasticsearch on EKS using ECK
Search
Developer
provision
10 min
(per cluster)
SRE
Good!
AWS Cloud
EKS Cluster
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
Application
Load Balancer
Application
Load Balancer
Kibana
Elasticsearch
…
provision
provision

55. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
namespace=search-engine
namespace=other
RBAC (Role Based Access Control)
Namespace
Search
Developer
edit
Great!
SRE
EKS Cluster

56. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
namespace=search-engine
Role & Responsibilities
SRE & Search Developer
SRE
Managed
Search
Developer
Managed
AWS Cloud
Load Balancers with Ingress
EKS Cluster

57. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10 min 30+ Developer
Managed
Outcome
1 10
30 EKS

58. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elastic Stack Kubernetes(EKS)
RBAC
Ingress
Kubernetes
Kubernetes(EKS)
Summary

59. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Reference
• Elastic Cloud on Kubernetes
https://www.elastic.co/guide/en/cloud-on-k8s/current/index.html
• Amazon Elastic Kubernetes Service
https://docs.aws.amazon.com/eks/index.html
• Amazon OpenSearch Service
https://docs.aws.amazon.com/opensearch-service/index.html
• MusE (Musinsa Elasticsearch)
https://medium.com/musinsa-tech/%EB%AC%B4%EC%8B%A0%EC%82%AC%EC%9D%98-
%EC%97%98%EB%9D%BC%EC%8A%A4%ED%8B%B1%EC%84%9C%EC%B9%98-muse-
musinsa-elasticsearch-e6355516186a

60. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
감사합니다
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.