서버리스, Lambda, Athena만 생각하셨나요? 서버리스 기술은 자동 크기 조정, 기본 제공 고가용성 및 종량제 결제 모델을 제공하여 민첩성을 개선하고 비용을 최적화할 수 있습니다. 이제는 AWS의 다양한 데이터 분석 서비스에서 서버리스 기술을 이용하여, 보다 효율적인 분석 환경 구성을 할 수 있습니다. Amazon Redshift, EMR, Opensearch에서 서버리스 기술을 활용할 수 있는 방법과 유즈케이스를 알아볼 수 있습니다.

1. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S E O U L | M A Y 4 , 2 0 2 3

2. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
,
AWS
WWSO
AWS

3. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?
Agenda

4. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
TELEMETRY
LOGS
APPLICATIONS
SENSORS
IoT
THIRD PARTY
MOBILE
EVENTS
WEB

6. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
of data created in 2023

7. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

8. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
V I S U A L I Z A T I O N
M A C H I N E L E A R N I N G
I o T
A P P L I C A T I O N S
E C O M M E R C E
E D G E
O T H E R
A N A L Y T I C S
A P P L I C A T I O N S
DATA LAKE

9. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

10. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1
0
0

11. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
/

12. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

14. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 AWS Lambda
Amazon EC2
OS
Fail over
,

15. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 AWS Lambda
AWS Lambda
Lambda
, ,

16. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

17. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS
Built-in best practices
&
&
fail-over
SQL, ETL,
You
Push-button
Built-in best practices
&
fail-over
Push-button
&
SQL, ETL,
You

18. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

20. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS
Analytics
, ETL

21. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS
Analytics
데이터
SQL
SQL
데이터가공
검색,
실시간스트리밍
실시간스트리밍
데이터가공

22. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

23. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
데이터
/

24. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
9$
ML /
,
Amazon QuickSight
데이터

25. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
BI Insight
BI
AWS
Auto NLQ &
ML-insights
&
데이터

26. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
데이터

27. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SQL

28. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SQL
Amazon Redshift
Serverless
Amazon Athena
SELECT
product_category,
count(*)
FROM
amazon_reviews_by_marketplace
GROUP BY
product_category;
SQL

29. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S3
, ,
30 ~ 90 %
ANSI SQL
JDBC/ODBC
Amazon Athena
SQL
SQL

30. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Athena
S 3 S Q L
Amazon Athena
SQL

31. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SQL

32. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S3 Table
32
S3
SQL
1
2

33. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Query editor SQL
1
2

34. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
,
, ,
Redshift Processing Unit(RPU)
Amazon Redshift
Serverless SQL
SQL

35. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift
/ , S P E C T R U M
Auto-scaling clusters
Spectrum
Node
Spectrum
AQUA
Parallel execution
Compilation
Service
Global
Cache (*.o)
CaaS
Spectrum
Node
Redshift
Compute
Cluster
Leader Node
Compute
Nodes
AWS
Nitro
Node
AWS-
designed
processor
Node
AWS-
designed
processor
Node
AWS-
designed
processor
Node
AWS-
designed
processor
Spectrum
Node
Spectrum
Node
Data lake
Redshift
Managed
Storage
Amazon S3
SQL

36. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift Serverless
S 3
Data lake
Redshift
Managed
Storage
Amazon S3
Amazon
Redshift
Serverless
ML기반
워크로드 모니터링
자동 튜닝
자동 스케일링
자동 워크로드
관리
사용한만큼 지불
대규모 성능 지원
자동 유지 보수
SQL

37. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
V2
Redshift ,
,
1
2
SQL

38. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

39. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Glue
, ,
데이터가공

40. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
, , , ,
AWS Glue Studio
ETL
ETL job
데이터가공

41. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
,
AWS Glue DataBrew
250+
데이터가공

42. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
E T L ( , )
AWS Glue Notebooks
250+
데이터가공

43. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Glue
다양한 옵션
AWS Glue for
Apache Spark
• 5
•
• Spark 3.3.0
•
: Hudi,
Iceberg, Delta Lake
• Ray.io
•
Python
• Python
AWS Glue for
Ray
(Preview)
• 2
•
• Python 3.10
AWS Glue for
Python Shell
•
34%
•
SLA
AWS Glue
Flexible
Execution
데이터가공

44. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EMR
Serverless
E M R Multi-AZ resiliency
데이터가공

45. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EMR serverless
다양한 요청에 따른 동작방식
Job A
Job B
파이프라인 B
파이프라인 A
가용 영역 1
Spark Spark Spark
Spark Spark Spark
Spark Spark Spark
Spark Spark Spark
Spark Spark Spark
Spark
Spark
Spark
Spark
Data engineer 1
Data engineer 2
AWS Step Functions
Amazon MWAA
EMR Serverless
데이터가공

46. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EMR serverless
더 간편해진 사용방법
Amazon EMR on Amazon EC2
Job 제출
Amazon EMR Serverless
시작
중지
Job 제출
시작
중지
데이터가공

47. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

48. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon OpenSearch Service
사용사례
Boolean
Relevance
검색,

49. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon OpenSearch
Serverless
,
clients, pipelines, API
검색,

50. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon OpenSearch Serverless
특성 비교
, ,
검색,

51. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon OpenSearch Serverless
기술적 혁신
인덱싱 검색
Amazon S3
Active Standby Replicas
Index Index
-
Active-standby
검색,

52. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

53. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Kinesis
,
실시간스트리밍
Kinesis Data Streams
Kinesis Data Analytics
Kinesis Data Firehose
AWS
Kinesis Video Streams
, ,
온디멘드

54. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon MSK
Serverless
KAFKA
200MBps , 400MBps
* MSK : Managed Streaming for Apache Kafka
KAFKA
ㅊ
실시간스트리밍

55. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

56. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
서버리스 선택 가이드
유즈케이스와 비용에 따른 선택
예측할 수 없는 워크로드
유즈케이스
과금형태 사용한 만큼만 지불
주기적이지만 유휴시간 존재
유즈케이스
과금형태 유휴시간에는 지불하지 않음
스파이크성 요청 존재
유즈케이스
과금형태 추가된 만큼만 지불

57. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summary

58. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summary
특징에 따른 선택
, , ,

59. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
서버리스를 자동차에 비유한다면?

60. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
서버리스를 자동차에 비유한다면?

61. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
참고자료
• https://aws.amazon.com/ko/quicksight/
• https://aws.amazon.com/ko/athena/
• https://aws.amazon.com/ko/redshift/redshift-serverless/
• https://aws.amazon.com/ko/glue/
• https://aws.amazon.com/ko/emr/serverless/
• https://aws.amazon.com/ko/opensearch-service/features/serverless/
• https://aws.amazon.com/ko/kinesis/
• https://aws.amazon.com/ko/msk/features/msk-serverless/
서버리스 분석 서비스 Amazon Web Service 한국 블로그
Amazon EMR Serverless –
• https://aws.amazon.com/ko/blogs/korea/amazon-emr-serverless-now-
generally-available-run-big-data-applications-without-managing-
servers/
Amazon MSK Serverless – Kafka
• https://aws.amazon.com/ko/blogs/korea/amazon-msk-serverless-now-
generally-available-no-more-capacity-planning-for-your-managed-
kafka-clusters/
Amazon OpenSearch –
• https://aws.amazon.com/ko/blogs/korea/preview-amazon-
opensearch-serverless-run-search-and-analytics-workloads-without-
managing-clusters/
Amazon Redshift Serverless –
• https://aws.amazon.com/ko/blogs/korea/introducing-amazon-
redshift-serverless-run-analytics-at-any-scale-without-having-to-
manage-infrastructure/

62. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.