[AWS summit 2018] MSA 기반 Micro Batch로의 변화

•Download as PPTX, PDF•

0 likes•87 views

The document discusses the shift from traditional batch processing to micro batch processing. Batch processing can cause issues like latency and complexity. Micro batch processing breaks jobs into smaller, more frequent batches to reduce latency and complexity. This allows for near real-time processing and responses.

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
주경호
LDCC/HIT
Micro Batch 로의 변화

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Batch

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Why 배치 작업은 고통만 주는가

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
배치 목적은

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Micro Batch 변화

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Micro Batch

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

AWS 인공지능 서비스와 서버리스 서비스를 이용한 동영상 분석 서비스 구축하기 동영상에 포함되어 있는 다양한 정보를 쉽고 빠르게 분석하는 솔루션을 구축할 수 있습니다. VOD 동영상을 S3에 업로드하면, Lambda에서 Elemental MediaConvert를 호출하여 대량의 이미지로 분할하여 S3에 저장합니다. 대량의 이미지는 AWS Lambda를 활용하여 Rekognition 서비스를 호출하여 이미지 정보를 수집합니다. 수집 결과물은 ElasticSearch에 저장하고 Kibana를 통해 시각화 할 수 있습니다.

AWS Welcome and Opening - Startup Day Toronto 2018 - Jim Routh

Amazon Web Services

IVS CTO Night And Day 2018 Winter - [re:Cap] AWS Managed Blockchain & Amazon ...

Amazon Web Services Japan

The Internet Report - Ep.3: April 6-12, 2020

ThousandEyes

Security Deployment by CI/CD

Peerapat Asoktummarungsri

AWS Startup Day Toronto - Sudip Chakrabarti- Building & Selling AI-Powered En...

Amazon Web Services

Machine learning has the potential to transform enterprises, leading to the discovery of thousands of opportunities for improved efficiencies across marketing, sales, and operations. As a result, every enterprise executive and board member is asking or being asked: how will your organization capitalize? For startups, the opportunity is rivaled only by the challenges. How to strike the balance between product and service when context is king in enterprises? How does one educate customers with so much hype in the market? How to demonstrate value in complex enterprise sales? Cyft has faced these and many more questions in the course of building a startup in the highly regulated, highly complex world of healthcare. Cyft founder and CEO, Dr. Leonard D'Avolio will share his experiences and lessons learned to help other founders accelerate their journeys toward success.

첫 서버를 AWS 서울 리전에 시작한 2년차 개발자로서, AWS Fargate를 비롯 여러 클라우드 매니지드 서비스의 도움을 받아 모놀리틱 애플리케이션을 마이크로서비스 아키텍처로 옮겼던 과정 및 경험 등을 공유합니다. MyMusicTaste는 서비스를 전 세계 리전 배포 방법, 싱글페이지 애플리케이션(SPA)에서 흔히 겪는 SEO 및 CORS 이슈 등을 Lambda@Edge 등으로 손쉽게 대응했던 사례를 공유합니다.

マイクロサービスを AWS サーバレス＆コンテナで実装する方法

崇之清水

2018 AWS DevDay Seoul community track - 데이터센터 1도 모르는 개발자가 MSA를 만났을 때

주은 안

Run Production Workloads on Spot, Save up to 90% (CMP306-R1) - AWS re:Invent ...

Amazon Web Services

Amazon EC2 Spot Instances enable you to use spare EC2 computing capacity— capacity that is often 90% less than On-Demand prices. In this session, learn how to effectively harness Spot Instances for production workloads. We explore application requirements for using Spot Instances, best practices learned from thousands of customers, and the services that make it easy to use. Finally, we run through practical examples of how to use Spot for the most common production workloads, the common pitfalls customers run into, and how to avoid them.

はじめてのグラフデータベース〜 Amazon Neptune と主なユースケース〜

Amazon Web Services Japan

Zendesk: Building a World-Class Cloud Center of Excellence (ENT309-S) - AWS r...

Amazon Web Services

When it comes to doing the cloud right, no one size fits all. Yet sometimes organizations become distracted by the day-to-day management of cost, security, and overall operations. They can lose sight of the reasons they chose to embrace the cloud in the first place. How can you possibly manage it all and stay focused on the business outcomes that are most important? In this session, learn how forming a Cloud Center of Excellence (CCoE) has become an increasingly common way to address many of these challenges. When implemented well, the CCoE acts as a bridge, connecting all departments that use, measure, or fund your cloud operation. This session is brought to you by AWS partner, CloudHealth Technologies.

How to Automate Security Learning at Scale (ANT335-S) - AWS re:Invent 2018

Amazon Web Services

The mountain of data generated by your deployment can be a valuable source of insight for your security practice IF you take advantage of some key tools on the AWS Cloud. In this session, learn how to build an analytics process that uses security tools, whether from AWS or the community, to create a continuous feedback loop to maintain and improve the security of your deployments. Additionally, learn when to use AWS security services and other tools in your deployment and how to manage the output, thus creating an analytics workflow alongside a feedback loop in order to streamline the entire process. The end result is an automated feedback loop aimed at making sure that your deployment is doing what you intend ... and only what you intend. This session is brought to you by AWS partner, Trend Micro.

AWS Direct Connect: Deep Dive (NET403) - AWS re:Invent 2018

Amazon Web Services

Globalizing Player Accounts at Riot Games While Maintaining Availability (ARC...

Amazon Web Services

The Player Accounts team at Riot Games needed to consolidate the player account infrastructure and provide a single, global accounts system for the League of Legends player base. To do this, they migrated hundreds of millions of player accounts into a consolidated, globally replicated composite database cluster in AWS. This provided higher fault tolerance and lower latency access to account data. In this talk, we discuss this effort to migrate eight disparate database clusters into AWS as a single composite database cluster replicated in four different AWS regions, provisioned with terraform, and managed and operated by Ansible.

Cloud Ops Engineer: A Day in the Life (ENT312-R1) - AWS re:Invent 2018

Amazon Web Services

Are you an expert data center operations engineer looking to sharpen your AWS skills? Are you an IT operations manager looking to speed up your team's cloud learning curve for operating in a hybrid cloud environment? Are you a DevOps engineer looking to grow your operations experience? This session follows two AWS operations experts throughout their day as they solve real-life problems in complex, enterprise hybrid cloud AWS environments. Expect to learn actionable hacks and tricks that you won't get in standard training classes, practical advice for solving common and not-so-common issues, and insights in to the top things our experts wish they knew when they were getting started with AWS.

Industrial Transformation

Amazon Web Services

Monitoring Serverless Applications (SRV303-S) - AWS re:Invent 2018

Amazon Web Services

Serverless brings many advantages to software development, but it introduces new monitoring challenges as well. Isolated telemetry on individual functions might not provide enough visibility, and instrumentation in a world where 100 ms of extra execution time could cost thousands of dollars might prove prohibitive. In this session, we explore how New Relic enables full observability of the serverless stack, including its executing context, with minimal impact in performance. Learn from customer case studies and real-world examples. This session is brought to you by AWS partner, New Relic.

[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...

Amazon Web Services

This session introduces AWS Global Accelerator, a new global service that enables you to optimally route traffic to your multi-regional endpoints via static Anycast IP addresses that are announced from the expansive AWS edge network. This session walks through the various features and customer use cases for Global Accelerator. Several example use cases demonstrate how you can use Ubiquity to achieve near-zero application downtime and reduce latency for your global applications. We will walk you through the architecture and will also include a demo of the workflow. Attend this session if you are looking at ways to accelerate performance of your global applications, achieve high availability for your mission critical applications or easily manage multiple IP addresses through a static Anycast IP that fronts your applications.

Future of Enterprise IT

Amazon Web Services

What's hot

KeynoteKosut_SFStartupDay

Amazon Web Services

Orchard: 500 Demo Day Batch 23

500 Startups

Beer and UPS slideshow

SwitchOn to Eaton

Startup Day Kyiv: Introduction to fundraising 101

Amazon Web Services

Top 10 Start-Up Mistakes & How to Avoid Them: AWS Startup Day - New York 2018

Amazon Web Services

Developing Channel and Messaging Strategies: Intrinsic vs. Extrinsic Motivators

Prove

What's hot (6)

KeynoteKosut_SFStartupDay

Orchard: 500 Demo Day Batch 23

Beer and UPS slideshow

Startup Day Kyiv: Introduction to fundraising 101

Top 10 Start-Up Mistakes & How to Avoid Them: AWS Startup Day - New York 2018

Developing Channel and Messaging Strategies: Intrinsic vs. Extrinsic Motivators

Similar to [AWS summit 2018] MSA 기반 Micro Batch로의 변화

MSA를 넘어 Function의 로의 진화::주경호 수석::AWS Summit Seoul 2018Amazon Web Services Korea

Role of Central Teams in DevOps Organizations (DEV370) - AWS re:Invent 2018

Amazon Web Services

데이터센터 1도모르는 개발자가 마이크로서비스를 만났을때 (안주은, MyMusicTaste) :: AWS DevDay 2018

Amazon Web Services Korea

マイクロサービスを AWS サーバレス＆コンテナで実装する方法

崇之清水

2018 AWS DevDay Seoul community track - 데이터센터 1도 모르는 개발자가 MSA를 만났을 때

주은 안

Run Production Workloads on Spot, Save up to 90% (CMP306-R1) - AWS re:Invent ...

Amazon Web Services

はじめてのグラフデータベース〜 Amazon Neptune と主なユースケース〜

Amazon Web Services Japan

Zendesk: Building a World-Class Cloud Center of Excellence (ENT309-S) - AWS r...

Amazon Web Services

How to Automate Security Learning at Scale (ANT335-S) - AWS re:Invent 2018

Amazon Web Services

AWS Direct Connect: Deep Dive (NET403) - AWS re:Invent 2018

Amazon Web Services

Globalizing Player Accounts at Riot Games While Maintaining Availability (ARC...

Amazon Web Services

Cloud Ops Engineer: A Day in the Life (ENT312-R1) - AWS re:Invent 2018

Amazon Web Services

Industrial Transformation

Amazon Web Services

Monitoring Serverless Applications (SRV303-S) - AWS re:Invent 2018

Amazon Web Services

[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...

Amazon Web Services

Future of Enterprise IT

Amazon Web Services

AWS 主題演講：聚焦企業工作負載 (enterprise workloads) 與全球案例分享

Amazon Web Services

Advanced Serverless Data Processing (GPSWS406) - AWS re:Invent 2018

Amazon Web Services

In this hands-on workshop, you learn best practices and architectural patterns for building streaming data processing pipelines without servers. Using Amazon Kinesis, AWS Lambda, and other services, you have the opportunity to build, deploy, and monitor an application to ingest and process high-velocity data at scale. This advanced workshop assumes that you have experience writing Lambda functions and understand the basics of the AWS serverless platform, so come ready to dive into the deep end. Bring your laptop with a full keyboard. We provide a sandbox AWS account for you to use during the workshop.

AWS Transformation Day 2018 - Charlotte NC

Amazon Web Services

About the event: AWS Transformation Day is designed for enterprise organizations migrating to the cloud to become more responsive, agile and innovative, while staying secure and compliant. Join us for this one-day event and we’ll share our experiences of helping enterprise customers accelerate the pace of migration and adoption of strategic services. Who should attend? This event is recommended for IT and business leaders who are looking to create sustainable benefits and a competitive advantage by using the AWS Cloud. CIOs, CTOs, CISOs, CDOs, CFOs, IT leaders and IT professionals, enterprise developers, business decision makers, and finance executives.

Operating at Scale: Preparing for the Journey

Amazon Web Services

How do I grow with my organization and meet my organization's needs? How do I rise to the new challenges before me? In this session we discuss the differences in preparing to operate in the cloud, what your operational priorities need to be, how to start designing for operations, and building your operational readiness. We will walk you through the process of how to launch your new life in the cloud. You will learn to make the early choices that lay the foundations for a successful adoption of cloud services. At the end of this session you will understand the key considerations when planning your personal journey to the cloud. This session is for leaders, operations, service owners and anyone interested in how to get started in the cloud to ensure successful business outcomes

Similar to [AWS summit 2018] MSA 기반 Micro Batch로의 변화 (20)

MSA를 넘어 Function의 로의 진화::주경호 수석::AWS Summit Seoul 2018

Role of Central Teams in DevOps Organizations (DEV370) - AWS re:Invent 2018

데이터센터 1도모르는 개발자가 마이크로서비스를 만났을때 (안주은, MyMusicTaste) :: AWS DevDay 2018

マイクロサービスを AWS サーバレス＆コンテナで実装する方法

2018 AWS DevDay Seoul community track - 데이터센터 1도 모르는 개발자가 MSA를 만났을 때

Run Production Workloads on Spot, Save up to 90% (CMP306-R1) - AWS re:Invent ...

はじめてのグラフデータベース〜 Amazon Neptune と主なユースケース〜

Zendesk: Building a World-Class Cloud Center of Excellence (ENT309-S) - AWS r...

How to Automate Security Learning at Scale (ANT335-S) - AWS re:Invent 2018

AWS Direct Connect: Deep Dive (NET403) - AWS re:Invent 2018

Globalizing Player Accounts at Riot Games While Maintaining Availability (ARC...

Cloud Ops Engineer: A Day in the Life (ENT312-R1) - AWS re:Invent 2018

Industrial Transformation

Monitoring Serverless Applications (SRV303-S) - AWS re:Invent 2018

[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...

Future of Enterprise IT

AWS 主題演講：聚焦企業工作負載 (enterprise workloads) 與全球案例分享

Advanced Serverless Data Processing (GPSWS406) - AWS re:Invent 2018

AWS Transformation Day 2018 - Charlotte NC

Operating at Scale: Preparing for the Journey

Recently uploaded

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Neuro-symbolic is not enough, we need neuro-*semantic*

Frank van Harmelen

Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”. All of this illustrated with link prediction over knowledge graphs, but the argument is general.

Bits & Pixels using AI for Good.........

Alison B. Lowndes

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

Elevating Tactical DDD Patterns Through Object Calisthenics

Dorra BARTAGUIZ

After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Designing Great Products: The Power of Design and Leadership by Chief Designe...

Product School

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

Product School

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Sri Ambati

Key Trends Shaping the Future of Infrastructure.pdf

Cheryl Hung

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Product School

Recently uploaded (20)

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Neuro-symbolic is not enough, we need neuro-*semantic*

Bits & Pixels using AI for Good.........

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

Elevating Tactical DDD Patterns Through Object Calisthenics

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Leading Change strategies and insights for effective change management pdf 1.pdf

UiPath Test Automation using UiPath Test Suite series, part 4

Designing Great Products: The Power of Design and Leadership by Chief Designe...

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Key Trends Shaping the Future of Infrastructure.pdf

GraphRAG is All You need? LLM & Knowledge Graph

UiPath Test Automation using UiPath Test Suite series, part 3

Epistemic Interaction - tuning interfaces to provide information for AI support

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

[AWS summit 2018] MSA 기반 Micro Batch로의 변화

Recommended

Recommended

More Related Content

What's hot

What's hot (6)

Similar to [AWS summit 2018] MSA 기반 Micro Batch로의 변화

Similar to [AWS summit 2018] MSA 기반 Micro Batch로의 변화 (20)

More from KyungHo Joo

More from KyungHo Joo (11)

Recently uploaded

Recently uploaded (20)

[AWS summit 2018] MSA 기반 Micro Batch로의 변화