Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Innovation at Amazon & Voice of Customer 雲端創新應用規模化

347 views

Published on

  • Be the first to comment

  • Be the first to like this

Innovation at Amazon & Voice of Customer 雲端創新應用規模化

  1. 1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  2. 2. The Start of Something New “Bezos wants Amazon to run the messy technical and logistical parts of your business using the same technologies and operations that power his $10 billion online store” “Amazon is primed to lead the migration of computing power from the desktop to the Net” This theory will allow small companies to spend most of their time developing their businesses, rather than occupying themselves with the ‘undifferentiated muck’ of buying servers, setting up bandwidth contracts and the like”
  3. 3. The broadest and deepest platform for today’s builders Technical & Business Support AWS Marketplace 7 SERVICES Analytics 11 SERVICES IoT 11 SERVICES Machine Learning 20 SERVICES Core Services 5 SERVICES Management Tools 8 SERVICES DevOps 11 SERVICES Blockchain 2 SERVICES Mobile Services 8 SERVICES App Services 5 SERVICES Infrastructure 7 SERVICES Enterprise Apps 9 SERVICES Migration 7 SERVICES Security & Compliance 19 SERVICES 9 SERVICES
  4. 4. Stockholm Hong Kong Announced Regions AWS Global Infrastructure
  5. 5. RELATIONAL Amazon Aurora MySQL Amazon Aurora PostgreSQL P U R P O S E - B U I L T Key value: Amazon DynamoDB Document: Amazon DocumentDB In-memory: Amazon Elasticache Graph: Amazon Neptune Time-series: Amazon Timestream Ledger: Amazon QLDB Databases MIGRATION SERVICES AWS Migration Hub AWS Database Migration Service Amazon RDS for MySQL Amazon RDS for PostgreSQL Amazon RDS for MariaDB Amazon RDS for Oracle Amazon RDS for SQL Server
  6. 6. The most volume options BLOCK OBJECT 6 storage classes Best security, compliance, and audit capabilities Most object-level controls Unmatched durability, availability, and scalability Unique analytics capabilities FILE The most cloud native file systems (3) 4 performance modes DATA TRANSFER 11 unique ways to get data into AWS Storage 2 storage classes Resize elastically across all volume types Automate EBS volume snapshots
  7. 7. ENCRYPTION & KEY MANAGEMENT 116 encryption enabled services 54 services integrated with key management service Global compliance certifications CERTIFICATIONS 100% AWS services attested and GDPR ready THREAT DETECTION/APP SECURITY Threat detection Machine Learning- powered security Web application firewall DDOS protection Fine-grained access control Assessment & reporting Configuration compliance Resource & usage auditing Security
  8. 8. even faster
  9. 9. AWS Direct Connect AWS Snowball AWS Snowball Edge AWS Snowmobile AWS Storage Gateway Amazon Kinesis Data Firehose Amazon Kinesis Data Streams Amazon Kinesis Video Streams Amazon S3 Transfer Acceleration AWS DataSync AWS Transfer for SFTP DATA TRANSFER & STORAGE
  10. 10. 140,000+ Databases Migrated Migrate between on-prem and AWS Migrate between databases Automated schema conversion Data replication for zero downtime DATABASE MIGRATION
  11. 11. APP MIGRATION
  12. 12. Hundreds of thousands of customers running Windows on AWS
  13. 13. H Y B R I D
  14. 14. Connect your on-prem environments with AWS through network options and services Use your VMware software and tools to run workloads on AWS Run latency-sensitive workloads on premises in a way that seamlessly integrates with AWS Run compute on the edge in locations with limited or no connectivity VMware Cloud on AWS Snowball Edge Compute-Optimized AWS Outposts H Y B R I D AWS Direct Connect
  15. 15. Momentum for VMWare Cloud on AWS
  16. 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. KKBOX Innovation with SRE Rianol Jou Head of Site Reliability Engineering KKBOX Taiwan Co., Ltd.
  17. 17. INTO DARKNESS
  18. 18. 2011
  19. 19. 2013
  20. 20. 2014
  21. 21. 2016
  22. 22. 2018
  23. 23. WHAT WE DID RIGHT
  24. 24. GET THE RIGHT PEOPLE TECHNICAL SKILL PERSONALITY CULTURE FIT • Recruitment • Training • Sharing • Communication • Collaboration • Authorization
  25. 25. DO THE RIGHT THINGS • Business-critical • Blocking • Bottleneck • Wrong direction POLICY TECHNOLOGY BUSINESS PROCESS
  26. 26. IN THE RIGHT WAY STRATEGY TECHNOLOGY STACK ARCHITECTURE • Characteristics • Technical skill • Resource • Limitation
  27. 27. AT THE RIGHT TIME TECHNICAL DEBT BARE METAL VIRTUAL MACHINE CONTAINER SERVERLESS MONOLITH MICROSERVICES WORKAROUND SOLUTION ON-PREMISE HYBRID CLOUD
  28. 28. BEYOND
  29. 29. WHAT WE DOING NOW • Architecture review • Performance tuning • Refactoring • Capacity planning • Cost optimization • Recruitment • Training • Collaboration • Troubleshooting • Profiling • Benchmarking
  30. 30. Thank you! © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Rianol Jou rianoljou@kkbox.com
  31. 31. Moving to open source OPEN SOURCE ENGINES
  32. 32. Amazon Aurora MySQL and PostgreSQL compatible 5X faster than standard MySQL and 3X PostgreSQL Highly available and durable 1/10th the cost of commercial grade databases Scaled-out distributed architecture
  33. 33. Amazon Aurora remains the fastest-growing service in the history of AWS T E N S O F T H O U S A N D S O F C U S T O M E R S , 2 X C U S T O M E R G R O W T H F O R L A S T 3 Y E A R S
  34. 34. Amazon ElastiCache f o r R ed is & M em cac h ed In-Memory Amazon Neptune Graph Time-Series Amazon Timestream Ledger Amazon QLDB Amazon DynamoDB Key Value Amazon DocumentDB Document wi t h M o n g o DB c o m p a tibil ity The most complete family of purpose-built databases
  35. 35. Global tables On-demand backups Point-in-time recover Read/write capacity on demand Amazon DynamoDB Reliable performance at any scale
  36. 36. Amazon DynamoDB: reliable performance at any scale
  37. 37. How do we think about Blockchain?
  38. 38. A fully-managed Ledger database that provides a transparent, immutable, cryptographically verifiable transaction log owned by a central trusted authority. LEDGER Amazon QLDB The evolution of databases for all your application needs
  39. 39. Amazon Managed Blockchain Create and manage scalable blockchain networks Choose Hyperledger Fabric (AVAILABLE TODAY) or Ethereum (COMING SOON) Create blockchain networks with a few clicks; manage them with simple API calls Scales to support thousands of applications running millions of transactions Secured by AWS Key Management Service Improved reliability of Ordering Service with QLDB technology
  40. 40. THE MOST POPULAR CHOICE FOR DATA LAKES Unmatched durability, availability, and scalability Cross Region Replication Best security, compliance, and audit capabilities Easiest to use storage classes Analyze exabytes of data in S3 with the analytics service of your choice Most ways to bring data in Amazon S3
  41. 41. Move, store, catalog, and clean your data faster with machine learning Enforce security policies across multiple services Gain and manage new insights AWS Lake Formation A secure service that allows you to build a secure data lake in days P R E V I E W
  42. 42. VISUALIZATION & ML ANALYTICS DATA LAKE DATA MOVEMENT Amazon QuickSight Amazon SageMaker Amazon Redshift Amazon EMR AWS Glue Amazon Athena Amazon Elasticsearch Service Amazon Kinesis Data Analytics Amazon S3 Amazon Lake Formation AWS Glue AWS Snowmobile AWS Snowball Amazon Kinesis Data Firehose Amazon Kinesis Data Streams Amazon Managed Streaming for Kafka AWS Direct Connect AWS Storage Gateway Amazon Kinesis Video Streams Amazon S3 Transfer Acceleration AWS Transfer for SFTP AWS Snowball Edge Broadest and deepest data and analytics portfolio
  43. 43. Amazon Redshift Petabyte-scale data warehousing for complex queries and fast performance Pull together data from different sources Highly structured Complex queries across very large databases 10x faster average customer query times
  44. 44. What about data at the edge?
  45. 45. Sources: McKinsey & Co., Inc., Statista car lightbulb bicycle door lock camera factory cart coffee pot house bank windfarmpolice equipment plane utilitymedical equipment thermostat Source: Statista.com 75 billionC O N N E C T E D D E V I C E S online by: 2025 The source of data is increasing coming from billions of edge devices
  46. 46. AWS IoT Device SDK Amazon FreeRTOS AWS IoT Device Tester AWS IoT Greengrass AWS IoT Events AWS IoT Analytics AWS IoT SiteWise AWS IoT Device Management AWS IoT Things Graph AWS IoT Core AWS IoT Device Defender AWS has the most complete platform for IoT
  47. 47. AWS IoT customers span all industries
  48. 48. AWS IoT customers work across a variety of verticals Automotive Manufacturing Consumer Electronics Agriculture & Food Production Energy Management
  49. 49. Personalized recommendations Inventing new customer experiences Fulfillment automation/ inventory management Drones Voice driven interactions Machine Learning at Amazon: A L O N G H E R I T A G E
  50. 50. Put machine learning in the hands of every developer and data scientist
  51. 51. More machine learning is happening on AWS than anywhere else
  52. 52. AI Services R E K O G N I T I O N I M A G E P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N V I D E O F O R E C A S TT E X T R A C T P E R S O N A L I Z E VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services A m a z o n S a g e M a k e r Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting F R A M E W O RKS I N T E R F A CE S EC2 C5 FPGAs Greengrass Elastic inference Inferentia EC2 G4 EC2 P3 & P3n Deep learning containers I N F R A S T RU C T U R E ML Frameworks + Infrastructure
  53. 53. F R A M E W O RKS I N T E R F A CE S EC2 C5 FPGAs Greengrass Elastic inference Inferentia EC2 G4 EC2 P3 & P3n Deep learning containers I N F R A S T RU C T U R E P3dn instances Scale model training performance across multiple instances P3dn.24xl 3X faster network throughput than any other provider 2X as much GPU memory than any other GPU instance from other major providers 100+ GB more system memory than the next largest instance available from other providers Best price/performance for model training P 3 P3dn EC2 P3 & P3dn I N F R A S T RU C T U R E Infrastructure and frameworks for Machine Learning ML Frameworks + Infrastructure
  54. 54. F R A M E W O RKS I N T E R F A CE S EC2 C5 FPGAs Greengrass Elastic inference Inferentia EC2 G4 EC2 P3 & P3n Deep learning containers I N F R A S T RU C T U R E Best price/performance for model training P 3 P3dn ML Frameworks + Infrastructure FRAMEWORKS INTERFACES Infrastructure and frameworks for Machine Learning
  55. 55. 85% of all TensorFlow workloads in the cloud runs on AWS AWS is the platform of choice to run TensorFlow
  56. 56. 65% Scaling efficiency with 256 GPUs S T OC K T E N S ORFL OW 90% Scaling efficiency With 256 GPUS AW S - OPT IMZ E D T E N S ORFL OW Train twice as fast with TensorFlow
  57. 57. Running inference in production Drives the majority of cost for machine learning INFERENCE TRAINING INFRASTRUCTURE COSTS
  58. 58. COMING LATE 2019 Add GPU acceleration to any Amazon EC2 instance for faster inference at much lower cost (up to 75% savings) Amazon Elastic Inference Custom high performance machine learning inference chip that will reduce the cost of inference by 10X AWS Inferentia COMING SOON Designed for machine learning, training, inference and video transcoding Amazon EC2 G4 Instances
  59. 59. F R A M E W O RKS I N T E R F A CE S EC2 C5 FPGAs Greengrass Elastic inference Inferentia EC2 G4 EC2 P3 & P3n Deep learning containers I N F R A S T RU C T U R E ML Frameworks + Infrastructure AI Services R E K O G N I T I O N I M A G E P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N V I D E O F O R E C A S TT E X T R A C T P E R S O N A L I Z E VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services A m a z o n S a g e M a k e r Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
  60. 60. Bringing machine learning to all developers Amazon SageMaker Built-in, high performance algorithms and frameworks MORE THAN 200 ADDITIONAL ALGORITHMS AND MODELS IN AWS MARKETPLACE REDUCE DATA LABELING COSTS BY UP TO 70% Fully-managed reinforcement learning algorithms with SageMaker RL TRAIN MODELS WITHOUT LABELED TRAINING DATA BUI LD COLLECT AND PREPARE TRAINING DATA Fast and accurate data labeling with Ground Truth Pre-built notebooks for common problems
  61. 61. SET UP AND MANAGE ENVIRONMENTS FOR TRAINING HYPERPARAMETER OPTIMIZATION AND SAGEMAKER NEO TRAI N Built-in, high performance algorithms and frameworks MORE THAN 150 ADDITIONAL ALGORITHMS AND MODELS IN AWS MARKETPLACE REDUCE DATA LABELING COSTS BY UP TO 70% Fully-managed reinforcement learning algorithms with SageMaker RL TRAIN MODELS WITHOUT LABELED TRAINING DATA BUI LD COLLECT AND PREPARE TRAINING DATA OptimizationOne-click training Fast and accurate data labeling with Ground Truth Pre-built notebooks for common problems Bringing machine learning to all developers Amazon SageMaker
  62. 62. SET UP AND MANAGE ENVIRONMENTS FOR TRAINING HYPERPARAMETER OPTIMIZATION AND SAGEMAKER NEO TRAI N D E P LO Y SCALE AND MANAGE THE PRODUCTION ENVIRONMENT DEPLOY MODEL IN PRODUCTION Built-in, high performance algorithms and frameworks MORE THAN 150 ADDITIONAL ALGORITHMS AND MODELS IN AWS MARKETPLACE REDUCE DATA LABELING COSTS BY UP TO 70% Fully-managed reinforcement learning algorithms with SageMaker RL TRAIN MODELS WITHOUT LABELED TRAINING DATA BUI LD FAST AND ACCURATE DATA LABELING WITH GROUND TRUTH OptimizationOne-click training One-click deployment Fully managed with auto-scaling, health checks, automatic handling of node failure, and security checks Fast and accurate data labeling with Ground Truth Pre-built notebooks for common problems Bringing machine learning to all developers Amazon SageMaker
  63. 63. More than ten thousand customers using Amazon SageMaker
  64. 64. F R A M E W O RKS I N T E R F A CE S EC2 C5 FPGAs Greengrass Elastic inference Inferentia EC2 G4 EC2 P3 & P3n Deep learning containers I N F R A S T RU C T U R E ML Frameworks + Infrastructure AI Services R E K O G N I T I O N I M A G E P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N V I D E O F O R E C A S TT E X T R A C T P E R S O N A L I Z E VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS ML Services A m a z o n S a g e M a k e r Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
  65. 65. R E K O G N I T I O N I M A G E A N D V I D E O T E X T R A C T Deep learning based image and video analysis services Identify objects, people text, scenes, activities Automatically extract text and data from virtually any document Uses ML to go beyond simple OCR to also identify content in forms and tables D O G 9 9 . 3 % B A L L 8 3 . 0 % G R A S S 8 9 . 2 %
  66. 66. A M A Z O N P O L L Y 52 Voices across 25 languages Lip-Syncing & Text Highlighting Fine-grained Voice Control A M A Z O N T R A N S C R I B E Support for 16KHz and 8KHz Streaming support A M A Z O N T R A N S L A T E 24 language pairs Neural machine translation High accuracy A M A Z O N C O M P R E H E N D Sentiment, Entities, Key phrases, Languages, Topics A M A Z O N L E X Build conversational apps in minutes A M A Z O N C O M P R E H E N D M E D I C A L Build conversational apps in minutes
  67. 67. Accurate time-series forecasting service, based on the same technology used at Amazon.com Amazon Forecast Real-time personalization and recommendation service, based on the same technology used at Amazon.com Amazon Personalize P R E V I E W
  68. 68. Ways to get started Brainstorming Custom modeling Training Work side-by-side with Amazon experts Practical education on ML for new & experienced practitioners Based on the same material used to train Amazon developers
  69. 69. Purpose-built for ML-skills development Fully programmable & customizable Build custom Amazon SageMaker models 10-minutes to your first deep learning project The world’s first deep learning-enabled video camera for developers
  70. 70. Build machine learning models in Amazon SageMaker Train, test, and iterate on the track using the AWS DeepRacer 3D racing simulator Compete in the world’s first global autonomous racing league, to race for prizes and a chance to advance to win the coveted AWS DeepRacer Cup A fully autonomous 1/18th-scale race car designed to help you learn about reinforcement learning through autonomous driving AWS DeepRacer
  71. 71. Build reinforcement learning model DeepRacer League Races at AWS Summits Winners of each DRL Race and top scorers compete in Championship Cup at re:Invent 2019 World’s first global autonomous racing league
  72. 72. ai.aws

×