Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Deep Dive - Amazon Kinesis Video Streams - AWS Online Tech Talks

2,432 views

Published on

Learning Objectives:
- Get an overview of Amazon Kinesis Video Streams and key use cases
- Learn how to use the Kinesis Video Streams producer SDK to securely stream video to AWS
- Discover how to use the Kinesis Video Streams parser library to retrieve video fragments for analytics and processing

  • Be the first to comment

Deep Dive - Amazon Kinesis Video Streams - AWS Online Tech Talks

  1. 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS re:INVENT Introducing Amazon Kinesis Video Streams A d i K r i s h n a n , H e a d o f A m a z o n K i n e s i s Vi d e o S t r e a m s , AW S A B D 2 1 6
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What to Expect from the Session • Overview of Amazon Kinesis Video Streams • Key use cases • Product details
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Kinesis—real-time analytics Easily collect, process, and analyze real-time, streaming data Load data streams into AWS data stores Analyze data streams with SQL Build custom applications that analyze data streams Kinesis Data Streams Kinesis Data Firehose Kinesis Data Analytics SQL
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Video is critical to many applications Smart Home Security MonitoringSmart City Industrial Automation Computer Vision
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a video ingestion system is complex • Cumbersome to rewrite code for various devices and development environments • Difficult to elastically scale to millions of devices • Requires support for cadence, latency, and jitter on streams • Requires secure, highly scalable, available storage • Need easy-to-use APIs to retrieve, process, and replay video
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Stream video from millions of devices Easily build vision-enabled apps Secure Durable, searchable storage Fully managed Amazon Kinesis Video Streams S t r e a m v i d e o a n d t i m e - e n c o d e d d a t a f o r a n a l y t i c s Kinesis Video Streams
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Key Use Cases
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case: Smart Home Example: Pet Monitor
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case: Smart City Example: Amber Aler t Sys tem
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case: Industrial Automation Example: Equipment Pr eventive Maintenanc e
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kinesis Video Streams Product Details
  12. 12. Amazon Kinesis Video Streams Concept
  13. 13. Kinesis Video Streams: Basic Concepts • Kinesis Video Stream: • Customer-owned entity that transports video-like data such frames, samples, and fragments • Stores durably, and makes it available for both real-time and ad hoc consumption. • Kinesis Video Stream only has a single producer publishing data into it. • Producer: • Producers put data into Kinesis Video Streams, and include hardware devices like security cameras, body-worn cams, smartphones, dashcams, etc. • A single producer can generate one or more Kinesis Video Streams • Consumer: • Consumers are applications that get data from Streams to process. • Consumers get data in real-time/continuous or in batch-oriented path • Consumers run on the customers own Amazon EC2 instances.
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential • Flexible SDK for integration with on- device hardware media pipelines • Out-of-the-box integration with AWS auth mechanism: SigV4 • Flexible Put API to stream Frames or buffered Fragments or after-the-fact uploads • Build custom integrations with diverse camera and device types • Secure authN and authZ to connect devices w/ image sensors to AWS • Stream video data based on the preferred transmission scenario Video Streams SDK offers … … that enables developers to Kinesis Video Streams Producer SDK E a s i l y c o n n e c t a n d s t r e a m f r o m c a m e r a s o u r c e s
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kinesis Video Streams Producer SDK E a s i l y c o n n e c t a n d s t r e a m f r o m c a m e r a s o u r c e s Amazon Confidential Platform independent layer (C) OO Wrapper Layer (C++ and Java) Android Linux For app devs to install on target OS to build applications. Does not satisfy all underlying hardware media pipeline, source listing but makes it easy to do so For camera-level integrators who want a object-oriented, high-performance integration model that satisfies the service calls but is flexible to customize. For manufacturers who want full flexibility to integrate at source and firmware level for different hardware platform types.
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • CreateStream : Creates a new video stream • DeleteStream : Deletes the specified stream • DescribeStream : Returns the most current information: version, status, data retention, etc. about the specified stream • ListStreams : Returns an array of StreamInfo objects. Each object describes a stream • GetDataEndpoint : Gets an endpoint for a specified stream for either reading or writing Control Plane APIs (5 of 10)
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • UpdateDataRetention : Increases or decreases the stream's data retention period • UpdateStream : Updates stream metadata, such as the device name and media type • TagStream : Adds one or more tags (key-value pair)to a stream to help you define and categorize • ListTagsForStream : Returns a list of tags associated with the specified stream • UntagStream : Removes one or more tags from a stream Control Plane APIs (10 of 10)
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • PutMedia : long-running ‘streaming’ API to write media data to a video stream • GetMedia : retrieve media content from a video stream from the specified starting chunk continuously with low latency • GetMediaForFragmentList : retrieve media data for a list of fragments from the stored data in a video stream • ListFragments : returns a list of Fragments from the specified video stream and start location Data Plane APIs (4 of 4)
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. POST /putMedia HTTP/1.1 x-amzn-stream-name: StreamName x-amzn-stream-arn: StreamARN x-amzn-fragment-timecode-type: FragmentTimecodeType x-amzn-producer-start-timestamp: ProducerStartTimestamp Payload • Before using this API, you must call the GetDataEndpoint API to get an endpoint • Use a single long-running PutMedia session and send a large number of media data fragments in the payload. For each fragment received, Kinesis Video Streams sends one or more acknowledgements. • You can choose multiple consecutive PutMedia sessions, each with fewer fragments to ensure that you get all acknowledgements from the service in real time. PutMedia Details
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. POST /getMedia HTTP/1.1 Content-type: application/json { "StartSelector": { "AfterFragmentNumber": "string", "ContinuationToken": "string", "StartSelectorType": "string", "StartTimestamp": number }, "StreamARN": "string", "StreamName": "string" } • Before using this API, you must call the GetDataEndpoint API to get an endpoint • Kinesis Video Streams stores each incoming fragment and related metadata in what is called a "chunk“. The GetMedia API returns a stream of these chunks starting from the chunk that you specify in the request. GetMedia Details
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kinesis Video Streams Parser Library S o f t wa r e t h a t m a k e s i t e a s y t o wo r k wi t h G e t M e d i a o u t p u t • Get a frame-level object and its associated metadata • Extract and collect video streams-specific metadata attached for fragments • Merge consecutive fragments • Build into your custom ML or other video-processing applications
  22. 22. Kinesis Video Streams Pricing P a y f o r v o l u m e o f d a t a i n g e s t , s t o r e d , a n d c o n s u m e d Data Ingested (per GB) Data Consumed (per GB) Data Stored (per GB-Month) US EAST (N. Virginia) $ 0.00850 $ 0.00850 $ 0.0230 US WEST (Oregon) $ 0.00850 $ 0.00850 $ 0.0230 EU (Ireland) $ 0.00944 $ 0.00944 $ 0.0230 EU (Frankfurt) $ 0.01020 $ 0.01020 $ 0.0245 Asia Pacific (Tokyo) $ 0.01097 $ 0.01097 $ 0.0250
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Ecosystem
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Video and Kinesis Video
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agent Vi: Make any surveillance camera smart
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Health Deep Learnin g GPU Events Analytic s Search Admin Portal BW Optimai zer API Gatewa y Cache S3 RDS Agent Vi and Kinesis Video Streams Integration Agent Relay Kinesis Produce r Video Clip innoVi Micro Services Kinesis Gateway Clip Player Consumer SDK Producer SDK Kinesis Video Stream
  27. 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Veritone: B ring A I t o video analyt ics
  28. 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  29. 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Kinesis—real-time analytics Easily collect, process, and analyze video and data streams in real time Capture, process, and store video streams for analytics Load data streams into AWS data stores Analyze data streams with SQL Build custom applications that analyze data streams Kinesis Video Streams Kinesis Data Streams Kinesis Data Firehose Kinesis Data Analytics SQL New at re:Invent 2017 Amazon Confidential
  30. 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. THANK YOU! V i s i t a w s . a m a z o n . c o m / k i n e s i s / v i d e o - s t r e a m s

×