Content distribution
•
0 likes•2,904 views
This document discusses content distribution and archiving in a digital age. It describes using Amazon Web Services like S3, CloudFront, and Route 53 for content distribution, as well as services like ELB and RDS. It also discusses using Amazon Glacier for long-term archiving of content after 1 year. Live streaming and alternative services are also mentioned.
Report
Share
Report
Share
Download to read offline
Recommended
Harvard it summit 2016 - opencast in the cloud at harvard dce- live and on-d...
Harvard it summit 2016 - opencast in the cloud at harvard dce- live and on-demand from the dce classroom
Modern web dev_taxonomy
The document categorizes common tools used in modern web development into external management tools, internal language conveniences, and subordinate language conveniences. It provides examples of version control systems, dependency isolation tools, package managers, deployment tools, and more that are commonly used for languages like Ruby, Python, PHP, and JavaScript. The document also discusses enhanced REPLs/shells, web server abstraction layers, asset managers, and preprocessing tools for HTML, CSS and JavaScript.
Iguazú: A Long-Running Job Scheduler using Docker and Mesos
These slides describe how Coursera created its next generation of long-running job scheduler by integrating Docker and Mesos.
Building a PaaS with Docker and AWS
Eric Holmes from Remind discussed building an internal Platform as a Service (PaaS) called Empire using Docker and Amazon EC2 Container Service (ECS). Remind started on Heroku but encountered issues with scaling and visibility. Empire provides a management layer on top of ECS for deploying and scaling microservices. It implements a subset of the Heroku API and provides a single binary and CLI. Empire is running 15 of Remind's production services on ECS with improved performance over Heroku. A demo was shown of deploying a sample app with Empire.
PaaS with Java
Presentation about PaaS Clouds with Java. Touches Google App Engine, VMforce, Amazon Beanstalk and why Spring is a good idea in these scenario.
IaC on AWS Cloud
How to model Infrastructure as Code as part of CI / CD, incorporating it into your standard application development lifecycle, execute infrastructure changes in your CI/CD pipeline, and get additional benefits, such as reducing configuration errors and provisioning faster. All this leveraging IaC Tools on AWS like AWS CloudFormation, AWS SAM & AWS CDK
AWS Lambda and Serverless framework: lessons learned while building a serverl...
The document discusses lessons learned from building a serverless company. It introduces Planet 9 Energy and their use of AWS Lambda and the Serverless framework. Key topics covered include security, quality assurance, developer experience, costs, and lessons learned. Some challenges discussed are debugging, API Gateway custom domains, and Lambda limitations. The document emphasizes that serverless architectures provide infinite scalability at low cost but also have some limitations that require management.
FaaS or not to FaaS. Visible and invisible benefits of the Serverless paradig...
When we talk about prices, we often only talk about Lambda costs. In our applications, however, we rarely use only Lambda. Usually we have other building blocks like API Gateway, data sources like SNS, SQS or Kinesis. We also store our data either in S3 or in serverless databases like DynamoDB or recently in Aurora Serverless. All of these AWS services have their own pricing models to look out for. In this talk, we will draw a complete picture of the total cost of ownership in serverless applications and present a decision-making list for determining if and whether to rely on serverless paradigm in your project. In doing so, we look at the cost aspects as well as other aspects such as understanding application lifecycle, software architecture, platform limitations, organizational knowledge and plattform and tooling maturity. We will also discuss current challenges adopting serverless such as lack of high latency ephemeral storage, unsufficient network performance and missing security features.
Recommended
Harvard it summit 2016 - opencast in the cloud at harvard dce- live and on-d...
Harvard it summit 2016 - opencast in the cloud at harvard dce- live and on-demand from the dce classroom
Modern web dev_taxonomy
The document categorizes common tools used in modern web development into external management tools, internal language conveniences, and subordinate language conveniences. It provides examples of version control systems, dependency isolation tools, package managers, deployment tools, and more that are commonly used for languages like Ruby, Python, PHP, and JavaScript. The document also discusses enhanced REPLs/shells, web server abstraction layers, asset managers, and preprocessing tools for HTML, CSS and JavaScript.
Iguazú: A Long-Running Job Scheduler using Docker and Mesos
These slides describe how Coursera created its next generation of long-running job scheduler by integrating Docker and Mesos.
Building a PaaS with Docker and AWS
Eric Holmes from Remind discussed building an internal Platform as a Service (PaaS) called Empire using Docker and Amazon EC2 Container Service (ECS). Remind started on Heroku but encountered issues with scaling and visibility. Empire provides a management layer on top of ECS for deploying and scaling microservices. It implements a subset of the Heroku API and provides a single binary and CLI. Empire is running 15 of Remind's production services on ECS with improved performance over Heroku. A demo was shown of deploying a sample app with Empire.
PaaS with Java
Presentation about PaaS Clouds with Java. Touches Google App Engine, VMforce, Amazon Beanstalk and why Spring is a good idea in these scenario.
IaC on AWS Cloud
How to model Infrastructure as Code as part of CI / CD, incorporating it into your standard application development lifecycle, execute infrastructure changes in your CI/CD pipeline, and get additional benefits, such as reducing configuration errors and provisioning faster. All this leveraging IaC Tools on AWS like AWS CloudFormation, AWS SAM & AWS CDK
AWS Lambda and Serverless framework: lessons learned while building a serverl...
The document discusses lessons learned from building a serverless company. It introduces Planet 9 Energy and their use of AWS Lambda and the Serverless framework. Key topics covered include security, quality assurance, developer experience, costs, and lessons learned. Some challenges discussed are debugging, API Gateway custom domains, and Lambda limitations. The document emphasizes that serverless architectures provide infinite scalability at low cost but also have some limitations that require management.
FaaS or not to FaaS. Visible and invisible benefits of the Serverless paradig...
When we talk about prices, we often only talk about Lambda costs. In our applications, however, we rarely use only Lambda. Usually we have other building blocks like API Gateway, data sources like SNS, SQS or Kinesis. We also store our data either in S3 or in serverless databases like DynamoDB or recently in Aurora Serverless. All of these AWS services have their own pricing models to look out for. In this talk, we will draw a complete picture of the total cost of ownership in serverless applications and present a decision-making list for determining if and whether to rely on serverless paradigm in your project. In doing so, we look at the cost aspects as well as other aspects such as understanding application lifecycle, software architecture, platform limitations, organizational knowledge and plattform and tooling maturity. We will also discuss current challenges adopting serverless such as lack of high latency ephemeral storage, unsufficient network performance and missing security features.
(ISM301) Engineering Netflix Global Operations In The Cloud
- Netflix faced two operational challenges of accelerating innovation while sustaining quality at growing scale and complexity.
- Netflix adopted an approach of operational excellence through continuous improvement of operations management, design, and function to achieve greater quality and velocity.
- Netflix practices operations engineering by applying software engineering practices to operations to achieve operational excellence through automation, modular components, tools, and services.
The new Netflix API
1. The new Netflix API aims to provide orchestration of services, availability protection, and abstraction for client libraries and device teams.
2. To address complexity challenges, Netflix plans to move scripts out of the API and split the API into separate services for authentication and an edge platform for scripts.
3. This will reduce complexity, improve debugging and profiling, and allow faster independent development while still providing higher level APIs and resiliency across services.
Give your little scripts big wings: Using cron in the cloud with Amazon Simp...
Most developers write them and every company has them – a vast library of small and large scripts that are designed to run on a scheduled basis. These background angels help keep the lights on and the doors open. They’ve been built up over time and are forgotten little heroes that are only remembered when the machines they live on fail. They are scattered throughout a company’s IT infrastructure and do important things.
In this session, we will explain how to use Ruby on Simple Workflow to quickly build a system that schedules scripts, runs them on time, retries them if they fail, and stores the history of their execution. You will walk away from this session with an understanding of how Simple Workflow brings resiliency, concurrency, and tracking to your applications.
DevOpsCon Cloud Workshop
Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.
Sas 2015 event_driven
This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.
Serverless design considerations for Cloud Native workloads
We have built a news website with more than a billion views per month and we are sharing the learnings from that experience covering Serverless architectures, Design considerations, and Gotchas.
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
This document provides an overview of a workshop on cloud native, capacity, performance and cost optimization tools and techniques. It begins with introducing the difference between a presentation and workshop. It then discusses introducing attendees, presenting on various cloud native topics like migration paths and operations tools, and benchmarking Cassandra performance at scale across AWS regions. The goal is to explore cloud native techniques while discussing specific problems attendees face.
CQRS and Event Sourcing
The document discusses CQRS (Command Query Responsibility Segregation) and Event Sourcing application architectures. It begins with an overview of common application architectures like layered architecture and hexagonal architecture. It then explains event-driven architecture and how event sourcing can be used for data storage. CQRS is introduced as separating read and write interfaces. The document contrasts a traditional architecture with one using CQRS and event sourcing together. It provides a code example and concludes with questions and resources for further reading.
Docker in the Cloud
Shows how to abstract Cloud specific infrastructure in AWS, Azure and own DC using a demo application written in Vertx.
AWS ELB Tips & Best Practices
This document provides tips and best practices for using AWS Elastic Load Balancers (ELBs). It covers topics like load testing ELBs, using SSL with ELBs, CNAME records, balancing traffic both within and across availability zones, L4 load balancing support, internal ELBs, ELB logging, stickiness, blue/green deployments using ELBs, connection draining, using the ELB CLI for continuous integration/continuous delivery, auto scaling with ELB metrics, using CloudFront in front of ELBs, and some limitations around microservices support. The overall message is that ELBs are generally easy to use but have some limitations, so it's important to understand how to configure them properly
AWS Lambda: Best Practices and Common Mistakes - Dev Ops West 2019
Derek C. Ashmore gave a presentation on AWS Lambda best practices and common mistakes. He discussed what Lambdas are, their business benefits, and limitations. Ashmore provided code-level tips like including inputs and environment on exceptions. For operations and design, he recommended automating builds and deployments, limiting custom nesting, and using configuration injection without secrets. Lambdas are suitable for stateless workloads under 15 minutes like data processing, security tasks, and serving as microservices.
Building a Machine Learning App with AWS Lambda
Ludi Rehaks' meetup on 03.17.16
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
Open stack ocata summit enabling aws lambda-like functionality with openstac...
Presentation delivered at the OpenStack summit Barcelona 2016.
https://www.openstack.org/videos/video/enabling-aws-s3-lambda-like-functionality-with-openstack-swift-and-openwhisk
Does the concept of server-less architecture intrigue you? OpenWhisk (https://git.io/vKeu3) accelerates innovation through creative chaining of microservices into highly scalable applications. By abstracting away infrastructure, OpenWhisk frees small teams to rapidly work on independent pieces of code simultaneously, keeping development focused solely on creating essential business logic. OpenWhisk allows you to create rules to connect events with actions and compose microservices that get executed independently and in parallel.
With a bit of code, you can have OpenWhisk process events from your Swift Object Storage; similar to what you can do with Lambda functions and AWS S3 storage. As an example, we will demonstrate how you can create an OpenWhisk action to transform an image into a thumbnail whenever a new (larger) image is uploaded into a Swift Container.
Ibm cloud nativenetflixossfinal
1. The document discusses running NetflixOSS microservices on Docker locally and in the cloud. It demonstrates Docker local setup with Eureka for service discovery and Microscaler for auto scaling and recovery.
2. Key lessons from running SkyDNS and Eureka together for service discovery in Docker include that both work well but Eureka provides more application awareness while SkyDNS has looser coupling.
3. Microscaler is an open source auto scaling system developed to handle auto scaling, recovery, and version rolling for Docker local deployments, providing functionality similar to Amazon Auto Scaling and RightScale for Docker environments.
Serverless Summit - Quiz
The document contains a 10 question quiz about serverless computing concepts. It begins by explaining that the term "lambda" in serverless functions originates from Alonzo Church's "lambda calculus" in 1936. Each question is then presented along with the corresponding answer and brief explanation. The questions cover topics like principles for creating lambda functions, suitable and unsuitable use cases for serverless, where to store credentials, characteristics of serverless functions, the "freeze/thaw cycle", and approaches to avoid for state management.
AWS Lambda from the Trenches
In this talk, we discussed lessons have learnt about operating AWS Lambda in production, whilst transitioning from a traditional, monolithic system.
Journey towards serverless infrastructure
Some lessons we learned during the AWS migration of Opintopolku.fi (studyinfo.fi). Presented at the meetup of AWS User Group Helsinki on 2018-03-08.
Startup DevOps - Jon Milsom Pitchero - Leeds DevOps - August 2014
Presentation at Leeds DevOps by Jon Milsom (Co-Founder & CTO, Pitchero), August 2014
http://www.pitchero.com/
http://www.leedsdevops.org.uk/
https://twitter.com/jonmilsom
https://twitter.com/leedsDevops
Lessons Learned from building a serverless API
We had to build a fast and reliable API for a public-facing phone application. Why use a shiny new technology to build this API when there are already proven ways to do it?
In this talk I will explore why we decided to use AWS Lambdas and how it was different from developing and deploying a “conventional" API. Hear about lessons learned throughout the journey, from just playing with Lambdas at home through to successfully shipping a functional product.
Learning outcomes.
- What serverless is
- How building a serverless architecture differs from a conventional one.
- What kind of projects could benefit from a serverless architecture.
Performance Monitoring with AOP and Amazon CloudWatch
This document discusses using aspect-oriented programming (AOP) and Amazon Web Services (AWS) for performance monitoring of server-side applications. It describes how AOP can be used to gather runtime data with minimal boilerplate code. The data is then published to AWS CloudWatch, which provides visualization of metrics over time as well as alarm and notification capabilities. With this approach, developers can monitor important metrics like method execution times, errors and IO operations across a distributed environment in a simple and cost-effective manner.
Building a Scalable Asset Management (DAM) Platform in the AWS
This document outlines the architecture for building a scalable digital asset management (DAM) platform in the cloud. Key components include Amazon S3 for storage, auto scaling EC2 instances for processing metadata and generating renditions, DynamoDB for the catalog, CloudSearch for search, and Elastic Transcoder for transcoding. The architecture provides ingest of assets from S3, metadata extraction using EC2 workers, generation of renditions, building the catalog in DynamoDB and CloudSearch, and delivery of assets through CloudFront.
Netflix keynote-adrian-qcon
Netflix uses cloud computing to address challenges in scaling its infrastructure to support unpredictable growth. It has transitioned its website to be nearly 100% cloud-based using Amazon Web Services (AWS) to gain the scale, availability and agility needed. AWS provides tools and features like auto-scaling that allow Netflix to easily expand capacity as its subscriber base grows by over 50% per year. By leveraging AWS' mature cloud platform, Netflix can focus on its core video business rather than managing data centers.
More Related Content
What's hot
(ISM301) Engineering Netflix Global Operations In The Cloud
- Netflix faced two operational challenges of accelerating innovation while sustaining quality at growing scale and complexity.
- Netflix adopted an approach of operational excellence through continuous improvement of operations management, design, and function to achieve greater quality and velocity.
- Netflix practices operations engineering by applying software engineering practices to operations to achieve operational excellence through automation, modular components, tools, and services.
The new Netflix API
1. The new Netflix API aims to provide orchestration of services, availability protection, and abstraction for client libraries and device teams.
2. To address complexity challenges, Netflix plans to move scripts out of the API and split the API into separate services for authentication and an edge platform for scripts.
3. This will reduce complexity, improve debugging and profiling, and allow faster independent development while still providing higher level APIs and resiliency across services.
Give your little scripts big wings: Using cron in the cloud with Amazon Simp...
Most developers write them and every company has them – a vast library of small and large scripts that are designed to run on a scheduled basis. These background angels help keep the lights on and the doors open. They’ve been built up over time and are forgotten little heroes that are only remembered when the machines they live on fail. They are scattered throughout a company’s IT infrastructure and do important things.
In this session, we will explain how to use Ruby on Simple Workflow to quickly build a system that schedules scripts, runs them on time, retries them if they fail, and stores the history of their execution. You will walk away from this session with an understanding of how Simple Workflow brings resiliency, concurrency, and tracking to your applications.
DevOpsCon Cloud Workshop
Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.
Sas 2015 event_driven
This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.
Serverless design considerations for Cloud Native workloads
We have built a news website with more than a billion views per month and we are sharing the learnings from that experience covering Serverless architectures, Design considerations, and Gotchas.
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
This document provides an overview of a workshop on cloud native, capacity, performance and cost optimization tools and techniques. It begins with introducing the difference between a presentation and workshop. It then discusses introducing attendees, presenting on various cloud native topics like migration paths and operations tools, and benchmarking Cassandra performance at scale across AWS regions. The goal is to explore cloud native techniques while discussing specific problems attendees face.
CQRS and Event Sourcing
The document discusses CQRS (Command Query Responsibility Segregation) and Event Sourcing application architectures. It begins with an overview of common application architectures like layered architecture and hexagonal architecture. It then explains event-driven architecture and how event sourcing can be used for data storage. CQRS is introduced as separating read and write interfaces. The document contrasts a traditional architecture with one using CQRS and event sourcing together. It provides a code example and concludes with questions and resources for further reading.
Docker in the Cloud
Shows how to abstract Cloud specific infrastructure in AWS, Azure and own DC using a demo application written in Vertx.
AWS ELB Tips & Best Practices
This document provides tips and best practices for using AWS Elastic Load Balancers (ELBs). It covers topics like load testing ELBs, using SSL with ELBs, CNAME records, balancing traffic both within and across availability zones, L4 load balancing support, internal ELBs, ELB logging, stickiness, blue/green deployments using ELBs, connection draining, using the ELB CLI for continuous integration/continuous delivery, auto scaling with ELB metrics, using CloudFront in front of ELBs, and some limitations around microservices support. The overall message is that ELBs are generally easy to use but have some limitations, so it's important to understand how to configure them properly
AWS Lambda: Best Practices and Common Mistakes - Dev Ops West 2019
Derek C. Ashmore gave a presentation on AWS Lambda best practices and common mistakes. He discussed what Lambdas are, their business benefits, and limitations. Ashmore provided code-level tips like including inputs and environment on exceptions. For operations and design, he recommended automating builds and deployments, limiting custom nesting, and using configuration injection without secrets. Lambdas are suitable for stateless workloads under 15 minutes like data processing, security tasks, and serving as microservices.
Building a Machine Learning App with AWS Lambda
Ludi Rehaks' meetup on 03.17.16
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
Open stack ocata summit enabling aws lambda-like functionality with openstac...
Presentation delivered at the OpenStack summit Barcelona 2016.
https://www.openstack.org/videos/video/enabling-aws-s3-lambda-like-functionality-with-openstack-swift-and-openwhisk
Does the concept of server-less architecture intrigue you? OpenWhisk (https://git.io/vKeu3) accelerates innovation through creative chaining of microservices into highly scalable applications. By abstracting away infrastructure, OpenWhisk frees small teams to rapidly work on independent pieces of code simultaneously, keeping development focused solely on creating essential business logic. OpenWhisk allows you to create rules to connect events with actions and compose microservices that get executed independently and in parallel.
With a bit of code, you can have OpenWhisk process events from your Swift Object Storage; similar to what you can do with Lambda functions and AWS S3 storage. As an example, we will demonstrate how you can create an OpenWhisk action to transform an image into a thumbnail whenever a new (larger) image is uploaded into a Swift Container.
Ibm cloud nativenetflixossfinal
1. The document discusses running NetflixOSS microservices on Docker locally and in the cloud. It demonstrates Docker local setup with Eureka for service discovery and Microscaler for auto scaling and recovery.
2. Key lessons from running SkyDNS and Eureka together for service discovery in Docker include that both work well but Eureka provides more application awareness while SkyDNS has looser coupling.
3. Microscaler is an open source auto scaling system developed to handle auto scaling, recovery, and version rolling for Docker local deployments, providing functionality similar to Amazon Auto Scaling and RightScale for Docker environments.
Serverless Summit - Quiz
The document contains a 10 question quiz about serverless computing concepts. It begins by explaining that the term "lambda" in serverless functions originates from Alonzo Church's "lambda calculus" in 1936. Each question is then presented along with the corresponding answer and brief explanation. The questions cover topics like principles for creating lambda functions, suitable and unsuitable use cases for serverless, where to store credentials, characteristics of serverless functions, the "freeze/thaw cycle", and approaches to avoid for state management.
AWS Lambda from the Trenches
In this talk, we discussed lessons have learnt about operating AWS Lambda in production, whilst transitioning from a traditional, monolithic system.
Journey towards serverless infrastructure
Some lessons we learned during the AWS migration of Opintopolku.fi (studyinfo.fi). Presented at the meetup of AWS User Group Helsinki on 2018-03-08.
Startup DevOps - Jon Milsom Pitchero - Leeds DevOps - August 2014
Presentation at Leeds DevOps by Jon Milsom (Co-Founder & CTO, Pitchero), August 2014
http://www.pitchero.com/
http://www.leedsdevops.org.uk/
https://twitter.com/jonmilsom
https://twitter.com/leedsDevops
Lessons Learned from building a serverless API
We had to build a fast and reliable API for a public-facing phone application. Why use a shiny new technology to build this API when there are already proven ways to do it?
In this talk I will explore why we decided to use AWS Lambdas and how it was different from developing and deploying a “conventional" API. Hear about lessons learned throughout the journey, from just playing with Lambdas at home through to successfully shipping a functional product.
Learning outcomes.
- What serverless is
- How building a serverless architecture differs from a conventional one.
- What kind of projects could benefit from a serverless architecture.
Performance Monitoring with AOP and Amazon CloudWatch
This document discusses using aspect-oriented programming (AOP) and Amazon Web Services (AWS) for performance monitoring of server-side applications. It describes how AOP can be used to gather runtime data with minimal boilerplate code. The data is then published to AWS CloudWatch, which provides visualization of metrics over time as well as alarm and notification capabilities. With this approach, developers can monitor important metrics like method execution times, errors and IO operations across a distributed environment in a simple and cost-effective manner.
What's hot (20)
(ISM301) Engineering Netflix Global Operations In The Cloud
(ISM301) Engineering Netflix Global Operations In The Cloud
Give your little scripts big wings: Using cron in the cloud with Amazon Simp...
Give your little scripts big wings: Using cron in the cloud with Amazon Simp...
Serverless design considerations for Cloud Native workloads
Serverless design considerations for Cloud Native workloads
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
AWS Lambda: Best Practices and Common Mistakes - Dev Ops West 2019
AWS Lambda: Best Practices and Common Mistakes - Dev Ops West 2019
Open stack ocata summit enabling aws lambda-like functionality with openstac...
Open stack ocata summit enabling aws lambda-like functionality with openstac...
Startup DevOps - Jon Milsom Pitchero - Leeds DevOps - August 2014
Startup DevOps - Jon Milsom Pitchero - Leeds DevOps - August 2014
Performance Monitoring with AOP and Amazon CloudWatch
Performance Monitoring with AOP and Amazon CloudWatch
Similar to Content distribution
Building a Scalable Asset Management (DAM) Platform in the AWS
This document outlines the architecture for building a scalable digital asset management (DAM) platform in the cloud. Key components include Amazon S3 for storage, auto scaling EC2 instances for processing metadata and generating renditions, DynamoDB for the catalog, CloudSearch for search, and Elastic Transcoder for transcoding. The architecture provides ingest of assets from S3, metadata extraction using EC2 workers, generation of renditions, building the catalog in DynamoDB and CloudSearch, and delivery of assets through CloudFront.
Netflix keynote-adrian-qcon
Netflix uses cloud computing to address challenges in scaling its infrastructure to support unpredictable growth. It has transitioned its website to be nearly 100% cloud-based using Amazon Web Services (AWS) to gain the scale, availability and agility needed. AWS provides tools and features like auto-scaling that allow Netflix to easily expand capacity as its subscriber base grows by over 50% per year. By leveraging AWS' mature cloud platform, Netflix can focus on its core video business rather than managing data centers.
Building a Scalable Digital Asset Management Platform in the Cloud (MED402) |...
With the breadth of AWS services available that are relevant to digital media, organizations can readily build out complete content/asset management (DAM/MAM/CMS) solutions in the cloud. This session provides a detailed walkthrough for implementing a scalable, rich-media asset management platform capable of supporting a variety of industry use cases. The session includes code-level walkthrough, AWS architecture strategies, and integration best practices for content storage, metadata processing, discovery, and overall library management functionality—with particular focus on the use of Amazon S3, Amazon Elastic Transcoder, Amazon DynamoDB and Amazon CloudSearch. Customer case study will highlight successful usage of Amazon CloudSearch by PBS to enable rich discovery of programming content across the breadth of their network catalog.
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
4K video is fast setting the minimum bar for content capture, be it consumer, prosumer, professional, episodic or theatrical. This in turn is leading to more demanding infrastructure requirements for media production, management and distribution. Consumers now have a variety of viewing devices and expect an optimal viewing experience for all of them, regardless of screen size or bandwidth availability. Media companies need to deliver on that consumer expectation while at the same time optimizing for costs. They need to produce content for the highest quality viewing experience, but have the ability to deliver to a wide variety of quality levels. They need an infrastructure that scales automatically and just works, whether it is a full 4K production workflow, subsequent archive and content management, or a multi-device streaming. In addition to discussing the way in which an agile cloud infrastructure can meet the demands of a 4K workflow, this session will cover cutting edge technologies like remote application visualization and server-less workflow automation that can greatly help today's media companies in the race to serve their gadget savvy consumer.
Whole Site Delivery with Amazon CloudFront
CloudFront can be used for whole site delivery to make websites faster, better able to scale, more available, easier to manage, and less costly. It works by caching both static and dynamically generated content at edge locations close to users to provide low latency. Customers like the Toronto Star and NPR have used CloudFront for whole site delivery to improve performance during major traffic events and reduce hosting costs. Key aspects are configuring caching rules and handling cookies to take advantage of CloudFront's global edge network.
Netflix in the cloud 2011
Netflix has over 20 million subscribers in the US and Canada and is expanding internationally. It is moving its operations entirely to the cloud to gain the scalability and flexibility needed to support unpredictable growth. Netflix uses Amazon Web Services extensively to handle its increasing capacity needs, leveraging AWS's large scale and feature set. The cloud allows Netflix to focus on its core business instead of managing infrastructure.
Gaming across multiple devices
Introduction to Microsoft Windows Azure and the Microsoft Cloud Services for Game Developers.
http://europe.casualconnect.org/content.html
AWS CDK: Your Infrastructure is Code!
Highlighting problems of the current tools in IaC space and showing better paths and alternatives for those kinds of issues. As a solution to the current state of affairs, I would like to present AWS CDK, which in my opinion shows the direction of the future Infrastructure as Code.
Inside dropbox
Dropbox is a cloud storage service that allows users to store and sync files across devices. It has over 100 million registered users who store over 1 billion files daily. Dropbox uses a distributed architecture, with metadata stored separately from file data to improve performance. File data is stored on Amazon S3 for scalability. Dropbox utilizes various networking techniques like TCP optimizations and caching to improve sync speeds and reduce bottlenecks despite limited bandwidth.
Scaling the Platform for Your Startup
Understand how to architect an infrastructure to handle going from zero to millions of users. From leveraging highly scalable AWS services to making smart decisions on building out your application, you'll learn a number of best practices for scaling your infrastructure in the cloud.
Cloud-based Data Lake for Analytics and AI
IBM's Cloud-based Data Lake for Analytics and AI presentation covered:
1) IBM's cloud data lake provides serverless architecture, low barriers to entry, and pay-as-you-go pricing for analytics on data stored in cloud object storage.
2) The data lake offers SQL-based data exploration, transformation, and analytics capabilities as well as industry-leading optimizations for time series and geospatial data.
3) Security features include customer-controlled encryption keys and options to hide SQL queries and keys from IBM.
Cloudpack
This document summarizes Amazon Web Services (AWS) and provides examples of how Japanese companies are using AWS. It discusses how AWS provides scalable computing resources through web services, allowing customers to increase or decrease capacity depending on their needs. It then gives examples of websites like SAVE JAPAN and JustGiving Japan that were able to handle spikes in traffic during disasters by using the flexible scaling of AWS. The document concludes by discussing how other Japanese companies are using AWS services like S3 and Route53 for applications and disaster recovery.
JOSA TechTalks - Downgrade your Costs
Docker is an open platform for developers and system administrators to build, ship and run distributed applications. Using Docker, companies in Jordan have been able to build powerful system architectures that allow speeding up delivery, easing deployment processes and at the same time cutting major hosting costs.
Osama Jaber shares his experience at ArabiaWeather in how they moved away from AWS to a highly-redundant, high-performance and low-cost solution using docker and other open-source technologies.
Infopark AG - AWS Customer Presentation
This document summarizes lessons learned from converting a web application to a multitenant architecture and deploying it on Amazon Web Services using Scalarium. Key lessons included implementing a "shared nothing" database architecture, automating machine installation and management with Chef recipes, using multiple availability zones for high availability, choosing a NoSQL database like CouchDB for scalability, implementing stringent security practices like IAM and MFA, and considering human factors like data privacy when moving to a cloud platform. The speaker concluded it is important to automate everything possible and not forget the human aspects of transitioning to SaaS.
Digital Media Ingest and Storage Options on AWS
Storage is the most clear requirement for digital media. The AWS Cloud has customized solutions that cater to digital media storage, and present an array of options to ingest, store and move digital media, using the Cloud as a transport and storage mechanism.
Erik Durand, the Principal Business Development Manager for AWS Storage, takes us on this analysis of the options, benefits and characteristics of each one.
Presented during the AWS Media and Entertainment Symposium in Toronto
AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...
Whether you’re a cash-strapped startup or an enterprise optimizing spend, it pays to run cost-efficient architectures on AWS. This session reviews a wide range of cost planning, monitoring, and optimization strategies, featuring real-world experience from AWS customers. We’ll cover how you can effectively combine EC2 On-Demand, Reserved, and Spot instances to handle different use cases, leveraging auto scaling to match capacity to workload, choosing the most optimal instance type through load testing, taking advantage of multi-AZ support, and using CloudWatch to monitor usage and automatically shut off resources when not in use. We'll discuss taking advantage of tiered storage and caching, offloading content to Amazon CloudFront to reduce back-end load, and getting rid of your back end entirely, by leveraging AWS high-level services. We will also showcase simple tools to help track and manage costs, including the AWS Cost Explorer, Billing Alerts, and Trusted Advisor. This session will be your pocket guide for running cost effectively in the Amazon cloud.
Watch the re:Invent recording here: https://www.youtube.com/watch?v=SG1DsYgeGEk
Choosing the Right Cloud Storage for Media and Entertainment Workloads - Apri...
- Learn about various AWS storage tiers with respect to cost, performance, throughput and durability for large-scale distributed processing workloads.
- Learn about various AWS storage tiers with respect to unique media workloads such as transcoding, QC, VFX/Animation rendering.
Learn about using AWS storage services for hybrid workloads for both content repositories in the cloud and processing on-premises or vice versa.
- Learn about AWS storage options and how to migrate legacy media applications running on the cloud to re-engineered applications.
- Learn about shared filesystem options on AWS including Amazon EFS and how to build your own using partner products on Amazon EC2 and Amazon EBS.
Media companies, driven by higher resolution and an increasing amount of content due to direct B2C delivery, are looking to cost effectively leverage cloud compute scalability. Emerging use cases, such as Media Supply Chains, VFX/Animation rendering, and transcoding for OTT streaming, require careful planning when being deployed to the cloud. Storage is an important component critical to the performance and processing of media.
Amazon Web Services provides a variety of highly available, cost effective storage solutions that can deliver the right performance for the underlying application. This technical session will discuss various cloud storage strategies for different content processing workloads. We will take a deep dive at Media Supply Chains (including content transcoding, QC, mastering and packaging), post production tasks in the cloud, and other Media & Entertainment workloads.
MongoDB .local London 2019: MongoDB Atlas Data Lake Technical Deep Dive
This document summarizes MongoDB Atlas Data Lake, a new service that allows customers to access, query, and analyze long-term data stored in AWS S3 buckets. It implements MongoDB's query language and security model to provide a familiar interface for working with structured data in object storage. The service is read-only, distributed, and optimized to handle queries over vast amounts of data efficiently using MongoDB's aggregation engine. Customers maintain full control over their data and how it is configured and accessed.
CommunityOneEast 09 - Running Java On Amazon EC2
The Amazon Elastic Compute Cloud (EC2) is a virtualized computing environment where you rapidly provision and manage servers via a web services API. It is ideally suited to running Java applications because it allows you to develop applications using standard software packages such as Glassfish and MySQL. However, because it is a cloud, some aspects of EC2 are very different than a traditional, physical computing environment, which impacts how you handle security, networking, storage and availability.
Deploying a Disaster Recovery Site on AWS: Minimal Cost with Maximum Efficiency
This document provides an overview of deploying a disaster recovery site on AWS. It discusses various disaster recovery techniques including pilot light, warm standby, and hot site approaches. It then presents several use cases for disaster recovery on AWS including backup for entry-level users, large data archive needs, on-site virtualization replication, multisite replication, knowledge worker DR sites, and mobile access to recovery capabilities. For each use case it estimates the monthly costs for running the disaster recovery solution on AWS services. The presentation emphasizes lessons from history about planning for unexpected events, testing recovery plans, and having knowledge to properly interpret system alarms or failures. It concludes by discussing how AWS could enable more automated and easy to use disaster recovery capabilities.
Similar to Content distribution (20)
Building a Scalable Asset Management (DAM) Platform in the AWS
Building a Scalable Asset Management (DAM) Platform in the AWS
Building a Scalable Digital Asset Management Platform in the Cloud (MED402) |...
Building a Scalable Digital Asset Management Platform in the Cloud (MED402) |...
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...
AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...
Choosing the Right Cloud Storage for Media and Entertainment Workloads - Apri...
Choosing the Right Cloud Storage for Media and Entertainment Workloads - Apri...
MongoDB .local London 2019: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local London 2019: MongoDB Atlas Data Lake Technical Deep Dive
Deploying a Disaster Recovery Site on AWS: Minimal Cost with Maximum Efficiency
Deploying a Disaster Recovery Site on AWS: Minimal Cost with Maximum Efficiency
Recently uploaded
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
2024-05-30_meetup_devops_aix-marseille.pdf
Slides de notre meetup DevOps AixMarseille du 30 mai 2024 chez SmarTribune
Sujets: platform engineering / terragrunt / test containers
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...OECD Directorate for Financial and Enterprise Affairs
This presentation by OECD, OECD Secretariat, was made during the discussion “Competition and Regulation in Professions and Occupations” held at the 77th meeting of the OECD Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found at oe.cd/crps.
This presentation was uploaded with the author’s consent.
Carrer goals.pptx and their importance in real life
Career goals serve as a roadmap for individuals, guiding them toward achieving long-term professional aspirations and personal fulfillment. Establishing clear career goals enables professionals to focus their efforts on developing specific skills, gaining relevant experience, and making strategic decisions that align with their desired career trajectory. By setting both short-term and long-term objectives, individuals can systematically track their progress, make necessary adjustments, and stay motivated. Short-term goals often include acquiring new qualifications, mastering particular competencies, or securing a specific role, while long-term goals might encompass reaching executive positions, becoming industry experts, or launching entrepreneurial ventures.
Moreover, having well-defined career goals fosters a sense of purpose and direction, enhancing job satisfaction and overall productivity. It encourages continuous learning and adaptation, as professionals remain attuned to industry trends and evolving job market demands. Career goals also facilitate better time management and resource allocation, as individuals prioritize tasks and opportunities that advance their professional growth. In addition, articulating career goals can aid in networking and mentorship, as it allows individuals to communicate their aspirations clearly to potential mentors, colleagues, and employers, thereby opening doors to valuable guidance and support. Ultimately, career goals are integral to personal and professional development, driving individuals toward sustained success and fulfillment in their chosen fields.
Supercharge your AI - SSP Industry Breakout Session 2024-v2_1.pdf
During the May 2024 SSP Conference in Boston, MA, Margie Hlava gave this presentation during the Industry Breakout Session on May 29, 2024.
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Dutch Power Event
“AI – Navigeren naar de toekomst?”
Op 28 mei 2024 bij Info Support.
ASONAM2023_presection_slide_track-recommendation.pdf
Presented at the 2023 IEEE/ACM International Conference on
Advances in Social Networks Analysis and Mining.
XP 2024 presentation: A New Look to Leadership
Presentation slides from XP2024 conference, Bolzano IT. The slides describe a new view to leadership and combines it with anthro-complexity (aka cynefin).
Tom tresser burning issue.pptx My Burning issue
Addressing the status of black home ownership in America. and what actions are taken to impact these trends.
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Insight: In a landscape where traditional narrative structures are giving way to fragmented and non-linear forms of storytelling, there lies immense potential for creativity and exploration.
'Collapsing Narratives: Exploring Non-Linearity' is a micro report from Rosie Wells.
Rosie Wells is an Arts & Cultural Strategist uniquely positioned at the intersection of grassroots and mainstream storytelling.
Their work is focused on developing meaningful and lasting connections that can drive social change.
Please download this presentation to enjoy the hyperlinks!
Updated diagnosis. Cause and treatment of hypothyroidism
Types, classification, causes, diagnosis and treatment of hypothyroidism
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...OECD Directorate for Financial and Enterprise Affairs
This presentation by Professor Alex Robson, Deputy Chair of Australia’s Productivity Commission, was made during the discussion “Competition and Regulation in Professions and Occupations” held at the 77th meeting of the OECD Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found at oe.cd/crps.
This presentation was uploaded with the author’s consent.Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
This is a workshop about communication and collaboration. We will experience how we can analyze the reasons for resistance to change (exercise 1) and practice how to improve our conversation style and be more in control and effective in the way we communicate (exercise 2).
This session will use Dave Gray’s Empathy Mapping, Argyris’ Ladder of Inference and The Four Rs from Agile Conversations (Squirrel and Fredrick).
Abstract:
Let’s talk about powerful conversations! We all know how to lead a constructive conversation, right? Then why is it so difficult to have those conversations with people at work, especially those in powerful positions that show resistance to change?
Learning to control and direct conversations takes understanding and practice.
We can combine our innate empathy with our analytical skills to gain a deeper understanding of complex situations at work. Join this session to learn how to prepare for difficult conversations and how to improve our agile conversations in order to be more influential without power. We will use Dave Gray’s Empathy Mapping, Argyris’ Ladder of Inference and The Four Rs from Agile Conversations (Squirrel and Fredrick).
In the session you will experience how preparing and reflecting on your conversation can help you be more influential at work. You will learn how to communicate more effectively with the people needed to achieve positive change. You will leave with a self-revised version of a difficult conversation and a practical model to use when you get back to work.
Come learn more on how to become a real influencer!
Media as a Mind Controlling Strategy In Old and Modern Era
This presentation, created by Syed Faiz ul Hassan, explores the profound influence of media on public perception and behavior. It delves into the evolution of media from oral traditions to modern digital and social media platforms. Key topics include the role of media in information propagation, socialization, crisis awareness, globalization, and education. The presentation also examines media influence through agenda setting, propaganda, and manipulative techniques used by advertisers and marketers. Furthermore, it highlights the impact of surveillance enabled by media technologies on personal behavior and preferences. Through this comprehensive overview, the presentation aims to shed light on how media shapes collective consciousness and public opinion.
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Dutch Power Event
“AI – Navigeren naar de toekomst?”
Op 28 mei 2024 bij Info Support.
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
• For a full set of 760+ questions. Go to
https://skillcertpro.com/product/databricks-certified-data-engineer-associate-exam-questions/
• SkillCertPro offers detailed explanations to each question which helps to understand the concepts better.
• It is recommended to score above 85% in SkillCertPro exams before attempting a real exam.
• SkillCertPro updates exam questions every 2 weeks.
• You will get life time access and life time free updates
• SkillCertPro assures 100% pass guarantee in first attempt.
Recently uploaded (19)
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Carrer goals.pptx and their importance in real life
Carrer goals.pptx and their importance in real life
Supercharge your AI - SSP Industry Breakout Session 2024-v2_1.pdf
Supercharge your AI - SSP Industry Breakout Session 2024-v2_1.pdf
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
ASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdf
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Updated diagnosis. Cause and treatment of hypothyroidism
Updated diagnosis. Cause and treatment of hypothyroidism
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Media as a Mind Controlling Strategy In Old and Modern Era
Media as a Mind Controlling Strategy In Old and Modern Era
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
Content distribution
- 1. Content Distribution and Archival in a Digital Age ! ! Dan Coffey dan_coffey@harvard.edu ! David J. Malan malan@harvard.edu
- 2. EC2
- 3. EC2 EC2...
- 10. S3 student CF
- 12. Outbound Data Bandwidth Bucket Size CS50x 2012 342.49 TB 335 GB CSE1 2013 27.65 TB 123 GB
- 28. Live Streaming
- 35. Archiving
- 36. Media Lifecycle for CS50 Source Files Project Files Master Files Day 0 Backed up on fast RAID Created Project Completion Archived locally to slow RAID Archived locally to slow RAID Archived locally to slow RAID Day 365 Removed Removed Archived to Amazon Glacier
- 41. Content Distribution and Archival in a Digital Age ! ! Dan Coffey dan_coffey@harvard.edu ! David J. Malan malan@harvard.edu