In this presentation, learn how Agile Infrastructure for OpenStack enables you to quickly stand up a dynamic self-service cloud infrastructure so you can easily take advantage of the flexibility, scalability, and efficiency of OpenStack.
You'll gain a better understanding of how Agile Infrastructure:
* Extends the core values of cloud: scale, guaranteed performance, automation, high availability and efficiency
* Ensures you deploy OpenStack using a process that's repeatable and error free
* Allows you to run production and test/dev workloads on one storage platform
* Provides higher utilization, better performance and more operational efficiency than legacy solutions
Netflix Edge Engineering Open House Presentations - June 9, 2016Daniel Jacobson
Netflix's Edge Engineering team is responsible for handling all device traffic for to support the user experience, including sign-up, discovery and the triggering of the playback experience. Developing and maintaining this set of massive scale services is no small task and its success is the difference between millions of happy streamers or millions of missed opportunities.
This video captures the presentations delivered at the first ever Edge Engineering Open House at Netflix. This video covers the primary aspects of our charter, including the evolution of our API and Playback services as well as building a robust developer experience for the internal consumers of our APIs.
(ISM301) Engineering Netflix Global Operations In The CloudAmazon Web Services
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages.
Netflix Development Patterns for Scale, Performance & Availability (DMG206) |...Amazon Web Services
This session explains how Netflix is using the capabilities of AWS to balance the rate of change against the risk of introducing a fault. Netflix uses a modular architecture with fault isolation and fallback logic for dependencies to maximize availability. This approach allows for rapid independent evolution of individual components to maximize the pace of innovation and A/B testing, and offers nearly unlimited scalability as the business grows. Learn how we balance managing change to (or subtraction from) the customer experience, while aggressively scraping barnacle features that add complexity for little value.
Immutable Infrastructure: the new App DeploymentAxel Fontaine
Immutable Infrastructure: the new App Deployment
App deployment and server setup are complex, error-prone and time-consuming. They require OS installers, package managers, configuration recipes, install and deployment scripts, server tuning, hardening and more. But... Is this really necessary? Are we trapped in a mindset of doing things this way just because that's how they've always done?
What if we could start over and radically simplify all this? What if, within seconds, and with a single command, we could wrap our application into the bare minimal machine required to run it? What if this machine could then be transported and run unchanged on our laptop and in the cloud? How do the various platforms and tools like AWS, Docker, Heroku and Boxfuse fit into this picture? What are their strengths and weaknesses? When should you use them?
This talk is for developers and architects wishing to radically improve and simplify how they deploy their applications. It takes Continuous Delivery to a level far beyond what you've seen today. Welcome to Immutable Infrastructure generation. This is the new black.
(GAM405) Create Streaming Game Experiences with Amazon AppStream | AWS re:Inv...Amazon Web Services
What if you could deliver a console-quality gaming experience to mobile devices anywhere in the world? In this session, learn about Amazon AppStream and how it enables real-time app streaming as a service via a few SDK calls. Hear how CCP has designed a new initial experience for their massive multiplayer game, EVE Online, that streams their character creator from the cloud, while the game downloads in the background, increasing conversions. We look at how Amazon Game Studios is developing hybrid games that run half on the tablet, half in the cloud, enabling console-quality graphics on mobile devices.
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...Amazon Web Services
Netflix's migration to the cloud as our primary streaming control plane was paralleled by our move from traditional IT and centralized operations to a more decentralized DevOps organizational model. In this session, we explore the relationship between technical infrastructure and organization and how to find the right balance of centralized and decentralized operations. We also cover the rationale, goals, strategies, and technologies applied to accomplish this daunting task. We reflect on where we stand today and how we've realized many of our goals.
(SPOT302) Availability: The New Kind of Innovator’s DilemmaAmazon Web Services
Successful companies, while focusing on their current customers' needs, often fail to embrace disruptive technologies and business models. This phenomenon, known as the "Innovator's Dilemma," eventually leads to many companies' downfall and is especially relevant in the fast-paced world of online services. In order to protect its leading position and grow its share of the highly competitive global digital streaming market, Netflix has to continuously increase the pace of innovation by constantly refining recommendation algorithms and adding new product features, while maintaining a high level of service uptime. The Netflix streaming platform consists of hundreds of microservices that are constantly evolving, and even the smallest production change may cause a cascading failure that can bring the entire service down. We face a new kind of Innovator's Dilemma, where product changes may not only disrupt the business model but also cause production outages that deny customers service access. This talk will describe various architectural, operational and organizational changes adopted by Netflix in order to reconcile rapid innovation with service availability.
Netflix Edge Engineering Open House Presentations - June 9, 2016Daniel Jacobson
Netflix's Edge Engineering team is responsible for handling all device traffic for to support the user experience, including sign-up, discovery and the triggering of the playback experience. Developing and maintaining this set of massive scale services is no small task and its success is the difference between millions of happy streamers or millions of missed opportunities.
This video captures the presentations delivered at the first ever Edge Engineering Open House at Netflix. This video covers the primary aspects of our charter, including the evolution of our API and Playback services as well as building a robust developer experience for the internal consumers of our APIs.
(ISM301) Engineering Netflix Global Operations In The CloudAmazon Web Services
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages.
Netflix Development Patterns for Scale, Performance & Availability (DMG206) |...Amazon Web Services
This session explains how Netflix is using the capabilities of AWS to balance the rate of change against the risk of introducing a fault. Netflix uses a modular architecture with fault isolation and fallback logic for dependencies to maximize availability. This approach allows for rapid independent evolution of individual components to maximize the pace of innovation and A/B testing, and offers nearly unlimited scalability as the business grows. Learn how we balance managing change to (or subtraction from) the customer experience, while aggressively scraping barnacle features that add complexity for little value.
Immutable Infrastructure: the new App DeploymentAxel Fontaine
Immutable Infrastructure: the new App Deployment
App deployment and server setup are complex, error-prone and time-consuming. They require OS installers, package managers, configuration recipes, install and deployment scripts, server tuning, hardening and more. But... Is this really necessary? Are we trapped in a mindset of doing things this way just because that's how they've always done?
What if we could start over and radically simplify all this? What if, within seconds, and with a single command, we could wrap our application into the bare minimal machine required to run it? What if this machine could then be transported and run unchanged on our laptop and in the cloud? How do the various platforms and tools like AWS, Docker, Heroku and Boxfuse fit into this picture? What are their strengths and weaknesses? When should you use them?
This talk is for developers and architects wishing to radically improve and simplify how they deploy their applications. It takes Continuous Delivery to a level far beyond what you've seen today. Welcome to Immutable Infrastructure generation. This is the new black.
(GAM405) Create Streaming Game Experiences with Amazon AppStream | AWS re:Inv...Amazon Web Services
What if you could deliver a console-quality gaming experience to mobile devices anywhere in the world? In this session, learn about Amazon AppStream and how it enables real-time app streaming as a service via a few SDK calls. Hear how CCP has designed a new initial experience for their massive multiplayer game, EVE Online, that streams their character creator from the cloud, while the game downloads in the background, increasing conversions. We look at how Amazon Game Studios is developing hybrid games that run half on the tablet, half in the cloud, enabling console-quality graphics on mobile devices.
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...Amazon Web Services
Netflix's migration to the cloud as our primary streaming control plane was paralleled by our move from traditional IT and centralized operations to a more decentralized DevOps organizational model. In this session, we explore the relationship between technical infrastructure and organization and how to find the right balance of centralized and decentralized operations. We also cover the rationale, goals, strategies, and technologies applied to accomplish this daunting task. We reflect on where we stand today and how we've realized many of our goals.
(SPOT302) Availability: The New Kind of Innovator’s DilemmaAmazon Web Services
Successful companies, while focusing on their current customers' needs, often fail to embrace disruptive technologies and business models. This phenomenon, known as the "Innovator's Dilemma," eventually leads to many companies' downfall and is especially relevant in the fast-paced world of online services. In order to protect its leading position and grow its share of the highly competitive global digital streaming market, Netflix has to continuously increase the pace of innovation by constantly refining recommendation algorithms and adding new product features, while maintaining a high level of service uptime. The Netflix streaming platform consists of hundreds of microservices that are constantly evolving, and even the smallest production change may cause a cascading failure that can bring the entire service down. We face a new kind of Innovator's Dilemma, where product changes may not only disrupt the business model but also cause production outages that deny customers service access. This talk will describe various architectural, operational and organizational changes adopted by Netflix in order to reconcile rapid innovation with service availability.
Translating Developer Productivity to Netflix Customer DelightVasanth Asokan
Slides from my talk at the Edge Engineering Meetup on June 9, 2016 at Netflix HQ, Los Gatos, CA. The talk covers why developer productivity is important for the Netflix experience based API system and takes a look at the kinds of problems we attempt to solve for Netflix developers.
This talk was part of a series of talks about the Netflix Edge.
http://www.slideshare.net/danieljacobson/netflix-edge-engineering-open-house-presentations-june-9-2016
Engineering Netflix Global Operations in the CloudJosh Evans
Delivered at re:Invent 2015.
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages.
Embracing Failure - Fault Injection and Service Resilience at NetflixJosh Evans
A presentation given at AWS re:Invent on how Netflix induces failure to validate and harden production systems. Technologies discussed include the Simian Army (Chaos Monkey, Gorilla, Kong) and our next gen Failure Injection Test framework (FIT).
QCon London Presentation - 3/8/16
Abstract:
On December 24th, 2012 ASW US-EAST1 experienced a region-wide failure that took down the Netflix service for almost 24 hours. Knowing that failure is inevitable in any complex system we evolved our cloud-based, micro-service architecture to support multi-region traffic management and failover capabilities. With that foundation in place we drove initiatives to achieve service ubiquity and rapid global expansion. The overarching theme is #NetflixEverywhere - an amazing, global, highly available movie and TV streaming experience for any member, anytime, on any device, anywhere in the world.
Building and evolving a pervasive, global service requires a multi-disciplined approach that balances requirements around service availability, latency, data replication, compute capacity, and efficiency. In this session, we’ll follow the Netflix journey of failure, innovation, and ubiquity. We'll review the many facets of globalization then delve deep into the architectural patterns that enable seamless, multi-region traffic management, reliable, fast data propagation, and efficient service infrastructure. The patterns presented will be broadly applicable to internet services with global aspirations.
Deep Dive with Amazon EC2 Container Service Hands-on WorkshopAmazon Web Services
This is an advanced workshop for Amazon ECS. In this workshop you will learn:
How to provision your Amazon ECS with CloudFormation
Amazon ECS with Windows Container
Amazon ECS CI/CD
Amazon ECS service autoscaling and host autoscaling design pattern and best practices
Amazon ECS log consolidation design patterns
Secure credential management with IAM and EC2 Parameter Store
Amazon ECS Events and design patterns
Service Discovery with fully-managed etcd3 cluster on Amazon ECS
Refactoring Organizations - A Netflix Study (QCon NYC 2017)Josh Evans
Is your service architecture and engineering velocity constrained by organizational concerns? Does it seem impossible to give priority to key initiatives regardless of intent? Are engineers switching tasks so often that they are just treading water? Are critical projects endlessly backlogged? Has staffing up pushed the limits of your team structure? Navigating through challenges like these can be daunting and solutions fraught with uncertainty. How do you know what, where, when to change. And whatever the answer is today it will most certainly vary over time. Effective organizations evolve, at key inflection points, to support critical business and technical goals. There is not only a strong relationship between organizations and the software they produce (Conway’s Law) but many organizational solutions can be derived from analogs in the technical realm. In other words, we can treat organizational improvement as a refactoring exercise. Over the last 20 years Netflix engineering has proven time and again an ability to adapt and grow, resulting in undisputed dominance over the global internet tv market. In this talk we’ll use Netflix as a case study to illustrate how specific strategies, framed as technical analogs, have been employed to maximize engineering agility, velocity, and impact. These powerful, yet simple strategies and solutions provide a useful blueprint for organizational success.
Amazon EBS provides persistent block-level storage volumes for use with Amazon EC2 instances. In this technical session, you will discover how Amazon EBS can take your application deployments on EC2 to the next level. Session attendees will learn about the Amazon EBS features and benefits, how to identify applications that are appropriate for use with Amazon EBS, best practices, and details about its performance and volume types. We discuss how to maximize Amazon EBS performance, with a special emphasis on low-latency, high-throughput applications like transactional and NoSQL databases, and big data analysis frameworks like Hadoop and Kafka. We will also dive deep and discuss Elastic Volumes, our latest EBS feature that allows you to dynamically increase capacity, tune performance, and change the type of EBS volumes on the fly. Throughout, we share tips for success.
Android 10ms Problem? Solved.
Overview and Demonstration of Android Audio's sub-10 ms Solution: Superpowered Media Server for Android using Superpowered Latency Measurement app and Google’s Dr. Rick O’Rang latency and audio glitch measurement app.
See http://superpowered.com/Superpowered-Android-Media-Server
The Netflix API has undergone a transformation since its inception in 2008. It has transitioned from being a public API with a generic RESTful interface to a platform for creating highly optimized, device-centric APIs that are critical to delivering the Netflix streaming experience on over 1000 different device types.
This talk covers the design principles that shaped the transformation of the API as well as the technology that powers it, enabling rapid user experience iteration and bringing Netflix streaming to almost 38 million subscribers around the world.
(DEV309) From Asgard to Zuul: How Netflix’s Proven Open Source Tools Can Help...Amazon Web Services
Learn how you can leverage the many Netflix Open Source tools to help grow your services to web-scale, and make them robust and resilient. We cover a variety of the OSS components-from operational tools like Asgard and Simian Army, to core services and libraries like Zuul, Eureka, Archaius, and Hystrix, plus a variety of security and big data tools. We walk through a sample application to illustrate how the many components fit together to build a cohesive solution.
Intro to Batch Processing on AWS - DevDay Los Angeles 2017Amazon Web Services
What to expect:
• Batch processing – overview and challenges
• Why run batch workloads in the cloud
• Overview of AWS batch solutions
• Deep dive look at AWS Batch and Amazon ECS
• Best practices
LearnBop Blue Green AWS Deployments - October 2015Alec Lazarescu
The swap CNAMEs blue/green deployment technique appears so beguilingly simple. Yet provided you have detailed monitoring and error logging you'll eventually see periodic oddities during deployments while users are on the site:
- User requests from a new code server being processed by an old code server and generating an error
- Users seemingly stuck on old code servers for hours - far longer than even longer TTL overrides would suggest
- Users on new code servers running javascript from the old code despite a versioned CDN URL and getting an error
During this session you can expect:
- Walkthrough of our current deployment method using only Amazon APIs that addresses all of the issues
- Discussion of past systems architecture and their gaps
- Gaining a deeper understanding of surprising DNS behavior
- Techniques to monitor and identify any of the issues above and more
- Learning how WebSockets/long polling can affect your deployment time and how to mitigate
- Tips on implementing a CDN and caching strategy that doesn't risk stale data
Building High Quality Video Operations in the Cloud - SynacorAmazon Web Services
Hardys Eggum, Synacor's Head of IT & Technical Operations presentation to the Video Processing & Delivery track at the Media & Entertainment Cloud Symposium on November 4, 2016
Slide deck for a presentation at OSCON 2011 about why Netflix uses web technology for TV user interfaces and how we maximize performance for a broad range of devices.
TechTarget Event - Storage Architectures for the Modern Data Center - Jeramia...NetApp
Why Is All-Flash Adoption Growing So Fast?
Presented by Jeramiah Dooley, Principal Architect, SolidFire
To be successful today, IT must transition from a cost center to a competitive advantage – and the path to success is through the data center. More central to business than ever before, the next-generation data center must be powered by all-flash.
All-flash is no longer the future; it's the present. Learn how all-flash can save your IT team time and resources with intelligent policy-based management, automation and more.
Translating Developer Productivity to Netflix Customer DelightVasanth Asokan
Slides from my talk at the Edge Engineering Meetup on June 9, 2016 at Netflix HQ, Los Gatos, CA. The talk covers why developer productivity is important for the Netflix experience based API system and takes a look at the kinds of problems we attempt to solve for Netflix developers.
This talk was part of a series of talks about the Netflix Edge.
http://www.slideshare.net/danieljacobson/netflix-edge-engineering-open-house-presentations-june-9-2016
Engineering Netflix Global Operations in the CloudJosh Evans
Delivered at re:Invent 2015.
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages.
Embracing Failure - Fault Injection and Service Resilience at NetflixJosh Evans
A presentation given at AWS re:Invent on how Netflix induces failure to validate and harden production systems. Technologies discussed include the Simian Army (Chaos Monkey, Gorilla, Kong) and our next gen Failure Injection Test framework (FIT).
QCon London Presentation - 3/8/16
Abstract:
On December 24th, 2012 ASW US-EAST1 experienced a region-wide failure that took down the Netflix service for almost 24 hours. Knowing that failure is inevitable in any complex system we evolved our cloud-based, micro-service architecture to support multi-region traffic management and failover capabilities. With that foundation in place we drove initiatives to achieve service ubiquity and rapid global expansion. The overarching theme is #NetflixEverywhere - an amazing, global, highly available movie and TV streaming experience for any member, anytime, on any device, anywhere in the world.
Building and evolving a pervasive, global service requires a multi-disciplined approach that balances requirements around service availability, latency, data replication, compute capacity, and efficiency. In this session, we’ll follow the Netflix journey of failure, innovation, and ubiquity. We'll review the many facets of globalization then delve deep into the architectural patterns that enable seamless, multi-region traffic management, reliable, fast data propagation, and efficient service infrastructure. The patterns presented will be broadly applicable to internet services with global aspirations.
Deep Dive with Amazon EC2 Container Service Hands-on WorkshopAmazon Web Services
This is an advanced workshop for Amazon ECS. In this workshop you will learn:
How to provision your Amazon ECS with CloudFormation
Amazon ECS with Windows Container
Amazon ECS CI/CD
Amazon ECS service autoscaling and host autoscaling design pattern and best practices
Amazon ECS log consolidation design patterns
Secure credential management with IAM and EC2 Parameter Store
Amazon ECS Events and design patterns
Service Discovery with fully-managed etcd3 cluster on Amazon ECS
Refactoring Organizations - A Netflix Study (QCon NYC 2017)Josh Evans
Is your service architecture and engineering velocity constrained by organizational concerns? Does it seem impossible to give priority to key initiatives regardless of intent? Are engineers switching tasks so often that they are just treading water? Are critical projects endlessly backlogged? Has staffing up pushed the limits of your team structure? Navigating through challenges like these can be daunting and solutions fraught with uncertainty. How do you know what, where, when to change. And whatever the answer is today it will most certainly vary over time. Effective organizations evolve, at key inflection points, to support critical business and technical goals. There is not only a strong relationship between organizations and the software they produce (Conway’s Law) but many organizational solutions can be derived from analogs in the technical realm. In other words, we can treat organizational improvement as a refactoring exercise. Over the last 20 years Netflix engineering has proven time and again an ability to adapt and grow, resulting in undisputed dominance over the global internet tv market. In this talk we’ll use Netflix as a case study to illustrate how specific strategies, framed as technical analogs, have been employed to maximize engineering agility, velocity, and impact. These powerful, yet simple strategies and solutions provide a useful blueprint for organizational success.
Amazon EBS provides persistent block-level storage volumes for use with Amazon EC2 instances. In this technical session, you will discover how Amazon EBS can take your application deployments on EC2 to the next level. Session attendees will learn about the Amazon EBS features and benefits, how to identify applications that are appropriate for use with Amazon EBS, best practices, and details about its performance and volume types. We discuss how to maximize Amazon EBS performance, with a special emphasis on low-latency, high-throughput applications like transactional and NoSQL databases, and big data analysis frameworks like Hadoop and Kafka. We will also dive deep and discuss Elastic Volumes, our latest EBS feature that allows you to dynamically increase capacity, tune performance, and change the type of EBS volumes on the fly. Throughout, we share tips for success.
Android 10ms Problem? Solved.
Overview and Demonstration of Android Audio's sub-10 ms Solution: Superpowered Media Server for Android using Superpowered Latency Measurement app and Google’s Dr. Rick O’Rang latency and audio glitch measurement app.
See http://superpowered.com/Superpowered-Android-Media-Server
The Netflix API has undergone a transformation since its inception in 2008. It has transitioned from being a public API with a generic RESTful interface to a platform for creating highly optimized, device-centric APIs that are critical to delivering the Netflix streaming experience on over 1000 different device types.
This talk covers the design principles that shaped the transformation of the API as well as the technology that powers it, enabling rapid user experience iteration and bringing Netflix streaming to almost 38 million subscribers around the world.
(DEV309) From Asgard to Zuul: How Netflix’s Proven Open Source Tools Can Help...Amazon Web Services
Learn how you can leverage the many Netflix Open Source tools to help grow your services to web-scale, and make them robust and resilient. We cover a variety of the OSS components-from operational tools like Asgard and Simian Army, to core services and libraries like Zuul, Eureka, Archaius, and Hystrix, plus a variety of security and big data tools. We walk through a sample application to illustrate how the many components fit together to build a cohesive solution.
Intro to Batch Processing on AWS - DevDay Los Angeles 2017Amazon Web Services
What to expect:
• Batch processing – overview and challenges
• Why run batch workloads in the cloud
• Overview of AWS batch solutions
• Deep dive look at AWS Batch and Amazon ECS
• Best practices
LearnBop Blue Green AWS Deployments - October 2015Alec Lazarescu
The swap CNAMEs blue/green deployment technique appears so beguilingly simple. Yet provided you have detailed monitoring and error logging you'll eventually see periodic oddities during deployments while users are on the site:
- User requests from a new code server being processed by an old code server and generating an error
- Users seemingly stuck on old code servers for hours - far longer than even longer TTL overrides would suggest
- Users on new code servers running javascript from the old code despite a versioned CDN URL and getting an error
During this session you can expect:
- Walkthrough of our current deployment method using only Amazon APIs that addresses all of the issues
- Discussion of past systems architecture and their gaps
- Gaining a deeper understanding of surprising DNS behavior
- Techniques to monitor and identify any of the issues above and more
- Learning how WebSockets/long polling can affect your deployment time and how to mitigate
- Tips on implementing a CDN and caching strategy that doesn't risk stale data
Building High Quality Video Operations in the Cloud - SynacorAmazon Web Services
Hardys Eggum, Synacor's Head of IT & Technical Operations presentation to the Video Processing & Delivery track at the Media & Entertainment Cloud Symposium on November 4, 2016
Slide deck for a presentation at OSCON 2011 about why Netflix uses web technology for TV user interfaces and how we maximize performance for a broad range of devices.
TechTarget Event - Storage Architectures for the Modern Data Center - Jeramia...NetApp
Why Is All-Flash Adoption Growing So Fast?
Presented by Jeramiah Dooley, Principal Architect, SolidFire
To be successful today, IT must transition from a cost center to a competitive advantage – and the path to success is through the data center. More central to business than ever before, the next-generation data center must be powered by all-flash.
All-flash is no longer the future; it's the present. Learn how all-flash can save your IT team time and resources with intelligent policy-based management, automation and more.
Consolidate your enterprise workloads without creating new performance constr...NetApp
In this presentation by SolidFire's vExpert Jeramiah Dooley, you will learn about how consolidating workloads onto a single platform can be the crucial missing step as VMware customers transition from a legacy architecture into a Software Defined Data Center.
Storage has become the boat anchor of the modern, virtualized data center. Up until recently it has been slow, unpredictable, inflexible, required far too much operational overhead and was sized, deployed and managed using methods created in the 1980s. Worst of all, storage capacity and performance are often still locked together in fixed ratios, making it inevitable that even the best run storage environment will be wasteful and inefficient as you consolidate your applications.
But it doesn’t have to be this way. The technology and know-how exists to have storage be a predictable, flexible, and easily managed part of an overall virtualized platform designed to provide the performance and availability that today’s end user workloads demand.
Learn how to simplify management and guarantee application performance through the unique combination of vSphere and SolidFire.
- Consolidation of multiple mission critical applications on the same storage system
- Integrated End-to-End Quality of Service allocation using VMware's SIOC settings to eliminate inconsistent performance
- Eliminate VM sprawl and the need to over-provision storage, allowing you to deploy more VMs on the same infrastructure
StorPool Storage presenting at Storage Field Day 25pdfStorPool Storage
Storage Field Day 25 took place on March 22–23, 2023, and gathered industry leaders and storage analysts in an exciting 2-day meet up with technical presentations. StorPool Storage participated in the event, and our team showcased our storage platform, its capabilities, and improvements.
Learn more: Watch now the recording of the presentation: https://storpool.com/blog/storpool-presents-at-storage-field-day-25-video-recordings
Why Use Oracle VM for Oracle Databases? Revera PresentationFrancisco Alvarez
Presentation about results of internal benchmarks done by Revera in NZ regarding the performance of an Oracle Database runing in bare metal vs virtualized environments.
Accelerate Your OpenStack Deployment Presented by SolidFire and Red HatNetApp
What would you do if your storage infrastructure weren't a barrier to your cloud? In 'Accelerate your OpenStack Deployment' you'll see how Agile Infrastructure (AI) simplifies deployments and dynamic IT-as-a-Service-style offerings, such as self-service test & development or production-ready private clouds. AI frees you to think up the stack and stop worrying about your infrastructure.
Webinar - Introduction to Utilizing SolidFire in the Public Sector NetApp
This webinar examines why the future is all-flash storage and how consolidating workloads onto a single platform can be the crucial step to achieving the goal of The Federal Mandate for Data Center Consolidation.
AWS Summit Kuala Lumpur - Opening Keynote by Dr. Werner VogelsAmazon Web Services
Opening Keynote – Dr. Werner Vogels, Chief Technology Officer, Amazon.com and AWS Customers
Thivanka Rangala, Chief Financial Officer at edotco Group
Arzumy MD, Chief Technology Officer at KFit
Subash Palaniappan, Head of Idea Design at Maybank Innovation
DevOps the NetApp Way: 10 Rules for Forming a DevOps TeamNetApp
Does your enterprise IT organization practice DevOps without a common team approach? To create a standardized way for development and operations teams to work together at NetApp, the IT team differentiates a DevOps team from a regular development team based on these 10 rules.
Spot Lets NetApp Get the Most Out of the CloudNetApp
Prior to NetApp acquiring Spot.io, two of its IT teams had adopted Spot in their operations: Product Engineering for Cloud Volumes ONTAP test automation and NetApp IT for corporate business applications. Check out the results in this infographic.
NetApp has fully embraced tools that allow for seamless, collaborative work from home, and as a result was fully prepared to minimize COVID-19's impact on how we conduct business. Check out this infographic for a look at results from the new remote work reality.
4 Ways FlexPod Forms the Foundation for Cisco and NetApp SuccessNetApp
At Cisco and NetApp, seeing our customers succeed in their digital transformations means that we’ve succeeded too. But that’s only one of the ways we measure our performance. What’s another way? Hearing how our wide-ranging IT support helps Cisco and NetApp thrive. Here’s what makes FlexPod an indispensable part of Cisco’s and NetApp’s IT departments.
With the widespread adoption of hybrid multicloud as the de-facto architecture for the enterprise, organizations everywhere are modernizing to deliver tangible business value around data-intensive applications and workloads such as AI-driven IoT and Hyperledgers. Shifting from on-premises to public cloud services, private clouds, and moving from disk to flash – sometimes concurrently – opens the door to enormous potential, but also the unintended consequence of IT complexity.
With the widespread adoption of hybrid multicloud as the de facto IT architecture for the enterprise, organizations everywhere are modernizing to deliver tangible business value around data-intensive applications and workloads such as AI-driven IoT and indelible ledgers.
10 Reasons Why Your SAP Applications Belong on NetAppNetApp
NetApp has been supporting SAP for 20 years, delivering advanced solutions for SAP applications. Here are 10 reasons why your SAP applications belong on NetApp!
Redefining HCI: How to Go from Hyper Converged to Hybrid Cloud InfrastructureNetApp
The hyper converged infrastructure (HCI) market is entering a new phase of maturity. A modern HCI solution requires a private cloud platform that integrates with public clouds to create a consistent hybrid multi-cloud experience.
During this webinar, NetApp and an IDC guest speaker covered what led to the next generation of hyper converged infrastructure and which five capabilities are required to go from hyper converged to hybrid cloud infrastructure.
As we enter 2019, what stands out is how trends in business and technology are connected by common themes. For example, AI is at the heart of trends in development, data management, and delivery of applications and services at the edge, core, and cloud. Also essential are containerization as a critical enabling technology and the increasing intelligence of IoT devices at the edge. Navigating the tempests of transformation are developers, whose requirements are driving the rapid creation of new paradigms and technologies that they must then master in pursuit of long-term competitive advantage. Here are some of our perspectives and predictions for 2019.
Künstliche Intelligenz ist in deutschen Unter- nehmen ChefsacheNetApp
Einer aktuellen Umfrage des führenden Datenma- nagementspezialisten in der Hybrid Cloud NetApp zufolge gewinnt künstliche Intelligenz (KI) in deut- schen Unternehmen zunehmend an Relevanz.
Iperconvergenza come migliora gli economics del tuo ITNetApp
In this NetApp Webinar we present how NetApp HCI helps improve the economics of IT: accelerating and ensuring performance for each application, simplifying your Data Center and make your architecture more scalable by reducing waste, implementing and expanding your HCI infrastructure quickly and inexpensively, making your management even simpler and more intuitive, saving time and using the skills you already have in the company.
NetApp IT’s Tiered Archive Approach for Active IQNetApp
NetApp AutoSupport technology proactively monitors the health of NetApp systems installed at customer’s location and provides 24/7 actionable intelligence to optimize their storage environment. The amount of data received back to NetApp doubles approximately every 16 months. To manage the swelling waves of data to archive, NetApp IT sought a more flexible solution.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
4. Why are OpenStack Deployments Slow?
• GOOD ANSWERS
• Different technology that requires different skillsets
• Responding to new consumption models takes planning
• Workload availability is important, risk is high
• Transformation is hard
• BAD ANSWERS
• It’s unstable
• It’s too complex, and requires us to own the PhDs
• There are no good examples to follow
• It’s too new
5. What SolidFire Sees In the Field
• About 40% of our pipeline, across both SP and Enterprise is
OpenStack related
• The OpenStack ecosystem has come a long way
• Real ecosystem: code contributors, project leaders,
champions
• ‘Fake’ ecosystem: usually hardware vendors who are just
writing drivers
• Deployment process is so (SO) much better than it has been
• Enterprises are seriously working to figure out how to integrate
OpenStack from an operational standpoint
6. What Do Customers Need?
1. Help understanding the operational impact of OpenStack
2. Help understanding which workloads are best suited for
OpenStack
3. Examples of what works and what doesn’t
For almost every enterprise we talk to evaluating OpenStack,
storage is a huge question mark!
7. Let’s Get Started!
• Overview of SolidFire storage solution
• Details on SolidFire Cinder driver capabilities
• Overview of Agile Infrastructure reference designs
• Best Practices and Lessons Learned
8. High performance storage systems designed for
large scale infrastructure
Industry Leading
Quality of Service (QoS)
Scale-Out Architecture
• 4 – 100 nodes
• 35TB – 3.4PB Usable Capacity
• 200k – 7.5M Controllable IOPS
Simple all inclusive
pricing model Direct Tier 3 Support
for every customer
Industry-standard hardware
• 10 GigE iSCSI, 16/8 Gb FC
9. All-flash storage platform
for the next generation data center.
Scale-Out
Infrastructure Agility
Guaranteed
Quality of Service
Complete
System Automation
In-Line Data
Reduction
Self Healing
High Availability
11. Scale-Out Agility
Performance
Capacity
43.6 TB 250,000 IOPS
200,000 IOPS35 TB
Guaranteed Compatibility
between all SolidFire storage nodes
• Future-Proof your storage investment
• Eliminate storage migrations and forklift upgrades
• Never wait 3 years for an upgrade
Linear Scale
of Performance and Capacity
Expand / Contract
without disruption or reconfiguration
12. Scale-Out Agility
Performance
Capacity
43.6 TB 250,000 IOPS
52.2 TB 300,000 IOPS
200,000 IOPS35 TB
Guaranteed Compatibility
between all SolidFire storage nodes
• Future-Proof your storage investment
• Eliminate storage migrations and forklift upgrades
• Never wait 3 years for an upgrade
Linear Scale
of Performance and Capacity
Expand / Contract
without disruption or reconfiguration
13. Scale-Out Agility
Performance
Capacity
43.6 TB 250,000 IOPS
60.8 TB 350,000 IOPS
52.2 TB 300,000 IOPS
200,000 IOPS35 TB
Guaranteed Compatibility
between all SolidFire storage nodes
• Future-Proof your storage investment
• Eliminate storage migrations and forklift upgrades
• Never wait 3 years for an upgrade
Linear Scale
of Performance and Capacity
Expand / Contract
without disruption or reconfiguration
14. SolidFire QoS Eliminates of traditional
performance related storage problems - ESG 2015
Guaranteed Quality of Service (QoS)
Dynamically Allocate, Manage and Guarantee
storage performance independent of capacity
Define / enforce Min, Max and Burst settings
for each application / volume
15. Capacity & Performance
SOLIDFIRE CLUSTER
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
CAPACITY
VIRTUALIZATION
(GB)
PERFORMANCE
VIRTUALIZATION
(IOPS)
68
TB
AVAILABLE
200
K
AVAILABLE
VOLUMES
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
16. Capacity & Performance
SOLIDFIRE CLUSTER
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
CAPACITY
VIRTUALIZATION
(GB)
PERFORMANCE
VIRTUALIZATION
(IOPS)
VOLUMES
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
17. Capacity & Performance
SOLIDFIRE CLUSTER
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
CAPACITY
VIRTUALIZATION
(GB)
PERFORMANCE
VIRTUALIZATION
(IOPS)
VOLUMES
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
18. Capacity & Performance
SOLIDFIRE CLUSTER
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
17
TB
50k
IOPS
CAPACITY
VIRTUALIZATION
(GB)
PERFORMANCE
VIRTUALIZATION
(IOPS)
VOLUMES
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
19. How QoS Works
VOLUME
Per
Volume
QoS
Se1ngs
Burst
2,000
Max
1,000
Min
100
APP BEHAVIOR
Burst
Max
Min
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
CLUSTER
20. How QoS Works
VOLUME
Per
Volume
QoS
Se1ngs
Burst
2,000
Max
1,000
Min
100
APP BEHAVIOR
Burst
Max
Min
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
CLUSTER
21. How QoS Works
VOLUME
Per
Volume
QoS
Se1ngs
Burst
2,000
Max
1,000
Min
100
APP BEHAVIOR
Burst
Max
Min
MIXED WORKLOAD ENVIRONMENT
100
Min
200
Max
300
Burst
Volume
3
1000
Min
1500
Max
2000
Burst
VOLUME
2
100
Min
500
Max
700
Burst
VOLUME
1
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
CLUSTER
22. How QoS Works
VOLUME
Per
Volume
QoS
Se1ngs
Burst
2,000
Max
1,000
Min
100
APP BEHAVIOR
Burst
Max
Min
MIXED WORKLOAD ENVIRONMENT
100
Min
200
Max
300
Burst
Volume
3
1000
Min
1500
Max
2000
Burst
VOLUME
2
100
Min
500
Max
700
Burst
VOLUME
1
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
CLUSTER
23. How QoS Works
VOLUME
Per
Volume
QoS
Se1ngs
Burst
2,000
Max
1,000
Min
100
APP BEHAVIOR
Burst
Max
Min
MIXED WORKLOAD ENVIRONMENT
100
Min
200
Max
300
Burst
Volume
3
1000
Min
1500
Max
2000
Burst
VOLUME
2
100
Min
500
Max
700
Burst
VOLUME
1
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
CLUSTER
24. How QoS Works
VOLUME
Per
Volume
QoS
Se1ngs
Burst
2,000
Max
1,000
Min
100
APP BEHAVIOR
Burst
Max
Min
MIXED WORKLOAD ENVIRONMENT
100
Min
200
Max
300
Burst
Volume
3
1000
Min
1500
Max
2000
Burst
VOLUME
2
100
Min
500
Max
700
Burst
VOLUME
1
Element
OS
|
G U A R A N T E E D
P E R F O R M A N C E
CLUSTER
25. Empower Enterprise IT to deliver greater strategic value to the business
• Native REST-based API
• Deep integration with management & orchestration platforms
• Support development of user-facing storage controls
• Reduce risk of human error and associated with complex administrative tasks
• Enables rapid deployment of applications & services
Complete System Automation
“Spin up virtual machines up to 81% faster
than traditional storage” – ESG 2015
“SolidFire Automation helps lower
operating expenses by up to
– ESG 2015
Create
Volume
API
Call
{
"method":
"CreateVolume",
"params":
{
"name":
"<Volume
Name>",
"accountID":
1,
"totalSize":
10000,
"enable512e":
false,
"aLributes":
{},
"qos":
{
"minIOPS":
100,
"maxIOPS":
200,
"burstIOPS":
300
}
},
"id":
1
}
27. TIME YOUR BUSINESS
DESIGN
IniQal
size
(GB
or
IOPS)
INSTALLATION OPERATING
GB
and
IOPS
required
Account
CreaQon
SCALING
GB
and
IOPS
needed
UPGRADEDESIGN
IniQal
size
(GB
or
IOPS)
AnQcipated
growth
over
lifecycle
of
array
IOPS
required
lifeQme
of
product
Node
size
selecQon
RAID
type,
RAID
grouping
Drive
type
(FC,
NL,
Flash)
Drive
quanQQes
and
raQo
Cache
requirements
Drive
Sparing
Aggregate/CPG
MetaLUN
and
Bin
file
layout
INSTALLATION
Bin
File/RAID
Layout
Aggregate/MetaLUN
creaQon
Snapshot
spare
spacing
Vol0/quorum
drive
layout
Aggregate
snapshot
frequency
Snapshot
growth
limits
OPERATING
GB
and
IOPS
required
Account
CreaQon
Host
to
HBA
assignment
and
tracking
Host
iniQator
count
limits
RAID
type
required
Primary
Control
Node
assignment
IOPS
limitaQon
concerns
Snapshot
growth
policy
Thin
Provisioning
(or
not)
Aggregate/CPG
assignment
40%
CPU
limit
consideraQons
SCALING
GB
and
IOPS
needed
Drive
Shelves
required
Power/floor
space
restricQons
Control
node
limitaQons
(CPU
storage)
UPGRADE
HBA
compaQbility
list
CPU
uQlizaQon
on
control
nodes
Maintenance
window
MiQgate
risk
during
node
outage
Storage System Tasks
OTHER VENDORS
Element OS | A U T O M A T E D M A N A G E M E N T
28. DESIGN
IniQal
size
(GB
or
IOPS)
INSTALLATION OPERATING
GB
and
IOPS
required
Account
CreaQon
SCALING
GB
and
IOPS
needed
UPGRADE
Storage System Tasks
Element OS | A U T O M A T E D M A N A G E M E N T
29. • Performance tuning, caching or load balancing
• Tiering, prioritization or caching to manage
• Short Stroking or over provisioning
• RAID group or spare drive management
• Fire drills to replace failed disks, shelves, or controllers
• Generational upgrades or platform migrations
Complete System Automation
NO
MORE:
30. • Platform Compatibility Guarantee
– Ensures that all future software &
platforms from SolidFire will interoperate
with existing infrastructure
• Unlimited Drive Wear Guarantee
– Eliminate concerns around flash
endurance
– No restrictions on use-case or workload
Never Obsolete
Unparalleled
Investment Protection
No more forklift
upgrades
31. ▪ SolidFire Cinder driver enables all OpenStack
block storage features
▪ Ability to set and maintain true QoS levels
on a per-volume basis
▪ Create, snap, clone and manage SolidFire
volumes directly
▪ Run OpenStack instances on a SolidFire volume
▪ Eliminates arduous management layers between
OpenStack and the storage system
▪ SolidFire driver fully integrated into OpenStack -
no additional features / licenses required
Customer SuccessDeep OpenStack Integration Validated Interoperability
The Block Storage Choice for OpenStack
32. SolidFire Agile Infrastructure
▪ A series of pre-validated converged
infrastructure reference designs
▪ Modular design focus at all levels
▪ Built for dynamic IT-as-a-Service
consumption model
▪ Accelerating time-to-value for operators and
administrators deploying a functional cloud
infrastructure
▪ Supported by a complete ecosystem of
vendors, partners and community
Compute
/
Networking
Cloud
Management
Stack
OrchestraQon
Layer
ApplicaQons
34. Software Defined pools of compute, networking & storage
Operational Benefits of AI
Agile
<30 minutes to provision from bare metal to OS
<30 minutes to install and configure OpenStack
Automated
Linear Scalability of compute & storage nodesScalable
Maintain consistent performance via guaranteed QoSPredictable
Integrated Efficiency with cluster wide dedupe & compression
27U rack footprint - 360 cores, ~1000 vCPUs, 250k IOPS, 40TBs
Efficient
35. AI for OpenStack
Logical Framework
▪ Modularity at every level
▪ Built on vendor and
community best
practices
▪ Deep integration up the
management stack
▪ Support for 3rd Party
Tools
36. 5 Networks to segregate traffic
and provide security:
• Administrative Network
• Data Center Network
• OpenStack Service Network
• Storage Network
• Private network
AI for OpenStack Network Topology
37. Physical Network Layout to
Allow Scalability in Any Vector
• Add OpenStack Nodes
• Add SolidFire Nodes
• Add Upstream Bandwidth
• Add Racks
• Add Data Centers
AI for OpenStack Network Topology
38. Optimized for Mixed Workloads
Software Development Lifecycle • Test / Development
• QA, Staging, Production
• 3-Tier Apps
• Example: LAMP stacks
Large Scale Web Applications
Persistent Block Storage
Databases
• On Premise Versions of Amazon Elastic Block Storage
• Provisioned IOPS (e.g. pIOPS)
• Database Consolidation
• Database-as-a-Service (DBaaS)
Sample Use Cases Examples
39. • Red Hat Enterprise Linux OpenStack Certification Test Suite
• Tempest Test
• Deployment
– Provision from bare metal to operating system 17 nodes within 30 minutes
– Install and configure OpenStack on the same 17 nodes in less than 30 minutes
• Scalability
– Verify the ability to scale block storage and compute instances
– Dynamically add compute nodes into the environment
• Resource Agility
– Time to deploy 1000 Instances: 2.5 hours
– Time to delete 1000 Instances: 11 minutes
– Time to boot 1000 volumes as new Instances: 2.25 hours
– Time to delete 1000 instances and volumes: 17 minutes
Validated and Tested Use Cases
40. • Quality of Service (QoS)
– Demonstrate the QoS merits of the SolidFire storage system by showing multiple
applications running in parallel on the same shared storage infrastructure
• database
• file/web server
• general operating system IO
• readonly
• writeonly
• 80/20 mixed read/write
– Allow users to specify the IO requirements for a volume at create time
Validated and Tested Use Cases (Cont.)
41. General OpenStack Best Practices and Lessons Learned
• Really understand what you want to accomplish
• Storage choices are complex and critical
• Use a trusted distro to cover your weaknesses
• OpenStack is not a VMware replacement.
Seriously!
• Think big, start small: stick with defcore, graduate
into Big Tent
• Don’t roll beta/dev/test into production. Please?
• What are you leaving for the next guy?
42. • For more on building an OpenStack-powered cloud
infrastructure visit SolidFire.com/OpenStack
• For more on accelerating your OpenStack adoption with Agile
Infrastructure visit Solidfire.com/AI
• To see OpenStack and SolidFire in action, request a demo --
SolidFire.com/Get-Started
Want to learn more?
43. Powering the World’s Most Demanding Data Centers
Sales, Marketing, and Support :
• Over 320 Employees
• HQ: Boulder, Colorado
• North America
• EMEA
• APJ
Global
Enabling Customer Success
• Founded 2010
• Funding $150M, Series D
• GA Product since Nov 2012
• Over 2500 nodes shipped
• More than 45PB under mgt
• Fueling over 58,000 business
Proven
Updated 1/30/15
#1 ALL-FLASH ARRAY
CC 2014
#1 ALL-FLASH ARRAY
CC 2015
The Most Complete AFA Feature Set
• Scale-out Architecture
• Self Healing High Availability
• Guaranteed QoS
• Complete System Automation
• In-line Data Reduction
• 3 Replication Options
• 3rd Generation of Hardware
• 8th Generation of Software
Innovative
44. • Real-Time Replication
• Integrated Backup and Restore
• Encryption at Rest
• Snapshots and Clones
• Consistency Group Snapshots
• VLAN tagging / Multi-tenant Networking
• SNMP Monitoring
• Simultaneous Multiprotocol Support (FC / iSCSI)
All Inclusive Feature Set