Kubernetes Optimization - How We Cut Our Cloud Infrastructure Cost By 40% Usi...Magalix Corporation
In this webinar you'll learn how to optimize your cloud infrastructure resources (CPU, memory, and node pool in Kubernetes) with a focus on cost savings.
Ahmed Badran, CTO at Magalix, will use a real world example of how we cut our Google Cloud Platform monthly bill by around 40% by using our own product to constantly analyze and optimize on our node pool configurations, and other parameters.
Expect To Learn:
- Understand the USE method for analyzing resource performance
- How to identify wasted resources (CPU and memory, node pools)
- How to readjust these resources to cut your costs
- Ensure that your changes did not result in any performance degradation
- See how Magalix can help you quickly identify waste and automate the process
To Watch the Webinar Replay here:
https://www.magalix.com/resources/webinars/kubernetes-optimization-webinar
How does GROU.PS scale to serving 1PB of assets each month. memcache, nginx, gearman, tornado, libevent, kqueue, epoll, mysql, sharding, replication, memcached, tokyo cabinet
All these large data sets are so big its difficult to manage with traditional tools. Distributing computing is an approach to solve that problem! First the data needs to be mapped, then it can be analyzed or reduced.
Third edition of the SURF Research Boot Camp at the TU/e. About eighty researchers and research supporters came together in the Auditorium of the Technical University Eindhoven. The attendees choose between four tracks which contains three hands-on courses about UNIX, HPC Cloud, Cluster computing, Big Data, Visualization, data publishing with 4TU and research data management with IRODS.
Kubernetes Optimization - How We Cut Our Cloud Infrastructure Cost By 40% Usi...Magalix Corporation
In this webinar you'll learn how to optimize your cloud infrastructure resources (CPU, memory, and node pool in Kubernetes) with a focus on cost savings.
Ahmed Badran, CTO at Magalix, will use a real world example of how we cut our Google Cloud Platform monthly bill by around 40% by using our own product to constantly analyze and optimize on our node pool configurations, and other parameters.
Expect To Learn:
- Understand the USE method for analyzing resource performance
- How to identify wasted resources (CPU and memory, node pools)
- How to readjust these resources to cut your costs
- Ensure that your changes did not result in any performance degradation
- See how Magalix can help you quickly identify waste and automate the process
To Watch the Webinar Replay here:
https://www.magalix.com/resources/webinars/kubernetes-optimization-webinar
How does GROU.PS scale to serving 1PB of assets each month. memcache, nginx, gearman, tornado, libevent, kqueue, epoll, mysql, sharding, replication, memcached, tokyo cabinet
All these large data sets are so big its difficult to manage with traditional tools. Distributing computing is an approach to solve that problem! First the data needs to be mapped, then it can be analyzed or reduced.
Third edition of the SURF Research Boot Camp at the TU/e. About eighty researchers and research supporters came together in the Auditorium of the Technical University Eindhoven. The attendees choose between four tracks which contains three hands-on courses about UNIX, HPC Cloud, Cluster computing, Big Data, Visualization, data publishing with 4TU and research data management with IRODS.
Going to the cloud: Forget EVERYTHING you know!Bol.com Techlab
Speaker: Maarten Dirkse
Genre & level: Way of working, Medior
Can you handle the cloud the same way as you would handle our on-premise datacenter? The biggest issue is the mindset when using the cloud. This is completely different from the one you need when you’re ‘on the moon’ in our datacenter! Not only for developers, but even more so for classic operations-people. Let me make your road to the cloud less bumpy!
Scaling a database eventually brings you to the limits of your database engine’s capabilities. Many database users solve this with sharding, but that adds a new layer of management complexity. In this session, we’ll see how a single, scalable Amazon Aurora database can consolidate multiple shards in a scalable, cost-effective way. We’ll see a demo of a sharded system migration to Aurora using AWS Database Migration Service.
Empowering Amazon EC2 with GigaSpaces XAPUri Cohen
This short presentation explains the main value proposition on the GigaSpaces XAP platform on the cloud. After viewing you will understand how GigaSpaces XAP augments the cloud and enables you to take full advantage of it
Reducing latency on the web with the Azure CDN - DevSum - SWAGMaarten Balliauw
Serving up content on the Internet is something our web sites do daily. But are we doing this in the fastest way possible? How are users in faraway countries experiencing our apps? Why do we have three webservers serving the same content over and over again? In this session, we’ll explore the Azure Content Delivery Network or CDN, a service which makes it easy to serve up blobs, videos and other content from servers close to our users. We’ll explore simple file serving as well as some more advanced, dynamic edge caching scenarios.
We at Preply do our best to ensure that our website loads quicky as it has huge impact on business. In my talk I will explain:
- why pageload metric is important from business standpoint and how to measure its impact.
- how we evolved with our speed optimization technics starting from very basic ones(caching, orm optimizations) to more advanced(replicas, load-balancing) and the level where we are now(CDN optmization, microservices etc.)
- I will talk about both front-end and backend optimization with focus on the stack we use: AWS, Django/Python, Postgres, Docker.
Optimizing elastic search on google compute engineBhuvaneshwaran R
If you are running the elastic search clusters on the GCE, then we need to take a look at the Capacity planning, OS level and Elasticsearch level optimization. I have presented this at GDG Delhi on Feb 22,2020.
Performance Demystified for SQL Server on Azure Virtual MachinesAmit Banerjee
The slide deck for the session at TechEd which gives an overview of how to harness the power of Microsoft Azure Virtual Machines for SQL Server database. A few tips and tricks is all it requires to keep a SQL Server database healthy on an Azure Virtual Machine. What’s more, we will even slip in few tricks to automate the entire deployment with the performance best practices enabled.
Reducing latency on the web with the Azure CDN- TechDays NL 2014Maarten Balliauw
Serving up content on the Internet is something our web sites do daily. But are we doing this in the fastest way possible? How are users in faraway countries experiencing our apps? Why do we have three webservers serving the same content over and over again? In this session, we’ll explore the Azure Content Delivery Network or CDN, a service which makes it easy to serve up blobs, videos and other content from servers close to our users. We’ll explore simple file serving as well as some more advanced, dynamic edge caching scenarios.
OSMC 2017 | Icinga 2 + Director, flexible Thresholds with Ansible by Kevin H...NETWAYS
An introduction to the utilization of flexible Thresholds and how to adapt your checks to an ever changing Environment.
Central points:
– Where can I use flexible Thresholds
– What are the advantages and disadvantages
– Is it worth it?
Cloud storage costs are increasing and now represent a significant portion of cloud spend. As a result, cloud users need to focus on ways to reduce storage spend by selecting the best options while also finding ways to manage the rapid increase in the use of cloud storage.
Aymeric Weinbach - IoT et Azure - Global Azure Bootcamp 2016 ParisAZUG FR
Internet of Things - le monde des objets connectés est véritablement présent dans Azure. Focus sur les services spécialisés Azure IoT, mais surtout de la pratique geek avec des objets connectés live.
AWS vs Azure vs Google Cloud Storage Deep DiveRightScale
Cloud services keep evolving, and cloud storage is no different. It can be difficult to keep up to date with the latest from each cloud provider and understand how they compare. We’ll drill down on object, block, archival, and file storage for the leading public clouds. We’ll also compare prices for a variety of storage scenarios.
Going to the cloud: Forget EVERYTHING you know!Bol.com Techlab
Speaker: Maarten Dirkse
Genre & level: Way of working, Medior
Can you handle the cloud the same way as you would handle our on-premise datacenter? The biggest issue is the mindset when using the cloud. This is completely different from the one you need when you’re ‘on the moon’ in our datacenter! Not only for developers, but even more so for classic operations-people. Let me make your road to the cloud less bumpy!
Scaling a database eventually brings you to the limits of your database engine’s capabilities. Many database users solve this with sharding, but that adds a new layer of management complexity. In this session, we’ll see how a single, scalable Amazon Aurora database can consolidate multiple shards in a scalable, cost-effective way. We’ll see a demo of a sharded system migration to Aurora using AWS Database Migration Service.
Empowering Amazon EC2 with GigaSpaces XAPUri Cohen
This short presentation explains the main value proposition on the GigaSpaces XAP platform on the cloud. After viewing you will understand how GigaSpaces XAP augments the cloud and enables you to take full advantage of it
Reducing latency on the web with the Azure CDN - DevSum - SWAGMaarten Balliauw
Serving up content on the Internet is something our web sites do daily. But are we doing this in the fastest way possible? How are users in faraway countries experiencing our apps? Why do we have three webservers serving the same content over and over again? In this session, we’ll explore the Azure Content Delivery Network or CDN, a service which makes it easy to serve up blobs, videos and other content from servers close to our users. We’ll explore simple file serving as well as some more advanced, dynamic edge caching scenarios.
We at Preply do our best to ensure that our website loads quicky as it has huge impact on business. In my talk I will explain:
- why pageload metric is important from business standpoint and how to measure its impact.
- how we evolved with our speed optimization technics starting from very basic ones(caching, orm optimizations) to more advanced(replicas, load-balancing) and the level where we are now(CDN optmization, microservices etc.)
- I will talk about both front-end and backend optimization with focus on the stack we use: AWS, Django/Python, Postgres, Docker.
Optimizing elastic search on google compute engineBhuvaneshwaran R
If you are running the elastic search clusters on the GCE, then we need to take a look at the Capacity planning, OS level and Elasticsearch level optimization. I have presented this at GDG Delhi on Feb 22,2020.
Performance Demystified for SQL Server on Azure Virtual MachinesAmit Banerjee
The slide deck for the session at TechEd which gives an overview of how to harness the power of Microsoft Azure Virtual Machines for SQL Server database. A few tips and tricks is all it requires to keep a SQL Server database healthy on an Azure Virtual Machine. What’s more, we will even slip in few tricks to automate the entire deployment with the performance best practices enabled.
Reducing latency on the web with the Azure CDN- TechDays NL 2014Maarten Balliauw
Serving up content on the Internet is something our web sites do daily. But are we doing this in the fastest way possible? How are users in faraway countries experiencing our apps? Why do we have three webservers serving the same content over and over again? In this session, we’ll explore the Azure Content Delivery Network or CDN, a service which makes it easy to serve up blobs, videos and other content from servers close to our users. We’ll explore simple file serving as well as some more advanced, dynamic edge caching scenarios.
OSMC 2017 | Icinga 2 + Director, flexible Thresholds with Ansible by Kevin H...NETWAYS
An introduction to the utilization of flexible Thresholds and how to adapt your checks to an ever changing Environment.
Central points:
– Where can I use flexible Thresholds
– What are the advantages and disadvantages
– Is it worth it?
Cloud storage costs are increasing and now represent a significant portion of cloud spend. As a result, cloud users need to focus on ways to reduce storage spend by selecting the best options while also finding ways to manage the rapid increase in the use of cloud storage.
Aymeric Weinbach - IoT et Azure - Global Azure Bootcamp 2016 ParisAZUG FR
Internet of Things - le monde des objets connectés est véritablement présent dans Azure. Focus sur les services spécialisés Azure IoT, mais surtout de la pratique geek avec des objets connectés live.
AWS vs Azure vs Google Cloud Storage Deep DiveRightScale
Cloud services keep evolving, and cloud storage is no different. It can be difficult to keep up to date with the latest from each cloud provider and understand how they compare. We’ll drill down on object, block, archival, and file storage for the leading public clouds. We’ll also compare prices for a variety of storage scenarios.
(BDT208) A Technical Introduction to Amazon Elastic MapReduceAmazon Web Services
"Amazon EMR provides a managed framework which makes it easy, cost effective, and secure to run data processing frameworks such as Apache Hadoop, Apache Spark, and Presto on AWS. In this session, you learn the key design principles behind running these frameworks on the cloud and the feature set that Amazon EMR offers. We discuss the benefits of decoupling compute and storage and strategies to take advantage of the scale and the parallelism that the cloud offers, while lowering costs. Additionally, you hear from AOL’s Senior Software Engineer on how they used these strategies to migrate their Hadoop workloads to the AWS cloud and lessons learned along the way.
In this session, you learn the benefits of decoupling storage and compute and allowing them to scale independently; how to run Hadoop, Spark, Presto and other supported Hadoop Applications on Amazon EMR; how to use Amazon S3 as a persistent data-store and process data directly from Amazon S3; dDeployment strategies and how to avoid common mistakes when deploying at scale; and how to use Spot instances to scale your transient infrastructure effectively."
AWS Summit Stockholm 2014 – T3 – disaster recovery on AWSAmazon Web Services
Implementation of a disaster recovery (DR) site is crucial for the business continuity of any enterprise. Due to the fundamental nature of features like elasticity, scalability and geographic distribution, DR implementation on AWS can be done at 10-50% of the conventional cost. In this session, we do a deep dive into proven DR architectures on AWS and the best practices, tools and techniques to get the most out of them.
This session is recommended for attendees who wish to explore options for ensuring the continuity of their business.
UnConference for Georgia Southern Computer Science March 31, 2015Christopher Curtin
I presented to the Georgia Southern Computer Science ACM group. Rather than one topic for 90 minutes, I decided to do an UnConference. I presented them a list of 8-9 topics, let them vote on what to talk about, then repeated.
Each presentation was ~8 minutes, (Except Career) and was by no means an attempt to explain the full concept or technology. Only to wake up their interest.
Comment envisager l'architecture d'une solution dans le Cloud ? Quelles différences avec un hébergement classique ?
Nous illustrerons les grands principes du développement Cloud en prenant l'exemple d'une application web typique. Nous construirons l'architecture étape par étape pour la rendre scalable et lui faire bénéficier des avantages du Cloud.
Nous verrons ensuite les différents types d'implémentations et choix technologiques possibles de cette architecture sur le Cloud Microsoft Azure. Nous envisagerons aussi bien des services d'infrastructure (VMs, conteneurs, …) que des services de plus haut niveau de type plateforme, du serverless, des bases de données managées…
Nous zoomerons ensuite sur l'acquisition de la donnée et son traitement dans un contexte Big Data et verrons les caractéristiques d'une architecture lambda et ses implémentations possibles sur Azure (Hadoop, …). Nous terminerons par les différentes manières d'ajouter de l'intelligence dans sa solution : de la plus simple à mettre en œuvre pour le développeur via des APIs pré-packagées, à la plus élaborée et personnalisable pour le Data Scientist. Mais aussi comment la rendre plus facilement accessible par l'utilisateur via un bot Skype, Facebook, Slack, email, SMS...
Support du meetup https://www.meetup.com/fr-FR/Duchess-France-Meetup/events/238437772/
A Web architect who doesn't usually use Microsoft technologies explains Microsoft's cloud offering, Azure, in terms that hopefully other UNIX/open source people will understand.
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014Amazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your application on demand. If you have a new business and want to use cloud computing, you might be asking yourself, andquot;Where do I start?andquot; Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
High Performance Computing (HPC) has been driving technology advancements for many decades. HPC enables performance-demanding applications and workloads to solve complex problems while dramatically reducing time to solution. With a history of requiring very large data centers, HPC is now on the edge of a paradigm shift. The AWS Cloud will allow customers to have access to near infinite compute and storage resources, without the overhead of running their own data centers. There are a vast number of HPC segments and verticals that are already seeing great success running their workloads on AWS. Life Sciences, Financial Services, Energy & Geo Sciences, as well as Manufacturing are successfully deploying their applications on AWS. In these two sessions we will discuss how AWS can help you run HPC workloads in the cloud. The first session will be a general introduction to HPC on AWS.
Real world High Performance & High Throughput Computing on AWSAmazon Web Services
Dr Matthew Berryman
Managing Director, Across the Cloud Chair, High Performance Steering Committee, University of Wollongong
Background slides by Adrian White, Manager, APAC Research & Technical Computing, AWS
AWS Summit Stockholm 2014 – B2 – Migrating enterprise applications to AWSAmazon Web Services
This session discusses strategies, tools, and techniques for migrating enterprise software systems to AWS. These applications are complex by themselves; they are frequently customized; they have many touch points on other systems in the enterprise; and they often have large associated databases. Nevertheless, running enterprise applications in the cloud affords powerful benefits. We identify success factors and best practices.
Disaster recovery sites on AWS: minimal costs maximum efficiencyAmazon Web Services
Implementation of a disaster recovery (DR) site is crucial for the business continuity of any enterprise. Due to the fundamental nature of features like elasticity, scalability, and geographic distribution, DR implementation on AWS can be done at 10-50% of the conventional cost. In this session, we do a deep dive into proven DR architectures on AWS and the best practices, tools and techniques to get the most out of them.
Similar to Drupal in the cloud with Windows Azure (20)
4. Azure - what Data Center Browser Hosted Service Worker Service Worker Role LB Tables CDN Storage Web Site (ASPX, ASMX, WCF) Web Site (ASPX, ASMX, WCF) Web Role Queue LB Blobs
5. Quick facts Whoisworking on this ? Microsoft & Commerce Guys Wherecan I findit ? On d.o Whencan I use it ? Shouldbecompletebeforesummer How can I test on Azure ? Try « azure one monthpass » in yoursearchengine
6. Provisioning the web farm Azure basic deployment unit is a Role Application package (drupal in our case) Size of machines Number of machines Firewall configuration A drupal package is PHP runtime & configuration Drupal code Deployment-specific settings
7.
8. Relational data go to Sql Azure Highlyavailable, pay per volume 10$/month/Gb Currentimplementation uses Sql Azure for Sessions, Queues, Caches, Locks, Fields Some of thesewill change
9.
10.
11.
12. If you *really* wantMySql on Azure VIP VIP VIP Load Balancer Load Balancer Load Balancer M S S MySQL MySQL MySQL MySQL MySQL MySQL Doable, but you’ll manage a lot of moving parts. Seehttp://bit.ly/93Jgib
13. Other content goes to Blob storage Highlyscalable Stream wrapper API available for PHP Specialcredits to DamZ for ironingthis Some concepts differfromfilesystem 2-level structure (container+blob) Extended Metadataavailable Security isdonedifferently
16. Performance tuning You can use the usual suspects APC/Wincache for local caching Redis/Memcache for distributedcaching There’salso a CDN in Azure Untilyesterday, hooked up to blob storage Now usable on Azure Roles (web farms) Will honourcaching headers fromdynamic content Understandshttps Understandsquery string
17.
18.
19.
20. Where are wenow ? Sql Azure driver : done Blob storage module : in progress Needs to plug in the CDN Leverage the authorizationmechanism Deployment & updates : justbeginning Azure has instant-switchbetweenstaging & prod Plus hot database backups We’relookingatotherprojects to help
21.
22. What did you think? Locate this session on the DCC website: http://chicago2011.drupal.org/sessions Click the “Take the Survey” link. Thanks!