Xclone presentation final
•
0 likes•608 views
Xclone is a tool for fast VM provisioning that can deploy 100 VMs across 6 physical hosts in under 30 minutes. It uses a combination of full cloning for VMs on the same host and linked cloning for VMs on different hosts to minimize disk I/O bottlenecks. Testing showed the naive approach would take over an hour while Xclone deployed the VMs in under 30 minutes by leveraging different cloning techniques and parallelizing the workload across multiple hosts and disks. Future work may include using RAM disks, aware deployment based on infrastructure resources, and optimizing full cloning.
Report
Share
Report
Share
Download to read offline
Recommended
Boyan Ivanov - latency, the #1 metric of your cloud
No two clouds are the same. Yet the leading clouds all have one thing in common: they deliver on metrics, which matter to the customer. In this session we'll dissect leading clouds, to show why low latency is the thing that makes a cloud stand out.
Automatic Operation Bot for Ceph - You Ji
The document discusses an automatic operation bot for Ceph clusters at eBay. It describes monitoring the clusters with tools like Prometheus and node-exporter. When issues arise, over 95% are due to failed disks, which the bot would automatically remove and replace. It would record failures and perform remediation steps like removing OSDs, offline disks, and lighting indicator LEDs. The bot design includes components for monitoring, alerting, a task queue, and executor to automate common operations and reduce manual work.
Frontend Track NodeJS
The document discusses NodeJS, an asynchronous and event-driven JavaScript runtime. It describes how NodeJS works with a single-threaded event loop model to handle requests efficiently via non-blocking I/O. Key aspects covered include the V8 engine, event loop phases, streams, clusters, workers, and common uses of NodeJS like real-time web applications and APIs.
Extreme HTTP Performance Tuning: 1.2M API req/s on a 4 vCPU EC2 Instance
In this talk I will walk you through the performance tuning steps that I took to serve 1.2M JSON requests per second from a 4 vCPU c5 instance, using a simple API server written in C.
At the start of the journey the server is capable of a very respectable 224k req/s with the default configuration. Along the way I made extensive use of tools like FlameGraph and bpftrace to measure, analyze, and optimize the entire stack, from the application framework, to the network driver, all the way down to the kernel.
I began this wild adventure without any prior low-level performance optimization experience; but once I started going down the performance tuning rabbit-hole, there was no turning back. Fueled by my curiosity, willingness to learn, and relentless persistence, I was able to boost performance by over 400% and reduce p99 latency by almost 80%.
OOPs, OOMs, oh my! Containerizing JVM apps
This document discusses best practices for containerizing Java applications to avoid out of memory errors and performance issues. It covers choosing appropriate Java versions, garbage collector tuning, sizing heap memory correctly while leaving room for operating system caches, avoiding swapping, and monitoring applications to detect issues. Key recommendations include using the newest Java version possible, configuring the garbage collector appropriately for the workload, allocating all heap memory at startup, and monitoring memory usage to detect problems early.
Global deduplication for Ceph - Myoungwon Oh
Global deduplication for Ceph storage clusters can save up to 40% of total storage space by eliminating redundant data blocks. The document discusses two designs for implementing global deduplication in Ceph without adding a centralized metadata server: 1) using a double distribution hash to map data chunks to objects without redirection, and 2) storing deduplication metadata within self-contained objects to avoid complex linking between systems. It also describes the implementation of an extensible tier in Ceph for deduplication using object manifests and ongoing work to contribute these features to the upstream Ceph project. Remaining tasks are listed along with challenges around small chunk sizes and minimizing performance impacts.
Scaling Apache Pulsar to 10 Petabytes/Day
This document discusses optimizing an Apache Pulsar cluster to handle 10 PB of data per day for a financial customer. Initial estimates showed the cluster would need over 1000 VMs using HDD storage. Various optimizations were implemented, including eliminating the journal, using direct I/O, compression, and C++ client optimizations. This reduced the estimated number of needed VMs to 200 using L-SSD storage per VM. The optimized cluster can now meet the customer's requirements of processing 10 PB of data per day with 3 hours of retention and zone failure protection.
Using the Azure Container Service in your company
We know containers can solve some problems for us, but how should they be deployed within Azure. The Azure Container Service can be used to host your monolith solution, micro-services and everything in between.
In this session we will create multiple containers, deploy them using the Azure Container Service and see how this service can provide us with enough management information to use in a professional environment. We will also cover some best practices on setting up such a solution and how you can migrate your existing software solutions.
Recommended
Boyan Ivanov - latency, the #1 metric of your cloud
No two clouds are the same. Yet the leading clouds all have one thing in common: they deliver on metrics, which matter to the customer. In this session we'll dissect leading clouds, to show why low latency is the thing that makes a cloud stand out.
Automatic Operation Bot for Ceph - You Ji
The document discusses an automatic operation bot for Ceph clusters at eBay. It describes monitoring the clusters with tools like Prometheus and node-exporter. When issues arise, over 95% are due to failed disks, which the bot would automatically remove and replace. It would record failures and perform remediation steps like removing OSDs, offline disks, and lighting indicator LEDs. The bot design includes components for monitoring, alerting, a task queue, and executor to automate common operations and reduce manual work.
Frontend Track NodeJS
The document discusses NodeJS, an asynchronous and event-driven JavaScript runtime. It describes how NodeJS works with a single-threaded event loop model to handle requests efficiently via non-blocking I/O. Key aspects covered include the V8 engine, event loop phases, streams, clusters, workers, and common uses of NodeJS like real-time web applications and APIs.
Extreme HTTP Performance Tuning: 1.2M API req/s on a 4 vCPU EC2 Instance
In this talk I will walk you through the performance tuning steps that I took to serve 1.2M JSON requests per second from a 4 vCPU c5 instance, using a simple API server written in C.
At the start of the journey the server is capable of a very respectable 224k req/s with the default configuration. Along the way I made extensive use of tools like FlameGraph and bpftrace to measure, analyze, and optimize the entire stack, from the application framework, to the network driver, all the way down to the kernel.
I began this wild adventure without any prior low-level performance optimization experience; but once I started going down the performance tuning rabbit-hole, there was no turning back. Fueled by my curiosity, willingness to learn, and relentless persistence, I was able to boost performance by over 400% and reduce p99 latency by almost 80%.
OOPs, OOMs, oh my! Containerizing JVM apps
This document discusses best practices for containerizing Java applications to avoid out of memory errors and performance issues. It covers choosing appropriate Java versions, garbage collector tuning, sizing heap memory correctly while leaving room for operating system caches, avoiding swapping, and monitoring applications to detect issues. Key recommendations include using the newest Java version possible, configuring the garbage collector appropriately for the workload, allocating all heap memory at startup, and monitoring memory usage to detect problems early.
Global deduplication for Ceph - Myoungwon Oh
Global deduplication for Ceph storage clusters can save up to 40% of total storage space by eliminating redundant data blocks. The document discusses two designs for implementing global deduplication in Ceph without adding a centralized metadata server: 1) using a double distribution hash to map data chunks to objects without redirection, and 2) storing deduplication metadata within self-contained objects to avoid complex linking between systems. It also describes the implementation of an extensible tier in Ceph for deduplication using object manifests and ongoing work to contribute these features to the upstream Ceph project. Remaining tasks are listed along with challenges around small chunk sizes and minimizing performance impacts.
Scaling Apache Pulsar to 10 Petabytes/Day
This document discusses optimizing an Apache Pulsar cluster to handle 10 PB of data per day for a financial customer. Initial estimates showed the cluster would need over 1000 VMs using HDD storage. Various optimizations were implemented, including eliminating the journal, using direct I/O, compression, and C++ client optimizations. This reduced the estimated number of needed VMs to 200 using L-SSD storage per VM. The optimized cluster can now meet the customer's requirements of processing 10 PB of data per day with 3 hours of retention and zone failure protection.
Using the Azure Container Service in your company
We know containers can solve some problems for us, but how should they be deployed within Azure. The Azure Container Service can be used to host your monolith solution, micro-services and everything in between.
In this session we will create multiple containers, deploy them using the Azure Container Service and see how this service can provide us with enough management information to use in a professional environment. We will also cover some best practices on setting up such a solution and how you can migrate your existing software solutions.
Deep Dive In To Redis Replication: Vishy Kasar
This document summarizes a presentation about Redis replication. It discusses the basics of Redis replication including that it is asynchronous and non-blocking on the master. It also covers replication configuration, monitoring, data consistency, and memory usage. The presentation agenda includes topics like full and partial synchronization, and common replication issues. It concludes with an offer to demo Redis replication.
Nitty Gritty of Adaptive Video Transmuxing in JS
This document summarizes adaptive video transmuxing techniques for converting between streaming formats like MPEG-TS and MP4 in a web browser. It discusses using incremental computation and finite state machines to start playback faster by parsing media formats and extracting video data as it is received. The techniques aim to reduce latency, support more features and streams, and improve the developer experience through a cleaner architecture based on communicating sequential processes.
Zeromq - Pycon India 2013
ZeroMQ is a library for building distributed applications that provides patterns for request-reply, publish-subscribe, and pipelining between clients and services. It demonstrates using these patterns to build a hello world server and client, stock ticker publisher and subscriber, and parallel task processing pipeline. ZeroMQ supports multiple transport types and languages.
Multi-core Node.pdf
This document discusses using Node.js in a multi-core environment through clustering. It explains that Node.js is single-threaded, so clustering allows utilizing multiple CPU cores. Approaches include single VM with multiple processes or clustering Node.js processes. Clustering involves a master process that manages worker processes to distribute load. Tests show clustering improves throughput and reduces response times compared to single-core. The cluster module simplifies clustering Node.js across CPU cores.
Tips on High Performance Server Programming
This document provides tips and best practices for high performance server programming. It discusses avoiding blocking, using efficient algorithms and data structures, separating I/O from business logic, and tuning for bottlenecks. It also covers various I/O models like blocking, non-blocking, and asynchronous I/O. Key aspects of designing high performance servers include using non-blocking I/O, event-driven architectures, and avoiding excessive threading.
QCon 2017 - Java/JVM com Docker em produção: lições das trincheiras
This document discusses best practices for running Java applications in Docker containers in production environments. It covers common problems like out of memory errors and slow performance due to the JVM not being aware of Linux cgroups. Specific issues addressed include setting appropriate JVM memory and CPU limits based on the container restrictions, using named volumes for disk I/O, and configuring garbage collection and thread pools. It also provides an overview of tooling like Maven/Gradle plugins for building Docker images and schedulers like Docker Swarm and Kubernetes for container orchestration.
(SDD404) Amazon RDS for Microsoft SQL Server Deep Dive | AWS re:Invent 2014
Come learn how to turbocharge your application development with useful tips and tricks for Amazon RDS for SQL Server. We will cover practical and useful topics such as migrating your data to an Amazon RDS for SQL Server instance and as well as detailed guidance for taking advantage of Multi-AZ deployments to architect high-performance applications and production workloads.
Как построить видеоплатформу на 200 Гбитс / Ольховченков Вячеслав (Integros)
Как грамотная архитектура и правильное планирование запросов позволяет небольшим количеством серверов достичь высокой производительности при раздаче видеоконтента.
В докладе будет рассказано об опыте развития проекта видеоплатформы, о проблемах, которые возникли на пути, и как нам удается раздавать 200 Гбит меньше чем 10 серверами.
Тезисы - http://www.highload.ru/2015/abstracts/1872.html
Ceph Day Shanghai - Ceph Performance Tools
This document discusses tools for analyzing Ceph performance. It begins by describing common performance issues users encounter with Ceph and potential solutions like tuning configuration values or benchmarking. The rest of the document details various monitoring and benchmarking tools that can help identify bottlenecks like the dispatch layer, object store, or hardware. It provides examples of using tools like dstat, iostat, perf, systemtap, ceph perf dump, and benchmarking tools like Fio, rbd-replay and ceph_perf_local. It concludes with a case study where unaligned partitions and a driver bug were causing low IOPS that were resolved by fixing the partition alignment and downgrading the NVMe driver.
92 grand prix_2013
This document summarizes Josh Berkus's presentation on new features in PostgreSQL versions 9.1, 9.2, and the upcoming 9.3. Some key highlights include improvements to read and write performance, the addition of JSON data type and PL/v8 and PL/Coffee procedural languages, index-only scans, cascading replication, SP-GiST indexing, and many new monitoring and administration features. Josh Berkus is available for questions at josh@pgexperts.com and encourages attendees to upcoming PostgreSQL conferences.
Cassandra Anti-Patterns
This document summarizes several Cassandra anti-patterns including:
- Using a non-Oracle JVM which is not recommended.
- Putting the commit log and data directories on the same disk which can impact performance.
- Using EBS volumes on EC2 which can have unpredictable performance and throughput issues.
- Configuring overly large JVM heaps over 16GB which can cause garbage collection issues.
- Performing large batch mutations in a single operation which risks timeouts if not broken into smaller batches.
Crimson: Ceph for the Age of NVMe and Persistent Memory
Ceph is a mature open source software-defined storage solution that was created over a decade ago.
During that time new faster storage technologies have emerged including NVMe and Persistent memory.
The crimson project aim is to create a better Ceph OSD that is more well suited to those faster devices. The crimson OSD is built on the Seastar C++ framework and can leverage these devices by minimizing latency, cpu overhead, and cross-core communication. This talk will discuss the project design, our current status, and our future plans.
Node.js
Node.js is a JavaScript runtime built on Chrome's V8 engine. It is used for building scalable network applications like web servers. It uses an event-driven, asynchronous I/O model that makes it lightweight and efficient, especially for real-time apps with many simultaneous connections. Node.js has a large ecosystem of open source modules and sees widespread use for building fast web servers and APIs.
OSMC 2013 | Zabbix: A Practical Demo by Rihards Olups
Auch wenn es nützlich ist sich einen Überblick darüber zu verschaffen wie ein System funktioniert, versteht man es am besten, wenn das System gerade läuft.
Dieser Vortrag wird ein praktischer Quickstart sein, der aktuelle Basiskonfigurationen von Zabbix zeigen wird, von der Datensammlung bis hin zu Warnmeldungen.
Cassandra On EC2
This document discusses best practices for running Cassandra on Amazon EC2. It recommends instance sizes like m1.xlarge for most use cases. It emphasizes configuring data and commit logs on ephemeral drives for better performance than EBS volumes. It also stresses the importance of distributing nodes across availability zones and regions for high availability. Overall, the document provides guidance on optimizing Cassandra deployments on EC2 through choices of hardware, data storage, networking and operational practices.
PlovDev 2016: Application Performance in Virtualized Environments by Todor T...
This document discusses managing resources in virtualized environments. It covers CPU, memory, storage, and network resources. For CPU, it discusses scheduling, features like hyperthreading, and monitoring metrics. For memory, it discusses features like ballooning and compression for reclamation, monitoring metrics, and best practices like not overcommitting. For storage, it discusses overhead, monitoring metrics like latency, and best practices like separating disks. For network, it discusses components, monitoring metrics like dropped packets, and best practices like load balancing at the vSwitch level. The overall document provides an overview of key virtualization concepts and techniques for optimizing resource usage and monitoring performance.
Seastore: Next Generation Backing Store for Ceph
Ceph is an open source distributed file system addressing file, block, and object storage use cases. Next generation storage devices require a change in strategy, so the community has been developing crimson-osd, an eventual replacement for ceph-osd intended to minimize cpu overhead and improve throughput and latency. Seastore is a new backing store for crimson-osd targeted at emerging storage technologies including persistent memory and ZNS devices.
Keeping your files safe in the post-Snowden era with SXFS
This document describes SXFS, an encrypted distributed filesystem that allows for easy and secure file sharing. Some key points:
- SXFS uses client-side encryption with AES 256 and file deduplication to securely store and transfer files.
- It provides fault tolerance and scalability by backing the encrypted filesystem with the distributed SX object storage. Additional nodes can be added to increase speed and storage capacity.
- Setup involves installing SXFS on clients and servers, creating a user and volume, and mounting the encrypted filesystem on clients for easy access to shared files.
strangeloop 2012 apache cassandra anti patterns
random list of Apache Cassndra Anti Patterns. There is a lot of info on what to use Cassandra for and how, but not a lot of information on what not to do. This presentation works towards filling that gap.
C# Job System + ECS Usage and Demo with Intel
This intermediate-level session will showcase examples of the C# Job System + ECS (Entity Component System), and explain how to take advantage of this new Unity feature to optimize your CPU usage.
Issam Khalil - Intel
XE 오픈 세미나(2014-02-22) - about XE 1.7.4
발표 일시 : 2014년 2월 22일
발표자 : 홍성범 ( github @khongchi )
XE 1.7.4의 개선 사항 및 새로운 기능 그리고 현황에 대한 소개
Xay dung van hoa doanh nghiep
http://tuyendung.timviecnhanh.com/mo-hinh-dao-tao-nhan-vien-hieu-qua/
Xây dựng văn hóa doanh nghiệp – Chìa khóa vàng để tồn tại
VHDN là văn hoá của một tổ chức vì vậy nó không đơn thuần là văn hoá giao tiếp hay văn hoá kinh doanh như ta thường nghĩ. Bất kỳ một doanh nghiệp nào nếu thiếu đi yếu tố văn hóa, tri thức thì khó đứng vững…
www.facebook.com/timviecnhanh- Nơi thư giãn, tin tức, kết nối cộng đồng
Google.com/+timviecnhanh
www.timviecnhanh.com/nghenghiep
www.tuyendung.timviecnhanh.com
www.vieclam.timviecnhanh.com
Morning
More Related Content
What's hot
Deep Dive In To Redis Replication: Vishy Kasar
This document summarizes a presentation about Redis replication. It discusses the basics of Redis replication including that it is asynchronous and non-blocking on the master. It also covers replication configuration, monitoring, data consistency, and memory usage. The presentation agenda includes topics like full and partial synchronization, and common replication issues. It concludes with an offer to demo Redis replication.
Nitty Gritty of Adaptive Video Transmuxing in JS
This document summarizes adaptive video transmuxing techniques for converting between streaming formats like MPEG-TS and MP4 in a web browser. It discusses using incremental computation and finite state machines to start playback faster by parsing media formats and extracting video data as it is received. The techniques aim to reduce latency, support more features and streams, and improve the developer experience through a cleaner architecture based on communicating sequential processes.
Zeromq - Pycon India 2013
ZeroMQ is a library for building distributed applications that provides patterns for request-reply, publish-subscribe, and pipelining between clients and services. It demonstrates using these patterns to build a hello world server and client, stock ticker publisher and subscriber, and parallel task processing pipeline. ZeroMQ supports multiple transport types and languages.
Multi-core Node.pdf
This document discusses using Node.js in a multi-core environment through clustering. It explains that Node.js is single-threaded, so clustering allows utilizing multiple CPU cores. Approaches include single VM with multiple processes or clustering Node.js processes. Clustering involves a master process that manages worker processes to distribute load. Tests show clustering improves throughput and reduces response times compared to single-core. The cluster module simplifies clustering Node.js across CPU cores.
Tips on High Performance Server Programming
This document provides tips and best practices for high performance server programming. It discusses avoiding blocking, using efficient algorithms and data structures, separating I/O from business logic, and tuning for bottlenecks. It also covers various I/O models like blocking, non-blocking, and asynchronous I/O. Key aspects of designing high performance servers include using non-blocking I/O, event-driven architectures, and avoiding excessive threading.
QCon 2017 - Java/JVM com Docker em produção: lições das trincheiras
This document discusses best practices for running Java applications in Docker containers in production environments. It covers common problems like out of memory errors and slow performance due to the JVM not being aware of Linux cgroups. Specific issues addressed include setting appropriate JVM memory and CPU limits based on the container restrictions, using named volumes for disk I/O, and configuring garbage collection and thread pools. It also provides an overview of tooling like Maven/Gradle plugins for building Docker images and schedulers like Docker Swarm and Kubernetes for container orchestration.
(SDD404) Amazon RDS for Microsoft SQL Server Deep Dive | AWS re:Invent 2014
Come learn how to turbocharge your application development with useful tips and tricks for Amazon RDS for SQL Server. We will cover practical and useful topics such as migrating your data to an Amazon RDS for SQL Server instance and as well as detailed guidance for taking advantage of Multi-AZ deployments to architect high-performance applications and production workloads.
Как построить видеоплатформу на 200 Гбитс / Ольховченков Вячеслав (Integros)
Как грамотная архитектура и правильное планирование запросов позволяет небольшим количеством серверов достичь высокой производительности при раздаче видеоконтента.
В докладе будет рассказано об опыте развития проекта видеоплатформы, о проблемах, которые возникли на пути, и как нам удается раздавать 200 Гбит меньше чем 10 серверами.
Тезисы - http://www.highload.ru/2015/abstracts/1872.html
Ceph Day Shanghai - Ceph Performance Tools
This document discusses tools for analyzing Ceph performance. It begins by describing common performance issues users encounter with Ceph and potential solutions like tuning configuration values or benchmarking. The rest of the document details various monitoring and benchmarking tools that can help identify bottlenecks like the dispatch layer, object store, or hardware. It provides examples of using tools like dstat, iostat, perf, systemtap, ceph perf dump, and benchmarking tools like Fio, rbd-replay and ceph_perf_local. It concludes with a case study where unaligned partitions and a driver bug were causing low IOPS that were resolved by fixing the partition alignment and downgrading the NVMe driver.
92 grand prix_2013
This document summarizes Josh Berkus's presentation on new features in PostgreSQL versions 9.1, 9.2, and the upcoming 9.3. Some key highlights include improvements to read and write performance, the addition of JSON data type and PL/v8 and PL/Coffee procedural languages, index-only scans, cascading replication, SP-GiST indexing, and many new monitoring and administration features. Josh Berkus is available for questions at josh@pgexperts.com and encourages attendees to upcoming PostgreSQL conferences.
Cassandra Anti-Patterns
This document summarizes several Cassandra anti-patterns including:
- Using a non-Oracle JVM which is not recommended.
- Putting the commit log and data directories on the same disk which can impact performance.
- Using EBS volumes on EC2 which can have unpredictable performance and throughput issues.
- Configuring overly large JVM heaps over 16GB which can cause garbage collection issues.
- Performing large batch mutations in a single operation which risks timeouts if not broken into smaller batches.
Crimson: Ceph for the Age of NVMe and Persistent Memory
Ceph is a mature open source software-defined storage solution that was created over a decade ago.
During that time new faster storage technologies have emerged including NVMe and Persistent memory.
The crimson project aim is to create a better Ceph OSD that is more well suited to those faster devices. The crimson OSD is built on the Seastar C++ framework and can leverage these devices by minimizing latency, cpu overhead, and cross-core communication. This talk will discuss the project design, our current status, and our future plans.
Node.js
Node.js is a JavaScript runtime built on Chrome's V8 engine. It is used for building scalable network applications like web servers. It uses an event-driven, asynchronous I/O model that makes it lightweight and efficient, especially for real-time apps with many simultaneous connections. Node.js has a large ecosystem of open source modules and sees widespread use for building fast web servers and APIs.
OSMC 2013 | Zabbix: A Practical Demo by Rihards Olups
Auch wenn es nützlich ist sich einen Überblick darüber zu verschaffen wie ein System funktioniert, versteht man es am besten, wenn das System gerade läuft.
Dieser Vortrag wird ein praktischer Quickstart sein, der aktuelle Basiskonfigurationen von Zabbix zeigen wird, von der Datensammlung bis hin zu Warnmeldungen.
Cassandra On EC2
This document discusses best practices for running Cassandra on Amazon EC2. It recommends instance sizes like m1.xlarge for most use cases. It emphasizes configuring data and commit logs on ephemeral drives for better performance than EBS volumes. It also stresses the importance of distributing nodes across availability zones and regions for high availability. Overall, the document provides guidance on optimizing Cassandra deployments on EC2 through choices of hardware, data storage, networking and operational practices.
PlovDev 2016: Application Performance in Virtualized Environments by Todor T...
This document discusses managing resources in virtualized environments. It covers CPU, memory, storage, and network resources. For CPU, it discusses scheduling, features like hyperthreading, and monitoring metrics. For memory, it discusses features like ballooning and compression for reclamation, monitoring metrics, and best practices like not overcommitting. For storage, it discusses overhead, monitoring metrics like latency, and best practices like separating disks. For network, it discusses components, monitoring metrics like dropped packets, and best practices like load balancing at the vSwitch level. The overall document provides an overview of key virtualization concepts and techniques for optimizing resource usage and monitoring performance.
Seastore: Next Generation Backing Store for Ceph
Ceph is an open source distributed file system addressing file, block, and object storage use cases. Next generation storage devices require a change in strategy, so the community has been developing crimson-osd, an eventual replacement for ceph-osd intended to minimize cpu overhead and improve throughput and latency. Seastore is a new backing store for crimson-osd targeted at emerging storage technologies including persistent memory and ZNS devices.
Keeping your files safe in the post-Snowden era with SXFS
This document describes SXFS, an encrypted distributed filesystem that allows for easy and secure file sharing. Some key points:
- SXFS uses client-side encryption with AES 256 and file deduplication to securely store and transfer files.
- It provides fault tolerance and scalability by backing the encrypted filesystem with the distributed SX object storage. Additional nodes can be added to increase speed and storage capacity.
- Setup involves installing SXFS on clients and servers, creating a user and volume, and mounting the encrypted filesystem on clients for easy access to shared files.
strangeloop 2012 apache cassandra anti patterns
random list of Apache Cassndra Anti Patterns. There is a lot of info on what to use Cassandra for and how, but not a lot of information on what not to do. This presentation works towards filling that gap.
C# Job System + ECS Usage and Demo with Intel
This intermediate-level session will showcase examples of the C# Job System + ECS (Entity Component System), and explain how to take advantage of this new Unity feature to optimize your CPU usage.
Issam Khalil - Intel
What's hot (20)
QCon 2017 - Java/JVM com Docker em produção: lições das trincheiras
QCon 2017 - Java/JVM com Docker em produção: lições das trincheiras
(SDD404) Amazon RDS for Microsoft SQL Server Deep Dive | AWS re:Invent 2014
(SDD404) Amazon RDS for Microsoft SQL Server Deep Dive | AWS re:Invent 2014
Как построить видеоплатформу на 200 Гбитс / Ольховченков Вячеслав (Integros)
Как построить видеоплатформу на 200 Гбитс / Ольховченков Вячеслав (Integros)
Crimson: Ceph for the Age of NVMe and Persistent Memory
Crimson: Ceph for the Age of NVMe and Persistent Memory
OSMC 2013 | Zabbix: A Practical Demo by Rihards Olups
OSMC 2013 | Zabbix: A Practical Demo by Rihards Olups
PlovDev 2016: Application Performance in Virtualized Environments by Todor T...
PlovDev 2016: Application Performance in Virtualized Environments by Todor T...
Keeping your files safe in the post-Snowden era with SXFS
Keeping your files safe in the post-Snowden era with SXFS
Viewers also liked
XE 오픈 세미나(2014-02-22) - about XE 1.7.4
발표 일시 : 2014년 2월 22일
발표자 : 홍성범 ( github @khongchi )
XE 1.7.4의 개선 사항 및 새로운 기능 그리고 현황에 대한 소개
Xay dung van hoa doanh nghiep
http://tuyendung.timviecnhanh.com/mo-hinh-dao-tao-nhan-vien-hieu-qua/
Xây dựng văn hóa doanh nghiệp – Chìa khóa vàng để tồn tại
VHDN là văn hoá của một tổ chức vì vậy nó không đơn thuần là văn hoá giao tiếp hay văn hoá kinh doanh như ta thường nghĩ. Bất kỳ một doanh nghiệp nào nếu thiếu đi yếu tố văn hóa, tri thức thì khó đứng vững…
www.facebook.com/timviecnhanh- Nơi thư giãn, tin tức, kết nối cộng đồng
Google.com/+timviecnhanh
www.timviecnhanh.com/nghenghiep
www.tuyendung.timviecnhanh.com
www.vieclam.timviecnhanh.com
Morning
Xavier cugat alejandro osvaldo patrizio
Xavier Cugat, músico español nacido en 1900, introdujo los ritmos cubanos en Estados Unidos en las primeras décadas del siglo XX. Dirigió una orquesta que tocaba versiones de estos ritmos en clubs nocturnos durante la Ley Seca, popularizándolos. Uno de sus mayores éxitos fue la canción "Perfidia" de 1940. Cugat se destacó por incluir instrumentos latinoamericanos como la marimba en su música y tuvo una vida amorosa muy activa.
dokumenppt
Instalasi Wordpress offline melibatkan pengunduhan dan instalasi XAMPP dan Wordpress, membuat database MySQL untuk Wordpress, dan mengkonfigurasi berkas wp-config.php untuk menghubungkan Wordpress dengan database sebelum menyelesaikan proses instalasi melalui alamat http://localhost/wordpress/wp-admin.php/install.php
Xbox kinect pet 673 pe geek
The Xbox Kinect is a motion sensing input device and controller-free gaming system created by Microsoft for the Xbox 360 console and Windows PCs. It uses a motion sensor bar to track the user's full body movements up to 6-8 feet away, allowing control through motion rather than a handheld controller. Kinect games include sports, action-adventure, fitness, dance, and family games that require different full-body motions. New Kinect systems typically cost $200-300 and include a game and controller, while used consoles can be found for $75-100. The Kinect provides an interactive gaming experience that increases physical activity over stationary console gaming.
Xcode 6 - O poder do Interface Builder
O documento discute as novas funcionalidades do Xcode 6, incluindo IBInspectable, IB_DESIGNABLE e Size Classes que permitem criar interfaces visuais de forma mais flexível e direta no Interface Builder. O View Debugger permite visualizar camadas e índices de componentes em tempo de execução sem ferramentas externas.
Viewers also liked (6)
Similar to Xclone presentation final
Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...
Let’s be honest: Running a distributed stateful stream processor that is able to handle terabytes of state and tens of gigabytes of data per second while being highly available and correct (in an exactly-once sense) does not work without any planning, configuration and monitoring. While the Flink developer community tries to make everything as simple as possible, it is still important to be aware of all the requirements and implications In this talk, we will provide some insights into the greatest operations mysteries of Flink from a high-level perspective: - Capacity and resource planning: Understand the theoretical limits. - Memory and CPU configuration: Distribute resources according to your needs. - Setting up High Availability: Planning for failures. - Checkpointing and State Backends: Ensure correctness and fast recovery For each of the listed topics, we will introduce the concepts of Flink and provide some best practices we have learned over the past years supporting Flink users in production.
Sizing MongoDB on AWS with Wired Tiger-Patrick and Vigyan-Final
This document provides guidance on sizing MongoDB deployments on AWS for optimal performance. It discusses key considerations for capacity planning like testing workloads, measuring performance, and adjusting over time. Different AWS services like compute-optimized instances and storage options like EBS are reviewed. Best practices for WiredTiger like sizing cache, effects of compression and encryption, and monitoring tools are covered. The document emphasizes starting simply and scaling based on business needs and workload profiling.
Open Source Data Backup, or: How to Sleep Better at Night (OSCON 2005)
An updated version of my Amanda talk that I gave at OSCON 2004. For this version, I added coverage of Bacula.
Deployment Strategies (Mongo Austin)
The document discusses best practices for deploying MongoDB including sizing hardware with sufficient memory, CPU and I/O; using an appropriate operating system and filesystem; installing and upgrading MongoDB; ensuring durability with replication and backups; implementing security, monitoring performance with tools, and considerations for deploying on Amazon EC2.
Oracle Performance On Linux X86 systems
On X86 systems, using an Unbreakable Enterprise Kernel (UEK) is recommended over other enterprise distributions as it provides better hardware support, security patches, and testing from the larger Linux community. Key configuration recommendations include enabling maximum CPU performance in BIOS, using memory types validated by Oracle, ensuring proper NUMA and CPU frequency settings, and installing only Oracle-validated packages to avoid issues. Monitoring tools like top, iostat, sar and ksar help identify any CPU, memory, disk or I/O bottlenecks.
(ARC348) Seagull: How Yelp Built A System For Task Execution
Efficiently parallelizing mutually exclusively tasks can be a challenging problem when done at scale. Yelp's recent in-house product, Seagull, demonstrates how an intelligent scheduling system can use several open-source products to provide a highly scalable and fault-tolerant distributed system. Learn how Yelp built Seagull with a variety of Amazon Web Services to concurrently execute thousands of tasks that can greatly improve performance. Seagull combines open-source software like ElasticSearch, Mesos, Docker, and Jenkins with Amazon Web Services (AWS) to parallelize Yelp's testing suite. Our current use case of Seagull involves distributively running Yelp's test suite that has over 55,000 test cases. Using our smart scheduling, we can run one of our largest test suites to process 42 hours of serial work in less than 10 minutes using 200 r3.8xlarge instances from Amazon Elastic Compute Cloud (Amazon EC2). Seagull consumes and produces data at very high rates. On a typical day, Seagull writes 60 GBs of data and consumes 20 TBs of data. Although we are currently using Seagull to parallelize test execution, it can efficiently parallelize other types of independent tasks.
High performance Infrastructure Oct 2013
The document discusses high performance infrastructure for Server Density which includes 150 servers that have been running since June 2009 and migrated from MySQL to MongoDB. It stores 25TB of data per month. Key aspects of performance discussed are using fast networks like 10 Gigabit Ethernet on AWS, ensuring high memory, using SSDs over spinning disks for performance, and factors like replication lag based on location. The document also compares options like using cloud, dedicated servers, or colocation and discusses monitoring, backups, dealing with outages, and other operational aspects.
The Secret Guide to Cloud Performance - Cloudlook
1) The document presents benchmark results that compare the performance of different cloud providers and instance types across metrics like CPU, concurrency, memory, and disk performance.
2) There is significant variation in performance both between different cloud providers and instance types, and also within the same instance type over time.
3) While the cloud provides benefits like easy resizing and deployment, raw performance is generally better with dedicated hosting and benchmarks show the cloud is not always lower cost. Careful performance testing is needed to select the best instance type for each application.
Infrastructure review - Shining a light on the Black Box
Scenario: You work as a consultant and a new client has just signed on. Their DBA left suddenly leaving nothing but some outdated documentation in their wiki. After the kick-off meeting you realise that the operations and the development teams know little to none about the databases. They have been encountering intermittent problems with the application’s performance and suspect it’s related to the databases. You are told: "Please fix it ASAP!” So you have your public key installed on their jumphost and they manage to provide you with a 6 character long mysql root password. This is where your journey begins! During this session you will learn some of the best practices around discovering a new environment, finding possible threats and weaknesses and determining what key metrics to focus on for performance and reliability. We will cover architecture, replication, OS and MySQL level configuration, storage engines, failover strategies, backup and restores, monitoring, query tuning and possible ways to save money. The goal at the end of the presentation is to have a prioritized action plan. I will also explain the usage and the output of some tools/wrappers that help during an infrastructure review. Examples include creation of maximum integetr usage reports, table fragmentation and duplicate keys (we will be leveraging multiple Percona Toolkit scripts but also some lesser known tools as well). It is often easy to overlook underlying problems in the infrastructure during day-to-day operations, so this presentation will aim to highlight how to identify and resolve potential bottlenecks with your systems.
3 Flink Mistakes We Made So You Won't Have To
"Is your team looking to bring the power of full, end-to-end stream processing with Apache Flink to your organization but are concerned about the time, resources or skills required? In this talk, Sharon Xie, Decodable Founding Engineer and Apache Flink PMC Member, Robert Metzger, will reveal the biggest lessons learned, and how to avoid common mistakes when adopting Apache Flink. If you have any plans on implementing Apache Flink, then this is a session you do not want to miss.
We will talk about avoiding data-loss with Flink’s Kafka exactly-once producer, configuring Flink for getting the most bang for the buck out of your memory configuration and tuning for efficient checkpointing."
Android Meets Docker
How does awesome Android benefit from dazzling Docker? With an introduction to the Docker way of continuous integration for Android, it would help you get a consistent Android development and build environment with minimal effort.
Syllabus:
* Background story - where the problem happened
* Why Android dev should care?
* How to provision an Android environment to build project usually? How Docker is gonna solve it?
* Typical machine dependant failing unit tests examples, which could be revealed by using Docker
* Philosophy, features, improvements, comparison against traditional approach
* Limitations
* Quick setup of Jenkins using AndroidSDK docker slaves (live demo)
KoprowskiT - SQLBITS X - 2am a disaster just began
A document outlines best practices for surviving a disaster involving SQL Server infrastructure. It recommends being well prepared with regular backups stored offsite, documented restore procedures, clear roles and responsibilities, and service level agreements defining acceptable downtimes. Key aspects of preparation include backups, restore testing, documentation, contact lists, hardware and software inventory, passwords, encryption keys, defined teams, and keeping management informed. The overall message is that with proper planning, a disaster can be survived by following the best practice of being prepared.
Kraken mesoscon 2018
Kraken is a P2P docker image distribution system. It’s loosely based on BitTorrent protocol, fully compatible with docker registry API, and supports pluggable storage backends like S3, HDFS, etc. It successfully solved scaling problems we saw under different scenarios, also greatly sped up container deployment.
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
EVCache is a distributed, sharded, replicated key-value store optimized for Netflix's use cases on AWS. It is based on Memcached but uses RocksDB for persistent storage, lowering costs compared to storing all data in memory. Moneta is the next generation EVCache server, using Rend and Mnemonic libraries to intelligently manage data placement in RAM and SSD. This provides high performance for both volatile and batch workloads while reducing costs by 70% compared to the original Memcached-based design.
ceph-barcelona-v-1.2
The document provides recommendations for optimizing an OpenStack cloud environment using Ceph storage. It discusses configuring Glance, Cinder, and Nova to integrate with Ceph, as well as recommendations for the Ceph cluster itself regarding OSDs, journals, networking, and failure domains. Performance was improved by converting image formats to raw, enabling SSD journals, bonding network interfaces, and adjusting scrubbing settings.
Ceph barcelona-v-1.2
Best Practices & Performance Tuning - OpenStack Cloud Storage with Ceph - In this presentation, we discuss best practices and performance tuning for OpenStack cloud storage with Ceph to achieve high availability, durability, reliability and scalability at any point of time. Also discuss best practices for failure domain, recovery, rebalancing, backfilling, scrubbing, deep-scrubbing and operations
Deployment Strategies
- The document provides guidance on deploying MongoDB including sizing hardware, installing and upgrading MongoDB, configuration considerations for EC2, security, backups, durability, scaling out, and monitoring. Key aspects discussed are profiling and indexing queries for performance, allocating sufficient memory, CPU and disk I/O, using 64-bit OSes, ext4/XFS filesystems, upgrading to even version numbers, and replicating for high availability and backups.
Deployment Strategy
The document provides guidance on deploying MongoDB in production environments. It discusses sizing hardware requirements for memory, CPU, and disk I/O. It also covers installing and upgrading MongoDB, considerations for cloud platforms like EC2, security, backups, durability, scaling out, and monitoring. The focus is on performance optimization and ensuring data integrity and high availability.
Introduction to Ansible
Ansible has huge potential, also working with docker. These slides give an introduction to how Ansible works and can be used to automate and improve your infrastructure setup.
Cassandra Day Atlanta 2015: Recording the Web: High-Fidelity Storage and Play...
FullStory is like a DVR for the web. An in-page script captures everything that happens during a user's online session, with the ability to play it back later with high-fidelity. In this talk I'll describe how we use Cassandra, starting with the initial requirements and our resulting schema design (including both good and bad choices there), and following up with some highlights of our experience as well as future plans.
Similar to Xclone presentation final (20)
Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...
Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...
Sizing MongoDB on AWS with Wired Tiger-Patrick and Vigyan-Final
Sizing MongoDB on AWS with Wired Tiger-Patrick and Vigyan-Final
Open Source Data Backup, or: How to Sleep Better at Night (OSCON 2005)
Open Source Data Backup, or: How to Sleep Better at Night (OSCON 2005)
(ARC348) Seagull: How Yelp Built A System For Task Execution
(ARC348) Seagull: How Yelp Built A System For Task Execution
Infrastructure review - Shining a light on the Black Box
Infrastructure review - Shining a light on the Black Box
KoprowskiT - SQLBITS X - 2am a disaster just began
KoprowskiT - SQLBITS X - 2am a disaster just began
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
Cassandra Day Atlanta 2015: Recording the Web: High-Fidelity Storage and Play...
Cassandra Day Atlanta 2015: Recording the Web: High-Fidelity Storage and Play...
Recently uploaded
Webinar: Designing a schema for a Data Warehouse
Are you new to data warehouses (DWH)? Do you need to check whether your data warehouse follows the best practices for a good design? In both cases, this webinar is for you.
A data warehouse is a central relational database that contains all measurements about a business or an organisation. This data comes from a variety of heterogeneous data sources, which includes databases of any type that back the applications used by the company, data files exported by some applications, or APIs provided by internal or external services.
But designing a data warehouse correctly is a hard task, which requires gathering information about the business processes that need to be analysed in the first place. These processes must be translated into so-called star schemas, which means, denormalised databases where each table represents a dimension or facts.
We will discuss these topics:
- How to gather information about a business;
- Understanding dictionaries and how to identify business entities;
- Dimensions and facts;
- Setting a table granularity;
- Types of facts;
- Types of dimensions;
- Snowflakes and how to avoid them;
- Expanding existing dimensions and facts.
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Project Management Semester Long Project - Acuity
Acuity is an innovative learning app designed to transform the way you engage with knowledge. Powered by AI technology, Acuity takes complex topics and distills them into concise, interactive summaries that are easy to read & understand. Whether you're exploring the depths of quantum mechanics or seeking insight into historical events, Acuity provides the key information you need without the burden of lengthy texts.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Recently uploaded (20)
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Xclone presentation final
- 3. What we do？ • Environment o 6 physical hosts(CPU:12, Memory:16GB） • Requirement o Deploy 100 serengeti VMs in 30 minutes o Make it as fast as possible
- 4. Why we do it？ • VMware use it everyday • Hybrid Cloud • Distributed App • Only Automation ? • Fast
- 6. Problem Analysis • Full Clone o Resource Usage o Time Cost: ~3 minutes o Naïve Solution：3 *（5 + 100/6) = 66 minutes Metrics Value cpu <2% memory 200M disk 40MB/s network 80-100MB/s
- 7. Problem Analysis • Linked Clone o Time Cost: ~10 seconds o Naive Solution: 3*5 + 10*(100/6)/60 + delta = 18~22 minutes • Shortcomings o Must in one host
- 8. Problem Analysis • Hardware Performance Test • Metrics Value Disk read 25MB/s Disk write 50MB/s Network ~100MB/s
- 9. Problem Analysis • Key Decision o Full clone in multi-host, linked clone in inner host linked clone much faster o Use tree clone disk bottleneck single srcVM lock
- 11. Our solution（Architecture） UI Deploy Algorithm Information collector Infrastructure Ops VC API
- 13. Future work • Ramdisk • Infrastructure Aware Deployment（Disk & Network） • Full Clone Optimization
- 14. Our code & docs Codes on: Git: https://github.com/linvictor88/Xclone Docs: Plan Edit Doc:https://docs.google.com/a/vmware.com/document/d/1eoD5X2B4hBI69eFlkV671n1QFz- Pggy14UZTyeG0YjI/edit#heading=h.84hu40wudn8o Plan pub: https://docs.google.com/document/d/1eoD5X2B4hBI69eFlkV671n1QFz-Pggy14UZTyeG0YjI/pub Status Edit Doc:https://docs.google.com/a/vmware.com/document/d/1gg_7zw9ZJwiqR_wQSnwOMqn1Zk1aTxeZgEne 0AwQUvc/edit#heading=h.vlkvaq5eerus Status pub:https://docs.google.com/a/vmware.com/document/d/1gg_7zw9ZJwiqR_wQSnwOMqn1Zk1aTxeZgEne 0AwQUvc/pub Cloning research Doc:https://docs.google.com/a/vmware.com/document/d/1rqD8pmG6So3ARA4YD9Hd6Ut0q9ROAZ7K_qG V4Xr8k4U/edit# Cloning research pub: https://docs.google.com/document/d/1rqD8pmG6So3ARA4YD9Hd6Ut0q9ROAZ7K_qGV4Xr8k4U/pub Xclone Code Design https://docs.google.com/a/vmware.com/document/d/17zMxuN4EjpyRkAMarahvlEyTjsb3hQmG- O4NMQmAk40/edit
- 15. Learned Lessons • Teamworking • Source code management
- 16. Thanks • Junping Du • Xinhui Li • Yang Liu • Terry Li