CCNxCon2012: Session 5: Easy CCNx experimentation on PlanetLab

Xen versus kvm_20080623Todd Deshane

Skale your test environment! Containerized End-2-End-Testing @Herbstcampus Nü...

Tobias Schneck

http://www.herbstcampus.de/veranstaltung-5222-containerized-end-2-end-testing.html?id=5222 Bei der Konzeption von End-2-End-Tests ist eines der größten Probleme die Frage, wie die Testausführung möglichst robust, reproduzierbar und skalierbar gestaltet werden kann. Diese Hürde lässt sich mit klassischen Ansätzen nicht überwinden. Einen eleganten Ausweg bieten in Container verpackte Testumgebungen. Dadurch wird es möglich, einen definierten Systemstand reproduzierbar aufzurufen und Tests performant auszuführen. Es wird zeigt, wie z.B. parallele GUI-Tests in verschiedenen Umgebungen zur Qualitätssicherung beitragen. Die Beispiele sind mit dem Open-Source-Tools Sakuli und Docker realisiert und testen Web- und Rich-Client-Applikationen. Der Vortrag beinhaltet eine großen Anteil an Live-Demo. Die zugehörige Codebasis wird den Zuhören auch zugänglich gemacht. Skills Keine Lernziele Ziel ist es, dem Zuhörer aufzuzeigen, wie das Potenzial von Container-Technologien genutzt werden kann, um die Softwarequalität zu erhöhen und den manuellen Testaufwand drastisch zu verringern. Eine abschließende Bewertung der Erfahrungen sowie ein Ausblick auf weitere Einsatzszenarien und Entwicklungsschritte runden den Vortrag ab.

Union FileSystem - A Building Blocks Of a Container

Knoldus Inc.

Namespace, CGroup, and Union file-system are the basic building blocks of a container. Let’s have our focus on file-system. Why yet another file-system for the container? Is Conventional Linux file-systems like ext2, ext3, ext4, XFS, etc. not good enough to meet the purpose? In this blog post, I will try to answer these questions. Here we will be delving deeply into the Union File System and a few of its essential properties.

P2P Container Image Distribution on IPFS With containerd and nerdctl

Talked at FOSDEM 2022 about IPFS-based P2P image distribution with containerd and nerdctl (Feburary 6, 2022). https://fosdem.org/2022/schedule/event/container_ipfs_image/ nerdctl is a Docker-compatible CLI of containerd, developed as a subproject of containerd. nerdctl recently added support of P2P image distribution on IPFS. This enables to share container images among hosts without hosting or relying on the registry. In this session, Kohei, one of the maintainers of nerdctl, will introduce IPFS-based P2P image distribution with containerd and nerdctl. This session will also show the combination of IPFS-based distribution with the existing image distribution techniques, focusing on lazy pulling (eStargz) and image encryption (OCIcrypt). The status of integration work with other tools including Kubernetes will also be shared. Related blog post: "P2P Container Image Distribution on IPFS With Containerd" . https://medium.com/nttlabs/nerdctl-ipfs-975569520e3d

Introduction to Docker and deployment and Azure

If you're not familiar with Docker yet, here is your chance to catch up: a quick overview of the Open Source Docker Engine, and its associated services delivered through the Docker Hub. It also includes Jérôme will also discuss the new features of Docker 1.0, and briefly explain how you can run and maintain Docker on Azure. In addition, an Azure team member will demonstrate how deploy docker to Azure. The presentation will be followed by a Q&A session!

This slides were presented at the 24th International Symposium on High-Performance Parallel and Distributed Computing (HPDC '15) Performance isolation is emerging as a requirement for High Performance Computing (HPC) applications, particularly as HPC architectures turn to in situ data processing and application composition techniques to increase system throughput. These approaches require the co-location of disparate workloads on the same compute node, each with different resource and runtime requirements. In this paper we claim that these workloads cannot be effectively managed by a single Operating System/Runtime (OS/R). Therefore, we present Pisces, a system software architecture that enables the co-existence of multiple independent and fully isolated OS/Rs, or enclaves, that can be customized to address the disparate requirements of next generation HPC workloads. Each enclave consists of a specialized lightweight OS co-kernel and runtime, which is capable of independently managing partitions of dynamically assigned hardware resources. Contrary to other co-kernel approaches, in this work we consider performance isolation to be a primary requirement and present a novel co-kernel architecture to achieve this goal. We further present a set of design requirements necessary to ensure performance isolation, including: (1) elimination of cross OS dependencies, (2) internalized management of I/O, (3) limiting cross enclave communication to explicit shared memory channels, and (4) using virtualization techniques to provide missing OS features. The implementation of the Pisces co-kernel architecture is based on the Kitten Lightweight Kernel and Palacios Virtual Machine Monitor, two system software architectures designed specifically for HPC systems. Finally we will show that lightweight isolated co-kernels can provide better performance for HPC applications, and that isolated virtual machines are even capable of outperforming native environments in the presence of competing workloads.

Anatomy of a Container: Namespaces, cgroups & Some Filesystem Magic - LinuxCon

Containers are everywhere. But what exactly is a container? What are they made from? What's the difference between LXC, butts-nspawn, Docker, and the other container systems out there? And why should we bother about specific filesystems? In this talk, Jérôme will show the individual roles and behaviors of the components making up a container: namespaces, control groups, and copy-on-write systems. Then, he will use them to assemble a container from scratch, and highlight the differences (and likelinesses) with existing container systems.

How Quantum configures Virtual Networks under the Hood?Etsuji Nakai

Introduction to linux containers

Google

Shoot4U: Using VMM Assists to Optimize TLB Operations on Preempted vCPUs

Jiannan Ouyang, PhD

This slides were presented at the 12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’16). Virtual Machine based approaches to workload consolidation, as seen in IaaS cloud as well as datacenter platforms, have long had to contend with performance degradation caused by synchronization primitives inside the guest environments. These primitives can be affected by virtual CPU preemptions by the host scheduler that can introduce delays that are orders of magnitude longer than those primitives were designed for. While a significant amount of work has focused on the behavior of spinlock primitives as a source of these performance issues, spinlocks do not represent the entirety of synchronization mechanisms that are susceptible to scheduling issues when running in a virtualized environment. In this paper we address the virtualized performance issues introduced by TLB shootdown operations. Our profiling study, based on the PARSEC benchmark suite, has shown that up to 64% of a VM's CPU time can be spent on TLB shootdown operations under certain workloads. In order to address this problem, we present a paravirtual TLB shootdown scheme named Shoot4U. Shoot4U completely eliminates TLB shootdown preemptions by invalidating guest TLB entries from the VMM and allowing guest TLB shootdown operations to complete without waiting for remote virtual CPUs to be scheduled. Our performance evaluation using the PARSEC benchmark suite demonstrates that Shoot4U can reduce benchmark runtime by up to 85% compared an unmodified Linux kernel, and up to 44% over a state-of-the-art paravirtual TLB shootdown scheme.

Lxc – next gen virtualization for cloud intro (cloudexpo)

Introduction and Deep Dive Into Containerd

Lxc- Introduction

Luís Eduardo

DockerとKubernetesをかけめぐる

CloudNative Days Spring 2021 ONLINE キーノートでの発表資料です。 https://event.cloudnativedays.jp/cndo2021/talks/1071 本セッションでは、DockerとKubernetesのもつ基本的な機能の概要を、コンテナの仕組みをふまえつつイラストを用いて紹介していきます。一般にあまり焦点をあてて取り上げられることは多くありませんが、コンテナの作成や管理を担う低レベルなソフトウェア「コンテナランタイム」も本セッションの中心的なトピックのひとつです。本セッションは、拙著「イラストで分かるDockerとKubernetes」(技術評論社)の内容を参考にしています。 https://www.amazon.co.jp/dp/4297118378

Lxc- Linux Containers

samof76

SCALE 2011 Deploying OpenStack with Chef

Matt Ray

Cgroups, namespaces, and beyond: what are containers made from? (DockerCon Eu...

Real-time soultionNylon

Node.js at Joyent: Engineering for Production

jclulow

Joyent is one of the largest deployers of Node.js in production systems. In order to successfully deploy large-scale, distributed systems, we must understand the systems we build! For us, that means having first-class tools for debugging our software, and understanding and improving its performance. Come on a whirlwind tour of the tools and techniques we use at Joyent as we build out large-scale distributed software with Node.js: from mdb for Post-Mortem Debugging, to Flame Graphs for performance analysis; from DTrace for dynamic, production-safe instrumentation and tracing, to JSON-formatted logging with Bunyan.

Cgroups, namespaces and beyond: what are containers made from?

Container Torture: Run any binary, in any container

Gane presentation v1

growingaudiences

World templatecoolstuff

What's hot

Portable TeX Documents (PTD): PackagingCon 2021

Jonathan Fine

Performance characteristics of traditional v ms vs docker containers (dockerc...

Linux containers – next gen virtualization for cloud (atl summit) ar4 3 - copy

Introduction to Docker at Glidewell Laboratories in Orange County

Achieving Performance Isolation with Lightweight Co-Kernels

Jiannan Ouyang, PhD

Anatomy of a Container: Namespaces, cgroups & Some Filesystem Magic - LinuxCon

How Quantum configures Virtual Networks under the Hood?Etsuji Nakai

Introduction to linux containers

Google

Shoot4U: Using VMM Assists to Optimize TLB Operations on Preempted vCPUs

Jiannan Ouyang, PhD

Lxc – next gen virtualization for cloud intro (cloudexpo)

Introduction and Deep Dive Into Containerd

Lxc- Introduction

Luís Eduardo

DockerとKubernetesをかけめぐる

Lxc- Linux Containers

samof76

SCALE 2011 Deploying OpenStack with Chef

Matt Ray

Cgroups, namespaces, and beyond: what are containers made from? (DockerCon Eu...

Real-time soultionNylon

Node.js at Joyent: Engineering for Production

jclulow

Cgroups, namespaces and beyond: what are containers made from?

Container Torture: Run any binary, in any container