Backup using rsync
•Download as PPTX, PDF•
0 likes•260 views
Rsync is a software tool used to perform disk backups either locally or remotely. It performs differential synchronization, only copying files that have changed, to save bandwidth. Rsync can be used to create archives including permissions and metadata, specify remote shell connections like SSH, filter files, compress data transfers, update existing backups by only sending changed files, and delete files from the destination that no longer exist in the source.
Report
Share
Report
Share
Recommended
Optimizing Kubernetes Resource Requests/Limits for Cost-Efficiency and Latenc...
Kubernetes has the concept of resource requests and limits. Pods get scheduled on the nodes based on their requests and optionally limited in how much of the resource they can consume. Understanding and optimizing resource requests/limits is crucial both for reducing resource "slack" and ensuring application performance/low-latency. This talk shows our approach to monitoring and optimizing Kubernetes resources for 80+ clusters to achieve cost-efficiency and reducing impact for latency-critical applications. All shown tools are Open Source and can be applied to most Kubernetes deployments.
Ceph Day Melbourne - Troubleshooting Ceph
This document provides troubleshooting guidance for issues with Ceph. It begins by suggesting identifying the problem domain as either performance, hang, crash, or unexpected behavior. For each problem, it recommends tools and techniques for further investigation such as debugging logs, profiling tools, and source code analysis. Debugging steps include establishing baselines, identifying implicated hosts or subsystems, increasing log verbosity, and tracing transactions through logs. The document emphasizes starting at the user end and working back towards Ceph to isolate issues.
[OpenInfra Days Korea 2018] Day 2 - CEPH 운영자를 위한 Object Storage Performance T...
[OpenInfra Days Korea 2018] Day 2 - CEPH 운영자를 위한 Object Storage Performance T...OpenStack Korea Community
- 발표자: netmarble 한승진
- 설명: https://event.openinfradays.kr/2018/session2/50_track1Nginx A High Performance Load Balancer, Web Server & Reverse Proxy
Nginx is a web server which can also be used as a reverse proxy, load balancer, mail proxy and HTTP cache
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Après la petite intro sur le stockage distribué et la description de Ceph, Jian Zhang réalise dans cette présentation quelques benchmarks intéressants : tests séquentiels, tests random et surtout comparaison des résultats avant et après optimisations. Les paramètres de configuration touchés et optimisations (Large page numbers, Omap data sur un disque séparé, ...) apportent au minimum 2x de perf en plus.
Automation with ansible
A hands-on workshop on "Automation with Ansible". Starting from installing and setting up Ansible to managing servers and application deployments.
NGINX ADC: Basics and Best Practices – EMEA
In this webinar we help you get started with NGINX, industry’s most ubiquitous web server and API gateway. We cover best practices for installing, configuring, and troubleshooting both NGINX Open Source and the enterprise-grade NGINX Plus. We provide insights about using NGINX Controller to manage your NGINX Plus instances.
Watch this webinar to learn:
- How to create NGINX configurations for web server, load balancer, etc.
- About improving performance using keepalives and other NGINX directives
- How the NGINX Controller Load Balancing Module can manage NGINX Plus instances at scale
- About augmenting your existing ADC with NGINX
https://www.nginx.com/resources/webinars/nginx-adc-basics-best-practices-emea/
Docker Advanced registry usage
The document discusses advanced configuration and usage of Docker registries. It describes what a registry is for storing Docker images and supporting various storage backends. It then covers configuring a registry to add features like a search index using SQLite, mirroring another registry, and adding a Redis cache. The document concludes by discussing extending the registry code for customization.
Recommended
Optimizing Kubernetes Resource Requests/Limits for Cost-Efficiency and Latenc...
Kubernetes has the concept of resource requests and limits. Pods get scheduled on the nodes based on their requests and optionally limited in how much of the resource they can consume. Understanding and optimizing resource requests/limits is crucial both for reducing resource "slack" and ensuring application performance/low-latency. This talk shows our approach to monitoring and optimizing Kubernetes resources for 80+ clusters to achieve cost-efficiency and reducing impact for latency-critical applications. All shown tools are Open Source and can be applied to most Kubernetes deployments.
Ceph Day Melbourne - Troubleshooting Ceph
This document provides troubleshooting guidance for issues with Ceph. It begins by suggesting identifying the problem domain as either performance, hang, crash, or unexpected behavior. For each problem, it recommends tools and techniques for further investigation such as debugging logs, profiling tools, and source code analysis. Debugging steps include establishing baselines, identifying implicated hosts or subsystems, increasing log verbosity, and tracing transactions through logs. The document emphasizes starting at the user end and working back towards Ceph to isolate issues.
[OpenInfra Days Korea 2018] Day 2 - CEPH 운영자를 위한 Object Storage Performance T...
[OpenInfra Days Korea 2018] Day 2 - CEPH 운영자를 위한 Object Storage Performance T...OpenStack Korea Community
- 발표자: netmarble 한승진
- 설명: https://event.openinfradays.kr/2018/session2/50_track1Nginx A High Performance Load Balancer, Web Server & Reverse Proxy
Nginx is a web server which can also be used as a reverse proxy, load balancer, mail proxy and HTTP cache
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Après la petite intro sur le stockage distribué et la description de Ceph, Jian Zhang réalise dans cette présentation quelques benchmarks intéressants : tests séquentiels, tests random et surtout comparaison des résultats avant et après optimisations. Les paramètres de configuration touchés et optimisations (Large page numbers, Omap data sur un disque séparé, ...) apportent au minimum 2x de perf en plus.
Automation with ansible
A hands-on workshop on "Automation with Ansible". Starting from installing and setting up Ansible to managing servers and application deployments.
NGINX ADC: Basics and Best Practices – EMEA
In this webinar we help you get started with NGINX, industry’s most ubiquitous web server and API gateway. We cover best practices for installing, configuring, and troubleshooting both NGINX Open Source and the enterprise-grade NGINX Plus. We provide insights about using NGINX Controller to manage your NGINX Plus instances.
Watch this webinar to learn:
- How to create NGINX configurations for web server, load balancer, etc.
- About improving performance using keepalives and other NGINX directives
- How the NGINX Controller Load Balancing Module can manage NGINX Plus instances at scale
- About augmenting your existing ADC with NGINX
https://www.nginx.com/resources/webinars/nginx-adc-basics-best-practices-emea/
Docker Advanced registry usage
The document discusses advanced configuration and usage of Docker registries. It describes what a registry is for storing Docker images and supporting various storage backends. It then covers configuring a registry to add features like a search index using SQLite, mirroring another registry, and adding a Redis cache. The document concludes by discussing extending the registry code for customization.
Ansible presentation
This document discusses repetitive system administration tasks and proposes Ansible as a solution. It describes how Ansible works using agentless SSH to automate tasks like software installation, configuration, and maintenance across multiple servers. Key aspects covered include Ansible's inventory, modules, playbooks, templates, variables, roles and Docker integration. Ansible Tower is also introduced as a GUI tool for running Ansible jobs. The document recommends Ansible for anyone doing the same tasks across multiple servers to gain efficiencies over manual processes.
PostgreSQL High Availability in a Containerized World
This document discusses PostgreSQL high availability in a containerized environment. It begins with an overview of containers and their advantages like lower footprint and density. It then covers enterprise needs for high availability like recovery time objectives. Common approaches to PostgreSQL high availability are discussed like replication, shared storage, and using projects like Patroni and Stolon. Modern trends with containers are highlighted like separating data and binaries. Kubernetes is presented as a production-grade orchestrator that can provide horizontal scaling and self-healing capabilities. The discussion concludes with challenges of multi-region deployments and how service discovery with Consul can help address those challenges.
Discover How IBM Uses InfluxDB and Grafana to Help Clients Monitor Large Prod...
IBM uses InfluxDB to store metrics collected from nmon and Grafana to visualize those metrics. This helps IBM monitor large production servers and benchmark centers. Some key points:
- nmon was originally created 25 years ago by Nigel Griffiths to monitor OS performance but the data format and lack of central storage was limiting. nmon was updated to output JSON and line protocol for InfluxDB.
- Grafana provides various visualizations of the metrics stored in InfluxDB like donut graphs, line graphs, heat maps, and single stat/graph panels. This helps identify issues like busy periods and system bottlenecks.
- Ideas were discussed for better visualizing periodic trends like busy Fridays or batch over
Using eBPF for High-Performance Networking in Cilium
The Cilium project is a popular networking solution for Kubernetes, based on eBPF. This talk uses eBPF code and demos to explore the basics of how Cilium makes network connections, and manipulates packets so that they can avoid traversing the kernel's built-in networking stack. You'll see how eBPF enables high-performance networking as well as deep network observability and security.
Ansible 101
This document provides an overview of Ansible, an IT automation tool. It discusses key Ansible concepts like configuration management, infrastructure evolution, deployment flows, host inventory, playbooks, modules, variables, templates, conditionals, loops, roles, and more. The document also covers how to install Ansible, run ad-hoc commands and playbooks, and provides examples of playbooks, templates, and roles.
Introduction to Docker storage, volume and image
Docker storage drivers allow images and containers to be stored in different ways by implementing a pluggable storage driver interface. Common storage drivers include overlay2, aufs, devicemapper, and vfs. Images are composed of read-only layers stacked on top of each other, with containers adding a writable layer. Storage can be persisted using volumes, bind mounts, or tmpfs mounts. Strategies for managing persistent container data include host-based storage, volume plugins, and container storage platforms.
Kubernetes Networking 101
Kubernetes has two simple but powerful network concepts: every Pod is connected to the same network, and Services let you talk to a Pod by name. Bryan will take you through how these concepts are implemented - Pod Networks via the Container Network Interface (CNI), Service Discovery via kube-dns and Service virtual IPs, then on to how Services are exposed to the rest of the world.
Kubernetes and Nested Containers: Enhanced 3 Ps (Performance, Price and Provi...
Kubernetes and Nested Containers: Enhanced 3 Ps (Performance, Price and Provi...Jelastic Multi-Cloud PaaS
Kubernetes enables possibilities to develop cloud native microservices or decompose traditional applications making them more technologically advanced with the help of containers. Currently, most of the Kubernetes solutions are offered on top of VMs and there is a room for further improvements. Implementing nested architecture of application containers running inside system containers opens additional flexibility of resource allocation and management, accelerates provisioning of the clusters and pods, as well as cuts the overall costs. Or in other words it enhances 3 Ps - Provisioning, Performance and Price. During this session Ruslan Synytsky (CEO and co-founder of Jelastic PaaS) reviews the possibilities of running a Kubernetes cluster inside nested containers, what configurations should be taken into account, and how to overcome the barriers on the way to more efficient Kubernetes hosting.
Video presentation: https://youtu.be/VzkXuMx7jLE
Learn more at https://jelastic.com/kubernetes-hosting/NGINX: Basics and Best Practices
On-demand recording: nginx.com/resources/webinars/nginx-basics-best-practices
You’ve heard of NGINX and the benefits it can provide to your web application, but maybe you’re not sure how to get started. There are a lot of tutorials online, but they can be outdated and contradict each other, making things more challenging. In this webinar we’ll cover the basics of NGINX to help you effectively begin using it as part of your existing or new web app.
This webinar covers how to:
* Install NGINX and verify it's properly running
* Create NGINX configurations for reverse proxy, load balancer, etc.
* Improve performance using keepalives and other NGINX directives
* Debug and troubleshoot using NGINX logs
Delivering Docker & K3s worloads to IoT Edge devices
About 94% of AI Adopters are planning to use containers in the next 1 year. What’s driving this exponential growth? Faster time to deployment and Faster AI workload processing are the two major reasons. You can use GPUs in big data applications such as machine learning, data analytics, and genome sequencing. Docker containerization makes it easier for you to package and distribute applications. You can enable GPU support when using YARN on Docker containers. In this talk, I will demonstrate how Docker accelerates the AI workload development and deployment over the IoT Edge devices in efficient manner
Container Performance Analysis
The document summarizes a talk on container performance analysis. It discusses identifying bottlenecks at the host, container, and kernel level using various Linux performance tools. It then provides an overview of how containers work in Linux using namespaces and control groups (cgroups). Finally, it demonstrates some example commands like docker stats, systemd-cgtop, and bcc/BPF tools that can be used to analyze containers and cgroups from the host system.
Performance Tuning EC2 Instances
Talk for AWS re:Invent 2014. Video: https://www.youtube.com/watch?v=7Cyd22kOqWc . Netflix tunes Amazon EC2 instances for maximum performance. In this session, you learn how Netflix configures the fastest possible EC2 instances, while reducing latency outliers. This session explores the various Xen modes (e.g., HVM, PV, etc.) and how they are optimized for different workloads. Hear how Netflix chooses Linux kernel versions based on desired performance characteristics and receive a firsthand look at how they set kernel tunables, including hugepages. You also hear about Netflix’s use of SR-IOV to enable enhanced networking and their approach to observability, which can exonerate EC2 issues and direct attention back to application performance.
Secure container: Kata container and gVisor
Kata Container & gVisor provide approaches to securely isolate containers by keeping them out of the direct kernel space. Kata Container uses virtual machines with lightweight kernels to isolate containers, while gVisor uses a userspace kernel implemented in Go to provide isolation. Both aim to protect the host kernel by preventing containers from accessing kernel resources directly. Kata Container has a larger memory footprint than gVisor due to its use of virtual machines, but provides stronger isolation of containers.
NGINX: Basics & Best Practices - EMEA Broadcast
This document provides an overview of installing and configuring the NGINX web server. It discusses installing NGINX from official repositories or from source on Linux systems like Ubuntu, Debian, CentOS and Red Hat. It also covers verifying the installation, basic configurations for web serving, reverse proxying, load balancing and caching. The document discusses modifications that can be made to the main nginx.conf file to improve performance and reliability. It also covers monitoring NGINX using status pages and logs, and summarizes key documentation resources.
Ceph Introduction 2017
This document provides an overview of Ceph, a distributed storage system. It defines software defined storage and discusses different storage options like file, object, and block storage. It then introduces Ceph, highlighting that it provides a unified storage platform for block, object, and file storage using commodity hardware in a massively scalable, self-managing, and fault-tolerant manner. The document outlines Ceph's architecture including its components like OSDs, monitors, RADOS, RBD, RGW, and CephFS. It also discusses various access methods and use cases for Ceph like with OpenStack.
Camel Day Italia 2021 - Camel K
Nicola Ferraro and Luca Burgazzoli presented on Apache Camel K, a lightweight integration platform for running integrations on Kubernetes. Camel K allows developers to write integration logic in a simple DSL and have it run as serverless functions on Kubernetes. It integrates well with Knative for auto-scaling and can connect to over 300 components. The presentation demonstrated Camel K's use in a event mesh and discussed current developments including support for Quarkus, Kamelets for reusable integration snippets, and testing with YAKS. Camel K aims to simplify building integrations in a cloud native environment.
DPDK: Multi Architecture High Performance Packet Processing
What is DPDK? Why DPDK? How DPDK enhances OVS/NFV Infrastructure
Author: Muthurajan (M Jay) Jayakumar
Optimizing Kubernetes Resource Requests/Limits for Cost-Efficiency and Latenc...
Talk given at JAX DevOps London on 2019-05-15.
Kubernetes has the concept of resource requests and limits. Pods get scheduled on the nodes based on their requests and optionally limited in how much of the resource they can consume. Understanding and optimizing resource requests/limits is crucial both for reducing resource "slack" and ensuring application performance/low-latency. This talk shows our approach to monitoring and optimizing Kubernetes resources for 90+ clusters to achieve cost-efficiency and reducing impact for latency-critical applications. All shown tools are open source and can be applied to most Kubernetes deployments. Topics covered in the talk include: understanding resource requests and limits, cgroups and CFS quota behavior, contributing factors to cluster costs (in public clouds), and best practices for managing Kubernetes resources.
Using filesystem capabilities with rsync
As presented at the FLOSS UK Unconference 2015.
Updated 2015-02-08: added details of caveats, primarily the fact that CAP_DAC_READ_SEARCH does exactly what it says on the tin, and covering precautions like ensuring that password authentication is *never* allowed for the backuphelper user.
OpenStack DRaaS - Freezer - 101
Freezer is an OpenStack backup and restore service that allows users to automate backup processes. It includes components like an API, scheduler, and agent. The scheduler retrieves backup jobs from the API and executes them via the agent. Freezer supports different backup types including file system, Cinder volume, and MySQL backups. It can store backups in OpenStack Swift, locally, or remotely using SSH. Backups can be restored locally or by recreating volumes/instances in Cinder/Nova.
More Related Content
What's hot
Ansible presentation
This document discusses repetitive system administration tasks and proposes Ansible as a solution. It describes how Ansible works using agentless SSH to automate tasks like software installation, configuration, and maintenance across multiple servers. Key aspects covered include Ansible's inventory, modules, playbooks, templates, variables, roles and Docker integration. Ansible Tower is also introduced as a GUI tool for running Ansible jobs. The document recommends Ansible for anyone doing the same tasks across multiple servers to gain efficiencies over manual processes.
PostgreSQL High Availability in a Containerized World
This document discusses PostgreSQL high availability in a containerized environment. It begins with an overview of containers and their advantages like lower footprint and density. It then covers enterprise needs for high availability like recovery time objectives. Common approaches to PostgreSQL high availability are discussed like replication, shared storage, and using projects like Patroni and Stolon. Modern trends with containers are highlighted like separating data and binaries. Kubernetes is presented as a production-grade orchestrator that can provide horizontal scaling and self-healing capabilities. The discussion concludes with challenges of multi-region deployments and how service discovery with Consul can help address those challenges.
Discover How IBM Uses InfluxDB and Grafana to Help Clients Monitor Large Prod...
IBM uses InfluxDB to store metrics collected from nmon and Grafana to visualize those metrics. This helps IBM monitor large production servers and benchmark centers. Some key points:
- nmon was originally created 25 years ago by Nigel Griffiths to monitor OS performance but the data format and lack of central storage was limiting. nmon was updated to output JSON and line protocol for InfluxDB.
- Grafana provides various visualizations of the metrics stored in InfluxDB like donut graphs, line graphs, heat maps, and single stat/graph panels. This helps identify issues like busy periods and system bottlenecks.
- Ideas were discussed for better visualizing periodic trends like busy Fridays or batch over
Using eBPF for High-Performance Networking in Cilium
The Cilium project is a popular networking solution for Kubernetes, based on eBPF. This talk uses eBPF code and demos to explore the basics of how Cilium makes network connections, and manipulates packets so that they can avoid traversing the kernel's built-in networking stack. You'll see how eBPF enables high-performance networking as well as deep network observability and security.
Ansible 101
This document provides an overview of Ansible, an IT automation tool. It discusses key Ansible concepts like configuration management, infrastructure evolution, deployment flows, host inventory, playbooks, modules, variables, templates, conditionals, loops, roles, and more. The document also covers how to install Ansible, run ad-hoc commands and playbooks, and provides examples of playbooks, templates, and roles.
Introduction to Docker storage, volume and image
Docker storage drivers allow images and containers to be stored in different ways by implementing a pluggable storage driver interface. Common storage drivers include overlay2, aufs, devicemapper, and vfs. Images are composed of read-only layers stacked on top of each other, with containers adding a writable layer. Storage can be persisted using volumes, bind mounts, or tmpfs mounts. Strategies for managing persistent container data include host-based storage, volume plugins, and container storage platforms.
Kubernetes Networking 101
Kubernetes has two simple but powerful network concepts: every Pod is connected to the same network, and Services let you talk to a Pod by name. Bryan will take you through how these concepts are implemented - Pod Networks via the Container Network Interface (CNI), Service Discovery via kube-dns and Service virtual IPs, then on to how Services are exposed to the rest of the world.
Kubernetes and Nested Containers: Enhanced 3 Ps (Performance, Price and Provi...
Kubernetes and Nested Containers: Enhanced 3 Ps (Performance, Price and Provi...Jelastic Multi-Cloud PaaS
Kubernetes enables possibilities to develop cloud native microservices or decompose traditional applications making them more technologically advanced with the help of containers. Currently, most of the Kubernetes solutions are offered on top of VMs and there is a room for further improvements. Implementing nested architecture of application containers running inside system containers opens additional flexibility of resource allocation and management, accelerates provisioning of the clusters and pods, as well as cuts the overall costs. Or in other words it enhances 3 Ps - Provisioning, Performance and Price. During this session Ruslan Synytsky (CEO and co-founder of Jelastic PaaS) reviews the possibilities of running a Kubernetes cluster inside nested containers, what configurations should be taken into account, and how to overcome the barriers on the way to more efficient Kubernetes hosting.
Video presentation: https://youtu.be/VzkXuMx7jLE
Learn more at https://jelastic.com/kubernetes-hosting/NGINX: Basics and Best Practices
On-demand recording: nginx.com/resources/webinars/nginx-basics-best-practices
You’ve heard of NGINX and the benefits it can provide to your web application, but maybe you’re not sure how to get started. There are a lot of tutorials online, but they can be outdated and contradict each other, making things more challenging. In this webinar we’ll cover the basics of NGINX to help you effectively begin using it as part of your existing or new web app.
This webinar covers how to:
* Install NGINX and verify it's properly running
* Create NGINX configurations for reverse proxy, load balancer, etc.
* Improve performance using keepalives and other NGINX directives
* Debug and troubleshoot using NGINX logs
Delivering Docker & K3s worloads to IoT Edge devices
About 94% of AI Adopters are planning to use containers in the next 1 year. What’s driving this exponential growth? Faster time to deployment and Faster AI workload processing are the two major reasons. You can use GPUs in big data applications such as machine learning, data analytics, and genome sequencing. Docker containerization makes it easier for you to package and distribute applications. You can enable GPU support when using YARN on Docker containers. In this talk, I will demonstrate how Docker accelerates the AI workload development and deployment over the IoT Edge devices in efficient manner
Container Performance Analysis
The document summarizes a talk on container performance analysis. It discusses identifying bottlenecks at the host, container, and kernel level using various Linux performance tools. It then provides an overview of how containers work in Linux using namespaces and control groups (cgroups). Finally, it demonstrates some example commands like docker stats, systemd-cgtop, and bcc/BPF tools that can be used to analyze containers and cgroups from the host system.
Performance Tuning EC2 Instances
Talk for AWS re:Invent 2014. Video: https://www.youtube.com/watch?v=7Cyd22kOqWc . Netflix tunes Amazon EC2 instances for maximum performance. In this session, you learn how Netflix configures the fastest possible EC2 instances, while reducing latency outliers. This session explores the various Xen modes (e.g., HVM, PV, etc.) and how they are optimized for different workloads. Hear how Netflix chooses Linux kernel versions based on desired performance characteristics and receive a firsthand look at how they set kernel tunables, including hugepages. You also hear about Netflix’s use of SR-IOV to enable enhanced networking and their approach to observability, which can exonerate EC2 issues and direct attention back to application performance.
Secure container: Kata container and gVisor
Kata Container & gVisor provide approaches to securely isolate containers by keeping them out of the direct kernel space. Kata Container uses virtual machines with lightweight kernels to isolate containers, while gVisor uses a userspace kernel implemented in Go to provide isolation. Both aim to protect the host kernel by preventing containers from accessing kernel resources directly. Kata Container has a larger memory footprint than gVisor due to its use of virtual machines, but provides stronger isolation of containers.
NGINX: Basics & Best Practices - EMEA Broadcast
This document provides an overview of installing and configuring the NGINX web server. It discusses installing NGINX from official repositories or from source on Linux systems like Ubuntu, Debian, CentOS and Red Hat. It also covers verifying the installation, basic configurations for web serving, reverse proxying, load balancing and caching. The document discusses modifications that can be made to the main nginx.conf file to improve performance and reliability. It also covers monitoring NGINX using status pages and logs, and summarizes key documentation resources.
Ceph Introduction 2017
This document provides an overview of Ceph, a distributed storage system. It defines software defined storage and discusses different storage options like file, object, and block storage. It then introduces Ceph, highlighting that it provides a unified storage platform for block, object, and file storage using commodity hardware in a massively scalable, self-managing, and fault-tolerant manner. The document outlines Ceph's architecture including its components like OSDs, monitors, RADOS, RBD, RGW, and CephFS. It also discusses various access methods and use cases for Ceph like with OpenStack.
Camel Day Italia 2021 - Camel K
Nicola Ferraro and Luca Burgazzoli presented on Apache Camel K, a lightweight integration platform for running integrations on Kubernetes. Camel K allows developers to write integration logic in a simple DSL and have it run as serverless functions on Kubernetes. It integrates well with Knative for auto-scaling and can connect to over 300 components. The presentation demonstrated Camel K's use in a event mesh and discussed current developments including support for Quarkus, Kamelets for reusable integration snippets, and testing with YAKS. Camel K aims to simplify building integrations in a cloud native environment.
DPDK: Multi Architecture High Performance Packet Processing
What is DPDK? Why DPDK? How DPDK enhances OVS/NFV Infrastructure
Author: Muthurajan (M Jay) Jayakumar
Optimizing Kubernetes Resource Requests/Limits for Cost-Efficiency and Latenc...
Talk given at JAX DevOps London on 2019-05-15.
Kubernetes has the concept of resource requests and limits. Pods get scheduled on the nodes based on their requests and optionally limited in how much of the resource they can consume. Understanding and optimizing resource requests/limits is crucial both for reducing resource "slack" and ensuring application performance/low-latency. This talk shows our approach to monitoring and optimizing Kubernetes resources for 90+ clusters to achieve cost-efficiency and reducing impact for latency-critical applications. All shown tools are open source and can be applied to most Kubernetes deployments. Topics covered in the talk include: understanding resource requests and limits, cgroups and CFS quota behavior, contributing factors to cluster costs (in public clouds), and best practices for managing Kubernetes resources.
What's hot (20)
PostgreSQL High Availability in a Containerized World
PostgreSQL High Availability in a Containerized World
Discover How IBM Uses InfluxDB and Grafana to Help Clients Monitor Large Prod...
Discover How IBM Uses InfluxDB and Grafana to Help Clients Monitor Large Prod...
Using eBPF for High-Performance Networking in Cilium
Using eBPF for High-Performance Networking in Cilium
Kubernetes and Nested Containers: Enhanced 3 Ps (Performance, Price and Provi...
Kubernetes and Nested Containers: Enhanced 3 Ps (Performance, Price and Provi...
Delivering Docker & K3s worloads to IoT Edge devices
Delivering Docker & K3s worloads to IoT Edge devices
Amazon Redshift 아키텍처 및 모범사례::김민성::AWS Summit Seoul 2018
Amazon Redshift 아키텍처 및 모범사례::김민성::AWS Summit Seoul 2018
DPDK: Multi Architecture High Performance Packet Processing
DPDK: Multi Architecture High Performance Packet Processing
Optimizing Kubernetes Resource Requests/Limits for Cost-Efficiency and Latenc...
Optimizing Kubernetes Resource Requests/Limits for Cost-Efficiency and Latenc...
Similar to Backup using rsync
Using filesystem capabilities with rsync
As presented at the FLOSS UK Unconference 2015.
Updated 2015-02-08: added details of caveats, primarily the fact that CAP_DAC_READ_SEARCH does exactly what it says on the tin, and covering precautions like ensuring that password authentication is *never* allowed for the backuphelper user.
OpenStack DRaaS - Freezer - 101
Freezer is an OpenStack backup and restore service that allows users to automate backup processes. It includes components like an API, scheduler, and agent. The scheduler retrieves backup jobs from the API and executes them via the agent. Freezer supports different backup types including file system, Cinder volume, and MySQL backups. It can store backups in OpenStack Swift, locally, or remotely using SSH. Backups can be restored locally or by recreating volumes/instances in Cinder/Nova.
Unit 13 network client
This document discusses network clients and tools available in Red Hat Enterprise Linux, including web browsers like Firefox and wget, email clients like Evolution and Mutt, the instant messaging client Gaim, secure remote access tools like OpenSSH and scp, file synchronization tools like rsync, FTP clients like lftp and gFTP, the SMB/CIFS client smbclient, and network diagnostic tools like ping and traceroute. It provides instructions for using these various networking applications to browse the web, exchange email, access systems remotely, transfer files, and diagnose network issues.
Backup UUASC 9/6/12
This document discusses different backup strategies using rsync and duplicity. It recommends automating regular full and incremental backups to multiple locations and using strong encryption. Rsync is efficient for file transfers while duplicity builds incremental backups into encrypted and signed archives that can be restored from a variety of local and remote storage options. The best practice is to regularly verify backups and remove old backups to maintain data safety while reducing storage usage.
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
The simpler the backup, the higher is the chance that the backups will be done by users. So let’s look for simple backup methods.
Two known command-line backup tools of this kind are rdiff-backup and rsnapshot. Both tools allow easy-to-setup backups, and impress with a direct file-level access to the last backup copy.
Although the two tools share the same main idea – “incremental forever backups” – they differ in how they reach this goal. While rdiff-backup stores old versions of a file by only saving the changes (increments) compared to the following version, rsnapshot creates a new backup file whenever a file has changed since the last backup. This fact leads to different advantages and disadvantages: while rdiff-backup is very space-efficient, a restore of an older version of a file might take longer. Rsnapshot on the other hand allows fast restores even for older versions, but as a downside it needs more backup space to store the same amount of data.
So which tool should I use? rdiff-backup or rsnapshot? Well, it depends…
In this talk we will explain how rdiff-backup and rsnapshot work in detail, and show different use-cases. Along with that knowledge, you will find the right answer for you which tool to choose.
Adhocr T-dose 2012
Presenting adhocr (abbreviation for Ad-hoc copy and run) as a simple, but powerful UNIX administrator tool. If you like to retrieve data or execute commands on lots of systems simultaneously then this tool is your friend. There is no need to exchange your ssh keys as the power behind adhocr is the expect tool (language). For example, it is plain easy to use adhocr to distribute your public ssh key to all your systems. The real power of adhocr is the central point of logging, which is perfect for \'grep\'ing into stuff you\'re looking for.
You also have the ability to execute commands via the \'sudo su -\' way, which is a blessing in environments where root is not permitted to login directly.
You can even use it monitoring your systems thanks to the powerful error catching.
RHCE (RED HAT CERTIFIED ENGINEERING)
This Include YUM, NFS, SAMBA, FTP, APACHE (HTTP) servers. which include snapshots how to configure above defined servers. Good for Fresher in Linux.
Docker.io
Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more.
ITB2019 NGINX Overview and Technical Aspects - Kevin Jones
I will be giving a brief overview of the history of NGINX along with an overview of the features and functionality in the project as it stands today. I will give some real use case of example of how NGINX can be used to solve problems and eliminate complexity within infrastructure. I will then dive into the future of the modern web and how NGINX is monitoring and leveraging industry changes to enhance the product for individuals and companies in the industry.
Using Secure Shell on Linux: What Everyone Should Know
Secure Shell, or SSH, is a network protocol that allows data to be exchanged over a secure channel. SSH is much more than just data being passed over the wire. SSH can be used to tunnel traffic and specific ports or applications across multiple servers. SSH is a must for anyone using Linux. If you haven't used SSH, then you have not used Linux!
This session is designed for all technical staff or decision makers curious about great Linux tools and making access to Windows services, remote desktops and remote servers easier and less complicated. During this session, we will demonstrate techniques to tunnel RDP sessions, SOAP sessions and HTTP sessions between remote systems.
A3Sec Advanced Deployment System
This document discusses using SaltStack to manage Alienvault infrastructure. SaltStack is an open source tool for configuration management and remote execution that can control and deploy configurations to all servers. It has a simple architecture with a master server and minion clients. Custom modules, states, grains and templates can extend SaltStack's capabilities. Targeting allows applying configurations selectively based on server attributes. This enables centralized yet flexible management of an entire Alienvault deployment.
PHP development with Docker
This document discusses setting up a PHP development environment using Docker containers. It describes using Docker to run PHP, Apache/Nginx, MySQL, and Memcached services in separate containers linked together. Custom Docker images are built for the PHP application code and for adding development tools. Linked volumes and DNS aliases allow for easy access and configuration across containers. Docker Compose is used to define and run the multi-container app stack.
Ericas-Linux-Plus-Study-Guide
This document provides summaries of commands and configuration files related to Linux system administration. It covers topics like printing commands (lpr, lpq, lprm), init and inittab configuration, runlevels, networking commands (route, netstat), user management (userdel, passwd), file systems (e2fsck, ext2, ext3), and other administrative tools (top, ps, umount, vmstat).
Why favour Icinga over Nagios - Rootconf 2015
Keynote at the second day of RootConf in Bangalore organised by HasGeek. Talk deals with the major Icinga2 advantages compared to Nagios
Owning computers without shell access dark
My Talk From DerbyCon 3.0.
Link to Video Presentation:
https://www.youtube.com/watch?v=8hx6QG4SMdc
02 Hadoop deployment and configuration
This document provides instructions for configuring a single node Hadoop deployment on Ubuntu. It describes installing Java, adding a dedicated Hadoop user, configuring SSH for key-based authentication, disabling IPv6, installing Hadoop, updating environment variables, and configuring Hadoop configuration files including core-site.xml, mapred-site.xml, and hdfs-site.xml. Key steps include setting JAVA_HOME, configuring HDFS directories and ports, and setting hadoop.tmp.dir to the local /app/hadoop/tmp directory.
Securing Hadoop with OSSEC
This document discusses securing Hadoop clusters with OSSEC host-based intrusion detection. It provides an overview of OSSEC and how to configure it to monitor Hadoop and HBase logs. Specific steps are outlined to configure file integrity checking, select logs to monitor, add decoders and rules to generate alerts for security events like unauthorized access attempts. Sending alerts to Splunk for further analysis is also recommended for security event monitoring and trend analysis.
Squid proxy-configuration-guide
This document provides instructions for configuring a Squid proxy server on CentOS. It discusses obtaining information about the system like the OS distribution, hardware architecture, and installed application versions. It also outlines basic Squid configuration steps like backing up the default configuration file, checking the port Squid listens on, and ensuring the log file location is set correctly before starting Squid. Configuring access controls and caching policies would be covered in more depth in subsequent sections.
Disk quota and sysd procd
This document discusses disk quotas, procfs, sysfs, and process information on Linux systems. It provides information on setting up and using disk quotas, describes the purpose and structure of the procfs and sysfs filesystems, and lists various files and directories that can be found under procfs for obtaining system and process information. Instructions are given on installing and configuring disk quotas, and examples of files that can be found under procfs and sysfs are provided.
Mem forensic
The document discusses volatility and memory forensics. It covers topics like how volatility works on different operating systems like Linux and Windows, acquiring memory dumps, analyzing memory structures like page tables and processes, dealing with semantic gaps in raw memory, plugin development, and investigating various artifacts in memory related to authentication, passwords, encryption, and applications. The document provides information on memory forensics techniques and how volatility is used as an open-source memory forensics framework.
Similar to Backup using rsync (20)
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
ITB2019 NGINX Overview and Technical Aspects - Kevin Jones
ITB2019 NGINX Overview and Technical Aspects - Kevin Jones
Using Secure Shell on Linux: What Everyone Should Know
Using Secure Shell on Linux: What Everyone Should Know
More from Gaurav Mishra
FOSSology and OSS-Tools for License Compliance and Automation
FOSSology is an open source tool for license compliance and automation of license clearing for software packages. It scans source code for license texts and other relevant statements, and allows users to review findings and generate reports. FOSSology supports importing SPDX files and has features for bulk scanning, documentation of analysis, and managing license obligations. While FOSSology provides automation capabilities, some human review is still needed to handle uncertain cases. New techniques are being explored for license detection without relying entirely on rules, including using n-grams and similarity algorithms.
FOSSology & GSOC Journey
This document discusses FOSSology, an open source tool for license compliance and copyright clearance of software components. It provides an overview of FOSSology's features, new features added in the last year including integration with LDAP and improved REST API. It also discusses using FOSSology for continuous integration scanning in GitLab and Travis CI pipelines. The document talks about FOSSology's involvement in Google Summer of Code (GSOC) over the years and projects completed by GSOC students like the Atarashi standalone scanner and FOSS-dash monitoring dashboard.
Block Chain - Merkel and Key exchange
The document discusses Merkle trees, symmetric cryptography, asymmetric cryptography, and key exchange methods for cryptography. It provides details on:
- How a Merkle tree contains hashed data blocks to verify information in a peer-to-peer network.
- Symmetric cryptography uses the same key to encrypt and decrypt, but transmitting the key is a weakness.
- Asymmetric cryptography uses public/private key pairs to encrypt and decrypt, overcoming weaknesses of symmetric cryptography.
- Various methods for exchanging public keys like certificates signed by a Certificate Authority.
Block Chain - Introduction
The document discusses blockchain and how it can be used as an alternative to the traditional banking system of transactions. In blockchain, a public ledger stores all transactions and anyone can own a copy of this ledger. Each transaction is authenticated using public-private key cryptography and blocks of transactions are hashed together and chained, making the records difficult to modify. This distributed and secured system allows for a trustworthy and transparent record of transactions without centralized control.
Linux User Management
This document discusses user and file permissions in Linux. It covers how every file is owned by a user and group, and how file access is defined using file mode bits. These bits determine read, write and execute permissions for the file owner, group and others. An example of a file with permissions -rw-rw-r-- is provided to demonstrate this. User accounts are configured in /etc/passwd, while passwords are securely stored in /etc/shadow. Common commands for managing users, groups, permissions and default file access (umask) are also outlined.
Apache, cron and proxy
This document discusses various topics related to Linux configuration including Apache configuration, cron jobs, and proxy servers. It provides details on Apache configuration files and directory structure, how to configure virtual hosts and SSL support. It also explains cron job formatting and examples, how to add cron jobs, and proxy server functionality and configuration.
Linux Run Level
The document discusses Linux services and run levels. It explains that Linux uses scripts in /etc/rc.d and /etc/init.d directories to start and stop services during boot up and shutdown. These scripts are executed in different run levels which determine the system configuration and available processes. The document also provides details on the structure and contents of different run level directories, a skeleton for service scripts, and how to use update-rc.d to automatically start scripts on boot.
Firewall and IPtables
This document discusses Linux firewalls and IPtables. It explains that firewalls use a set of security rules to filter packets and restrict access. These rules are stored in IPtables. Each rule contains information like the protocol, source/destination addresses, and a target action of ACCEPT, DROP, etc. Examples are given of rules to accept packets from only one IP, from the local network, and to prevent new connections on port 22. The document also covers Network Address Translation (NAT) operations in IPtables, including SNAT to change the source address and DNAT to change the destination address when packets pass through the PREROUTING and POSTROUTING chains.
Linux securities
This document contains information about encryption, SSH, and IPSec. It discusses encryption techniques like public key encryption and digital signatures. It describes the open source program GNU Privacy Guard (GnuPG) and how it can be used to encrypt and sign messages on Linux. It also covers Secure Shell (SSH) including how it provides secure connections using encryption and authentication. It discusses how SSH keys work and how to configure SSH. Finally, it discusses IPsec and how it incorporates network security directly into IP by providing encryption and authentication of packets sent over the network.
wget, curl and scp
The document discusses wget, curl, and scp commands. It provides descriptions of their functionality and common options. Wget is used to non-interactively download files from servers using various protocols. Curl allows sending and receiving data from servers using multiple protocols as well. Scp securely copies files between hosts on a network using SSH. Examples of using each command are also included, such as recursively downloading directories with wget or uploading files to FTP servers with curl.
More from Gaurav Mishra (10)
FOSSology and OSS-Tools for License Compliance and Automation
FOSSology and OSS-Tools for License Compliance and Automation
Recently uploaded
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
A tale of scale & speed: How the US Navy is enabling software delivery from l...
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Communications Mining Series - Zero to Hero - Session 1
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentationsMicrosoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Building RAG with self-deployed Milvus vector database and Snowpark Container...
This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
20 Comprehensive Checklist of Designing and Developing a Website
Dive into the world of Website Designing and Developing with Pixlogix! Looking to create a stunning online presence? Look no further! Our comprehensive checklist covers everything you need to know to craft a website that stands out. From user-friendly design to seamless functionality, we've got you covered. Don't miss out on this invaluable resource! Check out our checklist now at Pixlogix and start your journey towards a captivating online presence today.
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Recently uploaded (20)
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Backup using rsync
- 1. Gaurav Mishra <gmishx@gmail.com> Linux - 9 Backup using rsync Unrestricted 01-03-2018
- 2. Gaurav Mishra <gmishx@gmail.com> rsync • rsync is a software in Linux environment use to make disk backups. • Backups can be either local or on remote machine. • The uniqueness of rsync is that it performs differential synchronizations. • Both the systems must have rsync installed. • rsync can use ssh secure connections for transmissions. 01-03-2018
- 3. Gaurav Mishra <gmishx@gmail.com> Using rsync • Install rsync on remote and local machine ▫ sudo apt-get install rsync • Creating archive on remote host ▫ Archive mode include recursive copy, sym links, permissions, time, group, owner and device files. rsync -r -a -v ~/proj user@host:~/backups/ • Specifying remote shell ▫ Additional information for the remote shell used to setup connection can be set using -e flag ▫ Setting the ssh port during transfer rsync -rav -e ‘ssh -p 2257’ ~/proj user@host:~/backups/ • Filtering files ▫ rsync can filter files to be copied using filter rules ▫ Filtering ‘.o’ files rsync -rav --exclude=“*.o” ~/proj user@host:~/backups/ 01-03-2018
- 4. Gaurav Mishra <gmishx@gmail.com> Using rsync • Performing compression on transmission ▫ rsync can compress the transmission to save bandwidth rsync -z -r ~/project user@host:~/backups/ • Updating a backup ▫ Using update options, rsync will not transfer files which are new in the destination rsync -av <-u/--update> ~/project user@host:~/repository/ • Deleting old files ▫ rsync support delete option which removes files from the destination which are not in the source ▫ To use this option, whole directory must be synchronized rsync -a --delete ~/project user@host:~/repository/ 01-03-2018