The Elastic PU
•Download as PPT, PDF•
2 likes•4,437 views
The document discusses the Elastic Processing Unit (EPU) in GigaSpaces, which allows automatic scaling of processing units across containers and machines, managing the entire container lifecycle as well as automatic rebalancing and capacity calculations. It provides instructions on deploying an EPU, scaling it manually or automatically based on resource monitoring, and undeploying it along with automatically terminating associated containers. The EPU also supports automatic provisioning of new machines through custom plugins to dynamically add resources on demand.
Report
Share
Report
Share
![The Elastic PU ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Vmware esx top commands doc 9279
Section 1 provides an introduction to esxtop, a tool for monitoring system resources like CPU, memory, disk, and network on an ESXi host. Esxtop displays statistics through interactive screens or collects data in batch mode.
Section 2 discusses CPU statistics reported by esxtop. It describes how worlds and groups are used to represent schedulable entities. Key global CPU statistics include utilization, load averages, and used/ready percentages for physical CPUs (PCPUs) and cores. PCPU utilization indicates busy time while used indicates effective work done.
Section 3 covers memory statistics, including total memory and usage at the machine, guest, group, and global levels.
Section 4 discusses disk statistics for
R&D work on pre exascale HPC systems
- The document discusses current R&D work on pre-Exascale HPC systems, including a PRACE 2011 prototype that delivers over 10 TFLOPS in a single rack using heterogeneous hardware with GPUs and achieves over 1.1 TFLOPS/kW efficiency.
- Performance debugging techniques are discussed for multi-socket, multi-chipset, multi-GPU systems to analyze issues like bottlenecks in the cache hierarchy topology and imbalanced I/O. Affinity and memory binding are important to optimize performance.
- Linux and Windows tools like HWLOC can be used to set CPU and GPU affinity as well as memory binding to improve data transfer rates between devices by ensuring local memory access.
Ac cuda c_1
CPU-only applications allocate data and perform all work on the CPU. GPU-accelerated applications allocate data in managed memory accessible to both the CPU and GPU. The data is automatically migrated to the GPU for parallel processing, allowing the CPU to perform other work simultaneously. The CPU can synchronize with the GPU using cudaDeviceSynchronize() and access results once processing is complete.
The Magic of Hot Streaming Replication, Bruce Momjian
This document discusses PostgreSQL 9.0's new capabilities for maintaining a current standby server and issuing read-only queries on the standby server. It covers how to configure continuous archiving from the primary server to the standby, and how to configure the standby for streaming replication so it can accept queries. The summary demonstrates streaming replication by creating and inserting a row on the primary which then appears on the standby.
Multi-GPU MapReduce on GPU Clusters
This document proposes GPMR, a GPU Map-Reduce framework that can distribute work across multiple GPU devices. GPMR aims to improve on existing GPU Map-Reduce systems by enabling network I/O between GPUs. It describes GPU and memory architecture, and how GPMR implements the Map and Reduce phases by distributing data chunks across GPU blocks and combining results. Benchmark results show GPMR outperforming other systems by leveraging multiple GPUs. However, limitations include low GPU memory and network I/O overhead for GPUs.
BookKeeper Administrator's Guide
This document provides instructions for deploying BookKeeper, including system requirements, running BookKeeper storage servers (bookies), and using ZooKeeper to store metadata. A typical deployment involves multiple bookies and ZooKeeper replicas, with a minimum of 3 bookies for self-verifying mode or 4 for generic mode. Each bookie server should have at least two disks, one for the write-ahead log and one for storing ledger entries. ZooKeeper can run in standalone mode but is typically configured with multiple replicas for resilience. The document explains how to start a bookie process and pass ZooKeeper connection parameters.
GPU
A GPU has thousands of cores that allow for highly parallel processing which makes it well-suited for graphics-intensive tasks like gaming. It renders frames in parallel to achieve 60 frames per second. In contrast, a CPU performs mostly sequential processing. GPUs require effective cooling systems to dissipate the substantial heat generated by their dense, high-powered components. Key parameters that impact a GPU's performance are its video memory speed and capacity, as well as its processing speed.
Nvprof um 2
Unified memory allocated with cudaMallocManaged may not initially be resident on the CPU or GPU. When work first accesses the memory, a page fault will trigger migration to the device where it is needed. This process of migrating memory on page fault will repeat whenever the memory is accessed from a device where it is not resident. Asynchronous prefetching can be used to migrate memory between devices in larger batches to prevent costly page faults.
Recommended
Vmware esx top commands doc 9279
Section 1 provides an introduction to esxtop, a tool for monitoring system resources like CPU, memory, disk, and network on an ESXi host. Esxtop displays statistics through interactive screens or collects data in batch mode.
Section 2 discusses CPU statistics reported by esxtop. It describes how worlds and groups are used to represent schedulable entities. Key global CPU statistics include utilization, load averages, and used/ready percentages for physical CPUs (PCPUs) and cores. PCPU utilization indicates busy time while used indicates effective work done.
Section 3 covers memory statistics, including total memory and usage at the machine, guest, group, and global levels.
Section 4 discusses disk statistics for
R&D work on pre exascale HPC systems
- The document discusses current R&D work on pre-Exascale HPC systems, including a PRACE 2011 prototype that delivers over 10 TFLOPS in a single rack using heterogeneous hardware with GPUs and achieves over 1.1 TFLOPS/kW efficiency.
- Performance debugging techniques are discussed for multi-socket, multi-chipset, multi-GPU systems to analyze issues like bottlenecks in the cache hierarchy topology and imbalanced I/O. Affinity and memory binding are important to optimize performance.
- Linux and Windows tools like HWLOC can be used to set CPU and GPU affinity as well as memory binding to improve data transfer rates between devices by ensuring local memory access.
Ac cuda c_1
CPU-only applications allocate data and perform all work on the CPU. GPU-accelerated applications allocate data in managed memory accessible to both the CPU and GPU. The data is automatically migrated to the GPU for parallel processing, allowing the CPU to perform other work simultaneously. The CPU can synchronize with the GPU using cudaDeviceSynchronize() and access results once processing is complete.
The Magic of Hot Streaming Replication, Bruce Momjian
This document discusses PostgreSQL 9.0's new capabilities for maintaining a current standby server and issuing read-only queries on the standby server. It covers how to configure continuous archiving from the primary server to the standby, and how to configure the standby for streaming replication so it can accept queries. The summary demonstrates streaming replication by creating and inserting a row on the primary which then appears on the standby.
Multi-GPU MapReduce on GPU Clusters
This document proposes GPMR, a GPU Map-Reduce framework that can distribute work across multiple GPU devices. GPMR aims to improve on existing GPU Map-Reduce systems by enabling network I/O between GPUs. It describes GPU and memory architecture, and how GPMR implements the Map and Reduce phases by distributing data chunks across GPU blocks and combining results. Benchmark results show GPMR outperforming other systems by leveraging multiple GPUs. However, limitations include low GPU memory and network I/O overhead for GPUs.
BookKeeper Administrator's Guide
This document provides instructions for deploying BookKeeper, including system requirements, running BookKeeper storage servers (bookies), and using ZooKeeper to store metadata. A typical deployment involves multiple bookies and ZooKeeper replicas, with a minimum of 3 bookies for self-verifying mode or 4 for generic mode. Each bookie server should have at least two disks, one for the write-ahead log and one for storing ledger entries. ZooKeeper can run in standalone mode but is typically configured with multiple replicas for resilience. The document explains how to start a bookie process and pass ZooKeeper connection parameters.
GPU
A GPU has thousands of cores that allow for highly parallel processing which makes it well-suited for graphics-intensive tasks like gaming. It renders frames in parallel to achieve 60 frames per second. In contrast, a CPU performs mostly sequential processing. GPUs require effective cooling systems to dissipate the substantial heat generated by their dense, high-powered components. Key parameters that impact a GPU's performance are its video memory speed and capacity, as well as its processing speed.
Nvprof um 2
Unified memory allocated with cudaMallocManaged may not initially be resident on the CPU or GPU. When work first accesses the memory, a page fault will trigger migration to the device where it is needed. This process of migrating memory on page fault will repeat whenever the memory is accessed from a device where it is not resident. Asynchronous prefetching can be used to migrate memory between devices in larger batches to prevent costly page faults.
Docker, JVM and CPU
With the increasing adoption of cloud native technologies and containerization; the gap between Java development and system administration is decreasing. Whether you are using Docker Swarm, Kubernetes or Mesos/Marathon as a container orchestrator; fundamental challenges for running docker in production are common.
In this talk, I would like to share some of the basic linux concepts about CPU scheduling every Java Developer should know to be able to perform effective configuration and troubleshooting for docker containers.
Yes, Docker provides isolation, but only if you know how best to configure it.
Docker tips-for-java-developers
With the increasing adoption of cloud native technologies and containerization; the gap between Java development and system administration is decreasing. Whether you are using Docker Swarm, Kubernetes or Mesos as a container orchestrator; fundamental challenges for running docker in production are common.
In this talk, I would like to share some of the basic linux concepts (like memory management, CPU, IO, sockets, file descriptors, signals, OOM killer) every Java Developer should know to be able to perform effective configuration and troubleshooting for docker containers.
Mastering java in containers - MadridJUG
Introduction to things you need to know and care about if you're a Java developer and you intend or are already working with Containers.
Tsung Intro presentation 2013
The document provides an introduction to Tsung, an open source load testing tool for HTTP and other protocols. It discusses Tsung's key features including being highly concurrent, supporting multiple protocols, easy setup, and distributed testing capabilities. It also summarizes the phases of a Tsung load test and provides examples of using Tsung to test HTTP services and monitor servers under load.
Easy distributed load test with Tsung
Tsung is an open source tool for load testing applications. It can perform load testing from a single machine or in a distributed manner across multiple machines. The document discusses how to install Tsung and Erlang, configure a basic load test using a test.xml file, run the test, and view reports. It also covers how to set up distributed load testing using multiple client nodes and load balancing across Erlang VMs. Load testing WebSocket applications with Tsung is also briefly mentioned.
SOFA Tutorial
This slide will show you how to use SOFA to do performance analysis of CPU/GPU cooperative programs, especially programs running with deep software stacks like TensorFlow, PyTorch, etc.
source code at:
https://github.com/cyliustack/sofa
PostgreSQL Replication with Bucardo
Bucardo is an open source, asynchronous PostgreSQL replication system that allows for multi-master and multi-slave configurations. It was developed by Jon Jesen and Greg Sabino and is free to use under a BSD license. Bucardo supports master-master replication, conflict resolution, and custom code. It uses push delta, full copy, or swap replication methods and manages database objects in "herds" that are synced between databases.
LSA2 - 01 Virtualization with KVM
Virtualization allows hardware to be virtualized so that multiple operating systems can run on a single physical machine. It works by inserting a virtualization layer that provides a virtual operating system for each guest operating system. This document discusses full virtualization, para virtualization, and partial virtualization approaches. It also covers configuring KVM and libvirt for Linux virtualization and managing VMs, networks, storage, and migration.
GitLab PostgresMortem: Lessons Learned
1. A PostgreSQL database outage occurred at GitLab on January 31st due to a combination of factors including an increase in load, replication lag, and the deletion of the database directory.
2. Lessons learned include monitoring replication, using tools like pg_basebackup properly, and having backups and disaster recovery processes in place.
3. Recommended preventative measures include setting sane configuration values, automated testing of backups, assigning an owner for data durability, and improving documentation.
Dev ops
This document provides an overview of various Linux system administration concepts and tools, including:
- Explaining that everything is a file in Linux and describing some special files like /dev/null.
- Summarizing how to use utilities like top, iostat, vmstat, and free to monitor system performance.
- Describing how to use find, locate, xargs to search for files and sed/awk to manipulate text.
- Explaining how processes can still have open file handles even if the files are deleted and how lsof can identify these situations.
- Summarizing how to use cron, logrotate, and Upstart to automate tasks and manage processes and services
Tsung info
Tsung is a distributed load testing tool that can test systems using multiple protocols like HTTP, WebDAV, SOAP, and others. It allows for distributed testing across multiple clients and servers. It can record user sessions via an HTTP proxy and generate load based on probabilities and arrival rates defined in an XML file. It provides synchronized monitoring of clients and servers during tests and generates HTML reports of results.
Kernel Recipes 2015: Introduction to Kernel Power Management
The document introduces kernel power management concepts in Linux, including static and dynamic power management, idle power management for CPUs and devices, and the evolving driver model. It covers key frameworks like CPU frequency scaling, regulators, runtime power management, and power domains. Documentation files are referenced throughout for further reading.
(PFC302) Performance Benchmarking on AWS | AWS re:Invent 2014
In this session, we explain how to measure the key performance-impacting metrics in a cloud-based application and best practices for a reliable benchmarking process. Measuring the performance of applications correctly can be challenging and there are many tools available to measure and track performance. This session will provide you with specific examples of good and bad tests. We make it clear how to get reliable measurements of and how to map benchmark results to your application. We also cover the importance of selecting tests wisely, repeating tests, and measuring variability. In addition a customer will provide real-life examples of how they developed their application testing stack, utilize it for repeatable testing and identify bottlenecks.
Using cgroups in docker container
This document discusses experimenting with cgroups in Docker containers to isolate processes. It describes installing Docker, launching an Ubuntu container with capabilities enabled, and installing cgroup tools. It then mounts the cpuset and cpu cgroup hierarchies and creates low and high cgroups. Different CPU shares are assigned to each cgroup and processes are run in each to demonstrate the CPU isolation between cgroups.
LSA2 - 02 Control Groups
This document summarizes Linux control groups (cgroups) and their capabilities for limiting and accounting for CPU, memory, block I/O, networking, and freezing processes. It describes the general cgroup structure and available controllers for CPU, CPU accounting, CPU scheduling, memory limits and accounting, block I/O statistics and limiting, network classification and prioritization, freezing processes, and checkpoint/restore with CRIU. Examples are given for configuring CPU and memory limits on cgroups.
Case 4 mdm system change report - a car maker
onTune Case Study
How customer use onTune in their complex environment.
How they can take a benefit from onTune
Q4.11: Sched_mc on dual / quad cores
This document summarizes discussions from the Linaro Connect Q4-11 Power Management Working Group about scheduling domains and load balancing on multicore ARM processors. It describes using sched_mc domains to balance load at the multicore level instead of the CPU level. It also discusses using CPU power scaling to emulate different topologies, like packing tasks onto fewer cores at low load to save power on quad-core CPUs or pulling tasks to a single core on a dual-core system. Open issues around idle load balancing and spurious wakeups with these approaches are also outlined. Future work on load balancing for asymmetric big.LITTLE systems is mentioned.
(PFC303) Milliseconds Matter: Design, Deploy, and Operate Your Application fo...
You can't (yet) bend the law of Physics, but you can use the power of the cloud to design applications that run as fast as the speed of light! This session will focus on the best practices for optimizing performance to the very last millisecond. We'll dive into topics such as caching at every layer of your application, TCP optimizations, SSL optimizations, latency based routing, and much more. These best practices can help you to streamline your infrastructure utilization, improve performance and allow you to scale economically.
Ceph Day Beijing: CeTune: A Framework of Profile and Tune Ceph Performance
CeTune is a toolkit that helps deploy, benchmark, profile and tune Ceph cluster performance. It contains modules to deploy Ceph, run benchmarks, analyze collected data, tune Ceph configuration, and visualize results. CeTune automates the process of testing Ceph performance under different configurations and workloads to help identify optimal tuning parameters.
Backup, Restore, and Disaster Recovery
The document discusses various backup, restore, and disaster recovery strategies for MongoDB databases. It outlines options for backing up data using mongodump, copying database files, or taking filesystem snapshots. For restoring, it recommends using mongorestore which can replay oplog entries for point-in-time recovery. It also stresses the importance of testing restores. For disaster recovery, it suggests using replica sets for redundancy across multiple data centers and regions to avoid single points of failure.
Porting Spring PetClinic to GigaSpaces
This presentation shows the general methodology of porting a JEE web application to GigaSpaces XAP and the lessons learned from the process of porting the Spring PetClinic sample application to the GigaSpaces platform
GigaSpaces Flash Memory Summit 2014
Ultra Massive application storage capacity for real-time applications
A True Limitless Capacity Data Grid
More Related Content
What's hot
Docker, JVM and CPU
With the increasing adoption of cloud native technologies and containerization; the gap between Java development and system administration is decreasing. Whether you are using Docker Swarm, Kubernetes or Mesos/Marathon as a container orchestrator; fundamental challenges for running docker in production are common.
In this talk, I would like to share some of the basic linux concepts about CPU scheduling every Java Developer should know to be able to perform effective configuration and troubleshooting for docker containers.
Yes, Docker provides isolation, but only if you know how best to configure it.
Docker tips-for-java-developers
With the increasing adoption of cloud native technologies and containerization; the gap between Java development and system administration is decreasing. Whether you are using Docker Swarm, Kubernetes or Mesos as a container orchestrator; fundamental challenges for running docker in production are common.
In this talk, I would like to share some of the basic linux concepts (like memory management, CPU, IO, sockets, file descriptors, signals, OOM killer) every Java Developer should know to be able to perform effective configuration and troubleshooting for docker containers.
Mastering java in containers - MadridJUG
Introduction to things you need to know and care about if you're a Java developer and you intend or are already working with Containers.
Tsung Intro presentation 2013
The document provides an introduction to Tsung, an open source load testing tool for HTTP and other protocols. It discusses Tsung's key features including being highly concurrent, supporting multiple protocols, easy setup, and distributed testing capabilities. It also summarizes the phases of a Tsung load test and provides examples of using Tsung to test HTTP services and monitor servers under load.
Easy distributed load test with Tsung
Tsung is an open source tool for load testing applications. It can perform load testing from a single machine or in a distributed manner across multiple machines. The document discusses how to install Tsung and Erlang, configure a basic load test using a test.xml file, run the test, and view reports. It also covers how to set up distributed load testing using multiple client nodes and load balancing across Erlang VMs. Load testing WebSocket applications with Tsung is also briefly mentioned.
SOFA Tutorial
This slide will show you how to use SOFA to do performance analysis of CPU/GPU cooperative programs, especially programs running with deep software stacks like TensorFlow, PyTorch, etc.
source code at:
https://github.com/cyliustack/sofa
PostgreSQL Replication with Bucardo
Bucardo is an open source, asynchronous PostgreSQL replication system that allows for multi-master and multi-slave configurations. It was developed by Jon Jesen and Greg Sabino and is free to use under a BSD license. Bucardo supports master-master replication, conflict resolution, and custom code. It uses push delta, full copy, or swap replication methods and manages database objects in "herds" that are synced between databases.
LSA2 - 01 Virtualization with KVM
Virtualization allows hardware to be virtualized so that multiple operating systems can run on a single physical machine. It works by inserting a virtualization layer that provides a virtual operating system for each guest operating system. This document discusses full virtualization, para virtualization, and partial virtualization approaches. It also covers configuring KVM and libvirt for Linux virtualization and managing VMs, networks, storage, and migration.
GitLab PostgresMortem: Lessons Learned
1. A PostgreSQL database outage occurred at GitLab on January 31st due to a combination of factors including an increase in load, replication lag, and the deletion of the database directory.
2. Lessons learned include monitoring replication, using tools like pg_basebackup properly, and having backups and disaster recovery processes in place.
3. Recommended preventative measures include setting sane configuration values, automated testing of backups, assigning an owner for data durability, and improving documentation.
Dev ops
This document provides an overview of various Linux system administration concepts and tools, including:
- Explaining that everything is a file in Linux and describing some special files like /dev/null.
- Summarizing how to use utilities like top, iostat, vmstat, and free to monitor system performance.
- Describing how to use find, locate, xargs to search for files and sed/awk to manipulate text.
- Explaining how processes can still have open file handles even if the files are deleted and how lsof can identify these situations.
- Summarizing how to use cron, logrotate, and Upstart to automate tasks and manage processes and services
Tsung info
Tsung is a distributed load testing tool that can test systems using multiple protocols like HTTP, WebDAV, SOAP, and others. It allows for distributed testing across multiple clients and servers. It can record user sessions via an HTTP proxy and generate load based on probabilities and arrival rates defined in an XML file. It provides synchronized monitoring of clients and servers during tests and generates HTML reports of results.
Kernel Recipes 2015: Introduction to Kernel Power Management
The document introduces kernel power management concepts in Linux, including static and dynamic power management, idle power management for CPUs and devices, and the evolving driver model. It covers key frameworks like CPU frequency scaling, regulators, runtime power management, and power domains. Documentation files are referenced throughout for further reading.
(PFC302) Performance Benchmarking on AWS | AWS re:Invent 2014
In this session, we explain how to measure the key performance-impacting metrics in a cloud-based application and best practices for a reliable benchmarking process. Measuring the performance of applications correctly can be challenging and there are many tools available to measure and track performance. This session will provide you with specific examples of good and bad tests. We make it clear how to get reliable measurements of and how to map benchmark results to your application. We also cover the importance of selecting tests wisely, repeating tests, and measuring variability. In addition a customer will provide real-life examples of how they developed their application testing stack, utilize it for repeatable testing and identify bottlenecks.
Using cgroups in docker container
This document discusses experimenting with cgroups in Docker containers to isolate processes. It describes installing Docker, launching an Ubuntu container with capabilities enabled, and installing cgroup tools. It then mounts the cpuset and cpu cgroup hierarchies and creates low and high cgroups. Different CPU shares are assigned to each cgroup and processes are run in each to demonstrate the CPU isolation between cgroups.
LSA2 - 02 Control Groups
This document summarizes Linux control groups (cgroups) and their capabilities for limiting and accounting for CPU, memory, block I/O, networking, and freezing processes. It describes the general cgroup structure and available controllers for CPU, CPU accounting, CPU scheduling, memory limits and accounting, block I/O statistics and limiting, network classification and prioritization, freezing processes, and checkpoint/restore with CRIU. Examples are given for configuring CPU and memory limits on cgroups.
Case 4 mdm system change report - a car maker
onTune Case Study
How customer use onTune in their complex environment.
How they can take a benefit from onTune
Q4.11: Sched_mc on dual / quad cores
This document summarizes discussions from the Linaro Connect Q4-11 Power Management Working Group about scheduling domains and load balancing on multicore ARM processors. It describes using sched_mc domains to balance load at the multicore level instead of the CPU level. It also discusses using CPU power scaling to emulate different topologies, like packing tasks onto fewer cores at low load to save power on quad-core CPUs or pulling tasks to a single core on a dual-core system. Open issues around idle load balancing and spurious wakeups with these approaches are also outlined. Future work on load balancing for asymmetric big.LITTLE systems is mentioned.
(PFC303) Milliseconds Matter: Design, Deploy, and Operate Your Application fo...
You can't (yet) bend the law of Physics, but you can use the power of the cloud to design applications that run as fast as the speed of light! This session will focus on the best practices for optimizing performance to the very last millisecond. We'll dive into topics such as caching at every layer of your application, TCP optimizations, SSL optimizations, latency based routing, and much more. These best practices can help you to streamline your infrastructure utilization, improve performance and allow you to scale economically.
Ceph Day Beijing: CeTune: A Framework of Profile and Tune Ceph Performance
CeTune is a toolkit that helps deploy, benchmark, profile and tune Ceph cluster performance. It contains modules to deploy Ceph, run benchmarks, analyze collected data, tune Ceph configuration, and visualize results. CeTune automates the process of testing Ceph performance under different configurations and workloads to help identify optimal tuning parameters.
Backup, Restore, and Disaster Recovery
The document discusses various backup, restore, and disaster recovery strategies for MongoDB databases. It outlines options for backing up data using mongodump, copying database files, or taking filesystem snapshots. For restoring, it recommends using mongorestore which can replay oplog entries for point-in-time recovery. It also stresses the importance of testing restores. For disaster recovery, it suggests using replica sets for redundancy across multiple data centers and regions to avoid single points of failure.
What's hot (20)
Kernel Recipes 2015: Introduction to Kernel Power Management
Kernel Recipes 2015: Introduction to Kernel Power Management
(PFC302) Performance Benchmarking on AWS | AWS re:Invent 2014
(PFC302) Performance Benchmarking on AWS | AWS re:Invent 2014
(PFC303) Milliseconds Matter: Design, Deploy, and Operate Your Application fo...
(PFC303) Milliseconds Matter: Design, Deploy, and Operate Your Application fo...
Ceph Day Beijing: CeTune: A Framework of Profile and Tune Ceph Performance
Ceph Day Beijing: CeTune: A Framework of Profile and Tune Ceph Performance
Viewers also liked
Porting Spring PetClinic to GigaSpaces
This presentation shows the general methodology of porting a JEE web application to GigaSpaces XAP and the lessons learned from the process of porting the Spring PetClinic sample application to the GigaSpaces platform
GigaSpaces Flash Memory Summit 2014
Ultra Massive application storage capacity for real-time applications
A True Limitless Capacity Data Grid
Scrum@GigaSpaces
1. The document discusses the author's experience implementing Scrum practices at their company GigaSpaces over the past 2+ years to improve productivity, quality, and reduce waste and frustration.
2. Some of the initial challenges in adopting Scrum included getting the team on board with the new mindset and processes, defining roles and responsibilities, and streamlining practices like sprint planning and releases.
3. Key benefits realized included being able to react faster to changing priorities, increased transparency, reduced bottlenecks and defects through practices like continuous integration and automated regression testing.
Soa R Dataline Government Cloud Computing Geva Perry
The document discusses the rise of cloud computing as a new model for IT infrastructure over the next 20 years. It notes that cloud computing provides an on-demand, utility-based model that allows companies to pay for only the computing resources they need. This helps companies address issues like volatile application loads, costly downtime, and inefficient over-provisioning of servers. Major technology companies are making large investments in cloud computing platforms and services.
Sunx4450 Intel7460 GigaSpaces XAP Platform Benchmark
The document describes the results of benchmarks performed on the Sun Fire x4450-Intel 7460-XAP GigaSpaces platform to test its ability to scale up throughput, latency, and capacity when processing online transactions and high performance computing workloads. Key findings include throughput of over 1.8 million operations per second, latency under 1 millisecond, and near-linear scalability for up to 32 concurrent processing threads. The 6-core Intel Xeon processors provided around 30% better performance and scalability compared to 4-core processors.
Telecom universal datastatesharingfabric
A universal Data & State sharing Fabric can help address the problem of different telecom systems using various protocols for communication by providing a shared fabric for real-time data and state sharing across systems. Existing solutions like databases and ESBs have drawbacks like being disk-based instead of real-time, lacking state sharing capabilities, and lower performance. IMDG provides a unified solution by combining the benefits of databases and ESBs while avoiding their limitations, allowing different systems and components to share data and state in real-time at massive scale with low latency.
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
The document provides instructions for logging into the GigaSpaces cloud computing framework and demoing three applications - a data grid demo, trader stock desktop demo, and pet clinic demo. It describes accessing a trial account, logging in with GigaSpaces credentials, and launching the demo applications from the cloud console. Detailed steps are given for running benchmarks and tests for each demo to experience features like high availability and auto-scaling.
Xap memory xtend-tutorial-2014
This tutorial will guide you how to experiment with XAP 10 MemoryXtend
We will use EC2 to start a VM with a Flash Drive.
You may use any other machine running Linux 6.x with SSD Flash Drive with this tutorial.
Viewers also liked (9)
Soa R Dataline Government Cloud Computing Geva Perry
Soa R Dataline Government Cloud Computing Geva Perry
Sunx4450 Intel7460 GigaSpaces XAP Platform Benchmark
Sunx4450 Intel7460 GigaSpaces XAP Platform Benchmark
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
Similar to The Elastic PU
PuppetConf 2016: An Introduction to Measuring and Tuning PE Performance – Cha...
This document provides an overview of measuring and tuning performance for the Puppet Enterprise (PE) platform. It discusses gathering data from PE services like Puppet Server and PuppetDB through JVM logging, metrics, and configurations. Important metrics for Puppet Server include JRuby usage and catalog compilation times. Tuning options involve adjusting JRuby capacity and rebalancing agent checkins. The document also covers monitoring PuppetDB for storage usage and command processing, as well as optimizing PostgreSQL query performance.
A Presentation about Puppet that I've made at the OSSPAC conference
The document discusses infrastructure automation using Puppet. It describes Puppet as an open source tool that can be used to deploy and manage system configurations. Puppet works by defining system resources like files, packages and services using a declarative language and establishing relationships between them. It runs periodically on systems to ensure they match the defined configurations. The document provides examples of using Puppet types, classes, dependencies, templates and facts to automate common infrastructure tasks like managing sudoers files or deploying virtual hosts. Benefits of Puppet include reduced costs, improved productivity and reproducibility when managing large server environments.
Bpug mcollective 20140624
The document summarizes an agenda for a Belgian Puppet Users Group meeting about MCollective. The agenda includes an overview of orchestration and MCollective, hands-on setup of MCollective, the MCollective command line tool, MCollective agents, and future plans. It also provides details about installing and configuring MCollective clients, servers, and the ActiveMQ middleware.
Introduction to OS.
This chapter introduces operating system concepts and provides an overview of operating system components and functions. It discusses how operating systems act as an intermediary between the user and computer hardware to manage resources and execute programs. The chapter describes computer system organization with CPUs, memory, and I/O devices. It also outlines operating system structure for multiprogramming and timesharing, and key operating system operations like process management, memory management, storage management, and security.
♨️CPU limitation per Oracle database instance
Cgroups improve database performance by associating a dedicated set of CPUs and memory to a database instance, limiting each instance to only those resources. The setup_processor_group.sh script is used to create cgroups on Linux systems. To bind a database instance to a cgroup, the PROCESSOR_GROUP_NAME parameter must be set to the cgroup name and the instance restarted. Best practices include configuring cgroups out of CPU threads from minimum cores/sockets and creating cgroups with at least 2 CPU cores.
Deep Dive on Amazon EC2 Instances (March 2017)
This document provides an overview of Amazon EC2 instance types and performance optimization best practices. It discusses the factors that go into choosing an EC2 instance, how instance performance is characterized, and how to optimize workloads through choices like instance type, operating system, and configuration settings. Specific tips are provided around topics like timekeeping, CPU credit monitoring, NUMA, and kernel optimizations. The goal is to help users make the most of their EC2 experience through understanding instance internals and performance tradeoffs.
Beyond Unit Testing
The document discusses various techniques for testing large, distributed systems beyond traditional unit testing. It recommends embracing virtualization to simulate production environments and deploying applications and tests across multiple virtual machines. Various tools are presented to help with distributed, automated testing including Cactus for in-container testing, Selenium and jsUnit for browser testing, and SmartFrog as a framework for describing, deploying and managing distributed service components and tests. The document calls for a focus on system-level tests that simulate the full production environment and integrate testing across distributed systems.
Scalable systems management with puppet
This document discusses using Puppet for scalable systems management. It begins with challenges faced by system administrators and an introduction to Puppet. It covers installing and configuring Puppet, including certificate signing. It also discusses managing infrastructure with Puppet through classes, modules, and templates. Examples of Puppet configuration are provided.
Scalable Systems Management with Puppet
This document discusses using Puppet for scalable systems management. It begins with challenges faced by system administrators and an introduction to Puppet. It covers installing and configuring Puppet, including certificate signing. It also discusses managing infrastructure with Puppet through classes, modules, and templates. Examples of Puppet configuration are provided.
Stateful streaming data pipelines
This document discusses stateful streaming data pipelines using Apache Apex. It introduces Apache Apex and describes its key components like tuples, operators, and the directed acyclic graph (DAG) structure. It then discusses challenges around checkpointing large operator state and introduces managed state and spillable data structures as solutions. Managed state incrementally checkpoints state to disk and allows configuring memory thresholds. Spillable data structures decouple data from serialization and provide map, list, and set interfaces to stored data. Examples demonstrate building complex data structures on top of managed state.
1.introduction
This document provides an overview of operating system concepts by summarizing the major components and functions of an operating system. It discusses how operating systems manage resources like the CPU, memory, storage and I/O devices. It also covers key operating system services like process management, memory management, file systems, protection and security. Finally, it describes different computing environments that operating systems support like traditional systems, client-server, peer-to-peer and web-based computing.
1.Introduction
This document provides an overview of operating system concepts by summarizing the major components and functions of an operating system. It discusses how operating systems manage resources like the CPU, memory, storage and I/O devices. It also covers key operating system services like process management, memory management, file systems, protection and security. Finally, it describes different computing environments that operating systems support like traditional systems, client-server, peer-to-peer and web-based computing.
Installaling Puppet Master and Agent
Puppet is a configuration automation platform that simplifies system administration tasks. It uses a client/server model where agent nodes pull configuration profiles from the Puppet master. Modules on the master describe the desired system configuration. Puppet translates modules into code and configures agent servers as needed. Puppet can manage infrastructure across multiple servers.
Pandora FMS: Hyper V Plugin
A Hyper-V Monitoring Plugin that allows you to control Hyper-V virtual architectures easily. For more information visit the following webpage: http://pandorafms.com/index.php?sec=Library&sec2=repository&lng=es&action=view_PUI&id_PUI=587
DevoxxUK: Optimizating Application Performance on Kubernetes
Now that you have your apps running on K8s, wondering how to get the response time that you need ? Tuning a polyglot set of microservices to get the performance that you need can be challenging in Kubernetes. The key to overcoming this is observability. Luckily there are a number of tools such as Prometheus that can provide all the metrics you need, but here is the catch, there is so much of data and metrics that is difficult make sense of it all. This is where Hyperparameter tuning can come to the rescue to help build the right models.
This talk covers best practices that will help attendees
1. To understand and avoid common performance related problems.
2. Discuss observability tools and how they can help identify perf issues.
3. Look closer into Kruize Autotune which is a Open Source Autonomous Performance Tuning Tool for Kubernetes and where it can help.
AMS Node Meetup December presentation Phusion Passenger
Phusion Passenger is an app server for Node.js, Ruby and Python. It simplifies deployment and administration, increases your server's efficiency and helps identifying and solving problems.
In this talk Hongli Lai demonstrates how Passenger simplifies things by integrating with Nginx and by replacing Forever, PM2, Cluster and all sorts of other tools. Hongli also shares what other benefits Passenger has to offer, and what you can expect from future developments.
Running Java Applications inside Kubernetes with Nested Container Architectur...
Running Java Applications inside Kubernetes with Nested Container Architectur...Jelastic Multi-Cloud PaaS
Kubernetes enables possibilities to develop cloud native microservices or decompose traditional applications making them more technologically advanced with the help of containers. Currently, most of the Kubernetes solutions are offered on top of VMs and there is a room for further improvements. Implementing nested architecture of application containers running inside system containers opens additional flexibility of resource allocation and management, accelerates provisioning of the clusters and pods, as well as cuts the overall costs. In this presentation we cover the possibilities of running a Java-based application inside Kubernetes cluster with nested container architecture, what configurations should be taken into account, and how to overcome the barriers on the way to more efficient Kubernetes hosting. Nagios Conference 2011 - Daniel Wittenberg - Scaling Nagios At A Giant Insur...
Daniel Wittenburg' presentation on a reference story for a German Health Insurance Company. The presentation was given during the Nagios World Conference North America held Sept 27-29th, 2011 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
W 0300 codingfor_life-batterylifethatis
Coding for Life--Battery Life, That Is discusses how to optimize Android apps to be more battery efficient. It recommends using efficient data formats and parsers for network requests, gzipping text data, limiting wakelocks and location updates, recycling objects, and using coarse location services rather than GPS where possible. It also suggests starting background services through AlarmManager or manifest receivers rather than continuously running services, and giving users options to control background behavior and data usage to maximize battery life.
Ehcache Architecture, Features And Usage Patterns
In depth presentation on Ehcache from Greg Luck, the Wotif.com Chief Architect and Ehcache maintainer
Similar to The Elastic PU (20)
PuppetConf 2016: An Introduction to Measuring and Tuning PE Performance – Cha...
PuppetConf 2016: An Introduction to Measuring and Tuning PE Performance – Cha...
A Presentation about Puppet that I've made at the OSSPAC conference
A Presentation about Puppet that I've made at the OSSPAC conference
DevoxxUK: Optimizating Application Performance on Kubernetes
DevoxxUK: Optimizating Application Performance on Kubernetes
AMS Node Meetup December presentation Phusion Passenger
AMS Node Meetup December presentation Phusion Passenger
Running Java Applications inside Kubernetes with Nested Container Architectur...
Running Java Applications inside Kubernetes with Nested Container Architectur...
Nagios Conference 2011 - Daniel Wittenberg - Scaling Nagios At A Giant Insur...
Nagios Conference 2011 - Daniel Wittenberg - Scaling Nagios At A Giant Insur...
Recently uploaded
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Finale of the Year: Apply for Next One!
Presentation for the event called "Finale of the Year: Apply for Next One!" organized by GDSC PJATK
5th LF Energy Power Grid Model Meet-up Slides
5th Power Grid Model Meet-up
It is with great pleasure that we extend to you an invitation to the 5th Power Grid Model Meet-up, scheduled for 6th June 2024. This event will adopt a hybrid format, allowing participants to join us either through an online Mircosoft Teams session or in person at TU/e located at Den Dolech 2, Eindhoven, Netherlands. The meet-up will be hosted by Eindhoven University of Technology (TU/e), a research university specializing in engineering science & technology.
Power Grid Model
The global energy transition is placing new and unprecedented demands on Distribution System Operators (DSOs). Alongside upgrades to grid capacity, processes such as digitization, capacity optimization, and congestion management are becoming vital for delivering reliable services.
Power Grid Model is an open source project from Linux Foundation Energy and provides a calculation engine that is increasingly essential for DSOs. It offers a standards-based foundation enabling real-time power systems analysis, simulations of electrical power grids, and sophisticated what-if analysis. In addition, it enables in-depth studies and analysis of the electrical power grid’s behavior and performance. This comprehensive model incorporates essential factors such as power generation capacity, electrical losses, voltage levels, power flows, and system stability.
Power Grid Model is currently being applied in a wide variety of use cases, including grid planning, expansion, reliability, and congestion studies. It can also help in analyzing the impact of renewable energy integration, assessing the effects of disturbances or faults, and developing strategies for grid control and optimization.
What to expect
For the upcoming meetup we are organizing, we have an exciting lineup of activities planned:
-Insightful presentations covering two practical applications of the Power Grid Model.
-An update on the latest advancements in Power Grid -Model technology during the first and second quarters of 2024.
-An interactive brainstorming session to discuss and propose new feature requests.
-An opportunity to connect with fellow Power Grid Model enthusiasts and users.
Digital Marketing Trends in 2024 | Guide for Staying Ahead
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
Main news related to the CCS TSI 2023 (2023/1695)
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
Predictive maintenance is a proactive approach that anticipates equipment failures before they happen. At the forefront of this innovative strategy is Artificial Intelligence (AI), which brings unprecedented precision and efficiency. AI in predictive maintenance is transforming industries by reducing downtime, minimizing costs, and enhancing productivity.
A Comprehensive Guide to DeFi Development Services in 2024
DeFi represents a paradigm shift in the financial industry. Instead of relying on traditional, centralized institutions like banks, DeFi leverages blockchain technology to create a decentralized network of financial services. This means that financial transactions can occur directly between parties, without intermediaries, using smart contracts on platforms like Ethereum.
In 2024, we are witnessing an explosion of new DeFi projects and protocols, each pushing the boundaries of what’s possible in finance.
In summary, DeFi in 2024 is not just a trend; it’s a revolution that democratizes finance, enhances security and transparency, and fosters continuous innovation. As we proceed through this presentation, we'll explore the various components and services of DeFi in detail, shedding light on how they are transforming the financial landscape.
At Intelisync, we specialize in providing comprehensive DeFi development services tailored to meet the unique needs of our clients. From smart contract development to dApp creation and security audits, we ensure that your DeFi project is built with innovation, security, and scalability in mind. Trust Intelisync to guide you through the intricate landscape of decentralized finance and unlock the full potential of blockchain technology.
Ready to take your DeFi project to the next level? Partner with Intelisync for expert DeFi development services today!
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
This case study explores designing a scalable e-commerce platform, covering key requirements, system components, and best practices.
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
When it comes to unit testing in the .NET ecosystem, developers have a wide range of options available. Among the most popular choices are NUnit, XUnit, and MSTest. These unit testing frameworks provide essential tools and features to help ensure the quality and reliability of code. However, understanding the differences between these frameworks is crucial for selecting the most suitable one for your projects.
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on integration of Salesforce with Bonterra Impact Management.
Interested in deploying an integration with Salesforce for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Recently uploaded (20)
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
The Elastic PU
- 1. The Elastic PU Feb 2011
- 8. Deployment Server Deploy New Stateful EPU: - 64 GB Max Capacity - 32 GB Initial capacity - Highly Available - 4GB JVM heap size Grid Service Manager Data Center Server Server Agent Agent JVM JVM Server Server Agent Agent JVM JVM JVM JVM JVM JVM B B B B P P P P P P B B P P B B
- 9. Scale Out – Manual Mode Server Grid Service Manager Data Center Server Server Agent Agent JVM JVM Server Server Agent Agent JVM JVM Server Agent JVM JVM JVM JVM JVM JVM Scale Stateful EPU: - Increase memory Capacity to 40GB Capacity B B B P P P P P P B B P B B P B
- 10. Scale Out – Eager Mode Server Grid Service Manager Data Center Server Server Agent Agent JVM JVM Server Server Agent Agent JVM JVM Server Agent JVM JVM JVM JVM JVM Monitoring Available Memory/Cores Resource Capacity JVM B B B P P P P P P B B P B B P B
Editor's Notes
- Anmations: deploy, failover, scale out