The Icehouse release of OpenStack focused on improving the user experience and operational capabilities. It included stability enhancements and bug fixes for core projects like Nova, Neutron, Glance, Cinder, and Swift. New features were added for many services, such as scheduler improvements in Nova, policy-based storage in Swift, and alarming capabilities in Ceilometer. The release also incubated several new projects, including Sahara, Barbican, Marconi, and continued development of TripleO, Ironic, and other underlying projects.
Cloud economics design, capacity and operational concernsMarcos García
Learn how to choose your e-commerce infrastructure, and how to forecast the TCO based on a simple model, including the explanations on how public, private and hybrid cloud computing work.
This meeting we'll host a discussion on Google Cloud Platform and Amazon Web Services to bring light to similarities and differences between platforms. If you have questions about how our platforms compare this is the meeting to attend!
This talk will walk through the journey of Cassandra at Netflix. It will go into 3-4 specific use cases where Cassandra stands out than the rest of the data-stores and is being used in Netflix, bringing great viewing experience to all customers globally. Roopa will go into the specifics of the data model being used and where Cassandra stands out with its strengths and which places where they learnt the hard way. Roopa will then share some of the best practices and self service platform being used for Cassandra to cater to their developer needs.
GumGum relies heavily on Cassandra for storing different kinds of metadata. Currently GumGum reaches 1 billion unique visitors per month using 3 Cassandra datacenters in Amazon Web Services spread across the globe.
This presentation will detail how we scaled out from one local Cassandra datacenter to a multi-datacenter Cassandra cluster and all the problems we encountered and choices we made while implementing it.
How did we architect multi-region Cassandra in AWS? What were our experiences in implementing multi-datacenter Cassandra? How did we achieve low latency with multi-region Cassandra and the Datastax Driver? What are the different Cassandra use cases at GumGum? How did we integrate our Cassandra with Spark?
Building a Real-time Streaming ETL Framework Using ksqlDB and NoSQLScyllaDB
Event streaming applications unlock new benefits by combining various data feeds. However, getting actionable insights in a timely fashion has remained a challenge, as the data has been siloed in disparate systems. ksqlDB solves this by providing an interactive SQL interface that can seamlessly combine and transform data from various sources.
In this webinar, we will show how streaming queries of high throughput NoSQL systems can derive insights from various push/pull queries via ksqlDB's User-Defined Functions, Aggregate Functions and Table Functions.
Cloud economics design, capacity and operational concernsMarcos García
Learn how to choose your e-commerce infrastructure, and how to forecast the TCO based on a simple model, including the explanations on how public, private and hybrid cloud computing work.
This meeting we'll host a discussion on Google Cloud Platform and Amazon Web Services to bring light to similarities and differences between platforms. If you have questions about how our platforms compare this is the meeting to attend!
This talk will walk through the journey of Cassandra at Netflix. It will go into 3-4 specific use cases where Cassandra stands out than the rest of the data-stores and is being used in Netflix, bringing great viewing experience to all customers globally. Roopa will go into the specifics of the data model being used and where Cassandra stands out with its strengths and which places where they learnt the hard way. Roopa will then share some of the best practices and self service platform being used for Cassandra to cater to their developer needs.
GumGum relies heavily on Cassandra for storing different kinds of metadata. Currently GumGum reaches 1 billion unique visitors per month using 3 Cassandra datacenters in Amazon Web Services spread across the globe.
This presentation will detail how we scaled out from one local Cassandra datacenter to a multi-datacenter Cassandra cluster and all the problems we encountered and choices we made while implementing it.
How did we architect multi-region Cassandra in AWS? What were our experiences in implementing multi-datacenter Cassandra? How did we achieve low latency with multi-region Cassandra and the Datastax Driver? What are the different Cassandra use cases at GumGum? How did we integrate our Cassandra with Spark?
Building a Real-time Streaming ETL Framework Using ksqlDB and NoSQLScyllaDB
Event streaming applications unlock new benefits by combining various data feeds. However, getting actionable insights in a timely fashion has remained a challenge, as the data has been siloed in disparate systems. ksqlDB solves this by providing an interactive SQL interface that can seamlessly combine and transform data from various sources.
In this webinar, we will show how streaming queries of high throughput NoSQL systems can derive insights from various push/pull queries via ksqlDB's User-Defined Functions, Aggregate Functions and Table Functions.
OpenEBS Technical Workshop - KubeCon San Diego 2019MayaData Inc
Know how to navigate the journey to cloud-native data management with lessons learned and best practices to help you deploy Kubernetes, storage, and data management with confidence.
How Russia’s #1 Internet Provider Gets High Performance at Low Cost
What if you could store huge amounts of data using traditional low-cost HDDs while still maintaining low single-digit millisecond latencies? That’s just what they did at Mail.Ru, the largest email and Internet service provider in Russia.
Cassandra on Google Cloud Platform (Ravi Madasu, Google / Ben Lackey, DataSta...DataStax
During this session Ben Lackey (DataStax) and Ravi Madasu (Google) will cover best practices for quickly setting up a cluster on Google Cloud Platform (GCP) using both Google Compute Engine (GCE) and Google Container Engine (GKE) which is based on Kubernetes and Docker.
About the Speakers
Ben Lackey Partner Architect, DataStax
I work in the Cloud Strategy group at DataStax where I concentrate on improving the integration between DataStax Enterprise and cloud platforms including Azure, GCP and Pivotal.
Ravi Madasu
Ravi Madasu is a program manager at Google, primarily focused on Google Cloud Launcher. He works closely with ISV partners to make their products and services available on the Google Cloud Platform providing a developer friendly deployment experience. He has 15+ years of experience, working in variety of roles such as software engineer, project manager and product manager. Ravi received a Masters degree in Information Systems from Northeastern University and an MBA from Carnegie Mellon University.
Building Event Streaming Architectures on Scylla and KafkaScyllaDB
Event streaming architectures require high-throughput, low-latency components to consistently and smoothly transfer data between heterogenous transactional and analytical systems. Join us and Confluent's Tim Berglund to learn how the Scylla and Confluent Kafka interoperate as a foundation upon which you can build enterprise-grade, event-driven applications, plus a use case from Numberly.
Netflix’s architecture involves thousands of microservices built to serve unique business needs. As this architecture grew, it became clear that the data storage and query needs were unique to each area; there is no one silver bullet which fits the data needs for all microservices. CDE (Cloud Database Engineering team) offers polyglot persistence, which promises to offer ideal matches between problem spaces and persistence solutions. In this meetup you will get a deep dive into the Self service platform, our solution to repairing Cassandra data reliably across different datacenters, Memcached Flash and cross region replication and Graph database evolution at Netflix.
ScyllaDB recently announced Project Alternator, a new open source project that will enable Amazon DynamoDB users to easily migrate to an open-source database that runs anywhere — on most cloud platforms, on-premises, on bare-metal, virtual machines or via Kubernetes — all while preserving their investments in their existing application code.
Project Alternator will help DynamoDB users achieve much better and more reliable performance, reduce database costs by 80% - 90%, support large items (10s of MBs) and large partitions (multiple GBs), control the number of replicas, balance cost vs. redundancy, and much more.
Join ScyllaDB founders Avi Kivity and Dor Laor and lead engineer Nadav Har’El for a live webinar on September 25th, where they will share an overview of Project Alternator, including:
Alternator’s design implementation and goals
How to configure Alternator (ok, add alternator_port: 8000 to your scylla.yaml)
Demo how to easily run it from docker/rpm
Run several examples:
Tic-tac-toe based DynamoDB example with Alternator
How to benchmark Scylla Alternator with YCSB and considerations around it
How to run a serverless application along with Alternator
How to migrate DynamoDB data to Alternator using the Spark migrator
Discuss the current limitations of Alternator
Plus we will discuss current limitations of Alternator, describe different consistencies and active-active vs leader model, share the project roadmap, and answer your questions at the end.
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics
How did Maginatics build a strongly consistent and secure distributed file system? Niraj Tolia, Chief Architect at Maginatics, gave this presentation on the design of MagFS at the Storage Developer Conference on September 16, 2013.
For more information about MagFS—The File System for the Cloud, visit maginatics.com or contact us directly at info@maginatics.com.
In Pravega's first community meeting as a CNCF project, we overviewed experimental features of Pravega:
* Schema Registry - preserving the structure of data in an unstructured storage system and controlling for safe schema evolution
* Consumption-Based Retention - stream truncation based on subscriber positions
* Simplified Long-Term Storage (SLTS) - abstracting the distributed management of segments while removing complicated problems such as fencing
* SLTS Plugin for BookKeeper - an implementation of the SLTS interfaces for BlobIt! object stores on BookKeeper: https://github.com/diegosalvi/pravega-blobit-chunkmanager
MySQL Cluster (NDB) - Best Practices Percona Live 2017Severalnines
This presentation by Johan Andersson at Percona Live 2017 in Santa Clara, California gives detailed information on all you need to know to effectively deploy and manage MySQL Cluster technology in your environment.
Why you need benchmarks
Finding the right database solution for your use case can be an arduous journey. The database deployment touches aspects of throughput performance, latency control, high availability and data resilience.
You will need to decide on the infrastructure to use: Cloud, on-premise or a hybrid solution.
Data models also have an impact on finding the right fit for the use case. Once you establish a requirements set, the next step is to test your use case against the databases of choice.
In this workshop, we will discuss the different data points you need to collect in order to get the most realistic testing environment.
We will cover:
Data model impact on performance and latency
Client behavior related to database capabilities
Failover and high availability testing
Hardware selection and cluster configuration impact
We will show 2 benchmarking tools you can use to test and benchmark your clusters to identify the optimal deployment scenario for your use case.
Attend this virtual workshop if you are:
Looking to minimize the cost of your database deployment
Making a database decision based on performance and scale data
Planning to emulate your workload on a pre-production system where you can test, fail fast and learn.
RDBMS to NoSQL: Practical Advice from Successful MigrationsScyllaDB
When and how to migrate data from SQL to NoSQL are matters of much debate. It can certainly be a daunting task, but when your SQL systems hit architectural limits or your Aurora expenses skyrocket, it’s probably time to consider the move.
See a discussion of how best to migrate data from SQL to NoSQL, and how to get heterogenous data systems to communicate with each other effectively in real time. Get important architectural considerations, tips and tricks and several real-world use cases.
From this webinar you will learn:
Key differences between RDBMS and NoSQL, and how to know when it’s time to migrate
How to harness the greatest strengths out of both classes of databases, SQL and NoSQL
Migration techniques proven in the field
Modeling differences between RDBMS and NoSQL
Managing releases in NoSQL vs RDBMS
Scylla features and services that help with migrating from a relational database
NoSQL and NewSQL: Tradeoffs between Scalable Performance & ConsistencyScyllaDB
This webinar compares NoSQL and NewSQL databases. We will look at the significant architectural differences between the two, tradeoffs between availability, scalable performance and consistency, data models, and share benchmark results to display the performance implications of NoSQL versus NewSQL.
Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy
n this talk we will address how we developed our Cassandra environments utilizing Cisco UCS Open Stack Platform with the DataStax Enterprise Edition software. In addition we are utilizing OpenSource CEPH storage in our Infrastructure to optimize the Performance and reduce the costs.
Mongo DB Monitoring - Become a MongoDB DBASeveralnines
This presentation was presented by Art van Scheppingen at Percona Live 2017 in Santa Clara CA and covers what you need to know to effectively monitor MongoDB
Under the Hood of a Shard-per-Core Database ArchitectureScyllaDB
Most databases are based on architectures that pre-date advances to modern hardware. This results in performance issues, the need to overprovision, and a high total cost of ownership. In this webinar we will discuss the advances to modern server technology and take a deep dive into Scylla’s shard-per-core architecture and our asynchronous engine, the Seastar framework.
Join us to learn how Seastar (and Scylla):
Avoid locks and contention on the CPU level
Bypass kernel bottlenecks
Implement its per-core shared-nothing autosharding mechanism
Utilize modern storage hardware
Leverage NUMA to get the best RAM performance
Balance your data across CPUs and nodes for best and smoothest performance
Plus we’ll cover the advantages of unlocking vertical scalability.
OpenEBS Technical Workshop - KubeCon San Diego 2019MayaData Inc
Know how to navigate the journey to cloud-native data management with lessons learned and best practices to help you deploy Kubernetes, storage, and data management with confidence.
How Russia’s #1 Internet Provider Gets High Performance at Low Cost
What if you could store huge amounts of data using traditional low-cost HDDs while still maintaining low single-digit millisecond latencies? That’s just what they did at Mail.Ru, the largest email and Internet service provider in Russia.
Cassandra on Google Cloud Platform (Ravi Madasu, Google / Ben Lackey, DataSta...DataStax
During this session Ben Lackey (DataStax) and Ravi Madasu (Google) will cover best practices for quickly setting up a cluster on Google Cloud Platform (GCP) using both Google Compute Engine (GCE) and Google Container Engine (GKE) which is based on Kubernetes and Docker.
About the Speakers
Ben Lackey Partner Architect, DataStax
I work in the Cloud Strategy group at DataStax where I concentrate on improving the integration between DataStax Enterprise and cloud platforms including Azure, GCP and Pivotal.
Ravi Madasu
Ravi Madasu is a program manager at Google, primarily focused on Google Cloud Launcher. He works closely with ISV partners to make their products and services available on the Google Cloud Platform providing a developer friendly deployment experience. He has 15+ years of experience, working in variety of roles such as software engineer, project manager and product manager. Ravi received a Masters degree in Information Systems from Northeastern University and an MBA from Carnegie Mellon University.
Building Event Streaming Architectures on Scylla and KafkaScyllaDB
Event streaming architectures require high-throughput, low-latency components to consistently and smoothly transfer data between heterogenous transactional and analytical systems. Join us and Confluent's Tim Berglund to learn how the Scylla and Confluent Kafka interoperate as a foundation upon which you can build enterprise-grade, event-driven applications, plus a use case from Numberly.
Netflix’s architecture involves thousands of microservices built to serve unique business needs. As this architecture grew, it became clear that the data storage and query needs were unique to each area; there is no one silver bullet which fits the data needs for all microservices. CDE (Cloud Database Engineering team) offers polyglot persistence, which promises to offer ideal matches between problem spaces and persistence solutions. In this meetup you will get a deep dive into the Self service platform, our solution to repairing Cassandra data reliably across different datacenters, Memcached Flash and cross region replication and Graph database evolution at Netflix.
ScyllaDB recently announced Project Alternator, a new open source project that will enable Amazon DynamoDB users to easily migrate to an open-source database that runs anywhere — on most cloud platforms, on-premises, on bare-metal, virtual machines or via Kubernetes — all while preserving their investments in their existing application code.
Project Alternator will help DynamoDB users achieve much better and more reliable performance, reduce database costs by 80% - 90%, support large items (10s of MBs) and large partitions (multiple GBs), control the number of replicas, balance cost vs. redundancy, and much more.
Join ScyllaDB founders Avi Kivity and Dor Laor and lead engineer Nadav Har’El for a live webinar on September 25th, where they will share an overview of Project Alternator, including:
Alternator’s design implementation and goals
How to configure Alternator (ok, add alternator_port: 8000 to your scylla.yaml)
Demo how to easily run it from docker/rpm
Run several examples:
Tic-tac-toe based DynamoDB example with Alternator
How to benchmark Scylla Alternator with YCSB and considerations around it
How to run a serverless application along with Alternator
How to migrate DynamoDB data to Alternator using the Spark migrator
Discuss the current limitations of Alternator
Plus we will discuss current limitations of Alternator, describe different consistencies and active-active vs leader model, share the project roadmap, and answer your questions at the end.
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics
How did Maginatics build a strongly consistent and secure distributed file system? Niraj Tolia, Chief Architect at Maginatics, gave this presentation on the design of MagFS at the Storage Developer Conference on September 16, 2013.
For more information about MagFS—The File System for the Cloud, visit maginatics.com or contact us directly at info@maginatics.com.
In Pravega's first community meeting as a CNCF project, we overviewed experimental features of Pravega:
* Schema Registry - preserving the structure of data in an unstructured storage system and controlling for safe schema evolution
* Consumption-Based Retention - stream truncation based on subscriber positions
* Simplified Long-Term Storage (SLTS) - abstracting the distributed management of segments while removing complicated problems such as fencing
* SLTS Plugin for BookKeeper - an implementation of the SLTS interfaces for BlobIt! object stores on BookKeeper: https://github.com/diegosalvi/pravega-blobit-chunkmanager
MySQL Cluster (NDB) - Best Practices Percona Live 2017Severalnines
This presentation by Johan Andersson at Percona Live 2017 in Santa Clara, California gives detailed information on all you need to know to effectively deploy and manage MySQL Cluster technology in your environment.
Why you need benchmarks
Finding the right database solution for your use case can be an arduous journey. The database deployment touches aspects of throughput performance, latency control, high availability and data resilience.
You will need to decide on the infrastructure to use: Cloud, on-premise or a hybrid solution.
Data models also have an impact on finding the right fit for the use case. Once you establish a requirements set, the next step is to test your use case against the databases of choice.
In this workshop, we will discuss the different data points you need to collect in order to get the most realistic testing environment.
We will cover:
Data model impact on performance and latency
Client behavior related to database capabilities
Failover and high availability testing
Hardware selection and cluster configuration impact
We will show 2 benchmarking tools you can use to test and benchmark your clusters to identify the optimal deployment scenario for your use case.
Attend this virtual workshop if you are:
Looking to minimize the cost of your database deployment
Making a database decision based on performance and scale data
Planning to emulate your workload on a pre-production system where you can test, fail fast and learn.
RDBMS to NoSQL: Practical Advice from Successful MigrationsScyllaDB
When and how to migrate data from SQL to NoSQL are matters of much debate. It can certainly be a daunting task, but when your SQL systems hit architectural limits or your Aurora expenses skyrocket, it’s probably time to consider the move.
See a discussion of how best to migrate data from SQL to NoSQL, and how to get heterogenous data systems to communicate with each other effectively in real time. Get important architectural considerations, tips and tricks and several real-world use cases.
From this webinar you will learn:
Key differences between RDBMS and NoSQL, and how to know when it’s time to migrate
How to harness the greatest strengths out of both classes of databases, SQL and NoSQL
Migration techniques proven in the field
Modeling differences between RDBMS and NoSQL
Managing releases in NoSQL vs RDBMS
Scylla features and services that help with migrating from a relational database
NoSQL and NewSQL: Tradeoffs between Scalable Performance & ConsistencyScyllaDB
This webinar compares NoSQL and NewSQL databases. We will look at the significant architectural differences between the two, tradeoffs between availability, scalable performance and consistency, data models, and share benchmark results to display the performance implications of NoSQL versus NewSQL.
Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy
n this talk we will address how we developed our Cassandra environments utilizing Cisco UCS Open Stack Platform with the DataStax Enterprise Edition software. In addition we are utilizing OpenSource CEPH storage in our Infrastructure to optimize the Performance and reduce the costs.
Mongo DB Monitoring - Become a MongoDB DBASeveralnines
This presentation was presented by Art van Scheppingen at Percona Live 2017 in Santa Clara CA and covers what you need to know to effectively monitor MongoDB
Under the Hood of a Shard-per-Core Database ArchitectureScyllaDB
Most databases are based on architectures that pre-date advances to modern hardware. This results in performance issues, the need to overprovision, and a high total cost of ownership. In this webinar we will discuss the advances to modern server technology and take a deep dive into Scylla’s shard-per-core architecture and our asynchronous engine, the Seastar framework.
Join us to learn how Seastar (and Scylla):
Avoid locks and contention on the CPU level
Bypass kernel bottlenecks
Implement its per-core shared-nothing autosharding mechanism
Utilize modern storage hardware
Leverage NUMA to get the best RAM performance
Balance your data across CPUs and nodes for best and smoothest performance
Plus we’ll cover the advantages of unlocking vertical scalability.
This presentation is designed for awareness raising amongst school staff and other relevant professionals to help identify girls at risk of female genital mutilation (FGM).
Visit www.bit.ly/FGMguidancePSHE for more information.
BMR's consumer retail financing program. The answer to preventing those customers from walking out the door because of a lack of financing options and choices.
NetflixOSS Meetup S3 E1, covering latest components in Distributed Databases, Telemetry systems, Big Data tools and more. Speakers from Netflix, IBM Watson, Pivotal and Nike Digital
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...javier ramirez
QuestDB es una base de datos open source de alto rendimiento. Mucha gente nos comentaba que les gustaría usarla como servicio, sin tener que gestionar las máquinas. Así que nos pusimos manos a la obra para desarrollar una solución que nos permitiese lanzar instancias de QuestDB con provisionado, monitorización, seguridad o actualizaciones totalmente gestionadas.
Unos cuantos clusters de Kubernetes más tarde, conseguimos lanzar nuestra oferta de QuestDB Cloud. Esta charla es la historia de cómo llegamos ahí. Hablaré de herramientas como Calico, Karpenter, CoreDNS, Telegraf, Prometheus, Loki o Grafana, pero también de retos como autenticación, facturación, multi-nube, o de a qué tienes que decir que no para poder sobrevivir en la nube.
Netflix Container Scheduling and Execution - QCon New York 2016aspyker
Scheduling a Fuller House: Container Management At Netflix
Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. Various Netflix batch jobs and an increasing number of service applications use containers for their processing. In this talk Netflix will present a deep dive on the motivations and the technology powering container deployment on top of the AWS EC2 service. The talk will cover our approach to cloud resource management and scheduling with the open source Fenzo library, along with details on docker execution engine as a part of project Titus. As well, the talk will share some of the results so far, lessons learned, and end with a brief look at the developer experience for containers.
Kubernetes @ Squarespace: Kubernetes in the DatacenterKevin Lynch
This talk was presented at SRE NYC Meetup on August 16, 2017 at Squarespace HQ.
https://www.youtube.com/watch?v=UJ1QAKprVr4
As the engineering teams at Squarespace grow, we have been building more and more microservices. However, this has added operational strain as we try to shoehorn a growing, complex dynamic environment into our static data center infrastructure. We needed to rethink how we handle deployments, dependency management, resource allocation, monitoring, and alerting. Docker containerization and Kubernetes orchestration helps us tackle many of these problems, but the journey has been challenging. In this talk, we’ll discuss the challenges of running Kubernetes in a datacenter and how we switched to a more SLA-focused alert structure than per instance health with Prometheus and AlertManager.
Kubernetes 1.12 Update and Container Security with Liz RiceCloudOps2005
The latest Kubernetes and Cloud Native Meetup took place in Montreal on October 4th, 2018. Ayrat Khayretdinov introduced the latest highlights from the Cloud Native landscape and Liz Rice discussed various ways that DevOps engineers can implement security into their applications.
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthNicolas Brousse
TubeMogul grew from few servers to over two thousands servers and handling over one trillion http requests a month, processed in less than 50ms each. To keep up with the fast growth, the SRE team had to implement an efficient Continuous Delivery infrastructure that allowed to do over 10,000 puppet deployment and 8,500 application deployment in 2014. In this presentation, we will cover the nuts and bolts of the TubeMogul operations engineering team and how they overcome challenges.
Initial presentation of openstack (for montreal user group)Marcos García
Introduction to Openstack: basic concepts, latest Havana project release, cloud terminology (including IaaS, PaaS and SaaS). This presentation was shown in the first Openstack Montreal user group in November 19 2013 (http://montrealopenstack.org/)
Kubernetes @ Squarespace (SRE Portland Meetup October 2017)Kevin Lynch
In this presentation I talk about our motivation to converting our microservices to run on Kubernetes. I discuss many of the technical challenges we encountered along the way, including networking issues, Java issues, monitoring and alerting, and managing all of our resources!
Agenda:
What is Software Defined Storage?
What is Ceph?
What is Rook?
Storage for Kubernetes
Storage Classes
Storage on Kubernetes
Operator Pattern
Custom Resource Definition
Rook Operator
Rook architecture
Ceph on Kubernetes with Rook
Demo
Rook Framework for Storage solutions
How to Get Involved?
SkySQL implements a groundbreaking, state-of-the-art architecture based on Kubernetes and ServiceNow, and with a strong emphasis on cloud security – using compartmentalization and indirect access to secure and protect customer databases.
In this session, we’ll walk through the architecture of SkySQL and discuss how MariaDB leverages an advanced Kubernetes operator and powerful ServiceNow configuration/workflow management to deploy and manage databases on cloud infrastructure.
The OpenEBS Hangout #4 was held on 22nd December 2017 at 11:00 AM (IST and PST) where a live demo of cMotion was shown . Storage policies of OpenEBS 0.5 were also explained
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?XfilesPro
Worried about document security while sharing them in Salesforce? Fret no more! Here are the top-notch security standards XfilesPro upholds to ensure strong security for your Salesforce documents while sharing with internal or external people.
To learn more, read the blog: https://www.xfilespro.com/how-does-xfilespro-make-document-sharing-secure-and-seamless-in-salesforce/
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...informapgpstrackings
Keep tabs on your field staff effortlessly with Informap Technology Centre LLC. Real-time tracking, task assignment, and smart features for efficient management. Request a live demo today!
For more details, visit us : https://informapuae.com/field-staff-tracking/
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I didn't get rich from it but it did have 63K downloads (powered possible tens of thousands of websites).
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have.
For more Tendenci AMS events, check out www.tendenci.com/events
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
7. The Icehouse Release
Focus on the user (customer) and the operators
Operational enhancements (upgradability, manageability)
Lots of bug fixes and stability improvements
Integration/incubation of even more services (18!)
Check out the latest User Survey
http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey
8. Current User’s interests (according to survey)
● Stability of core should be a priority above adding new functions
● Add how-to guides, problem management documentation, expire old documentation, end
user guide (but much less than previous surveys)
● Zero downtime migrations
● Installation and configuration
● Cross Project consistency with APIs, SDKs and CLIs
● High availabilityVMs
● Neutron stability, simplification, resilience, IPv6 and scalability
● Improved function and usability in Horizon
● Security, auditing
● AWS/EC2 compatibility
10. Swift
● Discoverable-capabilities
○ Supports the /info URL, which reports back the cluster supported features and status.
● Persistent system metadata
○ Performed at a system-level (i.e. xattr), will allow advanced middleware operations, like on demand migration or
server side encryption
● Diskfile abstraction
○ Different storage implementation (besides regular filesystem), like gluster or Seagate Kinetic
● Storage policies
○ For all rings (accounts, containers, objects)
○ Allows different replication schemas
○ Future user-defined erasure encoding support
● Account level ACL and ACL v2 (JSON format)
● Ssync replication (alternative to rsync)
○ It will allow future improvements of replication subsystem
● Automatic retry on read failures
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
11. Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
Nova
● Better upgrade support (i.e. rolling upgrade)
● Some small features added to Hyper-V, Xen, VMWare backends
● KVM enhancements
○ Passing of boot-time kernel arguments stored in glance metadata
○ Virtio-scsi instead of virtio-blk
○ Virtio-rng (random number generator)
○ Specify video device
○ Watchdog device
○ better Neutron events handling and integration
● Scheduler
○ Server instance groups: affinity and anti-affinity filters
○ New host affinity filter according to namespaces found in image metadata
○ Improved weight normalization (free RAM or used CPU priorities)
○ Work in progress: split scheduler from Nova, new Gantt project
● Exposure of the hypervisor IP address
● XML support deprecated
● Other features
○ More and better notifications
○ File injection deprecated: use ConfigDrives or metatada servers (cloud-init) instead
○ Docker driver code moved to another repository (considered now as a plugin)
12. Glance
● Improved calculation of image usage quotas (ignore deleted images)
● New concept of ‘image location’ for faster consommation
● Splitting of size in 2 concepts: image_size (compressed or QCOW2) and virtual_size
(exploded or RAW)
● Fix to JSON pointer syntax (0-based instead of 1-based)
● VMWare backend improvement
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
13. Horizon
● i18n: Horizon is now available in Hindi, German and Serbian. Updated translations for
Australian English, British English, Dutch, French, Japanese, Korean, Polish, Portuguese,
Simplified and Traditional Chinese, Spanish and Russian.
● Ceilometer reports
● Other
○ Django 1.6
○ RDP console support
○ AngularJS as frontend
● UX
○ UI updated
○ Navigation enhancements
○ Wizard for multi-step operations
○ Inline table edits
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
14. Keystone
● New v3 API features (v2 still considered stable)
○ Federated athentication via Shibboleth
○ Password change
● Backend separation:
○ assignment backend (authorization data, i.e. in SQL)
○ identity backend (authentication data, i.e. in LDAP)
● KVS driver supports more backends: Redis, Cassandra or MongoDB
● Group-based role assignment when using LDAP
● Handle external authentication via REMOTE_USER (multi-domain deployments)
● Upgrade notes
○ S3 token middleware deprecated
○ Default token expiration reduced from 24h to 1h
● Other
○ Events revocation
○ Keystone event audits for record (CADF)
○ Regions API: allow deployers to specify a hierarchy of deployment regions
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
15. Neutron
● New drivers
○ General: IBM SDN-VE, Nuage, OpenConvergence, OpenDaylight
○ LBaaS: Embrane, NetScaler, Radware
○ VPNaaS: Cisco CSR
● Improve functional testing in Tempest, mandatory QA for all drivers
● Deprecation of Linux Bridge and OVS plugins, use ML2
● Nova notifications and better integration
● XML format deprecation, use JSON
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
16. Cinder
● Change the type of an existing volume on-the-fly
● Import/export backups
● Support for metadata in backup objects
● Delete quota for a specific tenant
● New Fiber Channel Zone manager
● Update encryption of volumes
● Ceilometer notifications
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
17. Ceilometer
● Alarming improvements
○ Time-constrained alarms
■ i.e. higher bars on weekdays, more relaxed at night or weekends)
○ Exclude weak samples, those with abnormal low values
○ Derived rate-based meters (like IOPS, kbps, etc)
● Feature parity in storage backends HBase, SQLAlchemy and DB2 Drivers
● Upgrade notes
○ Split from collector a new notification agent
○ New pipeline configuration (decouple sources from sinks)
■ allows pluggable resource discovery
● API
○ Complex filter expression in API query.
○ Direct API to samples
○ New aggregate functions for statistics, like standard deviation
● New metric sources
○ Neutron north-bound API on SDN controller
○ VMware vCenter Server API
○ SNMP daemons on baremetal hosts
○ OpenDaylight REST APIs
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
18. Heat
● New HOT format (yaml) is now the preferred vs CFN format (json)
● A lot of new resouces: software configuration, autoscaling, openstack resources
● Non-admin usage of Heat (requires keystone domains)
● New operator API
● Stack abandon and adopt without affecting the actual resources
● More notifications, for events or triggers
● Stack preview: simulate a stack creation
● File inclusion (i.e. cloud-init)
● The preferred ‘Deferred authentication method’ is now Trust, avoids passwords in templates
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
19. Trove
● User/Schema management for MySQL backend via the Trove API
● Resize support for both Trove instance flavor and linked cinder volumes
● Multiple datastore support
○ Full support: MySQL and Percona
○ Experimental: MongoDB, Redis, Cassandra and CouchBase
● Configuration groups, to apply them to a set of instances
● Backups and Restore support (full or incremental), leverages Swift containers
● Optional DNS support via Designate
Nova
Glance
Horizon
Keystone
Neutron
Cinder
Ceilometer
Heat
Trove
Swift
21. ● Ironic (Baremetal provisioning)
○ Stable release in IceHouse
○ Distribution of nodes being provisioned to avoid saturation
○ Maintenance mode for temporary node decomission
○ Periodically poll for power status of all nodes, enforce OFF status for unresponsive ones (IPMI)
● Marconi (message/notifications -aaS)
○ Codebase from Rackspace Cloud Queues. Version 1.0 ready
○ Support for multiple patterns (pub/sub for notifications, producer/consumer for tasks)
22. ● Sahara (Hadoop -aaS) - old Savanna
○ New for icehouse: incubated requirements fullfilled (gates, tempest, etc)
○ Heat provisioning support
○ Hadoop 2.x support
○ Interesting features:
■ Swift storage for Hadoop clusters
■ Define cluster attribures via API (i.e. heap memory, cluster size)
■ Full support for multiple job formats (hive, pig, jar-file, etc)
● Barbican (secret management -aaS)
○ Part of a bigger CloudKeep project. Deals with simmetric key, assymetric key or Raw secrets
○ Supports transparent encryption for Cinder volumes. Swift objects too
○ Message signing
○ Support extra features via other tools: KIMP, Symantec CA (SSL certs), Dogtag, certmonger
24. ● Oslo
○ more and more stuff :)
● TripleO
○ Major feature improvements. Now part of HP Helion installer
○ Use of Ironic for bare metal provisoning
○ diskimage-build as a tool for golden images
○ Tuskar as a dedicated project for controlled provisioning/orchestration of cloud resources
● Devstack
● QA projects
○ Tempest
○ Gerrit & Jenkins
○ Gating & Zuul
26. ● Designate
○ DNS as a Service - similar to Route 53
● Manila
○ Filesystem as a Service (NFS/CIFS)
● Rally
○ Benchmarking for Openstack (automated deployment/tempest verification/performance benchmarking)
● Blazar (Climate)
○ Reource reservation / capacity leasing
● Anvil
○ Refactored devstack, sort of a packaging tool for Openstack
● Satori
○ Configuration discovery (inspection of VMs, network settings, etc)
● Libra
○ Advanced LBaaS, configures HAProxy clusters using Nova VMs
● Gantt
○ Advanced Scheduling for Nova (VM placement)
● Mistral - TaskFlow
○ Like Amazon SWF, Workflow as a service: task scheduling (cron), environment deployment, long-running processes...
● Congress
○ Policy as a service: ensure business-defined policies and governance across cloud users
28. Don’t have ‘one PaaS to rule them all’ yet
● Solum
● CloudFoundry and its variants (pivotal, stackato, etc)
● Openshift
● Juju
● Cloudify
● AppScale
● Based on just Docker
○ Project Atomic
○ CoreOS
○ Deis.io
○ Dokku
○ Decker (for CloudFoundry)
○ flynn.io
○ maestrodev
(Note: as the definition of PaaS is vage, so is the classification, we included here Ops orchestration tools as well)