Xtrabackup and FTWRL
•
1 like•1,469 views
The document discusses Xtrabackup and FTWRL (Flush Tables With Read Lock). It describes how Xtrabackup works by taking consistent backups without locking tables for long durations. It also explains how FTWRL is used to get a consistent snapshot of databases during backups and replication. The document notes that while locking has benefits, alternatives like no-lock backups are being explored to avoid issues with DDL statements and non-transactional operations during backups. It concludes by inviting questions from the audience.
Report
Share
Report
Share
Download to read offline
Recommended
The need for speed. What is GraalVM? – 4Developers Wrocław 2019
GraalVM is a recent development from Oracle. It's supposed to replace HotSpot just-in-time compiler technology, but actually, it's much more. From a JIT compiler to a language implementation framework for JVM to a native image generator, it's going to change how software for JVM is written and run.
Intro to Node.js
This document introduces Node.js as a server-side JavaScript framework that uses non-blocking I/O and event-driven architecture. It runs the latest ECMAScript 5 JavaScript features and uses the Google V8 engine and CommonJS module system. Examples shown include file/process interaction, web servers, reverse proxies, and websockets. The document also discusses Node package manager (npm), popular Node.js modules, hosting options, current limitations, and how to get involved in the Node.js community.
Oreilly Webcast Jun17
This document provides step-by-step instructions for setting up a MySQL Cluster sandbox. It discusses MySQL Cluster concepts like NDB storage engine, ndbd nodes, and ndb_mgmd monitor nodes. It also covers configuration, performance considerations, limitations, and joining data from different storage engines. The conclusion is that MySQL Cluster provides unique database clustering with some features and limitations, and performance must be tested thoroughly.
Ops Skills and Tools for Beginners [#MongoDB World 2014]
Originally presented at MongoDB World 2014. This is an introduction to Ops with MongoDB aimed at Developers and people who haven't run MongoDB in production before. It covers some basics of servers, hosting, installation, monitoring and backups.
PLAM 2015 - Evolving Backups Strategy, Devploying pyxbackup
Not all backup requirements are the same, there are simple backups and then there are complex backup and recovery strategies. After working with hundreds of users laying out the ground work, we've decided that although not all installations are the same, all of them run through the same procedure so we have decided to automate most of this things with pyxbackup. This talk will highlight the evolution of the project from the most basic backup implementation to extending capabilities for different scenarios like compression, remote storage, encryption and being a portable, comprehensible backup utility for the novice and experts alike.
The pyxbackup project can be found at:
https://github.com/dotmanila/pyxbackup
Bsdtw17: mariusz zaborski: case studies of sandboxing base system with capsicum
This document discusses the Capsicum capability model and its use in sandboxing systems in FreeBSD. Capsicum allows tight sandboxing by limiting access when a process enters capability mode using cap_enter(). It describes debugging capabilities like ktrace and enotcap. It also introduces Casper, which provides additional capabilities through delegation before entering capability mode. Casper allows easier process separation by creating services run with user privileges that processes can then securely access through APIs. The document outlines several system services implemented through Casper and future work integrating it more fully with libc and sandboxing additional system services.
Mysql
Mysql replication allows data to be replicated from a master database server to slave database servers. It works by having the master record all write queries to its binary log which is then used by slaves to replicate the same queries. Replication can be synchronous for high data integrity or asynchronous for higher performance. Configuring replication involves setting up a replication user on the master, enabling binary logging, taking a snapshot of data, and configuring the slaves to connect to the master and replay the binary logs.
RVM, Bundler and Ruby Tracker
RVM allows installing and managing multiple Ruby environments and gemsets. The author had a mismatch between their Ruby and Rails versions that caused issues. They installed RVM and used it to install Ruby 1.8.6 and keep gems separate for different projects. Bundler works with RVM to specify gems in a Gemfile and ensure consistent dependencies. Creating an .rvmrc file sets the Ruby version and gemset for a project directory.
Recommended
The need for speed. What is GraalVM? – 4Developers Wrocław 2019
GraalVM is a recent development from Oracle. It's supposed to replace HotSpot just-in-time compiler technology, but actually, it's much more. From a JIT compiler to a language implementation framework for JVM to a native image generator, it's going to change how software for JVM is written and run.
Intro to Node.js
This document introduces Node.js as a server-side JavaScript framework that uses non-blocking I/O and event-driven architecture. It runs the latest ECMAScript 5 JavaScript features and uses the Google V8 engine and CommonJS module system. Examples shown include file/process interaction, web servers, reverse proxies, and websockets. The document also discusses Node package manager (npm), popular Node.js modules, hosting options, current limitations, and how to get involved in the Node.js community.
Oreilly Webcast Jun17
This document provides step-by-step instructions for setting up a MySQL Cluster sandbox. It discusses MySQL Cluster concepts like NDB storage engine, ndbd nodes, and ndb_mgmd monitor nodes. It also covers configuration, performance considerations, limitations, and joining data from different storage engines. The conclusion is that MySQL Cluster provides unique database clustering with some features and limitations, and performance must be tested thoroughly.
Ops Skills and Tools for Beginners [#MongoDB World 2014]
Originally presented at MongoDB World 2014. This is an introduction to Ops with MongoDB aimed at Developers and people who haven't run MongoDB in production before. It covers some basics of servers, hosting, installation, monitoring and backups.
PLAM 2015 - Evolving Backups Strategy, Devploying pyxbackup
Not all backup requirements are the same, there are simple backups and then there are complex backup and recovery strategies. After working with hundreds of users laying out the ground work, we've decided that although not all installations are the same, all of them run through the same procedure so we have decided to automate most of this things with pyxbackup. This talk will highlight the evolution of the project from the most basic backup implementation to extending capabilities for different scenarios like compression, remote storage, encryption and being a portable, comprehensible backup utility for the novice and experts alike.
The pyxbackup project can be found at:
https://github.com/dotmanila/pyxbackup
Bsdtw17: mariusz zaborski: case studies of sandboxing base system with capsicum
This document discusses the Capsicum capability model and its use in sandboxing systems in FreeBSD. Capsicum allows tight sandboxing by limiting access when a process enters capability mode using cap_enter(). It describes debugging capabilities like ktrace and enotcap. It also introduces Casper, which provides additional capabilities through delegation before entering capability mode. Casper allows easier process separation by creating services run with user privileges that processes can then securely access through APIs. The document outlines several system services implemented through Casper and future work integrating it more fully with libc and sandboxing additional system services.
Mysql
Mysql replication allows data to be replicated from a master database server to slave database servers. It works by having the master record all write queries to its binary log which is then used by slaves to replicate the same queries. Replication can be synchronous for high data integrity or asynchronous for higher performance. Configuring replication involves setting up a replication user on the master, enabling binary logging, taking a snapshot of data, and configuring the slaves to connect to the master and replay the binary logs.
RVM, Bundler and Ruby Tracker
RVM allows installing and managing multiple Ruby environments and gemsets. The author had a mismatch between their Ruby and Rails versions that caused issues. They installed RVM and used it to install Ruby 1.8.6 and keep gems separate for different projects. Bundler works with RVM to specify gems in a Gemfile and ensure consistent dependencies. Creating an .rvmrc file sets the Ruby version and gemset for a project directory.
Orchestrating Cassandra with Kubernetes Operator and PaaSTA
Video URL: https://youtu.be/GjI6MUz7AyE
This is the slide deck of the Percona Live Online 2020 talk given by me in May 2020: https://www.percona.com/resources/videos/orchestrating-cassandra-kubernetes-operator-and-yelp-paasta-percona-live-online
The talk delves into the architecture of our Cassandra Kubernetes Operator and the multi-region multi-AZ clusters it manages, and strategies we have in place for safe rollouts and zero-downtime migration.
Orchestrating Cassandra with Kubernetes
This talk was given at Cassandra London meetup: https://www.meetup.com/Cassandra-London/events/267271963/ . The talk is about orchestration of Cassandra with our Kubernetes Operator and Yelp PaaSTA. We also outline some of the opportunities and challenges associated with this architecture.
Youtube link: https://www.youtube.com/watch?v=JqAILFkkibA
Cassandra Operator with Yelp PaaSTA
This talk is about orchestration of Cassandra on Kubernetes with Cassandra Operator and Yelp's Platform-as-a-Service: PaaSTA. The talk focusses specifically on the internals of cassandra operator and its core reconcile loop for reconciliation of cluster state and on-disk configuration.
Safe and Fast Automation on AWS for Fun and Profit
This is a talk about safe and high velocity automation on AWS (Amazon Web Services) with AWS Systems Manager, and is applicable for use cases such as reliability engineering and deployment automation.
Orchestrating Cassandra with Kubernetes: Challenges and Opportunities
This is a talk about orchestration of Cassandra with cassandra operator, kubernetes and Yelp PaaSTA (https://github.com/Yelp/paasta).
The talk was presented at Computer Laboratory, University of Cambridge as part of the Engineering, Science and Technology Event (https://www.careers.cam.ac.uk/recruiting/event2Tech.asp) in November 2019.
Pass Elk: CAP Theorem since 90s and Beyond
This talk is about CAP theorem since its inception in 90s, and the PACELC theorem which followed it, and the present.
Cassandra in Docker at Yelp: Opportunities and Challenges
Cassandra in Docker talk was given at London Docker Meetup in May 2019.
Youtube: https://www.youtube.com/watch?v=1TshTqk2J2M&t=7s
Taskerman: A Distributed Cluster Task Manager
This is the talk presented at Percona Live 2018: https://www.percona.com/live/18/sessions/taskerman-a-distributed-cluster-task-manager
Taskerman - a distributed cluster task manager
This talk is about Taskerman, a distributed cluster task manager built on top of AWS SQS, Zookeeper and Yelp PaaSTA. The talk was given at Imperial College, London as part of its 'Application of Computing in Industry' series: http://www.imperial.ac.uk/computing/industry/aci/yelp/
NUMA and Java Databases
Talk given on state of NUMA with Java databases such as Cassandra and how it can improved / ameliorated, and compared with traditional storage engines.
Linux NUMA & Databases: Perils and Opportunities
This talk is about linux NUMA (non-uniform memory access), how it works, issues with it, how databases can fail or benefit from it.
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes
Raghavendra Prabhu presented on orchestrating Percona XtraDB Cluster (PXC) with Kubernetes. Some key points:
- Kubernetes provides horizontal scaling, self-healing, automated rollouts/rollbacks, service discovery, storage orchestration and more.
- In Kubernetes, PXC nodes would be deployed as pods with a replication controller to maintain a set number of pods. Services provide load balancing to the pods.
- Demonstrated deploying a basic PXC cluster on Kubernetes, including creating a network, cluster, service, replicating pods from a template, and exposing ports.
- Challenges include load balancing for state transfers between nodes and ensuring nodes are
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes.
The talk presented at MySQL & Friends devroom at FOSDEM 2016 in Brussels: https://fosdem.org/2016/schedule/event/clusternaut/
Devroom: https://fosdem.org/2016/schedule/track/mysql_and_friends/
Working from home - fun, facts and scares!
Gone are those days when companies used to be strictly colocated in a single office. Distributed workplaces are gradually becoming the norm than an exception. So, it is essential that we talk more about it and discuss it.
So, this talk is essentially about:
a) Productivity and working from home.
b) Scheduling flexibility.
c) Challenges in communication and ways to overcome them.
d) Ways of getting such a job and Open Source.
e) Measuring work and micro-management
f) Feeling of detachment and workarounds for it.
To sum up, I will make this talk a very informative and entertaining one, as a lightning talk ought to be.
Securing databases with systemd for containers and services
Data is the most valuable entity associated with a system, particularly when it is a sensitive one. Not only are there threats associated with physical access
to the box, but also ones where logical access suffices - sql injections etc.
Vulnerabilities like shellshock and heartbleed have also shown that an exploit in one component can also be used to access others through buffer overflows, memory overruns etc. and/or impact the immunity of system severely.
This is where "Principle of least privilege" comes into play. Wikipedia defines it as "a particular abstraction layer of a computing environment, every module (such as a process, a user or a program depending on the subject) must be able to access only the information and resources that are necessary for its legitimate purpose".
Corpus collapsum: Partition tolerance testing of Galera with Docker and NetEm
This talk is about partition tolerance and chaos testing of a Galera cluster with Docker containers and NetEm.
Dock'em: Distributed Systems Testing with NetEm and Docker
This talk is about distributed systems testing of Galera with NetEm and Docker!
Video of the talk: https://www.youtube.com/watch?v=YBuuvhSO38s&list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2&index=1
Playlist: https://www.youtube.com/playlist?list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2
Galera with Docker: How Synchronous Replication and Linux Containers mesh tog...
How Galera (Synchronous replication plugin for Percona XtraDB Cluster) can be used with Docker (or linux containers in general) to 'mesh' well.
Video of the talk: https://www.youtube.com/watch?v=3A8EF549Q3Y&list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2&index=2
Playlist: http://www.youtube.com/playlist?list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2
Jutsu or Dô: Open documentation: continuous process than a body
The document discusses various factors to consider for effective documentation of open source projects. It emphasizes that lucid documentation can help with rapid community growth, attracting more contributors, enhancing code quality, and aiding bug fixes. Conversely, poor documentation can repel users, lead to less understood code, slow project growth, and cause spurious bug reports. Some highlighted factors include keeping documentation up-to-date, using version control, integrating feedback, examples to aid learning, and considering different user types like end users, developers and architects.
Corpus collapsum: Partition tolerance of Galera in a noisy high load environment
This is the talk given at Highload++ 2014 in Moscow, Russia. The topic was partition tolerance testing of Galera in a noisy high load environment with NetEm and Docker.
What is an RPA CoE? Session 2 – CoE Roles
In this session, we will review the players involved in the CoE and how each role impacts opportunities.
Topics covered:
• What roles are essential?
• What place in the automation journey does each role play?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
GNSS spoofing via SDR (Criptored Talks 2024)
In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security.
This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing.
The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.
More Related Content
More from Raghavendra Prabhu
Orchestrating Cassandra with Kubernetes Operator and PaaSTA
Video URL: https://youtu.be/GjI6MUz7AyE
This is the slide deck of the Percona Live Online 2020 talk given by me in May 2020: https://www.percona.com/resources/videos/orchestrating-cassandra-kubernetes-operator-and-yelp-paasta-percona-live-online
The talk delves into the architecture of our Cassandra Kubernetes Operator and the multi-region multi-AZ clusters it manages, and strategies we have in place for safe rollouts and zero-downtime migration.
Orchestrating Cassandra with Kubernetes
This talk was given at Cassandra London meetup: https://www.meetup.com/Cassandra-London/events/267271963/ . The talk is about orchestration of Cassandra with our Kubernetes Operator and Yelp PaaSTA. We also outline some of the opportunities and challenges associated with this architecture.
Youtube link: https://www.youtube.com/watch?v=JqAILFkkibA
Cassandra Operator with Yelp PaaSTA
This talk is about orchestration of Cassandra on Kubernetes with Cassandra Operator and Yelp's Platform-as-a-Service: PaaSTA. The talk focusses specifically on the internals of cassandra operator and its core reconcile loop for reconciliation of cluster state and on-disk configuration.
Safe and Fast Automation on AWS for Fun and Profit
This is a talk about safe and high velocity automation on AWS (Amazon Web Services) with AWS Systems Manager, and is applicable for use cases such as reliability engineering and deployment automation.
Orchestrating Cassandra with Kubernetes: Challenges and Opportunities
This is a talk about orchestration of Cassandra with cassandra operator, kubernetes and Yelp PaaSTA (https://github.com/Yelp/paasta).
The talk was presented at Computer Laboratory, University of Cambridge as part of the Engineering, Science and Technology Event (https://www.careers.cam.ac.uk/recruiting/event2Tech.asp) in November 2019.
Pass Elk: CAP Theorem since 90s and Beyond
This talk is about CAP theorem since its inception in 90s, and the PACELC theorem which followed it, and the present.
Cassandra in Docker at Yelp: Opportunities and Challenges
Cassandra in Docker talk was given at London Docker Meetup in May 2019.
Youtube: https://www.youtube.com/watch?v=1TshTqk2J2M&t=7s
Taskerman: A Distributed Cluster Task Manager
This is the talk presented at Percona Live 2018: https://www.percona.com/live/18/sessions/taskerman-a-distributed-cluster-task-manager
Taskerman - a distributed cluster task manager
This talk is about Taskerman, a distributed cluster task manager built on top of AWS SQS, Zookeeper and Yelp PaaSTA. The talk was given at Imperial College, London as part of its 'Application of Computing in Industry' series: http://www.imperial.ac.uk/computing/industry/aci/yelp/
NUMA and Java Databases
Talk given on state of NUMA with Java databases such as Cassandra and how it can improved / ameliorated, and compared with traditional storage engines.
Linux NUMA & Databases: Perils and Opportunities
This talk is about linux NUMA (non-uniform memory access), how it works, issues with it, how databases can fail or benefit from it.
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes
Raghavendra Prabhu presented on orchestrating Percona XtraDB Cluster (PXC) with Kubernetes. Some key points:
- Kubernetes provides horizontal scaling, self-healing, automated rollouts/rollbacks, service discovery, storage orchestration and more.
- In Kubernetes, PXC nodes would be deployed as pods with a replication controller to maintain a set number of pods. Services provide load balancing to the pods.
- Demonstrated deploying a basic PXC cluster on Kubernetes, including creating a network, cluster, service, replicating pods from a template, and exposing ports.
- Challenges include load balancing for state transfers between nodes and ensuring nodes are
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes.
The talk presented at MySQL & Friends devroom at FOSDEM 2016 in Brussels: https://fosdem.org/2016/schedule/event/clusternaut/
Devroom: https://fosdem.org/2016/schedule/track/mysql_and_friends/
Working from home - fun, facts and scares!
Gone are those days when companies used to be strictly colocated in a single office. Distributed workplaces are gradually becoming the norm than an exception. So, it is essential that we talk more about it and discuss it.
So, this talk is essentially about:
a) Productivity and working from home.
b) Scheduling flexibility.
c) Challenges in communication and ways to overcome them.
d) Ways of getting such a job and Open Source.
e) Measuring work and micro-management
f) Feeling of detachment and workarounds for it.
To sum up, I will make this talk a very informative and entertaining one, as a lightning talk ought to be.
Securing databases with systemd for containers and services
Data is the most valuable entity associated with a system, particularly when it is a sensitive one. Not only are there threats associated with physical access
to the box, but also ones where logical access suffices - sql injections etc.
Vulnerabilities like shellshock and heartbleed have also shown that an exploit in one component can also be used to access others through buffer overflows, memory overruns etc. and/or impact the immunity of system severely.
This is where "Principle of least privilege" comes into play. Wikipedia defines it as "a particular abstraction layer of a computing environment, every module (such as a process, a user or a program depending on the subject) must be able to access only the information and resources that are necessary for its legitimate purpose".
Corpus collapsum: Partition tolerance testing of Galera with Docker and NetEm
This talk is about partition tolerance and chaos testing of a Galera cluster with Docker containers and NetEm.
Dock'em: Distributed Systems Testing with NetEm and Docker
This talk is about distributed systems testing of Galera with NetEm and Docker!
Video of the talk: https://www.youtube.com/watch?v=YBuuvhSO38s&list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2&index=1
Playlist: https://www.youtube.com/playlist?list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2
Galera with Docker: How Synchronous Replication and Linux Containers mesh tog...
How Galera (Synchronous replication plugin for Percona XtraDB Cluster) can be used with Docker (or linux containers in general) to 'mesh' well.
Video of the talk: https://www.youtube.com/watch?v=3A8EF549Q3Y&list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2&index=2
Playlist: http://www.youtube.com/playlist?list=PLctlsn9Gs8wbx47tuhxuNytdrsDf_LWI2
Jutsu or Dô: Open documentation: continuous process than a body
The document discusses various factors to consider for effective documentation of open source projects. It emphasizes that lucid documentation can help with rapid community growth, attracting more contributors, enhancing code quality, and aiding bug fixes. Conversely, poor documentation can repel users, lead to less understood code, slow project growth, and cause spurious bug reports. Some highlighted factors include keeping documentation up-to-date, using version control, integrating feedback, examples to aid learning, and considering different user types like end users, developers and architects.
Corpus collapsum: Partition tolerance of Galera in a noisy high load environment
This is the talk given at Highload++ 2014 in Moscow, Russia. The topic was partition tolerance testing of Galera in a noisy high load environment with NetEm and Docker.
More from Raghavendra Prabhu (20)
Orchestrating Cassandra with Kubernetes Operator and PaaSTA
Orchestrating Cassandra with Kubernetes Operator and PaaSTA
Safe and Fast Automation on AWS for Fun and Profit
Safe and Fast Automation on AWS for Fun and Profit
Orchestrating Cassandra with Kubernetes: Challenges and Opportunities
Orchestrating Cassandra with Kubernetes: Challenges and Opportunities
Cassandra in Docker at Yelp: Opportunities and Challenges
Cassandra in Docker at Yelp: Opportunities and Challenges
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes.
Clusternaut: Orchestrating Percona XtraDB Cluster with Kubernetes.
Securing databases with systemd for containers and services
Securing databases with systemd for containers and services
Corpus collapsum: Partition tolerance testing of Galera with Docker and NetEm
Corpus collapsum: Partition tolerance testing of Galera with Docker and NetEm
Dock'em: Distributed Systems Testing with NetEm and Docker
Dock'em: Distributed Systems Testing with NetEm and Docker
Galera with Docker: How Synchronous Replication and Linux Containers mesh tog...
Galera with Docker: How Synchronous Replication and Linux Containers mesh tog...
Jutsu or Dô: Open documentation: continuous process than a body
Jutsu or Dô: Open documentation: continuous process than a body
Corpus collapsum: Partition tolerance of Galera in a noisy high load environment
Corpus collapsum: Partition tolerance of Galera in a noisy high load environment
Recently uploaded
What is an RPA CoE? Session 2 – CoE Roles
In this session, we will review the players involved in the CoE and how each role impacts opportunities.
Topics covered:
• What roles are essential?
• What place in the automation journey does each role play?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
GNSS spoofing via SDR (Criptored Talks 2024)
In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security.
This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing.
The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Tomaz Bratanic
Graph ML and GenAI Expert - Neo4j
Northern Engraving | Nameplate Manufacturing Process - 2024
Manufacturing custom quality metal nameplates and badges involves several standard operations. Processes include sheet prep, lithography, screening, coating, punch press and inspection. All decoration is completed in the flat sheet with adhesive and tooling operations following. The possibilities for creating unique durable nameplates are endless. How will you create your brand identity? We can help!
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
How we managed to grow and scale a RAG application from zero to thousands of users in 7 months. Lessons from technical challenges around managing high load for LLMs, RAGs and Vector databases.
Leveraging the Graph for Clinical Trials and Standards
Katja Glaß
OpenStudyBuilder Community Manager - Katja Glaß Consulting
Marius Conjeaud
Principal Consultant - Neo4j
From Natural Language to Structured Solr Queries using LLMs
This talk draws on experimentation to enable AI applications with Solr. One important use case is to use AI for better accessibility and discoverability of the data: while User eXperience techniques, lexical search improvements, and data harmonization can take organizations to a good level of accessibility, a structural (or “cognitive” gap) remains between the data user needs and the data producer constraints.
That is where AI – and most importantly, Natural Language Processing and Large Language Model techniques – could make a difference. This natural language, conversational engine could facilitate access and usage of the data leveraging the semantics of any data source.
The objective of the presentation is to propose a technical approach and a way forward to achieve this goal.
The key concept is to enable users to express their search queries in natural language, which the LLM then enriches, interprets, and translates into structured queries based on the Solr index’s metadata.
This approach leverages the LLM’s ability to understand the nuances of natural language and the structure of documents within Apache Solr.
The LLM acts as an intermediary agent, offering a transparent experience to users automatically and potentially uncovering relevant documents that conventional search methods might overlook. The presentation will include the results of this experimental work, lessons learned, best practices, and the scope of future work that should improve the approach and make it production-ready.
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
This LF Energy webinar took place June 20, 2024. It featured:
-Alex Thornton, LF Energy
-Hallie Cramer, Google
-Daniel Roesler, UtilityAPI
-Henry Richardson, WattTime
In response to the urgency and scale required to effectively address climate change, open source solutions offer significant potential for driving innovation and progress. Currently, there is a growing demand for standardization and interoperability in energy data and modeling. Open source standards and specifications within the energy sector can also alleviate challenges associated with data fragmentation, transparency, and accessibility. At the same time, it is crucial to consider privacy and security concerns throughout the development of open source platforms.
This webinar will delve into the motivations behind establishing LF Energy’s Carbon Data Specification Consortium. It will provide an overview of the draft specifications and the ongoing progress made by the respective working groups.
Three primary specifications will be discussed:
-Discovery and client registration, emphasizing transparent processes and secure and private access
-Customer data, centering around customer tariffs, bills, energy usage, and full consumption disclosure
-Power systems data, focusing on grid data, inclusive of transmission and distribution networks, generation, intergrid power flows, and market settlement data
Demystifying Knowledge Management through Storytelling
The Department of Veteran Affairs (VA) invited Taylor Paschal, Knowledge & Information Management Consultant at Enterprise Knowledge, to speak at a Knowledge Management Lunch and Learn hosted on June 12, 2024. All Office of Administration staff were invited to attend and received professional development credit for participating in the voluntary event.
The objectives of the Lunch and Learn presentation were to:
- Review what KM ‘is’ and ‘isn’t’
- Understand the value of KM and the benefits of engaging
- Define and reflect on your “what’s in it for me?”
- Share actionable ways you can participate in Knowledge - - Capture & Transfer
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops Opensource Database Meetup 16
Topic: Must-Know PostgreSQL Extensions for Developers and DBAs During Migration
Speaker: Deepak Mahto, Founder of DataCloudGaze Consulting
Date & Time: 8th June | 10 AM - 1 PM IST
Venue: Bangalore International Centre, Bangalore
Abstract: Discover how PostgreSQL extensions can be your secret weapon! This talk explores how key extensions enhance database capabilities and streamline the migration process for users moving from other relational databases like Oracle.
Key Takeaways:
* Learn about crucial extensions like oracle_fdw, pgtt, and pg_audit that ease migration complexities.
* Gain valuable strategies for implementing these extensions in PostgreSQL to achieve license freedom.
* Discover how these key extensions can empower both developers and DBAs during the migration process.
* Don't miss this chance to gain practical knowledge from an industry expert and stay updated on the latest open-source database trends.
Mydbops Managed Services specializes in taking the pain out of database management while optimizing performance. Since 2015, we have been providing top-notch support and assistance for the top three open-source databases: MySQL, MongoDB, and PostgreSQL.
Our team offers a wide range of services, including assistance, support, consulting, 24/7 operations, and expertise in all relevant technologies. We help organizations improve their database's performance, scalability, efficiency, and availability.
Contact us: info@mydbops.com
Visit: https://www.mydbops.com/
Follow us on LinkedIn: https://in.linkedin.com/company/mydbops
For more details and updates, please follow up the below links.
Meetup Page : https://www.meetup.com/mydbops-databa...
Twitter: https://twitter.com/mydbopsofficial
Blogs: https://www.mydbops.com/blog/
Facebook(Meta): https://www.facebook.com/mydbops/
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
This is a session that details how PostgreSQL's features and Azure AI Services can be effectively used to significantly enhance the search functionality in any application.
In this session, we'll share insights on how we used PostgreSQL to facilitate precise searches across multiple fields in our mobile application. The techniques include using LIKE and ILIKE operators and integrating a trigram-based search to handle potential misspellings, thereby increasing the search accuracy.
We'll also discuss how the azure_ai extension on PostgreSQL databases in Azure and Azure AI Services were utilized to create vectors from user input, a feature beneficial when users wish to find specific items based on text prompts. While our application's case study involves a drug search, the techniques and principles shared in this session can be adapted to improve search functionality in a wide range of applications. Join us to learn how PostgreSQL and Azure AI can be harnessed to enhance your application's search capability.
High performance Serverless Java on AWS- GoTo Amsterdam 2024
Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless community. Java is known for its high cold start times and high memory footprint, comparing to other programming languages like Node.js and Python. In this talk I'll look at the general best practices and techniques we can use to decrease memory consumption, cold start times for Java Serverless development on AWS including GraalVM (Native Image) and AWS own offering SnapStart based on Firecracker microVM snapshot and restore and CRaC (Coordinated Restore at Checkpoint) runtime hooks. I'll also provide a lot of benchmarking on Lambda functions trying out various deployment package sizes, Lambda memory settings, Java compilation options and HTTP (a)synchronous clients and measure their impact on cold and warm start times.
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks creates AI-boosted business software that helps employees work more efficiently and effectively. Managing data across multiple RDBMS and NoSQL databases was already a challenge at their current scale. To prepare for 10X growth, they knew it was time to rethink their database strategy. Learn how they architected a solution that would simplify scaling while keeping costs under control.
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
At this talk we will discuss DDoS protection tools and best practices, discuss network architectures and what AWS has to offer. Also, we will look into one of the largest DDoS attacks on Ukrainian infrastructure that happened in February 2022. We'll see, what techniques helped to keep the web resources available for Ukrainians and how AWS improved DDoS protection for all customers based on Ukraine experience
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
What began over 115 years ago as a supplier of precision gauges to the automotive industry has evolved into being an industry leader in the manufacture of product branding, automotive cockpit trim and decorative appliance trim. Value-added services include in-house Design, Engineering, Program Management, Test Lab and Tool Shops.
ScyllaDB Tablets: Rethinking Replication
ScyllaDB is making a major architecture shift. We’re moving from vNode replication to tablets – fragments of tables that are distributed independently, enabling dynamic data distribution and extreme elasticity. In this keynote, ScyllaDB co-founder and CTO Avi Kivity explains the reason for this shift, provides a look at the implementation and roadmap, and shares how this shift benefits ScyllaDB users.
Session 1 - Intro to Robotic Process Automation.pdf
👉 Check out our full 'Africa Series - Automation Student Developers (EN)' page to register for the full program:
https://bit.ly/Automation_Student_Kickstart
In this session, we shall introduce you to the world of automation, the UiPath Platform, and guide you on how to install and setup UiPath Studio on your Windows PC.
📕 Detailed agenda:
What is RPA? Benefits of RPA?
RPA Applications
The UiPath End-to-End Automation Platform
UiPath Studio CE Installation and Setup
💻 Extra training through UiPath Academy:
Introduction to Automation
UiPath Business Automation Platform
Explore automation development with UiPath Studio
👉 Register here for our upcoming Session 2 on June 20: Introduction to UiPath Studio Fundamentals: https://community.uipath.com/events/details/uipath-lagos-presents-session-2-introduction-to-uipath-studio-fundamentals/
Recently uploaded (20)
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
From Natural Language to Structured Solr Queries using LLMs
From Natural Language to Structured Solr Queries using LLMs
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
Demystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through Storytelling
Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
Xtrabackup and FTWRL
- 1. Xtrabackup and FTWRL Xtrabackup and FTWRL Percona Live MySQL Conference and Expo 2013 Raghavendra Prabhu raghavendra.prabhu@percona.com Percona 24th April, 2013 Raghavendra Prabhu Percona Xtrabackup FTWRL
- 2. Xtrabackup and FTWRL Outline Xtrabackup and FTWRL Raghavendra Prabhu Percona Xtrabackup FTWRL
- 3. Xtrabackup and FTWRL Xtrabackup What and Why How it works Others based on similar principle Comparison Raghavendra Prabhu Percona Xtrabackup FTWRL
- 4. Xtrabackup and FTWRL Locking FTWRL Nice Backronym of ‘Flush Tables with Read Lock’ Duration: How it matters Necessity Why with InnoDB Replication co-ordinates Avoidable Galera Work in progress wsrep_recover Where is it used Backups PXC/Galera SST Anywhere you may want to Raghavendra Prabhu Percona Xtrabackup FTWRL
- 5. Xtrabackup and FTWRL Not Locking no-lock: “In a world without doors, why you need locks” Benefits Caveats DDL Non-transactional FRMs Redo-logging of ibd creation Only InnoDB Possible solutions MDL locking Consistent snapshots with Galera Bitmap based backups Transactional DDL in future? Raghavendra Prabhu Percona Xtrabackup FTWRL
- 6. Xtrabackup and FTWRL Conclusion Any questions Raghavendra Prabhu Percona Xtrabackup FTWRL
- 7. Xtrabackup and FTWRL Me Raghavendra Prabhu http://wnohang.net/about Software Engineer at Percona and Product Lead of PXC https://launchpad.net/percona-xtradb-cluster Slides downloadable at http://goo.gl/jsult Raghavendra Prabhu Percona Xtrabackup FTWRL