Online Upgrade Using Logical Replication

•

0 likes•68 views

Always upgrade! There are hundreds of fixes between each PostgreSQL release, and an important number of them are security fixes! Logical replication allows making major upgrades with minimal downtime and feasible cons.

Technology

Online upgrade using
logical replication
Florin Irion
8 December 2020
#postgresbuild2020

Whoami?
ﬂorin.irion@enterprisedb.com
@irionr

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.3
Agenda
• PostgreSQL releases
• Upgrade options
• What is Pglogical
• Major upgrades

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.4
Why
Upgrade? ● Security
● Features
● Dba/management
● Performance
● SQL standard

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.5
Release
Cadence

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.6
EOL

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.7
About
Minor
Updates

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.8
About
Major
Upgrades
● Logical dump/restore
● Trigger-based replication (not anymore) - e.g.
Londiste
● pg_upgrade
● Native logical streaming replication
○ publisher/subscriber
○ Pglogical extension

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.9
About
Major
Upgrades
● Logical dump/restore
● Trigger-based replication (not anymore) - e.g.
Londiste
● pg_upgrade
● Native logical streaming replication
○ publisher/subscriber
○ Pglogical extension

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.10
Pglogical

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.11
Pglogical
vs
Logical
Replication

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.12
Upgrading
with
pglogical

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.13
What are we
missing by
using
PostgreSQL 9.5?
https://why-upgrade.depesz.com/

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.14
Missing
Features
● Parallel Aggregates
● Parallel sequential scans
● Declarative partitioning
● SCRAM Authentication
● Just In Time (JIT) compilation
● Parallel creation of index
● Stored Procedures
● Reindex concurrently

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.15
Nomenclature
and
conventions
● Node -- Postgresql database instance
● Provider -- sending node
● Subscriber -- receiver node
● Replication Set -- rule
● Subscription -- one subscriber makes to the
provider.
● pg95 pg13 -- my hostnames

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.16
Requirements
● Primary key
● Table schema
● Table definition
● Constraints
● Global objects
● UNLOGGED and TEMPORARY
● DDL
○ replicate_ddl_command()

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.17
Installation
PostgreSQL 9.5: yum install postgresql95-pglogical
PostgreSQL 13: yum install postgresql13-pglogical

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.18
Configuration Postgresql.conf
shared_preload_libraries = 'pglogical'
wal_level = 'logical'
max_worker_processes = 10
max_wal_senders = 10
max_replication_slots = 10

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.19
Pg_hba.conf
Local replication pglogical md5
Local dbname pglogical md5
Host replication pglogical pg13_ip_add/0 md5
Host dbname pglogical pg13_ip_add/0 md5
Authentication

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.20
Create
extension
and nodes
CREATE EXTENSION pglogical;
SELECT pglogical.create_node (
node_name: = 'provider1',
dsn: = 'host = pg95 port = 5432 dbname = db'
);
CREATE EXTENSION pglogical;
SELECT pglogical.create_node (
node_name: = 'subscriber1',
dsn: = 'host = pg13 port = 5432 dbname = db'
);

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.21
Add tables
and
sequences
SELECT pglogical.replication_set_add_all_tables (
set_name := 'default',
schema_names := ARRAY ['public']
);
SELECT pglogical.replication_set_add_all_sequences
(
set_name : = 'default',
schema_names : = ARRAY ['public']
);

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.22
Create
subscription
SELECT pglogical.create_subscription(
subscription_name := 'my_subscription',
provider_dsn := 'host = pg95
port = 5432
dbname = db',
);

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.23
pglogical.create_subscription(
subscription_name name,
provider_dsn text,
replication_sets text[],
synchronize_structure boolean,
synchronize_data boolean,
forward_origins text[],
apply_delay interval
);
Create
subscription

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.24
Check SELECT subscription_name, status
FROM pglogical.show_subscription_status();
subscription_name | status
------------------------+-------------
my_subscription | replicating

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.25
Repeat
CREATE EXTENSION pglogical;
SELECT pglogical.create_node (...'provider'...);
SELECT pglogical.create_node (...'subscriber'...);
SELECT pglogical.create_subscription(...);

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.26
Testing and
application
testing

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.27
Cutover/
Switch

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.28
Post-switch

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.29
Conclusions
• Pglogical is my preferred major upgrade method

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.30
Conclusions
• Start simple and test everything
TEST! TEST! TEST!

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.31
Conclusions
• Pglogical 3
● Replication slot failover support
● REPLICA IDENTITY FULL
● DDL
● Performance
● Kafka and Rabbitmq
● Partitions
● Conﬂict detection
● Conﬂict resolution
● No SUPERUSER
● Statistics

© Copyright EnterpriseDB Corporation, 2020. All rights reserved.32
Conclusions
• Kubernetes and Cloud Native friendly

Thank you!
Questions?
@irionr
www.enterprisedb.com/contact

One of the main reasons we hear for not being able to migrate from Oracle to PostgreSQL is the fact that “We absolutely, definitively must have RAC”. Despite its cost and complexity, RAC is widely used in response to a variety of (real or imagined) performance, high availability and/or scalability requirements. PostgreSQL does not have an equivalent to RAC. But does anyone really need it? This talk investigates whether or not RAC is actually required in most situations and looks at the alternatives that are available to us in PostgreSQL.

Machine Learning for Capacity Management

EDB

Deployment of PostgreSQL inside of Kubernetes with High Availability

EDB

Postgres Deployment Automation with Terraform and Ansible

EDB

Apache AGE and the synergy effect in the combination of Postgres and NoSQL

EDB

In this session, we will introduce the concept of Apache AGE and the synergy effect in the combination of Postgres and NoSQL (Graph Database). We shall discuss the story and background of Apache AGE as an open-source project and introduce challenges that AGE can solve for its users. Furthermore, we will talk about a graph database as an extension to PostgreSQL and how it can support all the functionalities and features of PostgreSQL and offers a graph model in addition. We will also discuss how users with a relational background and data model who are in need of having a graph model on top of their existing relational model, can use this extension with minimal effort because they can use existing data without migration to enable a graph database.

PostgreSQL 12: What is coming up?, Enterprise Postgres Day

EDB

Pgsodium's Features: those not provided by pgcrypto and integration with rem...

EDB

How to use postgresql.conf to configure and tune the PostgreSQL server

EDB

Tuning your PostgreSQL server plays an important role in making sure you get the most out of your server resources, and running with default parameters is not always enough. Using the PostgreSQL server configuration file postgresql.conf, we can tune the right area and make the most out of the server resources. The postgresql.conf file tuning parameters are classified into different categories including database connections, memory, optimizers, and logging. In this webinar, you will learn: - A basic understanding of postgresql.conf - The categories and parameters of postgresql.conf - How to adjust parameters - Expert tuning recommendations

Join Marc Linster andDave Page as they shows you how to manage large scale Postgres deployments. This webinar will highlight how EnterpriseDB Postgres Enterprise Manager can be used for monitoring, alerting and administration of your Postgres estate - no matter where it is deployed. Highlights include: Tools and techniques for Postgres management Key database performance metrics and monitoring Operating Postgres on premises, in containers, and in the cloud They will conclude with a live demo of Postgres Enterprise Manager.

OLTP+OLAP=HTAP

EDB

Traditionally database systems were optimized either for OLAP either for OLTP workloads. Such mainstream DBMSes like Postgres,MySQL,... are mostly used for OLTP, while Greenplum, Vertica, Clickhouse, SparkSQL,... are oriented on analytic queries. But right now many companies do not want to have two different data stores for OLAP/OLTP and need to perform analytic queries on most recent data. I want to discuss which features should be added to Postgres to efficiently handle HTAP workload.

PostgreSQL to Accelerate Innovation

EDB

PostgreSQL is versatile and used for a wide range of applications and use cases in the enterprise. It is more than just database technology, it is an accelerator for innovation. Much innovation today is happening in new application development, application modernization, and re-platforming to the cloud across the information architecture landscape. In this webinar, you will learn how EDB supercharges PostgreSQL to re-platform to cloud and containers more efficiently and develop new applications that are more scalable and secure.

Automating a PostgreSQL High Availability Architecture with Ansible

EDB

Highly available databases are essential to organizations depending on mission-critical, 24/7 access to data. Postgres is widely recognized as an excellent open-source database, with critical maturity and features that allow organizations to scale and achieve high availability. EDB reference architectures are designed to help new and existing users alike to quickly design a deployment architecture that suits their needs. Users can use these reference architectures as a blueprint or as the basis for a design that enhances and extends the functionality and features offered. This webinar will explore: - Concepts of High Availability - Quick review of EDB reference architectures - EDB tools to create a highly available PostgreSQL architecture - Options for automating the deployment of reference architectures - EDB Ansible® roles helping in automating the deployment of reference architectures - Features and capabilities of Ansible roles - Automating the provisioning of the resources in the cloud using Terraform™

EDB Failover Manager - Features and Demo

EDB

Postgres expert Saurabh Shelar goes through the features and a live demo of EDB Postgres Failover Manager (EFM). You don’t want to miss this! EDB Postgres Failover Manager (EFM) is a high-availability module from EnterpriseDB that enables a Postgres Master node to automatically failover to a Standby node in the event of a software or hardware failure on the Master. Saurabh will cover key features of EDB Postgres Failover Manager and Demo Failover scenarios. Highlights Include: - Tuneable Properties for User Environment - Supported Failover Scenarios - A step by step demo

A Peek in the Elephant's Trunk

EDB

The Future of Postgres Sharding / Bruce Momjian (PostgreSQL)

Ontico

Database sharding involves spreading database contents across multiple servers, with each server holding only part of the database. While it is possible to vertically scale Postgres, and to scale read-only workloads across multiple servers, only sharding allows multi-server read-write scaling. This presentation will cover the advantages of sharding and future Postgres sharding implementation requirements, including foreign data wrapper enhancements, parallelism, and global snapshot and transaction control. This is a followup to my Postgres Scaling Opportunities presentation.

Apache Ignite: In-Memory Hammer for Your Data Science Toolkit

Denis Magda

Machine learning is a method of data analysis that automates the building of analytical models. By using algorithms that iteratively learn from data, computers are able to find hidden insights without the help of explicit programming. These insights bring tremendous benefits into many different domains. For business users, in particular, these insights help organizations improve customer experience, become more competitive, and respond much faster to opportunities or threats. The availability of very powerful in-memory computing platforms, such as the open-source Apache Ignite (https://ignite.apache.org/), means that more organizations can benefit from machine learning today. In this presentation, Denis will look at some of the main components of Apache Ignite, such as a distributed database, distributed computations, and machine learning toolkit. Through examples, attendees will learn how Apache Ignite can be used for data analysis.

Apache Spark and Apache Ignite: Where Fast Data Meets IoT

Denis Magda

It is not enough to build a mesh of sensors or embedded devices to obtain more insights about the surrounding environment and optimize your production systems. Usually, your IoT solution needs to be capable of transferring enormous amounts of data to storage or the cloud where the data have to be processed further. Quite often, the processing of the endless streams of data has to be done in real-time so that you can react on the IoT subsystem's state accordingly. This session will show attendees how to build a Fast Data solution that will receive endless streams from the IoT side and will be capable of processing the streams in real-time using Apache Ignite's cluster resources. In particular, attendees will learn about data streaming to an Apache Ignite cluster from embedded devices and real-time data processing with Apache Spark.

Leveraging docker for hadoop build automation and big data stack provisioning

Evans Ye

Json and Jsonpath in Postgres 12

EDB

Join Postgres experts, Bruce Momjian, Marc Linster, and Thom Brown, as they discuss jsquery. Jsquery was introduced to allow more sophisticated querying of JSON data with indexing support. However, this was an external project, with no official support. SQL/JSON is now coming in version 12 which will provide very similar functionality. This webinar will compare jsquery and SQL/JSON by discussing: - The similarities and differences between the two features - The equivalent functionality where they aren't identical - Examples of how they compare in practice

Whats New in Postgres 12

EDB

Automating Postgres Deployments on AWS and VMware, with Terraform and Ansible

EDB

Deploying Postgres on AWS and VMware shouldn’t be a clunky, manual task. In 2020 and beyond, automation and Postgres will go hand in hand. Highly available, fault-tolerant PostgreSQL database cluster creation and monitoring can now be deployed in a matter of minutes using Terraform and Ansible scripts. In this webinar, you will learn how developers, devOps, and DBAs can automate cloud and on-premise Postgres deployment with the help of Terraform and Ansible. We will cover: - Popular deployment options for Postgres - Postgres platform database and toolsets - Automating deployment of Postgres with high availability - Automating deployment of fault-tolerant Postgres cluster - Monitoring and managing Postgres at scale - Demo for Terraform Postgres deployment scripts

New and Improved Features in PostgreSQL 13

EDB

Join Postgres experts Bruce Momjian, Rushabh Lathia, and Marc Linster as they preview everything new in PostgreSQL 13. You don’t want to miss this! This session will explore: - Performance benchmarking: 4 years of going faster - Logical subscription for partitioned tables - Partitionwise joins - BEFORE row-level triggers - Parallel vacuum for indexes - Corruption checking: pg_catcheck - Improved security: libpq with channel binding - EDB Postgres Advanced Server improved partitioning features - Additional enhancements - PostgreSQL and EDB Postgres - - - Advanced Server Want to get all the PostgreSQL 13 updates but can’t make the live webinar? Register here and we will send you the slides and recording following the session.

How to Monitor Postgres Like a Pro!

EDB

Monitoring is a critical element of the database ecosystem and for overall performance of the database. It also helps ensure that your database is in a healthy state and contributing to the long term stability of your database and application. Monitoring becomes tricky without knowing what to monitor and how to monitor those variables. What you will learn in this webinar: 1. Why is it essential to monitor Postgres? 2. The proactive and reactive monitoring approaches and how they help handle future problems 3. The top 10 monitoring checklist 4. When not to monitor 5. A deeper dive into open source tools for monitoring with Prometheus and Grafana

How-To: Zero Downtime Migrations from Oracle to a Cloud-Native PostgreSQL

YugabyteDB

Introducing Data Redaction - an enabler to data security in EDB Postgres Adva...

EDB

With the rapid growth in digitalization, coupled with the current pandemic situation globally, many organizations and businesses are forced to operate remotely and online, more than they would prefer. At such times, how do corporations and businesses ensure data security, especially the secure management of personal information? There are many techniques used to secure information, such as authentication, authorization, access control, virtual database, and encryption. In this webinar, we focus on Data Redaction - a technique that limits sensitive data exposure in EDB Postgres Advanced Server (EPAS). This webinar covers: - What is EDB Data Redaction - How to limit sensitive data exposure in EPAS - Provision for Oracle compatibility in EPAS - Demo

PostgreSQL 13 is Coming - Find Out What's New!

EDB

PostgreSQL 13 is coming. Find out how to harness the power of new & improved features in PostgreSQL 13. This presentation explores the following: - Performance benchmarking: 4 years of going faster - Logical subscription for partitioned tables - Partitionwise joins - BEFORE row-level triggers - Parallel vacuum for indexes - Corruption checking: pg_catcheck - Improved security: libpq with channel binding - EDB Postgres Advanced Server improved partitioning features - Additional enhancements - PostgreSQL and EDB Postgres Advanced Server

Building Effective Apache Geode Applications with Spring Data GemFire

John Blum

Installing Postgres on Linux

EDB

Improve PostgreSQL replication with Oracle GoldenGate

Bobby Curtis

PostgreSQL databases use the Write-Ahead Logging approach for the replication of data. At the same time, customers worldwide have asked for Oracle GoldenGate to support replication to and from PostgreSQL databases. The wait is over! This session will introduce Oracle GoldenGate for PostgreSQL and highlight what needs to be looked at to ensure successful replication for any PostgreSQL environment.

New enhancements for security and usability in EDB 13

EDB

EDB 13 is here and it enhances our flagship database server and tools. This webinar will explore its security, usability, and portability updates. Join us to learn how EDB 13 can help you improve your PostgreSQL productivity and data protection. Webinar highlights include: - New security features such as SCRAM and the encryption of database passwords and traffic between Failover Manager agents - Usability updates that automate partitioning, verify backup integrity, and streamline the management of failover and backups - Portability improvements that simplify running PostgreSQL across on-premise and cloud environments

What's hot

Webinar: Managing Postgres at Scale

EDB

OLTP+OLAP=HTAP

EDB

PostgreSQL to Accelerate Innovation

EDB

Automating a PostgreSQL High Availability Architecture with Ansible

EDB

EDB Failover Manager - Features and Demo

EDB

A Peek in the Elephant's Trunk

EDB

The Future of Postgres Sharding / Bruce Momjian (PostgreSQL)

Ontico

Apache Ignite: In-Memory Hammer for Your Data Science Toolkit

Denis Magda

Apache Spark and Apache Ignite: Where Fast Data Meets IoT

Denis Magda

Leveraging docker for hadoop build automation and big data stack provisioning

Evans Ye

Json and Jsonpath in Postgres 12

EDB

Whats New in Postgres 12

EDB

Automating Postgres Deployments on AWS and VMware, with Terraform and Ansible

EDB

New and Improved Features in PostgreSQL 13

EDB

How to Monitor Postgres Like a Pro!

EDB

How-To: Zero Downtime Migrations from Oracle to a Cloud-Native PostgreSQL

YugabyteDB

Introducing Data Redaction - an enabler to data security in EDB Postgres Adva...

EDB

PostgreSQL 13 is Coming - Find Out What's New!

EDB

Building Effective Apache Geode Applications with Spring Data GemFire

John Blum

Installing Postgres on Linux

EDB

What's hot (20)

Webinar: Managing Postgres at Scale

OLTP+OLAP=HTAP

PostgreSQL to Accelerate Innovation

Automating a PostgreSQL High Availability Architecture with Ansible

EDB Failover Manager - Features and Demo

A Peek in the Elephant's Trunk

The Future of Postgres Sharding / Bruce Momjian (PostgreSQL)

Apache Ignite: In-Memory Hammer for Your Data Science Toolkit

Apache Spark and Apache Ignite: Where Fast Data Meets IoT

Leveraging docker for hadoop build automation and big data stack provisioning

Json and Jsonpath in Postgres 12

Whats New in Postgres 12

Automating Postgres Deployments on AWS and VMware, with Terraform and Ansible

New and Improved Features in PostgreSQL 13

How to Monitor Postgres Like a Pro!

How-To: Zero Downtime Migrations from Oracle to a Cloud-Native PostgreSQL

Introducing Data Redaction - an enabler to data security in EDB Postgres Adva...

PostgreSQL 13 is Coming - Find Out What's New!

Building Effective Apache Geode Applications with Spring Data GemFire

Installing Postgres on Linux

Similar to Online Upgrade Using Logical Replication

Improve PostgreSQL replication with Oracle GoldenGate

Bobby Curtis

New enhancements for security and usability in EDB 13

EDB

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

Márton Kodok

Teaser: provide developers a new way of understanding advanced analytics and choosing the right cloud architecture The new buzzword is #serverless, as there are many great services that helps us abstract away the complexity associated with managing servers. In this session we will see how serverless helps on large data analytics backends. We will see how to architect for Cloud and implement into an existing project components that will take us into the #serverless architecture that will ingest our streaming data, run advanced analytics on petabytes of data using BigQuery on Google Cloud Platform - all this next to an existing stack, without being forced to reengineer our app. BigQuery enables super-fast, SQL/Javascript queries against petabytes of data using the processing power of Google’s infrastructure. We will cover its core features, SQL 2011 standard, working with streaming inserts, User Defined Functions written in Javascript, reference external JS libraries, and several use cases for everyday backend developer: funnel analytics, email heatmap, custom data processing, building dashboards, extracting data using JS functions, emitting rows based on business logic.

New enhancements for security and usability in EDB 13

EDB

EDB 13 enhances our flagship database server and tools. This webinar will explore its security, usability, and portability updates. Join us to learn how EDB 13 can help you improve your PostgreSQL productivity and data protection. Webinar highlights include: - New security features such as SCRAM and the encryption of database passwords and traffic between Failover Manager agents - Usability updates that automate partitioning, verify backup integrity and streamline the management of failover and backups - Portability improvements that simplify running PostgreSQL across on-premise and cloud environments

PGEncryption_TutorialVibhor Kumar

EDB: Power to Postgres

Ashnikbiz

How to build a highly available PostgreSQL Cluster using EDB Failover Manager? Database downtime can cost your business significant revenue. And while PostgreSQL is incredibly stable, it does not identify a database failure or automatically switches traffic to a standby database. In such a scenario, EDB Failover Manager (EFM) can be at the forefront of automatically detecting master database failures and promoting the most up-to-date standby database to take over. Register for this free webinar and learn how EDB Failover Manager helps you build a highly available PostgreSQL Cluster for overall business continuity.

Implementing a build manager in Ada

Stephane Carrez

Having used Jenkins with more than 30 projects during 8 years, it was time to switch to another build manager. Written in Ada, Porion is a new build manager intended to replace Jenkins by providing more security, safety and performance. The presentation describes the complexity of designing a build manager. It highlights some security issues that apply to a build manager and its implementation. It explains the overall architecture that was chosen and the reason of the choice. Finally it presents the Ada generation tools that have been used in this project.

PGday_korea_2021_leeuijin

의진 이

An overview of reference architectures for Postgres

EDB

EDB Reference Architectures are designed to help new and existing users alike to quickly design a deployment architecture that suits their needs. They can be used as either the blueprint for a deployment, or as the basis for a design that enhances and extends the functionality and features offered. Add-on architectures allow users to easily extend their core database server deployment to add additional features and functionality "building block" style. In this webinar, we will review the following architectures: - Single Node - Multi Node with Asynchronous Replication - Multi Node with Synchronous Replication - Add-on Architectures

Guob consolidation implementation11gr2Rodrigo Almeida

Enterprise-class security with PostgreSQL - 2

Ashnikbiz

CISOA Conference 2020 Banner 9 Development

Brad Rippe

Sprint 45 review

ManageIQ

#GeodeSummit - Large Scale Fraud Detection using GemFire Integrated with Gree...

PivotalOpenSourceHub

In this session we explore a case study of a large-scale government fraud detection program that prevents billions of dollars in fraudulent payments each year leveraging the beta release of the GemFire+Greenplum Connector, which is planned for release in GemFire 9. Topics will include an overview of the system architecture and a review of the new GemFire+Greenplum Connector features that simplify use cases requiring a blend of massively parallel database capabilities and accelerated in-memory data processing.

When it all GOes right

Pavlo Golub

This talk covers how to use PostgreSQL together with the Golang (Go) programming language. I will describe what drivers and tools are available and which to use nowadays. In this talk I will cover what design choices of Go can help you to build robust programs. But also, we will reveal some parts of the language and drivers that can cause obstacles and what routines to apply to avoid risks. We will try to build the simplest cross-platform application in Go fully covered by tests and ready for CI/CD using GitHub Actions as an example.

PGConf.ASIA 2019 Bali - How did PostgreSQL Write Load Balancing of Queries Us...

Equnix Business Solutions

2-day-dba-oracle.pptx

Rocky572078

Supercharge your data analytics with BigQuery

Márton Kodok

Powering interactive data analysis require massive architecture, and Know-How to build a fast real-time computing system. BigQuery solves this problem by enabling super-fast, SQL-like queries against petabytes of data using the processing power of Google’s infrastructure. We will cover its core features, creating tables, columns, views, working with partitions, clustering for cost optimizations, streaming inserts, User Defined Functions, and several use cases for everydaay developer: funnel analytics, behavioral analytics, exploring unstructured data. The other part will be about BigQuery ML, which enables users to create and execute machine learning models in BigQuery using standard SQL queries. BigQuery ML democratizes machine learning by enabling SQL practitioners to build models using existing SQL tools and skills. BigQuery ML increases development speed by eliminating the need to move data.

Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...

Milomir Vojvodic

Upcoming changes in MySQL 5.7

Morgan Tocker

Similar to Online Upgrade Using Logical Replication (20)

Improve PostgreSQL replication with Oracle GoldenGate

New enhancements for security and usability in EDB 13

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

New enhancements for security and usability in EDB 13

PGEncryption_Tutorial

EDB: Power to Postgres

Implementing a build manager in Ada

PGday_korea_2021_leeuijin

An overview of reference architectures for Postgres

Guob consolidation implementation11gr2

Enterprise-class security with PostgreSQL - 2

CISOA Conference 2020 Banner 9 Development

Sprint 45 review

#GeodeSummit - Large Scale Fraud Detection using GemFire Integrated with Gree...

When it all GOes right

PGConf.ASIA 2019 Bali - How did PostgreSQL Write Load Balancing of Queries Us...

2-day-dba-oracle.pptx

Supercharge your data analytics with BigQuery

Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...

Upcoming changes in MySQL 5.7

More from EDB

Cloud Migration Paths: Kubernetes, IaaS, or DBaaS

EDB

Moving to the cloud is hard, and moving Postgres databases to the cloud is even harder. Public cloud or private cloud? Infrastructure as a Service (IaaS), or Platform as a Service (PaaS)? Kubernetes for the application, or for the database and the application? This talk will juxtapose self-managed Kubernetes and container-based database solutions, Postgres deployments on IaaS, and Postgres DBaaS solutions of which EDB’s DBaaS BigAnimal is the latest example.

Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen

EDB

Dieses Webinar hilft Ihnen, die Unterschiede zwischen den verschiedenen Replikationsansätzen zu verstehen, die Anforderungen der jeweiligen Strategie zu erkennen und sich über die Möglichkeiten klar zu werden, was mit jeder einzelnen zu erreichen ist. Damit werden Sie hoffentlich eher in der Lage sein, herauszufinden, welche PostgreSQL-Replikationsarten Sie wirklich für Ihr System benötigen. - Wie physische und logische Replikation in PostgreSQL funktionieren - Unterschiede zwischen synchroner und asynchroner Replikation - Vorteile, Nachteile und Herausforderungen bei der Multi-Master-Replikation - Welche Replikationsstrategie für unterschiedliche Use-Cases besser geeignet ist Referent: Borys Neselovskyi, Regional Sales Engineer DACH, EDB ------------------------------------------------------------ For more #webinars, visit http://bit.ly/EDB-Webinars Download free #PostgreSQL whitepapers: http://bit.ly/EDB-Whitepapers Read our #Postgres Blog http://bit.ly/EDB-Blogs Follow us on Facebook at http://bit.ly/EDB-FB Follow us on Twitter at http://bit.ly/EDB-Twitter Follow us on LinkedIn at http://bit.ly/EDB-LinkedIn Reach us via email at marketing@enterprisedb.com

Migre sus bases de datos Oracle a la nube

EDB

Cuando busca alternativas a Oracle en la nube, hacer el cambio puede parecer un trabajo duro. Entendemos que la migración involucra más que solo la base de datos. La compatibilidad es un punto clave, especialmente cuando se consideran los recursos que posiblemente ya haya invertido en Oracle, como por ejemplo el código de aplicación específico de Oracle.Este seminario web explorará las opciones y las principales consideraciones al pasar de las bases de datos de Oracle a la nube. - Revisión detallada de las ofertas de bases de datos disponibles en la nube - Factores críticos que se deben considerar considerar para elegir la oferta en la nube más adecuada - Cómo la experiencia de EDB con PostgreSQL puede ayudarlo en su decisión - Demostración de BigAnimal de EDB Présentateur: Sergio Romera, Senior Sales Engineer EMEA, EDB ------------------------------------------------------------ For more #webinars, visit http://bit.ly/EDB-Webinars Download free #PostgreSQL whitepapers: http://bit.ly/EDB-Whitepapers Read our #Postgres Blog http://bit.ly/EDB-Blogs Follow us on Facebook at http://bit.ly/EDB-FB Follow us on Twitter at http://bit.ly/EDB-Twitter Follow us on LinkedIn at http://bit.ly/EDB-LinkedIn Reach us via email at marketing@enterprisedb.com

EFM Office Hours - APJ - July 29, 2021

EDB

Benchmarking Cloud Native PostgreSQL

EDB

Database come PostgreSQL non possono girare su Kubernetes. Questo è il ritornello che sentiamo continuamente, ma al tempo stesso la motivazione per noi di EDB di abbattere questo muro, una volta per tutte. In questo webinar parleremo della nostra avventura finora per portare PostgreSQL su Kubernetes. Scopri perché crediamo che fare benchmark di storage e del database prima di andare in produzione porti a una più sana e longeva vita di un DBMS, anche su Kubernetes. Condivideremo il nostro processo, i risultati fin qui ottenuti e sveleremo i nostri piani per il futuro con Cloud Native PostgreSQL.

Las Variaciones de la Replicación de PostgreSQL

EDB

Replicación física, replicación lógica, síncrona, asíncrona, multi-maestro, escalabilidad horizontal, etc. Son muchos los términos asociados con la replicación de bases de datos. En esta charla revisaremos los conceptos fundamentales detrás de cada variación de la replicación de PostgreSQL, y en qué casos conviene usar una o la otra. La presentación incluye una parte práctica con demostraciones aunque no será un tutorial sobre como configurar un cluster. El enfoque está en entender cada variación para elegir la mejor dependiendo del caso de uso. Cosas que aprenderán: - Cómo funciona la replicación física en PostgreSQL - Cómo funciona la replicación lógica en PostgreSQL - Diferencias entre replicación síncrona y asíncrona - Qué es replicación multi-maestro

NoSQL and Spatial Database Capabilities using PostgreSQL

EDB

PostgreSQL is an object-relational database system. NoSQL on the other hand is a non-relational database and is document-oriented. Learn how the PostgreSQL database gives one the flexible options to combine NoSQL workloads with the relational query power by offering JSON data types. With PostgreSQL, new capabilities can be developed and plugged into the database as required. Attend this webinar to learn: - The new features and capabilities in PostgreSQL for new workloads, requiring greater flexibility in the data model - NoSQL with JSON, Hstore and its performance and features for enterprises - Spatial SQL - advanced features in PostGIS application with PostGIS extension

Is There Anything PgBouncer Can’t Do?

EDB

"Why use PgBouncer? It’s a lightweight, easy to configure connection pooler and it does one job well. As you’d expect from a talk on connection pooling, we’ll give a brief summary of connection pooling and why it increases efficiency. We’ll look at when not to use connection pooling, and we’ll demonstrate how to configure PgBouncer and how it works. But. Did you know you can also do this? 1. Scaling PgBouncer PgBouncer is single threaded which means a single instance of PgBouncer isn’t going to do you much good on a multi-threaded and/or multi-CPU machine. We’ll show you how to add more PgBouncer instances so you can use more than one thread for easy scaling. 2. Read-write / read only routing Using different pgBouncer databases you can route read-write traffic to the primary database and route read-only traffic to a number of standby databases. 3. Load balancing When we use multiple PgBouncer instances, load balancing comes for free. Load balancing can be directed to different standbys, and weighted according to ratios of load. 4. Silent failover You can perform silent failover during promotion of a new primary (assuming you have a VIP/DNS etc that always points to the primary). 5. And even: DoS prevention and protection from “badly behaved” applications! By using distinct port numbers you can provide database connections which deal with sudden bursts of incoming traffic in very different ways, which can help prevent the database from becoming swamped during high activity periods. You should leave the presentation wondering if there is anything PgBouncer can’t do."

Data Analysis with TensorFlow in PostgreSQL

EDB

In this talk I'll discuss how we can combine the power of PostgreSQL with TensorFlow to perform data analysis. By using the pl/python3 procedural language we can integrate machine learning libraries such as TensorFlow with PostgreSQL, opening the door for powerful data analytics combining SQL with AI. Typical use-cases might involve regression analysis to find relationships in an existing dataset and to predict results based on new inputs, or to analyse time series data and extrapolate future data taking into account general trends and seasonal variability whilst ignoring noise. Python is an ideal language for building custom systems to do this kind of work as it gives us access to a rich ecosystem of libraries such as Pandas and Numpy, in addition to TensorFlow itself.

Practical Partitioning in Production with Postgres

EDB

Has your table become too large to handle? Have you thought about chopping it up into smaller pieces that are easier to query and maintain? What if it's in constant use? An introduction to the problems that can arise and how PostgreSQL's partitioning features can help, followed by a real-world scenario of partitioning an existing huge table on a live system. We will be looking at the problems caused by having very large tables in your database and how declarative table partitioning in Postgres can help. Also, how to perform dimensioning before but also after creating huge tables, partitioning key selection, the importance of upgrading to get the latest Postgres features and finally we will dive into a real-world scenario of having to partition an existing huge table in use on a production system.

A Deeper Dive into EXPLAIN

EDB

There have been plenty of “explaining EXPLAIN” type talks over the years, which provide a great introduction to it. They often also cover how to identify a few of the more common issues through it. EXPLAIN is a deep topic though, and to do a good introduction talk, you have to skip over a lot of the tricky bits. As such, this talk will not be a good introduction to EXPLAIN, but instead a deeper dive into some of the things most don’t cover. The idea is to start with some of the more complex and unintuitive calculations needed to work out the relationships between operations, rows, threads, loops, timings, buffers, CTEs and subplans. Most popular tools handle at least several of these well, but there are cases where they don’t that are worth being conscious of and alert to. For example, we’ll have a look at whether certain numbers are averaged per-loop or per-thread, or both. We’ll also cover a resulting rounding issue or two to be on the lookout for. Finally, some per-operation timing quirks are worth looking out for where CTEs and subqueries are concerned, for example CTEs that are referenced more than once. As time allows, we can also look at a few rarer issues that can be spotted via EXPLAIN, as well as a few more gotchas that we’ve picked up along the way. This includes things like spotting when the query is JIT, planning, or trigger time dominated, spotting the signs of table and index bloat, issues like lossy bitmap scans or index-only scans fetching from the heap, as well as some things to be aware of when using auto_explain.

IOT with PostgreSQL

EDB

Internet of Things is a currently a burgeoning market, and is often associated with specialized data-stores. However PostgreSQL is just as capable at this use-case and can offer some compelling advantages. We’ll explore ways to store IoT data in PostgreSQL covering various ways to store and structure this kind of data. How range types and differing types of indexes can be of use. Also taking a quick look at some extensions designed for this use case. Then looking at powerful SQL features which can really help when analyzing IoT data streams, and how the power of a real SQL database can be a key advantage.

A Journey from Oracle to PostgreSQL

EDB

I would like you to join me on our journey from a complex, multi instance Oracle topology to a single logical database in PostgreSQL. Each technology and architectural decision point will be discussed describing how we arrived at our destination. There are five keys areas that will be covered: - Target architecture - Migration of database objects (tables, indexes, views, synonyms, etc) - Migration of database code (packages, functions, procedures, triggers) - Application tier - Migration of Data - with minimal downtime during cutover The target architecture is a BDR cluster, where the physical data model and data stored is different between the logical standbys and the lead master/shadow master. Will discuss how this allowed for the simplification of the topology, and the benefits this delivered. Before you go there, yes I know PostgreSQL does no have synonyms, but an alternative approach was needed. There is a significant amount of business logic in the database tier all of which needed to be translated into database code. Will look at the tools and extensions available to reproduce the functionality in PostgreSQL. Look at common non-ISO standard SQL embedded in the application tier, along with jdbc challenges. Finally a look at some of the data movement tools available. Full disclosure, we are still on the journey but have learnt a lot on the way.

Psql is awesome!

EDB

The proposed talk will go through several questions. The first obvious one is why would I bother learn CLI when I can do whatever I need with a GUI tool? We'll try to answer why knowing CLI is a MUST for some people (like Postgres DBAs, for example) whereas it's only a bonus for others (like data scientists, for example). Then we'll go through the basics about 101 (how to connect to, interactive mode versus not interactive more, how to set psql environment to work comfortably and so on...) The last part will be about tips and tricks that will make anyone's journey with psql more effective and enjoyable. I'm looking for the "TIL" effect in people's eyes.

EDB 13 - New Enhancements for Security and Usability - APJ

EDB

Database security is always of paramount importance to all organizations. In this webinar, we will explore the security, usability, and portability updates of the latest version of the EDB database server and tools. Join us in this webinar to learn: - The new security features such as SCRAM and the encryption of database passwords and traffic between Failover Manager agents - Usability updates that automate partitioning, verify backup integrity, and streamline the management of failover and backups - Portability improvements that simplify running PostgreSQL across on-premise and cloud environments

Comment sauvegarder correctement vos données

EDB

Cloud Native PostgreSQL - Italiano

EDB

Vieni a scoprire Cloud Native PostgreSQL (CNP), l’operatore per Kubernetes, direttamente da coloro che lo hanno ideato e lo sviluppano in EDB. CNP facilita l’integrazione di database PostgreSQL con le tue applicazioni all’interno di cluster Kubernetes e OpenShift Container Platform di RedHat, grazie alla sua gestione automatica dell’architettura primario/standby che include: self-healing, failover, switchover, rolling update, backup, ecc. Durante il webinar affronteremo i seguenti punti: - DevOps e Cloud Native - Introduzione a Cloud Native PostgreSQL - Architetture - Caratteristiche principali - Esempi di uso e configurazione - Kubernetes, Storage e Postgres - Demo - Conclusioni

Best Practices in Security with PostgreSQL

EDB

The webinar will review a multi-layered framework for PostgreSQL security, with a deeper focus on limiting access to the database and data, as well as securing the data. Using the popular AAA (Authentication, Authorization, Auditing) framework we will cover: - Best practices for authentication (trust, certificate, MD5, Scram, etc). - Advanced approaches, such as password profiles. - Deep dive of authorization and data access control for roles, database objects (tables, etc), view usage, row-level security, and data redaction. - Auditing, encryption, and SQL injection attack prevention. Note: this session is delivered in German Speaker: Borys Neselovskyi, Sales Engineer, EDB

Cloud Native PostgreSQL - APJ

EDB

EDB Cloud Native Postgres includes database container images and a Kubernetes Operator that manage the lifecycle of a database from deployment to operations. This Kubernetes Operator for Postgres is written by EDB entirely from scratch in the Go language and relies exclusively on the Kubernetes API. Attend this webinar to learn about: - DevOps & Cloud Native - Overview of Cloud Native Postgres - Storage for Postgres workloads in Kubernetes - Using Cloud Native Postgres - Demo

Best Practices in Security with PostgreSQL

EDB

More from EDB (20)

Cloud Migration Paths: Kubernetes, IaaS, or DBaaS

Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen

Migre sus bases de datos Oracle a la nube

EFM Office Hours - APJ - July 29, 2021

Benchmarking Cloud Native PostgreSQL

Las Variaciones de la Replicación de PostgreSQL

NoSQL and Spatial Database Capabilities using PostgreSQL

Is There Anything PgBouncer Can’t Do?

Data Analysis with TensorFlow in PostgreSQL

Practical Partitioning in Production with Postgres

A Deeper Dive into EXPLAIN

IOT with PostgreSQL

A Journey from Oracle to PostgreSQL

Psql is awesome!

EDB 13 - New Enhancements for Security and Usability - APJ

Comment sauvegarder correctement vos données

Cloud Native PostgreSQL - Italiano

Best Practices in Security with PostgreSQL

Cloud Native PostgreSQL - APJ

Best Practices in Security with PostgreSQL

Recently uploaded

Uni Systems Copilot event_05062024_C.Vlachos.pdf

Uni Systems S.M.S.A.

RESUME BUILDER APPLICATION Project for students

KAMESHS29

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

Artificial Intelligence for XMLDevelopment

Octavian Nadolu

In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject. We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup. Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved. The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring. The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise. By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

Microsoft - Power Platform_G.Aspiotis.pdf

Uni Systems S.M.S.A.

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Vladimir Iglovikov, Ph.D.

Presented by Vladimir Iglovikov: - https://www.linkedin.com/in/iglovikov/ - https://x.com/viglovikov - https://www.instagram.com/ternaus/ This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation. Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners. This case study covers various aspects, including: People: The contributors and community that have supported Albumentations. Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions. Challenges: The hurdles in monetizing open-source projects and measuring user engagement. Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration. Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community. Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations. Mental Health: Maintaining balance and not feeling pressured by user demands. Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth. Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects. Explore more about Albumentations and join the community at: GitHub: https://github.com/albumentations-team/albumentations Website: https://albumentations.ai/ LinkedIn: https://www.linkedin.com/company/100504475 Twitter: https://x.com/albumentations

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

By Design, not by Accident - Agile Venture Bolzano 2024

Pierluigi Pugliese

Elizabeth Buie - Older adults: Are we really designing for our future selves?

Nexer Digital

Mind map of terminologies used in context of Generative AI

Kumud Singh

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

GridMate - End to end testing is a critical piece to ensure quality and avoid...

ThomasParaiso2

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!

SOFTTECHHUB

As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.

Full-RAG: A modern architecture for hyper-personalization

Zilliz

Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack. I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Alex Pruden

This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second). Paper: https://eprint.iacr.org/2023/1886

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Aggregage

DevOps and Testing slides at DASA Connect

Kari Kakkonen

Recently uploaded (20)

Uni Systems Copilot event_05062024_C.Vlachos.pdf

RESUME BUILDER APPLICATION Project for students

Pushing the limits of ePRTC: 100ns holdover for 100 days

Artificial Intelligence for XMLDevelopment

Monitoring Java Application Security with JDK Tools and JFR Events

Microsoft - Power Platform_G.Aspiotis.pdf

Epistemic Interaction - tuning interfaces to provide information for AI support

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Introduction to CHERI technology - Cybersecurity

By Design, not by Accident - Agile Venture Bolzano 2024

Elizabeth Buie - Older adults: Are we really designing for our future selves?

Mind map of terminologies used in context of Generative AI

20240607 QFM018 Elixir Reading List May 2024

GridMate - End to end testing is a critical piece to ensure quality and avoid...

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!

Full-RAG: A modern architecture for hyper-personalization

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Generative AI Deep Dive: Advancing from Proof of Concept to Production

DevOps and Testing slides at DASA Connect

Online Upgrade Using Logical Replication

1. Online upgrade using logical replication Florin Irion 8 December 2020 #postgresbuild2020

2. Whoami? ﬂorin.irion@enterprisedb.com @irionr

8. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.8 About Major Upgrades ● Logical dump/restore ● Trigger-based replication (not anymore) - e.g. Londiste ● pg_upgrade ● Native logical streaming replication ○ publisher/subscriber ○ Pglogical extension

9. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.9 About Major Upgrades ● Logical dump/restore ● Trigger-based replication (not anymore) - e.g. Londiste ● pg_upgrade ● Native logical streaming replication ○ publisher/subscriber ○ Pglogical extension

14. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.14 Missing Features ● Parallel Aggregates ● Parallel sequential scans ● Declarative partitioning ● SCRAM Authentication ● Just In Time (JIT) compilation ● Parallel creation of index ● Stored Procedures ● Reindex concurrently

15. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.15 Nomenclature and conventions ● Node -- Postgresql database instance ● Provider -- sending node ● Subscriber -- receiver node ● Replication Set -- rule ● Subscription -- one subscriber makes to the provider. ● pg95 pg13 -- my hostnames

16. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.16 Requirements ● Primary key ● Table schema ● Table definition ● Constraints ● Global objects ● UNLOGGED and TEMPORARY ● DDL ○ replicate_ddl_command()

18. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.18 Configuration Postgresql.conf shared_preload_libraries = 'pglogical' wal_level = 'logical' max_worker_processes = 10 max_wal_senders = 10 max_replication_slots = 10

19. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.19 Pg_hba.conf Local replication pglogical md5 Local dbname pglogical md5 Host replication pglogical pg13_ip_add/0 md5 Host dbname pglogical pg13_ip_add/0 md5 Authentication

20. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.20 Create extension and nodes CREATE EXTENSION pglogical; SELECT pglogical.create_node ( node_name: = 'provider1', dsn: = 'host = pg95 port = 5432 dbname = db' ); CREATE EXTENSION pglogical; SELECT pglogical.create_node ( node_name: = 'subscriber1', dsn: = 'host = pg13 port = 5432 dbname = db' );

21. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.21 Add tables and sequences SELECT pglogical.replication_set_add_all_tables ( set_name := 'default', schema_names := ARRAY ['public'] ); SELECT pglogical.replication_set_add_all_sequences ( set_name : = 'default', schema_names : = ARRAY ['public'] );

22. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.22 Create subscription SELECT pglogical.create_subscription( subscription_name := 'my_subscription', provider_dsn := 'host = pg95 port = 5432 dbname = db', );

23. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.23 pglogical.create_subscription( subscription_name name, provider_dsn text, replication_sets text[], synchronize_structure boolean, synchronize_data boolean, forward_origins text[], apply_delay interval ); Create subscription

24. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.24 Check SELECT subscription_name, status FROM pglogical.show_subscription_status(); subscription_name | status ------------------------+------------- my_subscription | replicating

25. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.25 Repeat CREATE EXTENSION pglogical; SELECT pglogical.create_node (...'provider'...); SELECT pglogical.create_node (...'subscriber'...); SELECT pglogical.create_subscription(...);

31. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.31 Conclusions • Pglogical 3 ● Replication slot failover support ● REPLICA IDENTITY FULL ● DDL ● Performance ● Kafka and Rabbitmq ● Partitions ● Conﬂict detection ● Conﬂict resolution ● No SUPERUSER ● Statistics

33. Thank you! Questions? @irionr www.enterprisedb.com/contact

Online Upgrade Using Logical Replication

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Online Upgrade Using Logical Replication

Similar to Online Upgrade Using Logical Replication (20)

More from EDB

More from EDB (20)

Recently uploaded

Recently uploaded (20)

Online Upgrade Using Logical Replication