PostgreSQL ecosystem

•Download as PPTX, PDF•

0 likes•255 views

This document discusses the PostgreSQL ecosystem and provides an overview of various tools and extensions. It begins with introductions of the speaker and Taiwan PostgreSQL User Group. The agenda then covers topics like load balancers (PgBouncer, Pgpool-II), replication (Postgres BDR), REST APIs (PostgREST), schema models (PostGIS, PipelineDB, Apache AGE), scalability (Greenplum DB, Postgres-XC/XC2/XL), foreign data wrappers, and other tools like Apache MADlib. The speaker hopes to promote wider adoption of PostgreSQL in Taiwan and collaboration with local system integrators.

PostgreSQL ecosystem
Speaker: 林宗禧 @ COSCUP x RubyConf TW 2021
Taiwan PostgreSQL User Group
1

About
林宗禧
• PostgreSQL愛好者(2012-)
• PostgreSQL推廣者(2017-)
How to use ?
• 以前: 開發FDW套件 (C, Python都有)
• 後來: 到處整合PG的應用
• 推 Industry 4.0，讓業主不經意的導入 PG
• 推 Smart City Solutions ，拿PG做基礎
2021/7/16 2
Taiwan PostgreSQL User Group

Overview – PostgreSQL ecosystem (1/3)
• https://code.efficiencygeek.com/
Taiwan PostgreSQL User Group 3
2021/7/16

Overview – PostgreSQL ecosystem (2/3)
• https://code.efficiencygeek.com/
Taiwan PostgreSQL User Group 4
2021/7/16

Overview – PostgreSQL ecosystem (3/3)
• https://code.efficiencygeek.com/
Taiwan PostgreSQL User Group 5
2021/7/16

Taiwan PostgreSQL User Group 6
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

Taiwan PostgreSQL User Group 7
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

01. Load Balancers
PgBouncer
• https://www.pgbouncer.org/
• 1.15 - Nov 19, 2020
• 輕量級的 connection pool
• 提供重複使用session機制
• PG 9.5 沒有自動於時斷線機制
• PG 9.6 Transaction Timeout 參數
Taiwan PostgreSQL User Group 8
2021/7/16
https://mlog.club/article/2987957
# vim /etc/pgbouncer/pgbouncer.ini
[database]
Db1 = port=5432 dbname=demo_db1
db2 = host=127.0.0.1 port=5432 dbname=demo_db2
[pgbouncer]
listen_addr = *
listen_port = 6432
auth_type = md5
auth_file = /etc/pgbouncer/userlist.txt
pool_mode = session

01. Load Balancers
Pgpool - II
• https://pgpool.net
• 4.2.3 - May 20, 2021
• Connection Pooling
• Load Balance
• Replication
• Parallel Query
• pgpoolAdmin
Taiwan PostgreSQL User Group 9
2021/7/16
https://www.pgpool.net/docs/pgpool-II-4.1.0/en/html/example-cluster.html

Taiwan PostgreSQL User Group 10
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

02. Replication
Postgres BDR
• 2ndQuadrant
• github.com/2ndQuadrant/bdr
• 1.15 - Nov 19, 2020
• Bi-Directional Replication
• Async multi-master replication
• 最終一致性
• 默認以最後的更新為準
• BDR使用場景
• 有利於: 單一節點修改，減少衝突
• 不利於: 同一時間查詢各節點之修改
Taiwan PostgreSQL User Group 11
2021/7/16
https://www.2ndquadrant.com/en/resources/highly-available-postgresql-clusters/

Taiwan PostgreSQL User Group 12
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

03. Rest API
PostgREST
• https://github.com/PostgREST
• 7.0.1 - May 19, 2020
• 連接資料表直接
提供RESTful API
• 可提供 Swagger ui
Taiwan PostgreSQL User Group 13
2021/7/16
Purohit_Priyank_Kamlesh_202011_MSc_thesis.pdf
https://github.com/tatut/postgrest-ui

Taiwan PostgreSQL User Group 14
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

04. Schema Model
PostGIS
• https://postgis.net/
• 3.1.3 – July 20, 2020
• 地理圖資資料庫模組
(Spatial Database)
• 商用GIS的最佳替代方案
Taiwan PostgreSQL User Group 15
2021/7/16
QGIS 讀取 PostGIS
https://www.slideshare.net/mutolisp/postgis-57051746
SELECT superhero.name
FROM city, superhero
WHERE ST_Contains(city.geom, superhero.geom)
AND city.name = 'Gotham';

04. Schema Model
PipelineDB
• https://github.com/pipelinedb/
• 1.0 – Feb 20, 2019
• 基於PG的時序型資料庫
Taiwan PostgreSQL User Group 16
2021/7/16
pipeline -c "SELECT sum(count) FROM test_view"
sum
-------
100001
(1 row)
pipeline -c "SELECT * FROM test_view ORDER BY
count DESC limit 10"
key | count
-----+-------
2 | 10124
8 | 10100
1 | 10042
7 | 9996
4 | 9991
5 | 9977
3 | 9963
6 | 9927
9 | 9915
10 | 4997
0 | 4969
(11 rows)

04. Schema Model
Apache AGE (Incubating)
• https://age.incubator.apache.org/
• v0.5.0 – Jun 30, 2021
• A Graph Extension for PG
提供 graph function
• 從PG10開始開發，
目前基於PG11開發中
Taiwan PostgreSQL User Group 17
2021/7/16

Taiwan PostgreSQL User Group 18
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

05. Scalability
Taiwan PostgreSQL User Group 19
2021/7/16
Greenplum DB
• https://greenplum.org/
• 6.7.1 – April 2020
• based on PG 9.4
• 架構採用MPP (Massively
Parallel Processor )
• 在 MPP 系統中，每個 SMP
節點也可以運作自己的作業
系統、資料庫等
• Data distribution
• Shared nothing
• MapReduce
https://kknews.cc/tech/5meq9l3.html

05. Scalability
Taiwan PostgreSQL User Group 20
2021/7/16
Postgres-XC / XC2 / XL
• XC https://sourceforge.net/
projects/postgres-xc/
• XC2 https://github.com/
postgres-x2/
• XL https://www.postgres-xl.org/
• Data distribution
• Shared nothing
• GTM
• Coordinator
• Global Catalog
https://zhuanlan.zhihu.com/p/26391728

Taiwan PostgreSQL User Group 21
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

06. Foreign Data Wrappers
PG9.1 FDW - SELECT
PG9.3 FDW -INSERT / UPDATE / DELETE
https://wiki.postgresql.org/wiki/Foreign_data_wrappers
• Generic/Specific SQL Database Wrappers
• NoSQL Database Wrappers
• File / Geo / LDAP Wrappers
• Generic/Specific Web Wrappers
• Big Data Wrappers
• Column-Oriented Wrappers
• Scientific Wrappers
• Operating System Wrappers
• Exotic Wrappers
Taiwan PostgreSQL User Group 22
2021/7/16

06. Foreign Data Wrappers
Taiwan PostgreSQL User Group 23
2021/7/16
Generic / Specific SQL Database Wrappers

06. Foreign Data Wrappers
Taiwan PostgreSQL User Group 24
2021/7/16
NoSQL Database Wrappers

06. Foreign Data Wrappers
Taiwan PostgreSQL User Group 25
2021/7/16
File/Geo/LDAP Database Wrappers

06. Foreign Data Wrappers
Taiwan PostgreSQL User Group 26
2021/7/16
Generic / Specific Web Database Wrappers

06. Foreign Data Wrappers
Taiwan PostgreSQL User Group 27
2021/7/16
Generic / Specific Web Database Wrappers

Taiwan PostgreSQL User Group 28
2021/7/16
Agenda
01. Load Balancers
02. Replication
03. Rest API
04. Schema Model
05. Scalability
06. Foreign Data Wrappers
07. Others & support

07. Others & support
Apache MADlib
Taiwan PostgreSQL User Group 29
2021/7/16

07. Others & support
Apache MADlib
Functions
• 機器學習
• 矩陣分析
• 統計分析
• …
支援
• PostgreSQL
• Greenplum
Taiwan PostgreSQL User Group 30
2021/7/16
https://www.xuehua.us/a/5ebf13a880cf9e4954ac1981

07. Others & support
GUI / WebUI
Taiwan PostgreSQL User Group 31
2021/7/16

有很多不得不推的理由
Taiwan PostgreSQL User Group 32
2021/7/16
• Data Types
• Data Integrity
• Concurrency and Performance
• Reliability, Disaster Recovery
• Security
• Extensibility
• Internationalization, Text Search
• Not relational data (JSON, Hstore, Cstore)
• GIS (Geographic Information System)
最開源、最穩定、最先進…

持續貢獻
DB-engine ranking
• https://db-engines.com/en/ranking
Taiwan PostgreSQL User Group 33
2021/7/16
DBMS of the Year: PostgreSQL

期許…
• 持續為推廣而奔走，期許…
• 國內使用Oracle的辛苦業者，改用 PG
• 鼓勵新創在初期直接採用 PG
• 資料庫教育直接使用 PG 做為教材
• 與國內 SI 共同合作發展台版 PG
Taiwan PostgreSQL User Group 34
2021/7/16

Thank you.
PostgreSQL ecosystem
@ COSCUP x RubyConf TW 2021
Taiwan PostgreSQL User Group
林宗禧 linjose@postgresql.tw
35
https://www.postgresql.fastware.com/

Recommended

PostgreSQL 13 New Features

PostgreSQL 13 New Features

PostgreSQL 13 New Features

InfluxDB IOx Tech Talks: Query Processing in InfluxDB IOx

InfluxDB IOx Tech Talks: Query Processing in InfluxDB IOx

InfluxDB IOx Tech Talks: Query Processing in InfluxDB IOx

Postgres indexing and toward big data application

Postgres indexing and toward big data application

Postgres indexing and toward big data application

Postgres has evolved from its origins as an academic project in the 1980s. It uses indexes like a book index to quickly find data by pointing to specific rows. As more data is added, updated, or deleted, indexes also need updating to accurately reflect the table data. Toward handling big data, Postgres supports parallelism, database partitioning, and sharding to distribute data across multiple machines.

Database-Migration and -Upgrade with Transportable Tablespaces

Database-Migration and -Upgrade with Transportable Tablespaces

Database-Migration and -Upgrade with Transportable Tablespaces

Markus Flechtner

This document discusses using transportable tablespaces (TTS) to migrate a large telecommunications database from HP-UX to Linux with an Oracle upgrade. Key points: - The customer has 4 databases totaling over 15TB that need to be migrated with downtime under 6 hours. TTS was chosen for the migration. - Tuning efforts included resizing files, compression, and parallelizing file transfers and conversions across RAC nodes. - Challenges included long metadata export times. The issue was addressed by splitting exports across multiple self-contained tablespace subsets in parallel. - Automation scripts were created to coordinate the distributed migration work across RAC nodes.

Oracle Multitenant Database 2.0 - Improvements in Oracle Database 12c Release 2

Oracle Multitenant Database 2.0 - Improvements in Oracle Database 12c Release 2

Oracle Multitenant Database 2.0 - Improvements in Oracle Database 12c Release 2

Markus Flechtner

The document discusses new features in Oracle Database 12c Release 2 related to Oracle Multitenant architecture. Key points include: - PDBs can now have local undo tablespaces for improved flashback and other features. - PDBs can be plugged/unplugged into archive files, cloned with hot cloning, refreshed periodically, and relocated between CDBs. - New resource management features allow limiting I/O rates, configuring memory usage, and assigning performance profiles for PDBs. - PDB lockdown profiles provide a way to restrict features and operations on a per-PDB basis.

Setup oracle golden gate 11g replication

Setup oracle golden gate 11g replication

Setup oracle golden gate 11g replication

Postgres vision 2018: The Promise of zheap

Postgres vision 2018: The Promise of zheap

Postgres vision 2018: The Promise of zheap

PostgreSQL has advanced in many ways but bloat remains a challenge. A solution for this in development is zheap, a new storage format in which only the latest version of the data is kept in main storage and the old version will be moved to an undo log. In this presentation delivered at Postgres Vision 2018, Robert Haas, a Major Contributor to the PostgreSQL project who is leading development of zheap at EnterpriseDB, where he is Vice President, Chief Database Architect, explains the project.

Trivadis TechEvent 2017 PostgreSQL für die (Orakel) DBA by Ludovico Caldara

Trivadis TechEvent 2017 PostgreSQL für die (Orakel) DBA by Ludovico Caldara

Trivadis TechEvent 2017 PostgreSQL für die (Orakel) DBA by Ludovico Caldara

Recommended

PostgreSQL 13 New Features

PostgreSQL 13 New Features

PostgreSQL 13 New Features

InfluxDB IOx Tech Talks: Query Processing in InfluxDB IOx

InfluxDB IOx Tech Talks: Query Processing in InfluxDB IOx

InfluxDB IOx Tech Talks: Query Processing in InfluxDB IOx

Postgres indexing and toward big data application

Postgres indexing and toward big data application

Postgres indexing and toward big data application

Postgres has evolved from its origins as an academic project in the 1980s. It uses indexes like a book index to quickly find data by pointing to specific rows. As more data is added, updated, or deleted, indexes also need updating to accurately reflect the table data. Toward handling big data, Postgres supports parallelism, database partitioning, and sharding to distribute data across multiple machines.

Database-Migration and -Upgrade with Transportable Tablespaces

Database-Migration and -Upgrade with Transportable Tablespaces

Database-Migration and -Upgrade with Transportable Tablespaces

Markus Flechtner

This document discusses using transportable tablespaces (TTS) to migrate a large telecommunications database from HP-UX to Linux with an Oracle upgrade. Key points: - The customer has 4 databases totaling over 15TB that need to be migrated with downtime under 6 hours. TTS was chosen for the migration. - Tuning efforts included resizing files, compression, and parallelizing file transfers and conversions across RAC nodes. - Challenges included long metadata export times. The issue was addressed by splitting exports across multiple self-contained tablespace subsets in parallel. - Automation scripts were created to coordinate the distributed migration work across RAC nodes.

Oracle Multitenant Database 2.0 - Improvements in Oracle Database 12c Release 2

Oracle Multitenant Database 2.0 - Improvements in Oracle Database 12c Release 2

Oracle Multitenant Database 2.0 - Improvements in Oracle Database 12c Release 2

Markus Flechtner

The document discusses new features in Oracle Database 12c Release 2 related to Oracle Multitenant architecture. Key points include: - PDBs can now have local undo tablespaces for improved flashback and other features. - PDBs can be plugged/unplugged into archive files, cloned with hot cloning, refreshed periodically, and relocated between CDBs. - New resource management features allow limiting I/O rates, configuring memory usage, and assigning performance profiles for PDBs. - PDB lockdown profiles provide a way to restrict features and operations on a per-PDB basis.

Setup oracle golden gate 11g replication

Setup oracle golden gate 11g replication

Setup oracle golden gate 11g replication

Postgres vision 2018: The Promise of zheap

Postgres vision 2018: The Promise of zheap

Postgres vision 2018: The Promise of zheap

PostgreSQL has advanced in many ways but bloat remains a challenge. A solution for this in development is zheap, a new storage format in which only the latest version of the data is kept in main storage and the old version will be moved to an undo log. In this presentation delivered at Postgres Vision 2018, Robert Haas, a Major Contributor to the PostgreSQL project who is leading development of zheap at EnterpriseDB, where he is Vice President, Chief Database Architect, explains the project.

Trivadis TechEvent 2017 PostgreSQL für die (Orakel) DBA by Ludovico Caldara

Trivadis TechEvent 2017 PostgreSQL für die (Orakel) DBA by Ludovico Caldara

Trivadis TechEvent 2017 PostgreSQL für die (Orakel) DBA by Ludovico Caldara

RAC - The Savior of DBA

RAC - The Savior of DBA

RAC - The Savior of DBA

Real Application Cluster (RAC) allows multiple computers to simultaneously run Oracle RDBMS while accessing a single database, providing clustering. RAC provides high availability, scalability, and ease of administration by making multiple instances transparent to users. Nodes must have identical environments. Oracle Clusterware manages node additions and removals. Instances from different nodes write to the same physical database. The presentation covers RAC architecture, components, startup sequence, single instance configuration, node eviction, and tips for monitoring and improving the RAC environment.

The Google Bigtable

The Google Bigtable

The Google Bigtable

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

Equnix Business Solutions

PGSpider is a high-performance SQL cluster engine developed by Toshiba Corporation. It allows distributed querying of heterogeneous data sources using standard SQL. PGSpider improves retrieval performance through parallel queries across nodes and supports multi-tenant querying to retrieve records from the same table across nodes. It utilizes techniques like pushdown of conditional expressions and aggregation functions to nodes to reduce network traffic.

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

The document discusses PostgreSQL's write-ahead log (WAL), which records database changes before writing them to disk for crash safety. The WAL allows for features like online backups by archiving WAL records, point-in-time recovery by restoring from backups and replaying WAL, and replication by transmitting WAL to standby servers. It works by writing each change as a WAL record before updating data pages, and replaying the log during recovery to reconstruct unfinished transactions after a crash.

Wayfair Use Case: The four R's of Metrics Delivery

Wayfair Use Case: The four R's of Metrics Delivery

Wayfair Use Case: The four R's of Metrics Delivery

Oracle 12c Multi Process Multi Threaded

Oracle 12c Multi Process Multi Threaded

Oracle 12c Multi Process Multi Threaded

Markus Flechtner

The document discusses Oracle 12c's new "multi-process multi-threaded" model. This new feature allows Oracle database processes on Linux/Unix systems to run as operating system threads rather than processes. This reduces resource consumption by eliminating redundant memory and CPU usage from separate processes. Background processes and local client connections now run as threads within larger processes. Remote clients still use dedicated processes that connect via a connection broker thread.

Postgres clusters

Postgres clusters

Postgres clusters

This document provides an overview of Postgres clustering solutions and distributed Postgres architectures. It discusses master-slave replication, Postgres-XC/XL, Greenplum, CitusDB, pg_shard, BDR, pg_logical, and challenges around distributed transactions, high availability, and multimaster replication. Key points include the tradeoffs of different approaches and an implementation of multimaster replication built on pg_logical and a timestamp-based distributed transaction manager (tsDTM) that provides partition tolerance and automatic failover.

Wait! What’s going on inside my database?

Wait! What’s going on inside my database?

Wait! What’s going on inside my database?

Jeremy Schneider

PostgreSQL 9.6 introduced wait events and PostgreSQL 10 progressed them, but what are they? What do they mean? How do I find them and how do I make them go away? Wait events are one of the most significant advancements in observability for PostgreSQL databases; their usefulness is unparalleled in troubleshooting performance. This talk will go into all that and more as we explore the world of PostgreSQL wait events.

Whitepaper: Exadata Consolidation Success Story

Whitepaper: Exadata Consolidation Success Story

Whitepaper: Exadata Consolidation Success Story

Kristofferson A

1. The document discusses database and server consolidation using Oracle Exadata and describes the challenges of managing highly consolidated environments to ensure quality of service. 2. It outlines a 4-step process for accurate provisioning and capacity planning using a tool called the Provisioning Worksheet: collecting database details, defining the target Exadata hardware capacity, creating a provisioning plan, and reviewing resource utilization. 3. The process relies on basic capacity planning to ensure workload requirements fit available capacity. Database CPU and storage requirements are gathered, a target Exadata configuration is set, databases are mapped to nodes in the plan, and final utilization is summarized to identify any capacity shortfalls.

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Oracle is the most powerful DBMS in the world. However, Oracle's expensive and complex replication makes it difficult to build highly available applications or move data in real-time to data warehouses and popular databases like MySQL. In this webinar you will learn how Continuent Tungsten solves problems with Oracle replication at a fraction of the cost of other solutions and with less management overhead too – think "Oracle GoldenGate without the price tag!" We will demo constructing a highly available site using Oracle-to-Oracle replication. We will then show you how to replicate data in real time from Oracle to MySQL as well as load a data warehouse.

PostgreSQL WAL for DBAs

PostgreSQL WAL for DBAs

PostgreSQL WAL for DBAs

Devrim Gunduz gives a presentation on Write-Ahead Logging (WAL) in PostgreSQL. WAL logs all transactions to files called write-ahead logs (WAL files) before changes are written to data files. This allows for crash recovery by replaying WAL files. WAL files are used for replication, backup, and point-in-time recovery (PITR) by replaying WAL files to restore the database to a previous state. Checkpoints write all dirty shared buffers to disk and update the pg_control file with the checkpoint location.

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

Equnix Business Solutions

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Gittigidiyor, a subsidiary of eBay, needed to replicate data in real time from their MySQL database to an Oracle database to power their data warehouse. Continuent Tungsten was used to provide heterogeneous replication between the databases. The schema was translated from MySQL to Oracle using ddlscan. Initial data was exported and loaded into Oracle using parallel apply. Ongoing real-time replication now occurs between MySQL and Oracle using Tungsten Replicator with custom filters to handle data type translations.

Presentation 12c grid_upgrade

Presentation 12c grid_upgrade

Presentation 12c grid_upgrade

Tungsten University: Setup & Operate Tungsten Replicator

Tungsten University: Setup & Operate Tungsten Replicator

Tungsten University: Setup & Operate Tungsten Replicator

Do you have the background necessary to take full advantage of Tungsten Replicator in your environments? Tungsten offers enterprise-quality replication features in an open source package hosted on Google Code. This virtual course will teach you how to set up innovative topologies that solve complex replication problems. We start with single MySQL servers running MySQL replication and show a simple path migration path to Tungsten. Course Topics - Checking host and MySQL prerequisites - Downloading code from http://code.google.com/p/tungsten-replicator/ - Installation using the tungsten-installer utility - Transaction filtering using standard filters as well as customized filters you write yourself - Enabling and managing parallel replication - Configuring multi-master and fan-in using multiple replication services - Backup and restore integration - Troubleshooting replication problems - Logging bugs and participating in the Tungsten Replicator community. Replication is a powerful technology that takes knowledge and planning to use effectively. We give you the background that makes replication easier to set up, and allows you to take full advantage of the Tungsten Replicator benefits. Learn how to configure and use it more effectively for your projects in the cloud as well as on-premise hardware.

oracle 11G RAC Trianing Noida Delhi NCR

oracle 11G RAC Trianing Noida Delhi NCR

oracle 11G RAC Trianing Noida Delhi NCR

Shri Prakash Pandey

DUCAT imparts training in a way that is more practical and efficient. Anyone who wants to learn ORACLE 11G RAC needs to look no further than DUCAT. It gives training so that after the training ORACLE 11G RAC becomes a part of you. ORACLE 11G RAC starts where Oracle Parallel Server ends. It allows someone to approach the same database simultaneously. It ensures full tolerance, load balancing and of course performance. The heart of this technology is a concept of shared disk subsystem.

Oracle dataguard overview

Oracle dataguard overview

Oracle dataguard overview

Oracle Data Guard provides several key benefits: continuous database service during disasters or data failures, complete data protection against corruptions and loss, and offloading of queries and backups from primary systems. It uses redo transport to transfer redo logs from a primary database to one or more standby databases, and log apply to maintain synchronization. Different protection modes like maximum protection or maximum performance allow balancing data protection against primary performance.

Oow 2008 yahoo_pie-db

Oow 2008 yahoo_pie-db

Oow 2008 yahoo_pie-db

The document summarizes the architecture and configuration of a large-scale data warehouse implemented at Yahoo using Oracle RAC on IBM x3850 servers. Key aspects included 16-node Oracle RAC with InfiniBand networking, EMC storage, large memory and CPU configurations to support multi-terabyte datasets and high query concurrency. Comprehensive testing was performed to validate performance and scalability requirements.

Hot-Spot analysis Using Apache Spark framework

Hot-Spot analysis Using Apache Spark framework

Hot-Spot analysis Using Apache Spark framework

This document describes using Apache Spark and GeoSpark to process large-scale spatial and spatial-temporal data. It discusses loading spatial data into Resilient Distributed Datasets (RDDs) using GeoSpark APIs and performing operations like spatial range queries, k-nearest neighbor queries, and spatial joins on the data. It also describes implementing hot spot analysis to identify statistically significant hot spots in the spatial data using spatial statistics in Apache Spark. The document outlines the system design, including using Hadoop and Spark on a cluster, and describes experiments run on spatial data to analyze query efficiency and performance at scale.

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Postgres relies heavily on an extension ecosystem, but that is almost 100% dependent on C; which cuts out developers, libraries, and ideas from the world of Postgres. postgres-extension.rs changes that by supporting development of extensions in Rust. Rust is a memory-safe language that integrates nicely in any environment, has powerful libraries, a vibrant ecosystem, and a prolific developer community. Rust is a unique language because it supports high-level features but all the magic happens at compile-time, and the resulting code is not dependent on an intrusive or bulky runtime. That makes it ideal for integrating with postgres, which has a lot of its own runtime, like memory contexts and signal handlers. postgres-extension.rs offers this integration, allowing the development of extensions in rust, even if deeply-integrated into the postgres internals, and helping handle tricky issues like error handling. This is done through a collection of Rust function declarations, macros, and utility functions that allow rust code to call into postgres, and safely handle resulting errors.

Integrating PostGIS in Web Applications

Integrating PostGIS in Web Applications

Integrating PostGIS in Web Applications

Command Prompt., Inc

State of GeoServer 2015

State of GeoServer 2015

State of GeoServer 2015

State of GeoServer reviewing the new and noteworthy features introduced in the past year. The project has an aggressive six month release cycle with GeoServer 2.7 and 2.8 being released this year. These releases bring together exciting new features. A lot of work has been done on processing services with clustering, security and processing control. The rendering engine continues to improve with the addition of color blending opening up a range of creative possibilities. The CSS extension (used to easily generate OGC standard styles) has been cleaned up with a rewrite. This talk will highlighted updates on data import, application schema use, data transforms and the latest from the developer list. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.

More Related Content

What's hot

RAC - The Savior of DBA

RAC - The Savior of DBA

RAC - The Savior of DBA

Real Application Cluster (RAC) allows multiple computers to simultaneously run Oracle RDBMS while accessing a single database, providing clustering. RAC provides high availability, scalability, and ease of administration by making multiple instances transparent to users. Nodes must have identical environments. Oracle Clusterware manages node additions and removals. Instances from different nodes write to the same physical database. The presentation covers RAC architecture, components, startup sequence, single instance configuration, node eviction, and tips for monitoring and improving the RAC environment.

The Google Bigtable

The Google Bigtable

The Google Bigtable

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

Equnix Business Solutions

PGSpider is a high-performance SQL cluster engine developed by Toshiba Corporation. It allows distributed querying of heterogeneous data sources using standard SQL. PGSpider improves retrieval performance through parallel queries across nodes and supports multi-tenant querying to retrieve records from the same table across nodes. It utilizes techniques like pushdown of conditional expressions and aggregation functions to nodes to reduce network traffic.

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

The document discusses PostgreSQL's write-ahead log (WAL), which records database changes before writing them to disk for crash safety. The WAL allows for features like online backups by archiving WAL records, point-in-time recovery by restoring from backups and replaying WAL, and replication by transmitting WAL to standby servers. It works by writing each change as a WAL record before updating data pages, and replaying the log during recovery to reconstruct unfinished transactions after a crash.

Wayfair Use Case: The four R's of Metrics Delivery

Wayfair Use Case: The four R's of Metrics Delivery

Wayfair Use Case: The four R's of Metrics Delivery

Oracle 12c Multi Process Multi Threaded

Oracle 12c Multi Process Multi Threaded

Oracle 12c Multi Process Multi Threaded

Markus Flechtner

The document discusses Oracle 12c's new "multi-process multi-threaded" model. This new feature allows Oracle database processes on Linux/Unix systems to run as operating system threads rather than processes. This reduces resource consumption by eliminating redundant memory and CPU usage from separate processes. Background processes and local client connections now run as threads within larger processes. Remote clients still use dedicated processes that connect via a connection broker thread.

Postgres clusters

Postgres clusters

Postgres clusters

This document provides an overview of Postgres clustering solutions and distributed Postgres architectures. It discusses master-slave replication, Postgres-XC/XL, Greenplum, CitusDB, pg_shard, BDR, pg_logical, and challenges around distributed transactions, high availability, and multimaster replication. Key points include the tradeoffs of different approaches and an implementation of multimaster replication built on pg_logical and a timestamp-based distributed transaction manager (tsDTM) that provides partition tolerance and automatic failover.

Wait! What’s going on inside my database?

Wait! What’s going on inside my database?

Wait! What’s going on inside my database?

Jeremy Schneider

PostgreSQL 9.6 introduced wait events and PostgreSQL 10 progressed them, but what are they? What do they mean? How do I find them and how do I make them go away? Wait events are one of the most significant advancements in observability for PostgreSQL databases; their usefulness is unparalleled in troubleshooting performance. This talk will go into all that and more as we explore the world of PostgreSQL wait events.

Whitepaper: Exadata Consolidation Success Story

Whitepaper: Exadata Consolidation Success Story

Whitepaper: Exadata Consolidation Success Story

Kristofferson A

1. The document discusses database and server consolidation using Oracle Exadata and describes the challenges of managing highly consolidated environments to ensure quality of service. 2. It outlines a 4-step process for accurate provisioning and capacity planning using a tool called the Provisioning Worksheet: collecting database details, defining the target Exadata hardware capacity, creating a provisioning plan, and reviewing resource utilization. 3. The process relies on basic capacity planning to ensure workload requirements fit available capacity. Database CPU and storage requirements are gathered, a target Exadata configuration is set, databases are mapped to nodes in the plan, and final utilization is summarized to identify any capacity shortfalls.

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Oracle is the most powerful DBMS in the world. However, Oracle's expensive and complex replication makes it difficult to build highly available applications or move data in real-time to data warehouses and popular databases like MySQL. In this webinar you will learn how Continuent Tungsten solves problems with Oracle replication at a fraction of the cost of other solutions and with less management overhead too – think "Oracle GoldenGate without the price tag!" We will demo constructing a highly available site using Oracle-to-Oracle replication. We will then show you how to replicate data in real time from Oracle to MySQL as well as load a data warehouse.

PostgreSQL WAL for DBAs

PostgreSQL WAL for DBAs

PostgreSQL WAL for DBAs

Devrim Gunduz gives a presentation on Write-Ahead Logging (WAL) in PostgreSQL. WAL logs all transactions to files called write-ahead logs (WAL files) before changes are written to data files. This allows for crash recovery by replaying WAL files. WAL files are used for replication, backup, and point-in-time recovery (PITR) by replaying WAL files to restore the database to a previous state. Checkpoints write all dirty shared buffers to disk and update the pg_control file with the checkpoint location.

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

Equnix Business Solutions

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Gittigidiyor, a subsidiary of eBay, needed to replicate data in real time from their MySQL database to an Oracle database to power their data warehouse. Continuent Tungsten was used to provide heterogeneous replication between the databases. The schema was translated from MySQL to Oracle using ddlscan. Initial data was exported and loaded into Oracle using parallel apply. Ongoing real-time replication now occurs between MySQL and Oracle using Tungsten Replicator with custom filters to handle data type translations.

Presentation 12c grid_upgrade

Presentation 12c grid_upgrade

Presentation 12c grid_upgrade

Tungsten University: Setup & Operate Tungsten Replicator

Tungsten University: Setup & Operate Tungsten Replicator

Tungsten University: Setup & Operate Tungsten Replicator

Do you have the background necessary to take full advantage of Tungsten Replicator in your environments? Tungsten offers enterprise-quality replication features in an open source package hosted on Google Code. This virtual course will teach you how to set up innovative topologies that solve complex replication problems. We start with single MySQL servers running MySQL replication and show a simple path migration path to Tungsten. Course Topics - Checking host and MySQL prerequisites - Downloading code from http://code.google.com/p/tungsten-replicator/ - Installation using the tungsten-installer utility - Transaction filtering using standard filters as well as customized filters you write yourself - Enabling and managing parallel replication - Configuring multi-master and fan-in using multiple replication services - Backup and restore integration - Troubleshooting replication problems - Logging bugs and participating in the Tungsten Replicator community. Replication is a powerful technology that takes knowledge and planning to use effectively. We give you the background that makes replication easier to set up, and allows you to take full advantage of the Tungsten Replicator benefits. Learn how to configure and use it more effectively for your projects in the cloud as well as on-premise hardware.

oracle 11G RAC Trianing Noida Delhi NCR

oracle 11G RAC Trianing Noida Delhi NCR

oracle 11G RAC Trianing Noida Delhi NCR

Shri Prakash Pandey

DUCAT imparts training in a way that is more practical and efficient. Anyone who wants to learn ORACLE 11G RAC needs to look no further than DUCAT. It gives training so that after the training ORACLE 11G RAC becomes a part of you. ORACLE 11G RAC starts where Oracle Parallel Server ends. It allows someone to approach the same database simultaneously. It ensures full tolerance, load balancing and of course performance. The heart of this technology is a concept of shared disk subsystem.

Oracle dataguard overview

Oracle dataguard overview

Oracle dataguard overview

Oracle Data Guard provides several key benefits: continuous database service during disasters or data failures, complete data protection against corruptions and loss, and offloading of queries and backups from primary systems. It uses redo transport to transfer redo logs from a primary database to one or more standby databases, and log apply to maintain synchronization. Different protection modes like maximum protection or maximum performance allow balancing data protection against primary performance.

Oow 2008 yahoo_pie-db

Oow 2008 yahoo_pie-db

Oow 2008 yahoo_pie-db

The document summarizes the architecture and configuration of a large-scale data warehouse implemented at Yahoo using Oracle RAC on IBM x3850 servers. Key aspects included 16-node Oracle RAC with InfiniBand networking, EMC storage, large memory and CPU configurations to support multi-terabyte datasets and high query concurrency. Comprehensive testing was performed to validate performance and scalability requirements.

Hot-Spot analysis Using Apache Spark framework

Hot-Spot analysis Using Apache Spark framework

Hot-Spot analysis Using Apache Spark framework

This document describes using Apache Spark and GeoSpark to process large-scale spatial and spatial-temporal data. It discusses loading spatial data into Resilient Distributed Datasets (RDDs) using GeoSpark APIs and performing operations like spatial range queries, k-nearest neighbor queries, and spatial joins on the data. It also describes implementing hot spot analysis to identify statistically significant hot spots in the spatial data using spatial statistics in Apache Spark. The document outlines the system design, including using Hadoop and Spark on a cluster, and describes experiments run on spatial data to analyze query efficiency and performance at scale.

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Postgres relies heavily on an extension ecosystem, but that is almost 100% dependent on C; which cuts out developers, libraries, and ideas from the world of Postgres. postgres-extension.rs changes that by supporting development of extensions in Rust. Rust is a memory-safe language that integrates nicely in any environment, has powerful libraries, a vibrant ecosystem, and a prolific developer community. Rust is a unique language because it supports high-level features but all the magic happens at compile-time, and the resulting code is not dependent on an intrusive or bulky runtime. That makes it ideal for integrating with postgres, which has a lot of its own runtime, like memory contexts and signal handlers. postgres-extension.rs offers this integration, allowing the development of extensions in rust, even if deeply-integrated into the postgres internals, and helping handle tricky issues like error handling. This is done through a collection of Rust function declarations, macros, and utility functions that allow rust code to call into postgres, and safely handle resulting errors.

What's hot (20)

RAC - The Savior of DBA

RAC - The Savior of DBA

RAC - The Savior of DBA

The Google Bigtable

The Google Bigtable

The Google Bigtable

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

PostgreSQL Write-Ahead Log (Heikki Linnakangas)

Wayfair Use Case: The four R's of Metrics Delivery

Wayfair Use Case: The four R's of Metrics Delivery

Wayfair Use Case: The four R's of Metrics Delivery

Oracle 12c Multi Process Multi Threaded

Oracle 12c Multi Process Multi Threaded

Oracle 12c Multi Process Multi Threaded

Postgres clusters

Postgres clusters

Postgres clusters

Wait! What’s going on inside my database?

Wait! What’s going on inside my database?

Wait! What’s going on inside my database?

Whitepaper: Exadata Consolidation Success Story

Whitepaper: Exadata Consolidation Success Story

Whitepaper: Exadata Consolidation Success Story

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

Replicate from Oracle to Oracle, Oracle to MySQL, and Oracle to Analytics

PostgreSQL WAL for DBAs

PostgreSQL WAL for DBAs

PostgreSQL WAL for DBAs

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

PGConf.ASIA 2019 Bali - Fault Tolerance in PostgreSQL - Muhammad Haroon

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Tungsten Use Case: How Gittigidiyor (a subsidiary of eBay) Replicates Data In...

Presentation 12c grid_upgrade

Presentation 12c grid_upgrade

Presentation 12c grid_upgrade

Tungsten University: Setup & Operate Tungsten Replicator

Tungsten University: Setup & Operate Tungsten Replicator

Tungsten University: Setup & Operate Tungsten Replicator

oracle 11G RAC Trianing Noida Delhi NCR

oracle 11G RAC Trianing Noida Delhi NCR

oracle 11G RAC Trianing Noida Delhi NCR

Oracle dataguard overview

Oracle dataguard overview

Oracle dataguard overview

Oow 2008 yahoo_pie-db

Oow 2008 yahoo_pie-db

Oow 2008 yahoo_pie-db

Hot-Spot analysis Using Apache Spark framework

Hot-Spot analysis Using Apache Spark framework

Hot-Spot analysis Using Apache Spark framework

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Deep Postgres Extensions in Rust | PGCon 2019 | Jeff Davis

Similar to PostgreSQL ecosystem

Integrating PostGIS in Web Applications

Integrating PostGIS in Web Applications

Integrating PostGIS in Web Applications

Command Prompt., Inc

State of GeoServer 2015

State of GeoServer 2015

State of GeoServer 2015

State of GeoServer reviewing the new and noteworthy features introduced in the past year. The project has an aggressive six month release cycle with GeoServer 2.7 and 2.8 being released this year. These releases bring together exciting new features. A lot of work has been done on processing services with clustering, security and processing control. The rendering engine continues to improve with the addition of color blending opening up a range of creative possibilities. The CSS extension (used to easily generate OGC standard styles) has been cleaned up with a rewrite. This talk will highlighted updates on data import, application schema use, data transforms and the latest from the developer list. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.

State of GeoServer

State of GeoServer

State of GeoServer

State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year. Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summ...

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summ...

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summ...

Lightning Talk by Dr. Wei-Min Lu, Founder and CEO Anchora. The Shanghai Jiao Tong University PaaS is a community cloud PaaS based on Cloud Foundry jointly built and operated by the Network and Information Center at Shanghai Jiao Tong University and MoPaaS/Anchora. It serves more than 10,000 professors, instructors, and researchers, and more than 50,000 undergraduate and graduate students. In particular, it provides an agile cloud application platform for R&D and teaching. In this talk, I will share our experience building and operating such a community PaaS using Cloud Foundry.

Lodstats: The Data Web Census Dataset. Kobe, Japan, 2016

Lodstats: The Data Web Census Dataset. Kobe, Japan, 2016

Lodstats: The Data Web Census Dataset. Kobe, Japan, 2016

Database Migrations with Gradle and Liquibase

Database Migrations with Gradle and Liquibase

Database Migrations with Gradle and Liquibase

Database migration scripts are a notorious source of difficulty in the software delivery process. This session will discuss how we neutralized this all too common headache. Now our deployment framework executes database migrations automatically with every application deploy, and the QA team performs self-service full stack deployments in test environments. The resulting additional bandwidth has been invested in more frequent software releases, and the opportunity to focus on higher-value tasks.

State of GeoServer - FOSS4G 2016

State of GeoServer - FOSS4G 2016

State of GeoServer - FOSS4G 2016

State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year. Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.

PostgreSQL 9.5 Foreign Data Wrappers

PostgreSQL 9.5 Foreign Data Wrappers

PostgreSQL 9.5 Foreign Data Wrappers

Nicholas Kiraly

Foreign data wrappers in PostgreSQL allow data from external data stores like MySQL, Redis, and CSV files to be accessed using SQL. Wrappers implement the SQL/MED specification and are developed as PostgreSQL extensions. This allows data from these sources to be queried, analyzed, transformed, and indexed using PostgreSQL features. The presentation demonstrated creating foreign servers, user mappings, and tables to integrate yard inventory from CSV, online inventory from Redis, and sales from MySQL into a single PostgreSQL database.

Introduction to Open Source GIS

Introduction to Open Source GIS

Introduction to Open Source GIS

Migration From Oracle to PostgreSQL

Migration From Oracle to PostgreSQL

Migration From Oracle to PostgreSQL

A BASILar Approach for Building Web APIs on top of SPARQL Endpoints

A BASILar Approach for Building Web APIs on top of SPARQL Endpoints

A BASILar Approach for Building Web APIs on top of SPARQL Endpoints

Presented at #SALAD2015 The heterogeneity of methods and technologies to publish open data is still an issue to develop distributed systems on the Web. On the one hand, Web APIs, the most popular approach to offer data services, implement REST principles, which focus on addressing loose coupling and interoperability issues. On the other hand, Linked Data, available through SPARQL endpoints, focus on data integration between distributed data sources. We proposes BASIL, an approach to build Web APIs on top of SPARQL endpoints, in order to benefit of the advantages from both Web APIs and Linked Data approaches. Compared to similar solution, BASIL aims on minimising the learning curve for users to promote its adoption. The main feature of BASIL is a simple API that does not introduce new specifications, formalisms and technologies for users that belong to both Web APIs and Linked Data communities.

patroni-based citrus high availability environment deployment

patroni-based citrus high availability environment deployment

patroni-based citrus high availability environment deployment

The document discusses deploying a Citus high availability environment using Patroni. It begins with an introduction and agenda. It then covers service discovery with Consul, dynamic configuration using ConfD and Consul templates, high availability with Patroni, and distributed PostgreSQL with Citus. Key points include that Patroni allows customized PostgreSQL high availability solutions, Citus enables scaling out PostgreSQL across nodes, and the demo would show integrating these for a production-ready scalable and highly available database cluster.

PostgreSQL as a Strategic Tool

PostgreSQL as a Strategic Tool

PostgreSQL as a Strategic Tool

During this webinar, we will review best practices and lessons learned from working with large and mid-size companies on their deployment of PostgreSQL. We will explore the practices that helped industry leaders move through these stages quickly, and get as much value out of PostgreSQL as possible without incurring undue risk. We have identified a set of levers that companies can use to accelerate their success with PostgreSQL: - Application Tiering - Collaboration between DBAs and Development Teams - Evangelizing - Standardization and Automation - Balance of Migration and New Development

Midao JDBC presentation

Midao JDBC presentation

Midao JDBC presentation

Zachar Prychoda

Midao is a project that unites several data-oriented projects under an umbrella. It aims to simplify working with local, remote, distributed, document, and relational databases with a single API. Midao JDBC, which was already released, simplifies working with relational databases using Java JDBC by handling transactions, metadata, types, input/output processing, and more. Future Midao components will simplify working with other data storage systems and are planned for release by the end of 2014 or 2015. The Midao libraries are developed in Java and licensed under the Apache License Version 2.0.

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

New enhancements for security and usability in EDB 13

New enhancements for security and usability in EDB 13

New enhancements for security and usability in EDB 13

This document provides an overview of new enhancements in EDB 13 for security, usability and compatibility. Key highlights include improvements to Postgres Enterprise Manager for managing very large databases, enhanced security features like channel binding for authentication, and improved compatibility for Oracle migrations through features like automatic partitioning and Oracle compatible functions. It also outlines new capabilities in PostgreSQL 13 like parallel vacuuming and security tools, as well as enhancements to EDB tools for high availability, backup/recovery and Oracle compatibility.

Minerva: Drill Storage Plugin for IPFS

Minerva: Drill Storage Plugin for IPFS

Minerva: Drill Storage Plugin for IPFS

12 steps for IPv6 Deployment in Governments and Enterprises

12 steps for IPv6 Deployment in Governments and Enterprises

12 steps for IPv6 Deployment in Governments and Enterprises

Training is the first step, as IPv6 requires redesigning networks and is not like IPv4. A transition plan requires in-depth IPv6 knowledge of the current network and future evolution. It affects client devices, applications, and how small entities will deploy IPv6. The document outlines 12 steps for transitioning to a dual-stack network with the long-term goal of IPv6-only, including getting training, creating a deployment strategy, controlling DNS, considering BGP, developing an addressing plan, obtaining internet resources, using an IPAM tool, assigning and auditing addresses, verifying IPv6 support, testing applications, and checking contracts with third parties.

Managing Data in Jakarta EE Applications

Managing Data in Jakarta EE Applications

Managing Data in Jakarta EE Applications

In this talk, we will delve into the complexities of managing data in enterprise Java applications. Effective data management is crucial for maintaining the integrity, availability, and security of enterprise systems. Attendees will gain a deep understanding of various aspects related to data management, including data modeling, persistence frameworks, caching strategies, scalability, and data synchronization. Through real-world examples and best practices, this session aims to equip developers with the knowledge and tools necessary to efficiently handle data in their Java applications.

Flagis linked open_data_stijn_goedertier

Flagis linked open_data_stijn_goedertier

Flagis linked open_data_stijn_goedertier

This document discusses linked spatial data and spatial data infrastructures. It provides examples of using URIs to represent spatial things and linking spatial datasets. Key points discussed include: 1. Using URIs and HTTP to identify spatial things like locations and allowing information about those things to be retrieved in different formats like RDF and GML. 2. Examples of using linked spatial data for tasks like looking up information, identifying locations, linking datasets, and querying spatial relationships between objects. 3. Initiatives to link spatial metadata standards like ISO19115 to open data schemas like DCAT-AP to make spatial data more accessible on the web. 4. Revenue models for linked data providers including public funding, advertisements, and

Similar to PostgreSQL ecosystem (20)

Integrating PostGIS in Web Applications

Integrating PostGIS in Web Applications

Integrating PostGIS in Web Applications

State of GeoServer 2015

State of GeoServer 2015

State of GeoServer 2015

State of GeoServer

State of GeoServer

State of GeoServer

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summ...

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summ...

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summ...

Lodstats: The Data Web Census Dataset. Kobe, Japan, 2016

Lodstats: The Data Web Census Dataset. Kobe, Japan, 2016

Lodstats: The Data Web Census Dataset. Kobe, Japan, 2016

Database Migrations with Gradle and Liquibase

Database Migrations with Gradle and Liquibase

Database Migrations with Gradle and Liquibase

State of GeoServer - FOSS4G 2016

State of GeoServer - FOSS4G 2016

State of GeoServer - FOSS4G 2016

PostgreSQL 9.5 Foreign Data Wrappers

PostgreSQL 9.5 Foreign Data Wrappers

PostgreSQL 9.5 Foreign Data Wrappers

Introduction to Open Source GIS

Introduction to Open Source GIS

Introduction to Open Source GIS

Migration From Oracle to PostgreSQL

Migration From Oracle to PostgreSQL

Migration From Oracle to PostgreSQL

A BASILar Approach for Building Web APIs on top of SPARQL Endpoints

A BASILar Approach for Building Web APIs on top of SPARQL Endpoints

A BASILar Approach for Building Web APIs on top of SPARQL Endpoints

patroni-based citrus high availability environment deployment

patroni-based citrus high availability environment deployment

patroni-based citrus high availability environment deployment

PostgreSQL as a Strategic Tool

PostgreSQL as a Strategic Tool

PostgreSQL as a Strategic Tool

Midao JDBC presentation

Midao JDBC presentation

Midao JDBC presentation

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

New enhancements for security and usability in EDB 13

New enhancements for security and usability in EDB 13

New enhancements for security and usability in EDB 13

Minerva: Drill Storage Plugin for IPFS

Minerva: Drill Storage Plugin for IPFS

Minerva: Drill Storage Plugin for IPFS

12 steps for IPv6 Deployment in Governments and Enterprises

12 steps for IPv6 Deployment in Governments and Enterprises

12 steps for IPv6 Deployment in Governments and Enterprises

Managing Data in Jakarta EE Applications

Managing Data in Jakarta EE Applications

Managing Data in Jakarta EE Applications

Flagis linked open_data_stijn_goedertier

Flagis linked open_data_stijn_goedertier

Flagis linked open_data_stijn_goedertier

More from José Lin

2023 COSCUP - Whats new in PostgreSQL 16

2023 COSCUP - Whats new in PostgreSQL 16

2023 COSCUP - Whats new in PostgreSQL 16

This document contains an agenda for a presentation on PostgreSQL. The agenda includes 10 items: 1) improving adaptability to large environments, 2) monitoring, 3) client applications, 4) server management and operations, 5) localization, 6) security, 7) SQL functions and commands, 8) performance, 9) logical replication, and 10) conclusion. It also includes several links to external resources providing additional information on topics related to PostgreSQL.

2022 COSCUP - Let's speed up your PostgreSQL services!.pptx

2022 COSCUP - Let's speed up your PostgreSQL services!.pptx

2022 COSCUP - Let's speed up your PostgreSQL services!.pptx

This document discusses ways to speed up PostgreSQL services. It begins with an introduction of the speaker and covers three main topics: architecture design, query optimization, and parameter configuration. For architecture design, it recommends using connection pools like PgBouncer and read-write separation with Pgpool-II. For query optimization, it suggests finding slow queries, diagnosing abnormal SQL, using EXPLAIN, and parallel queries. For parameter configuration, it provides guidance on tuning background writer settings and memory-related parameters. The goal is to avoid bottlenecks being discovered only during emergencies and optimize performance without focusing on hardware.

The Digital Experiences with Postgresql in Taiwan

The Digital Experiences with Postgresql in Taiwan

The Digital Experiences with Postgresql in Taiwan

What's new in PostgreSQL 11 ?

What's new in PostgreSQL 11 ?

What's new in PostgreSQL 11 ?

The document summarizes the new features in PostgreSQL 11, including enhancements to table partitioning such as hash partitioning, default partitions, updating partition keys, automatically creating indexes on partitions, adding unique constraints to partitions, and enabling partition-wise joins and aggregates. It also provides examples of using various partitioning features and explains the benefits of partition-wise processing.

PostgreSQL 10 New Features

PostgreSQL 10 New Features

PostgreSQL 10 New Features

2016-12-15 NewSQL資料庫在IoT的應用 - iServDB

2016-12-15 NewSQL資料庫在IoT的應用 - iServDB

2016-12-15 NewSQL資料庫在IoT的應用 - iServDB

開源技術建構訂票交易資料庫

More from José Lin (7)

2023 COSCUP - Whats new in PostgreSQL 16

2023 COSCUP - Whats new in PostgreSQL 16

2023 COSCUP - Whats new in PostgreSQL 16

2022 COSCUP - Let's speed up your PostgreSQL services!.pptx

2022 COSCUP - Let's speed up your PostgreSQL services!.pptx

2022 COSCUP - Let's speed up your PostgreSQL services!.pptx

The Digital Experiences with Postgresql in Taiwan

The Digital Experiences with Postgresql in Taiwan

The Digital Experiences with Postgresql in Taiwan

What's new in PostgreSQL 11 ?

What's new in PostgreSQL 11 ?

What's new in PostgreSQL 11 ?

PostgreSQL 10 New Features

PostgreSQL 10 New Features

PostgreSQL 10 New Features

2016-12-15 NewSQL資料庫在IoT的應用 - iServDB

2016-12-15 NewSQL資料庫在IoT的應用 - iServDB

2016-12-15 NewSQL資料庫在IoT的應用 - iServDB

開源技術建構訂票交易資料庫

Recently uploaded

Columbus Data & Analytics Wednesdays - June 2024

Columbus Data & Analytics Wednesdays - June 2024

Columbus Data & Analytics Wednesdays - June 2024

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Pitangent Analytics & Technology Solutions Pvt. Ltd

Programming Foundation Models with DSPy - Meetup Slides

Programming Foundation Models with DSPy - Meetup Slides

Programming Foundation Models with DSPy - Meetup Slides

Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors

Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors

Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors

Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more. The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications. We’ll discuss and demo the benefits of UiPath Apps and connectors including: Creating a compelling user experience for any software, without the limitations of APIs. Accelerating the app creation process, saving time and effort Enjoying high-performance CRUD (create, read, update, delete) operations, for seamless data management. Speakers: Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP Charlie Greenberg, host

Leveraging the Graph for Clinical Trials and Standards

Leveraging the Graph for Clinical Trials and Standards

Leveraging the Graph for Clinical Trials and Standards

Y-Combinator seed pitch deck template PP

Y-Combinator seed pitch deck template PP

Y-Combinator seed pitch deck template PP

Essentials of Automations: Exploring Attributes & Automation Parameters

Essentials of Automations: Exploring Attributes & Automation Parameters

Essentials of Automations: Exploring Attributes & Automation Parameters

Building automations in FME Flow can save time, money, and help businesses scale by eliminating data silos and providing data to stakeholders in real-time. One essential component to orchestrating complex automations is the use of attributes & automation parameters (both formerly known as “keys”). In fact, it’s unlikely you’ll ever build an Automation without using these components, but what exactly are they? Attributes & automation parameters enable the automation author to pass data values from one automation component to the next. During this webinar, our FME Flow Specialists will cover leveraging the three types of these output attributes & parameters in FME Flow: Event, Custom, and Automation. As a bonus, they’ll also be making use of the Split-Merge Block functionality. You’ll leave this webinar with a better understanding of how to maximize the potential of automations by making use of attributes & automation parameters, with the ultimate goal of setting your enterprise integration workflows up on autopilot.

Northern Engraving | Nameplate Manufacturing Process - 2024

Northern Engraving | Nameplate Manufacturing Process - 2024

Northern Engraving | Nameplate Manufacturing Process - 2024

Northern Engraving

Manufacturing custom quality metal nameplates and badges involves several standard operations. Processes include sheet prep, lithography, screening, coating, punch press and inspection. All decoration is completed in the flat sheet with adhesive and tooling operations following. The possibilities for creating unique durable nameplates are endless. How will you create your brand identity? We can help!

Skybuffer SAM4U tool for SAP license adoption

Skybuffer SAM4U tool for SAP license adoption

Skybuffer SAM4U tool for SAP license adoption

Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool. SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

Mutation Testing for Task-Oriented Chatbots

Mutation Testing for Task-Oriented Chatbots

Mutation Testing for Task-Oriented Chatbots

Pablo Gómez Abajo

Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots. To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.

HCL Notes and Domino License Cost Reduction in the World of DLAU

HCL Notes and Domino License Cost Reduction in the World of DLAU

HCL Notes and Domino License Cost Reduction in the World of DLAU

Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/ The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this! We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model. Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward. These topics will be covered - Reducing license cost by finding and fixing misconfigurations and superfluous accounts - How do CCB and CCX licenses really work? - Understanding the DLAU tool and how to best utilize it - Tips for common problem areas, like team mailboxes, functional/test users, etc - Practical examples and best practices to implement right away

Main news related to the CCS TSI 2023 (2023/1695)

Main news related to the CCS TSI 2023 (2023/1695)

Main news related to the CCS TSI 2023 (2023/1695)

An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers. The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 . The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .

Dandelion Hashtable: beyond billion requests per second on a commodity server

Dandelion Hashtable: beyond billion requests per second on a commodity server

Dandelion Hashtable: beyond billion requests per second on a commodity server

Antonios Katsarakis

This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).

GNSS spoofing via SDR (Criptored Talks 2024)

GNSS spoofing via SDR (Criptored Talks 2024)

GNSS spoofing via SDR (Criptored Talks 2024)

Javier Junquera

In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security. This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing. The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.

zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...

zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...

zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...

Folding is a recent technique for building efficient recursive SNARKs. Several elegant folding protocols have been proposed, such as Nova, Supernova, Hypernova, Protostar, and others. However, all of them rely on an additively homomorphic commitment scheme based on discrete log, and are therefore not post-quantum secure. In this work we present LatticeFold, the first lattice-based folding protocol based on the Module SIS problem. This folding protocol naturally leads to an efficient recursive lattice-based SNARK and an efficient PCD scheme. LatticeFold supports folding low-degree relations, such as R1CS, as well as high-degree relations, such as CCS. The key challenge is to construct a secure folding protocol that works with the Ajtai commitment scheme. The difficulty, is ensuring that extracted witnesses are low norm through many rounds of folding. We present a novel technique using the sumcheck protocol to ensure that extracted witnesses are always low norm no matter how many rounds of folding are used. Our evaluation of the final proof system suggests that it is as performant as Hypernova, while providing post-quantum security. Paper Link: https://eprint.iacr.org/2024/257

Apps Break Data

Apps Break Data

Apps Break Data

How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?

Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe

Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe

Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe

Inconsistent user experience and siloed data, high costs, and changing customer expectations – Citizens Bank was experiencing these challenges while it was attempting to deliver a superior digital banking experience for its clients. Its core banking applications run on the mainframe and Citizens was using legacy utilities to get the critical mainframe data to feed customer-facing channels, like call centers, web, and mobile. Ultimately, this led to higher operating costs (MIPS), delayed response times, and longer time to market. Ever-changing customer expectations demand more modern digital experiences, and the bank needed to find a solution that could provide real-time data to its customer channels with low latency and operating costs. Join this session to learn how Citizens is leveraging Precisely to replicate mainframe data to its customer channels and deliver on their “modern digital bank” experiences.

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

Recently uploaded (20)

Columbus Data & Analytics Wednesdays - June 2024

Columbus Data & Analytics Wednesdays - June 2024

Columbus Data & Analytics Wednesdays - June 2024

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Programming Foundation Models with DSPy - Meetup Slides

Programming Foundation Models with DSPy - Meetup Slides

Programming Foundation Models with DSPy - Meetup Slides

Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors

Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors

Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors

Leveraging the Graph for Clinical Trials and Standards

Leveraging the Graph for Clinical Trials and Standards

Leveraging the Graph for Clinical Trials and Standards

Y-Combinator seed pitch deck template PP

Y-Combinator seed pitch deck template PP

Y-Combinator seed pitch deck template PP

Essentials of Automations: Exploring Attributes & Automation Parameters

Essentials of Automations: Exploring Attributes & Automation Parameters

Essentials of Automations: Exploring Attributes & Automation Parameters

Northern Engraving | Nameplate Manufacturing Process - 2024

Northern Engraving | Nameplate Manufacturing Process - 2024

Northern Engraving | Nameplate Manufacturing Process - 2024

Skybuffer SAM4U tool for SAP license adoption

Skybuffer SAM4U tool for SAP license adoption

Skybuffer SAM4U tool for SAP license adoption

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

Mutation Testing for Task-Oriented Chatbots

Mutation Testing for Task-Oriented Chatbots

Mutation Testing for Task-Oriented Chatbots

HCL Notes and Domino License Cost Reduction in the World of DLAU

HCL Notes and Domino License Cost Reduction in the World of DLAU

HCL Notes and Domino License Cost Reduction in the World of DLAU

Main news related to the CCS TSI 2023 (2023/1695)

Main news related to the CCS TSI 2023 (2023/1695)

Main news related to the CCS TSI 2023 (2023/1695)

Dandelion Hashtable: beyond billion requests per second on a commodity server

Dandelion Hashtable: beyond billion requests per second on a commodity server

Dandelion Hashtable: beyond billion requests per second on a commodity server

GNSS spoofing via SDR (Criptored Talks 2024)

GNSS spoofing via SDR (Criptored Talks 2024)

GNSS spoofing via SDR (Criptored Talks 2024)

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...

zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...

zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...

Apps Break Data

Apps Break Data

Apps Break Data

Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe

Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe

Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

PostgreSQL ecosystem

1. PostgreSQL ecosystem Speaker: 林宗禧 @ COSCUP x RubyConf TW 2021 Taiwan PostgreSQL User Group 1

2. About 林宗禧 • PostgreSQL愛好者(2012-) • PostgreSQL推廣者(2017-) How to use ? • 以前: 開發FDW套件 (C, Python都有) • 後來: 到處整合PG的應用 • 推 Industry 4.0，讓業主不經意的導入 PG • 推 Smart City Solutions ，拿PG做基礎 2021/7/16 2 Taiwan PostgreSQL User Group

3. Overview – PostgreSQL ecosystem (1/3) • https://code.efficiencygeek.com/ Taiwan PostgreSQL User Group 3 2021/7/16

4. Overview – PostgreSQL ecosystem (2/3) • https://code.efficiencygeek.com/ Taiwan PostgreSQL User Group 4 2021/7/16

5. Overview – PostgreSQL ecosystem (3/3) • https://code.efficiencygeek.com/ Taiwan PostgreSQL User Group 5 2021/7/16

6. Taiwan PostgreSQL User Group 6 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

7. Taiwan PostgreSQL User Group 7 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

8. 01. Load Balancers PgBouncer • https://www.pgbouncer.org/ • 1.15 - Nov 19, 2020 • 輕量級的 connection pool • 提供重複使用session機制 • PG 9.5 沒有自動於時斷線機制 • PG 9.6 Transaction Timeout 參數 Taiwan PostgreSQL User Group 8 2021/7/16 https://mlog.club/article/2987957 # vim /etc/pgbouncer/pgbouncer.ini [database] Db1 = port=5432 dbname=demo_db1 db2 = host=127.0.0.1 port=5432 dbname=demo_db2 [pgbouncer] listen_addr = * listen_port = 6432 auth_type = md5 auth_file = /etc/pgbouncer/userlist.txt pool_mode = session

9. 01. Load Balancers Pgpool - II • https://pgpool.net • 4.2.3 - May 20, 2021 • Connection Pooling • Load Balance • Replication • Parallel Query • pgpoolAdmin Taiwan PostgreSQL User Group 9 2021/7/16 https://www.pgpool.net/docs/pgpool-II-4.1.0/en/html/example-cluster.html

10. Taiwan PostgreSQL User Group 10 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

11. 02. Replication Postgres BDR • 2ndQuadrant • github.com/2ndQuadrant/bdr • 1.15 - Nov 19, 2020 • Bi-Directional Replication • Async multi-master replication • 最終一致性 • 默認以最後的更新為準 • BDR使用場景 • 有利於: 單一節點修改，減少衝突 • 不利於: 同一時間查詢各節點之修改 Taiwan PostgreSQL User Group 11 2021/7/16 https://www.2ndquadrant.com/en/resources/highly-available-postgresql-clusters/

12. Taiwan PostgreSQL User Group 12 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

13. 03. Rest API PostgREST • https://github.com/PostgREST • 7.0.1 - May 19, 2020 • 連接資料表直接提供RESTful API • 可提供 Swagger ui Taiwan PostgreSQL User Group 13 2021/7/16 Purohit_Priyank_Kamlesh_202011_MSc_thesis.pdf https://github.com/tatut/postgrest-ui

14. Taiwan PostgreSQL User Group 14 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

15. 04. Schema Model PostGIS • https://postgis.net/ • 3.1.3 – July 20, 2020 • 地理圖資資料庫模組 (Spatial Database) • 商用GIS的最佳替代方案 Taiwan PostgreSQL User Group 15 2021/7/16 QGIS 讀取 PostGIS https://www.slideshare.net/mutolisp/postgis-57051746 SELECT superhero.name FROM city, superhero WHERE ST_Contains(city.geom, superhero.geom) AND city.name = 'Gotham';

16. 04. Schema Model PipelineDB • https://github.com/pipelinedb/ • 1.0 – Feb 20, 2019 • 基於PG的時序型資料庫 Taiwan PostgreSQL User Group 16 2021/7/16 pipeline -c "SELECT sum(count) FROM test_view" sum ------- 100001 (1 row) pipeline -c "SELECT * FROM test_view ORDER BY count DESC limit 10" key | count -----+------- 2 | 10124 8 | 10100 1 | 10042 7 | 9996 4 | 9991 5 | 9977 3 | 9963 6 | 9927 9 | 9915 10 | 4997 0 | 4969 (11 rows)

17. 04. Schema Model Apache AGE (Incubating) • https://age.incubator.apache.org/ • v0.5.0 – Jun 30, 2021 • A Graph Extension for PG 提供 graph function • 從PG10開始開發，目前基於PG11開發中 Taiwan PostgreSQL User Group 17 2021/7/16

18. Taiwan PostgreSQL User Group 18 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

19. 05. Scalability Taiwan PostgreSQL User Group 19 2021/7/16 Greenplum DB • https://greenplum.org/ • 6.7.1 – April 2020 • based on PG 9.4 • 架構採用MPP (Massively Parallel Processor ) • 在 MPP 系統中，每個 SMP 節點也可以運作自己的作業系統、資料庫等 • Data distribution • Shared nothing • MapReduce https://kknews.cc/tech/5meq9l3.html

20. 05. Scalability Taiwan PostgreSQL User Group 20 2021/7/16 Postgres-XC / XC2 / XL • XC https://sourceforge.net/ projects/postgres-xc/ • XC2 https://github.com/ postgres-x2/ • XL https://www.postgres-xl.org/ • Data distribution • Shared nothing • GTM • Coordinator • Global Catalog https://zhuanlan.zhihu.com/p/26391728

21. Taiwan PostgreSQL User Group 21 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

22. 06. Foreign Data Wrappers PG9.1 FDW - SELECT PG9.3 FDW -INSERT / UPDATE / DELETE https://wiki.postgresql.org/wiki/Foreign_data_wrappers • Generic/Specific SQL Database Wrappers • NoSQL Database Wrappers • File / Geo / LDAP Wrappers • Generic/Specific Web Wrappers • Big Data Wrappers • Column-Oriented Wrappers • Scientific Wrappers • Operating System Wrappers • Exotic Wrappers Taiwan PostgreSQL User Group 22 2021/7/16

23. 06. Foreign Data Wrappers Taiwan PostgreSQL User Group 23 2021/7/16 Generic / Specific SQL Database Wrappers

24. 06. Foreign Data Wrappers Taiwan PostgreSQL User Group 24 2021/7/16 NoSQL Database Wrappers

25. 06. Foreign Data Wrappers Taiwan PostgreSQL User Group 25 2021/7/16 File/Geo/LDAP Database Wrappers

26. 06. Foreign Data Wrappers Taiwan PostgreSQL User Group 26 2021/7/16 Generic / Specific Web Database Wrappers

27. 06. Foreign Data Wrappers Taiwan PostgreSQL User Group 27 2021/7/16 Generic / Specific Web Database Wrappers

28. Taiwan PostgreSQL User Group 28 2021/7/16 Agenda 01. Load Balancers 02. Replication 03. Rest API 04. Schema Model 05. Scalability 06. Foreign Data Wrappers 07. Others & support

29. 07. Others & support Apache MADlib Taiwan PostgreSQL User Group 29 2021/7/16

30. 07. Others & support Apache MADlib Functions • 機器學習 • 矩陣分析 • 統計分析 • … 支援 • PostgreSQL • Greenplum Taiwan PostgreSQL User Group 30 2021/7/16 https://www.xuehua.us/a/5ebf13a880cf9e4954ac1981

31. 07. Others & support GUI / WebUI Taiwan PostgreSQL User Group 31 2021/7/16

32. 有很多不得不推的理由 Taiwan PostgreSQL User Group 32 2021/7/16 • Data Types • Data Integrity • Concurrency and Performance • Reliability, Disaster Recovery • Security • Extensibility • Internationalization, Text Search • Not relational data (JSON, Hstore, Cstore) • GIS (Geographic Information System) 最開源、最穩定、最先進…

33. 持續貢獻 DB-engine ranking • https://db-engines.com/en/ranking Taiwan PostgreSQL User Group 33 2021/7/16 DBMS of the Year: PostgreSQL

34. 期許… • 持續為推廣而奔走，期許… • 國內使用Oracle的辛苦業者，改用 PG • 鼓勵新創在初期直接採用 PG • 資料庫教育直接使用 PG 做為教材 • 與國內 SI 共同合作發展台版 PG Taiwan PostgreSQL User Group 34 2021/7/16

35. Thank you. PostgreSQL ecosystem @ COSCUP x RubyConf TW 2021 Taiwan PostgreSQL User Group 林宗禧 linjose@postgresql.tw 35 https://www.postgresql.fastware.com/