SlideShare a Scribd company logo
1 of 51
Download to read offline
EQUNIX PostgreSQL Professional Gathering
Plaza Semanggi 9 Fl, Unit 9
Jl. Jend Sudirman Kav 50, Jakarta - 12930 Indonesia
8 Eu Tong Street, #14-94, THE CENTRAL Singapore
+6221-22866662 | info@equnix.asia
Oracle to PostgreSQL,
A Challenge or Opportunity?
Copyright Notice
This document is owned by Equnix Business Solutions PTE LTD. This document contains
confidential information, which is protected by law. No part of this publication could be
photocopied, reproduced or translated into another language without permitted or the
express written consent of Equnix Business Solutions PTE LTD.
Data and information regarding the proposal and its offer is for limited use and are not
disclosed. The information contained in this document is subject to change at any time
without prior notice.
All rights reserved, © Copyright 2019
Equnix Business Solutions, PT
Equnix Business Solutions, PTE Ltd
We are EQUNIX.ASIA, we are:
info@equnix.asia | http://equnix.asia
Mission
Critical
Services
World Class
Software
Development
System
Optimization
Expertise
Open Source is the New Enterprise
RDBMS Trend from time to time
What is the real
“MONSTER” we are facing?
RDBMS - L'histoire de development
A relational database management system (RDBMS) is a database management
system (DBMS) that is based on the relational model as introduced by E. F. Codd in
1970, of IBM's San Jose Research Laboratory. Many popular databases currently in
use are based on the relational database model.
RDBMS - A.C.I.D
Atomicity
Either all of transaction happens or nothing
Consistency
Database is brought from one consistent state to
another
Durability
After commit, the transaction is permanent/durable.
No data lost potential
Isolation
The effects of transaction may not be visible to other
transactions until the transaction committed
PostgreSQL is ENTERPRISE
PostgreSQL is an ENTERPRISE
Level database
(does not even require commercial license)
The Compatibility
SQL ANSI Coverage
Full Core conformance = 179 features on Core SQL 2011 (and 2008)
PostgreSQL conforms to at least 160.
Features Oracle PostgreSQL
Parallelism Requires Hint Automatically Loaded on
SELECT
Table Partitioning Supported Supported
Tablespace Supported Supported
Stored Procedures &
Functions
Supported Supported
Online Backup Active
DataGuard/GoldenGate
Natively
PostgreSQL ENTERPRISE Features
Reliability:
Secure Data Access;
Financial Cryptography;
100% Ensure Durability
Availability:
Replication;
Advanced Recovery;
High Availability;
Uptime warranty up to: 99,99%
Scalability:
Hi Perf Tuning;
Scale Up/Scale Out;
Clustering;
Big Machine VS BIG Machine
EXADATA to PostgreSQL?
7 times faster than Oracle.
PostgreSQL Native Mirroring
Write-Ahead Log
1. Cold Backup (Offline mode)
Stores data into a offline mode (file dump). There are 2 kinds of cold backup:
a. Full Backup,
Use SQL dump, or just copy the whole datadir
b. Incremental Backup.
Logs the archive and play back later.
2. Warm Backup
The backup machine is up and running, but the service is not ready yet, usually
caused by the disk synchronization (PPRC service or DRBD). So the backup is done by 3rd party other than
database itself.
3. Hot Backup
The backup is on-line, and the service is also ready to serve. It is already hot, as hot as the Master / Main
server. There are some kind of Hot backup:
a. Synchronous Replication,
b. Asynchronous Replication,
c. Multi Master Replication
Multi-tier Backup Features
A Backup is not a “backup” if cannot be restored
Point-in-Time Recovery mechanism, allows you to go “Back to the Future” to timeline you
decide
Recovering an accidentally dropped data? Auditing a suspicious event on your database?
Can be used to replay transactions from last week until a specific day.
Point-in-Time Recovery
High Availability amongst PostgreSQL
Enterprise Level High Availability
configuration without hassle
Keep It Simple, SUCCESS!
Winning Stories - EDII
Oracle Migration
From 4 Servers Oracle RAC
System
Into 1 Server Intel
PostgreSQL
EDII - Current Topology
Jumping over the
“Rainbow”
Migration STAGES
Migration Stages
A. Migration Assessment
a. Preliminary
b. Comprehensive
B. Report and Brainstorming
C. Migration Preparation
a. Schematic Migration
b. Data Migration (Test and clean up)
c. Logic Migration
~To win the battle, you must understand your
enemy~ Sun Tzu.
D. System Migration
a. Finalization Rundown
b. 1st Rehearsal
c. Evaluation
d. 2nd Rehearsal (if needed)
e. Evaluation
f. Migration!
Migration Assessment
Preliminary Assessment
Given a couple of days (2 days) to
analyze all the database Objects briefly
to get some ideas on how long it take to
do such Comprehensive Assessment.
Look for potential Stopper: System
Functions, Customization possibility,
Specific Function/Datatype, Allowable
Downtime, Any potential copyright
infringement, etc. Develop Mitigation,
solution and possibility workaround.
Comprehensive Assessment
Assess all the object mentioned in the
scope of work, very detailed. Produce
Comprehensive Assessment Report,
consist:
1. Level of Difficulties
2. How many Mandays Effort
3. Migration Schedules
4. Proposed Migration Rundown
5. Analysis Report
(This is Commercial Effort)
Schematic Migration
Most of the Structures are compatible with PostgreSQL (even not 100%).
Prepare the “bucket” first, then the “water”
❖ Dump all database object structures (tables, sequences, views, etc.)
❖ Check whether specific data types should be converted
❖ User Defined Types should be deeply examined
❖ Constraints (PK, FK, Uniqueness, Indices) will be recreated in
PostgreSQL, as long as Database Object Relationship is kept consistent
Data Migration - Analysis
Migration Data from Oracle to PostgreSQL is dealing with downtime and
ETL, and somehow it needs very fast.
❖ How much is the Downtime tolerance
❖ Housekeep data from Oracle Source Database
❖ Doing Stress Test to the pre-migrated data
❖ Using FDW/ETL Tools, it is possible to start synchronizing data without
interrupting current Transactional Process on Source Database
Logic Migration - Analysis
Logic conversion is the PAIN, when doing migration.
Requires a deep understanding on how the function works.
❖ Streamline the Logic
❖ How many total line of codes used on Stored
Procedures/Functions/Packages
❖ Is there any Oracle specific functions used?
❖ Create a mimic for called functions, as long as output is the same
❖ PostgreSQL is highly extensible platform, if not supported yet, we can
create it as long as we have the expertise
❖ Do System Integration and Regression Test with application
System Migration - Analysis
1. How long downtime can be tolerate by
Management?
2. Based on the finding from Data
Migration, we can understand how long
it take to migration the live data, this is
the main consideration to develop
Rundown System Migration
3. How many Instance Application involve
in the System Migration?
4. How many party involved in System
Migration?
Goal:
1. Develop Rundown System Migration
2. Develop fallback scenario
3. Rehearse Rundown System
Migration smoothly
4. Develop rock solid Rundown and its
fallback plan.
5. Ensure it can be run within
constraints
6. RUN SYSTEM MIGRATION
Case Study 1 (by Chris Travers)
Bioprospecting platform by a Danish biotech company
❖ 12TB of genome and protein data
❖ 100 million transactions a day
❖ 12TB of genome and protein data
❖ 100 million transactions a day or more
❖ Main workload similar to most line of business or financial applications
❖ Single PostgreSQL server backing 1000 core scientific computing cluster
running 24x7
Case Study 2 (by Chris Travers)
Advertising Analytics Platform by German Ad
❖ 1PB of mobile event data
❖ 1-300000 requests a second
❖ Near-real-time analytics
❖ Queries similar to data warehouses
❖ Distributed, “Big Data” environment
Technology - Foreign Data Wrapper (FDW)
PostgreSQL has a useful feature called Foreign Data Wrapper, which lets you
create foreign tables in a PostgreSQL database from other data source.
When you make a query against a foreign table, the Foreign Data Wrapper
will query the external data source and return the results as if they were
coming from a table in your database.
FDW - High Integration
Enterprise ETL Tools
DATABASE AGGREGATION
Head Office
TABLE A
(Subscriber)
DATABASE
Medan
TABLE A
(Publisher)
DATABASE
Bandung
TABLE A
(Publisher)
TABLE C
(Subscriber)
TABLE D
(Subscriber)
TABLE B
(Subscriber)
DATABASE
Surabaya
TABLE A
(Publisher)
DATABASE
Jakarta
TABLE A
(Publisher)
Table Replication (Realtime)
Geographic Information System
JSON = NoSQL in PostgreSQL
PostgreSQL Ecosystem
Financial
Services
Factory Oil & Gas Retail Insurance
Training Research
Contributor Developer Professional
Industries
Education
Certification
Community
Provider
PostgreSQL World Conference - Ottawa
PostgreSQL World Conference - Ottawa
PGDay ASIA in Singapore - 2017
PGDay ASIA in Singapore - 2017
PGConf ASIA - Japan - 2014
PGConf ASIA - Japan - 2015
PGConf ASIA - Japan - 2017
PostgreSQL Meetup Indonesia
Equnix Campus Campaign
Equnix Campus Campaign Semarang
Equnix Campus Campaign Bali
PGConf ASIA - Indonesia Bali 2019
We will held an International Event in Sept
2019, it is PostgreSQL Conference Asia in Bali
2019.
Please come there, meet and greet with
Developers, Architects, Geeks, Hackers,
Beaches, Suns, etc
Oracle to PostgreSQL, Challenges to Opportunity.pdf

More Related Content

Similar to Oracle to PostgreSQL, Challenges to Opportunity.pdf

EDB Database Servers and Tools
EDB Database Servers and Tools EDB Database Servers and Tools
EDB Database Servers and Tools Ashnikbiz
 
AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)
AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)
AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)Amazon Web Services
 
Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
Modernizing Global Shared Data Analytics Platform and our Alluxio JourneyModernizing Global Shared Data Analytics Platform and our Alluxio Journey
Modernizing Global Shared Data Analytics Platform and our Alluxio JourneyAlluxio, Inc.
 
High Availability And Oracle Data Guard 11g R2
High Availability And Oracle Data Guard 11g R2High Availability And Oracle Data Guard 11g R2
High Availability And Oracle Data Guard 11g R2Mario Redón Luz
 
Oracle presentations RAC dataguard active database
Oracle presentations RAC dataguard active databaseOracle presentations RAC dataguard active database
Oracle presentations RAC dataguard active databasemabessisindu
 
Brk3288 sql server v.next with support on linux, windows and containers was...
Brk3288 sql server v.next with support on linux, windows and containers   was...Brk3288 sql server v.next with support on linux, windows and containers   was...
Brk3288 sql server v.next with support on linux, windows and containers was...Bob Ward
 
hari_duche_updated
hari_duche_updatedhari_duche_updated
hari_duche_updatedHari Duche
 
PostgreSQL as a Strategic Tool
PostgreSQL as a Strategic ToolPostgreSQL as a Strategic Tool
PostgreSQL as a Strategic ToolEDB
 
Muthu_Oracle DBA
Muthu_Oracle DBAMuthu_Oracle DBA
Muthu_Oracle DBAtraffic89
 
Azure Data platform
Azure Data platformAzure Data platform
Azure Data platformMostafa
 
Maruthi_YH_resume
Maruthi_YH_resumeMaruthi_YH_resume
Maruthi_YH_resumeMaruthi YH
 
Raj_Ranjan_Oracle_DBA
Raj_Ranjan_Oracle_DBARaj_Ranjan_Oracle_DBA
Raj_Ranjan_Oracle_DBARaj Ranjan
 

Similar to Oracle to PostgreSQL, Challenges to Opportunity.pdf (20)

Greenplum Architecture
Greenplum ArchitectureGreenplum Architecture
Greenplum Architecture
 
EDB Database Servers and Tools
EDB Database Servers and Tools EDB Database Servers and Tools
EDB Database Servers and Tools
 
AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)
AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)
AWS re:Invent 2016: Automating Workflows for Analytics Pipelines (DEV401)
 
Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
Modernizing Global Shared Data Analytics Platform and our Alluxio JourneyModernizing Global Shared Data Analytics Platform and our Alluxio Journey
Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
 
Shankar_C
Shankar_CShankar_C
Shankar_C
 
Insync10 goldengate
Insync10 goldengateInsync10 goldengate
Insync10 goldengate
 
High Availability And Oracle Data Guard 11g R2
High Availability And Oracle Data Guard 11g R2High Availability And Oracle Data Guard 11g R2
High Availability And Oracle Data Guard 11g R2
 
dgintro (1).ppt
dgintro (1).pptdgintro (1).ppt
dgintro (1).ppt
 
Oracle presentations RAC dataguard active database
Oracle presentations RAC dataguard active databaseOracle presentations RAC dataguard active database
Oracle presentations RAC dataguard active database
 
LALIT-TCS
LALIT-TCSLALIT-TCS
LALIT-TCS
 
Brk3288 sql server v.next with support on linux, windows and containers was...
Brk3288 sql server v.next with support on linux, windows and containers   was...Brk3288 sql server v.next with support on linux, windows and containers   was...
Brk3288 sql server v.next with support on linux, windows and containers was...
 
Gyan_resume
Gyan_resumeGyan_resume
Gyan_resume
 
siddharthaBS_DBA
siddharthaBS_DBAsiddharthaBS_DBA
siddharthaBS_DBA
 
hari_duche_updated
hari_duche_updatedhari_duche_updated
hari_duche_updated
 
PostgreSQL as a Strategic Tool
PostgreSQL as a Strategic ToolPostgreSQL as a Strategic Tool
PostgreSQL as a Strategic Tool
 
Muthu_Oracle DBA
Muthu_Oracle DBAMuthu_Oracle DBA
Muthu_Oracle DBA
 
Azure Data platform
Azure Data platformAzure Data platform
Azure Data platform
 
JSN NRG Resume
JSN NRG ResumeJSN NRG Resume
JSN NRG Resume
 
Maruthi_YH_resume
Maruthi_YH_resumeMaruthi_YH_resume
Maruthi_YH_resume
 
Raj_Ranjan_Oracle_DBA
Raj_Ranjan_Oracle_DBARaj_Ranjan_Oracle_DBA
Raj_Ranjan_Oracle_DBA
 

More from Equnix Business Solutions

Yang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdf
Yang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdfYang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdf
Yang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdfEqunix Business Solutions
 
Kebocoran Data_ Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...
Kebocoran Data_  Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...Kebocoran Data_  Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...
Kebocoran Data_ Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...Equnix Business Solutions
 
Kuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdf
Kuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdfKuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdf
Kuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdfEqunix Business Solutions
 
EWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdf
EWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdfEWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdf
EWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdfEqunix Business Solutions
 
[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf
[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf
[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdfEqunix Business Solutions
 
Webinar2021 - Does HA Can Help You Balance Your Load-.pdf
Webinar2021 - Does HA Can Help You Balance Your Load-.pdfWebinar2021 - Does HA Can Help You Balance Your Load-.pdf
Webinar2021 - Does HA Can Help You Balance Your Load-.pdfEqunix Business Solutions
 
Webinar2021 - In-Memory Database, is it really faster-.pdf
Webinar2021 - In-Memory Database, is it really faster-.pdfWebinar2021 - In-Memory Database, is it really faster-.pdf
Webinar2021 - In-Memory Database, is it really faster-.pdfEqunix Business Solutions
 
equpos - General Presentation v20230420.pptx
equpos - General Presentation v20230420.pptxequpos - General Presentation v20230420.pptx
equpos - General Presentation v20230420.pptxEqunix Business Solutions
 
Equnix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdf
Equnix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdfEqunix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdf
Equnix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdfEqunix Business Solutions
 
OSPX - Professional PostgreSQL Certification Scheme v20201111.pdf
OSPX - Professional PostgreSQL Certification Scheme v20201111.pdfOSPX - Professional PostgreSQL Certification Scheme v20201111.pdf
OSPX - Professional PostgreSQL Certification Scheme v20201111.pdfEqunix Business Solutions
 
PGConf.ASIA 2019 - The Future of TDEforPG - Taiki Kondo
PGConf.ASIA 2019 - The Future of TDEforPG - Taiki KondoPGConf.ASIA 2019 - The Future of TDEforPG - Taiki Kondo
PGConf.ASIA 2019 - The Future of TDEforPG - Taiki KondoEqunix Business Solutions
 
PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose
PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo HirosePGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose
PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo HiroseEqunix Business Solutions
 
PGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky Haryadi
PGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky HaryadiPGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky Haryadi
PGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky HaryadiEqunix Business Solutions
 
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...Equnix Business Solutions
 
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGaiPGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGaiEqunix Business Solutions
 
PGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan Pachenko
PGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan PachenkoPGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan Pachenko
PGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan PachenkoEqunix Business Solutions
 
PGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce Momjian
PGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce MomjianPGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce Momjian
PGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce MomjianEqunix Business Solutions
 

More from Equnix Business Solutions (20)

Yang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdf
Yang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdfYang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdf
Yang perlu kita ketahui Untuk memahami aspek utama IT dalam bisnis_.pdf
 
Kebocoran Data_ Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...
Kebocoran Data_  Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...Kebocoran Data_  Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...
Kebocoran Data_ Tindakan Hacker atau Kriminal_ Bagaimana kita mengantisipasi...
 
Kuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdf
Kuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdfKuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdf
Kuliah Tamu - Dari Proses Bisnis Menuju Struktur Data.pdf
 
EWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdf
EWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdfEWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdf
EWTT22_ Apakah Open Source Cocok digunakan dalam Korporasi_.pdf
 
[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf
[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf
[EWTT2022] Strategi Implementasi Database dalam Microservice Architecture.pdf
 
PostgreSQL as Enterprise Solution v1.1.pdf
PostgreSQL as Enterprise Solution v1.1.pdfPostgreSQL as Enterprise Solution v1.1.pdf
PostgreSQL as Enterprise Solution v1.1.pdf
 
Webinar2021 - Does HA Can Help You Balance Your Load-.pdf
Webinar2021 - Does HA Can Help You Balance Your Load-.pdfWebinar2021 - Does HA Can Help You Balance Your Load-.pdf
Webinar2021 - Does HA Can Help You Balance Your Load-.pdf
 
Webinar2021 - In-Memory Database, is it really faster-.pdf
Webinar2021 - In-Memory Database, is it really faster-.pdfWebinar2021 - In-Memory Database, is it really faster-.pdf
Webinar2021 - In-Memory Database, is it really faster-.pdf
 
EQUNIX - PPT 11DB-Postgres™.pdf
EQUNIX - PPT 11DB-Postgres™.pdfEQUNIX - PPT 11DB-Postgres™.pdf
EQUNIX - PPT 11DB-Postgres™.pdf
 
equpos - General Presentation v20230420.pptx
equpos - General Presentation v20230420.pptxequpos - General Presentation v20230420.pptx
equpos - General Presentation v20230420.pptx
 
Equnix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdf
Equnix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdfEqunix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdf
Equnix Appliance- Jawaban terbaik untuk kebutuhan komputasi yang mumpuni.pdf
 
OSPX - Professional PostgreSQL Certification Scheme v20201111.pdf
OSPX - Professional PostgreSQL Certification Scheme v20201111.pdfOSPX - Professional PostgreSQL Certification Scheme v20201111.pdf
OSPX - Professional PostgreSQL Certification Scheme v20201111.pdf
 
Equnix Company Profile v20230329.pdf
Equnix Company Profile v20230329.pdfEqunix Company Profile v20230329.pdf
Equnix Company Profile v20230329.pdf
 
PGConf.ASIA 2019 - The Future of TDEforPG - Taiki Kondo
PGConf.ASIA 2019 - The Future of TDEforPG - Taiki KondoPGConf.ASIA 2019 - The Future of TDEforPG - Taiki Kondo
PGConf.ASIA 2019 - The Future of TDEforPG - Taiki Kondo
 
PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose
PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo HirosePGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose
PGConf.ASIA 2019 - PGSpider High Performance Cluster Engine - Shigeo Hirose
 
PGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky Haryadi
PGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky HaryadiPGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky Haryadi
PGConf.ASIA 2019 - High Availability, 10 Seconds Failover - Lucky Haryadi
 
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
 
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGaiPGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
 
PGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan Pachenko
PGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan PachenkoPGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan Pachenko
PGConf.ASIA 2019 Bali - Keynote Speech 2 - Ivan Pachenko
 
PGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce Momjian
PGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce MomjianPGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce Momjian
PGConf.ASIA 2019 Bali - Keynote Speech 1 - Bruce Momjian
 

Recently uploaded

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 

Recently uploaded (20)

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 

Oracle to PostgreSQL, Challenges to Opportunity.pdf

  • 1. EQUNIX PostgreSQL Professional Gathering Plaza Semanggi 9 Fl, Unit 9 Jl. Jend Sudirman Kav 50, Jakarta - 12930 Indonesia 8 Eu Tong Street, #14-94, THE CENTRAL Singapore +6221-22866662 | info@equnix.asia Oracle to PostgreSQL, A Challenge or Opportunity?
  • 2. Copyright Notice This document is owned by Equnix Business Solutions PTE LTD. This document contains confidential information, which is protected by law. No part of this publication could be photocopied, reproduced or translated into another language without permitted or the express written consent of Equnix Business Solutions PTE LTD. Data and information regarding the proposal and its offer is for limited use and are not disclosed. The information contained in this document is subject to change at any time without prior notice. All rights reserved, © Copyright 2019 Equnix Business Solutions, PT Equnix Business Solutions, PTE Ltd
  • 3. We are EQUNIX.ASIA, we are: info@equnix.asia | http://equnix.asia Mission Critical Services World Class Software Development System Optimization Expertise
  • 4. Open Source is the New Enterprise
  • 5. RDBMS Trend from time to time
  • 6. What is the real “MONSTER” we are facing?
  • 7. RDBMS - L'histoire de development A relational database management system (RDBMS) is a database management system (DBMS) that is based on the relational model as introduced by E. F. Codd in 1970, of IBM's San Jose Research Laboratory. Many popular databases currently in use are based on the relational database model.
  • 8. RDBMS - A.C.I.D Atomicity Either all of transaction happens or nothing Consistency Database is brought from one consistent state to another Durability After commit, the transaction is permanent/durable. No data lost potential Isolation The effects of transaction may not be visible to other transactions until the transaction committed
  • 9.
  • 10. PostgreSQL is ENTERPRISE PostgreSQL is an ENTERPRISE Level database (does not even require commercial license)
  • 11. The Compatibility SQL ANSI Coverage Full Core conformance = 179 features on Core SQL 2011 (and 2008) PostgreSQL conforms to at least 160. Features Oracle PostgreSQL Parallelism Requires Hint Automatically Loaded on SELECT Table Partitioning Supported Supported Tablespace Supported Supported Stored Procedures & Functions Supported Supported Online Backup Active DataGuard/GoldenGate Natively
  • 12. PostgreSQL ENTERPRISE Features Reliability: Secure Data Access; Financial Cryptography; 100% Ensure Durability Availability: Replication; Advanced Recovery; High Availability; Uptime warranty up to: 99,99% Scalability: Hi Perf Tuning; Scale Up/Scale Out; Clustering;
  • 13. Big Machine VS BIG Machine
  • 15. 7 times faster than Oracle.
  • 17. 1. Cold Backup (Offline mode) Stores data into a offline mode (file dump). There are 2 kinds of cold backup: a. Full Backup, Use SQL dump, or just copy the whole datadir b. Incremental Backup. Logs the archive and play back later. 2. Warm Backup The backup machine is up and running, but the service is not ready yet, usually caused by the disk synchronization (PPRC service or DRBD). So the backup is done by 3rd party other than database itself. 3. Hot Backup The backup is on-line, and the service is also ready to serve. It is already hot, as hot as the Master / Main server. There are some kind of Hot backup: a. Synchronous Replication, b. Asynchronous Replication, c. Multi Master Replication Multi-tier Backup Features
  • 18. A Backup is not a “backup” if cannot be restored Point-in-Time Recovery mechanism, allows you to go “Back to the Future” to timeline you decide Recovering an accidentally dropped data? Auditing a suspicious event on your database? Can be used to replay transactions from last week until a specific day. Point-in-Time Recovery
  • 19. High Availability amongst PostgreSQL Enterprise Level High Availability configuration without hassle Keep It Simple, SUCCESS!
  • 20. Winning Stories - EDII Oracle Migration From 4 Servers Oracle RAC System Into 1 Server Intel PostgreSQL
  • 21. EDII - Current Topology
  • 23. Migration STAGES Migration Stages A. Migration Assessment a. Preliminary b. Comprehensive B. Report and Brainstorming C. Migration Preparation a. Schematic Migration b. Data Migration (Test and clean up) c. Logic Migration ~To win the battle, you must understand your enemy~ Sun Tzu. D. System Migration a. Finalization Rundown b. 1st Rehearsal c. Evaluation d. 2nd Rehearsal (if needed) e. Evaluation f. Migration!
  • 24. Migration Assessment Preliminary Assessment Given a couple of days (2 days) to analyze all the database Objects briefly to get some ideas on how long it take to do such Comprehensive Assessment. Look for potential Stopper: System Functions, Customization possibility, Specific Function/Datatype, Allowable Downtime, Any potential copyright infringement, etc. Develop Mitigation, solution and possibility workaround. Comprehensive Assessment Assess all the object mentioned in the scope of work, very detailed. Produce Comprehensive Assessment Report, consist: 1. Level of Difficulties 2. How many Mandays Effort 3. Migration Schedules 4. Proposed Migration Rundown 5. Analysis Report (This is Commercial Effort)
  • 25. Schematic Migration Most of the Structures are compatible with PostgreSQL (even not 100%). Prepare the “bucket” first, then the “water” ❖ Dump all database object structures (tables, sequences, views, etc.) ❖ Check whether specific data types should be converted ❖ User Defined Types should be deeply examined ❖ Constraints (PK, FK, Uniqueness, Indices) will be recreated in PostgreSQL, as long as Database Object Relationship is kept consistent
  • 26. Data Migration - Analysis Migration Data from Oracle to PostgreSQL is dealing with downtime and ETL, and somehow it needs very fast. ❖ How much is the Downtime tolerance ❖ Housekeep data from Oracle Source Database ❖ Doing Stress Test to the pre-migrated data ❖ Using FDW/ETL Tools, it is possible to start synchronizing data without interrupting current Transactional Process on Source Database
  • 27. Logic Migration - Analysis Logic conversion is the PAIN, when doing migration. Requires a deep understanding on how the function works. ❖ Streamline the Logic ❖ How many total line of codes used on Stored Procedures/Functions/Packages ❖ Is there any Oracle specific functions used? ❖ Create a mimic for called functions, as long as output is the same ❖ PostgreSQL is highly extensible platform, if not supported yet, we can create it as long as we have the expertise ❖ Do System Integration and Regression Test with application
  • 28. System Migration - Analysis 1. How long downtime can be tolerate by Management? 2. Based on the finding from Data Migration, we can understand how long it take to migration the live data, this is the main consideration to develop Rundown System Migration 3. How many Instance Application involve in the System Migration? 4. How many party involved in System Migration? Goal: 1. Develop Rundown System Migration 2. Develop fallback scenario 3. Rehearse Rundown System Migration smoothly 4. Develop rock solid Rundown and its fallback plan. 5. Ensure it can be run within constraints 6. RUN SYSTEM MIGRATION
  • 29. Case Study 1 (by Chris Travers) Bioprospecting platform by a Danish biotech company ❖ 12TB of genome and protein data ❖ 100 million transactions a day ❖ 12TB of genome and protein data ❖ 100 million transactions a day or more ❖ Main workload similar to most line of business or financial applications ❖ Single PostgreSQL server backing 1000 core scientific computing cluster running 24x7
  • 30. Case Study 2 (by Chris Travers) Advertising Analytics Platform by German Ad ❖ 1PB of mobile event data ❖ 1-300000 requests a second ❖ Near-real-time analytics ❖ Queries similar to data warehouses ❖ Distributed, “Big Data” environment
  • 31. Technology - Foreign Data Wrapper (FDW) PostgreSQL has a useful feature called Foreign Data Wrapper, which lets you create foreign tables in a PostgreSQL database from other data source. When you make a query against a foreign table, the Foreign Data Wrapper will query the external data source and return the results as if they were coming from a table in your database.
  • 32. FDW - High Integration
  • 34. DATABASE AGGREGATION Head Office TABLE A (Subscriber) DATABASE Medan TABLE A (Publisher) DATABASE Bandung TABLE A (Publisher) TABLE C (Subscriber) TABLE D (Subscriber) TABLE B (Subscriber) DATABASE Surabaya TABLE A (Publisher) DATABASE Jakarta TABLE A (Publisher) Table Replication (Realtime)
  • 36. JSON = NoSQL in PostgreSQL
  • 38. Financial Services Factory Oil & Gas Retail Insurance Training Research Contributor Developer Professional Industries Education Certification Community Provider
  • 41. PGDay ASIA in Singapore - 2017
  • 42. PGDay ASIA in Singapore - 2017
  • 43. PGConf ASIA - Japan - 2014
  • 44. PGConf ASIA - Japan - 2015
  • 45. PGConf ASIA - Japan - 2017
  • 50. PGConf ASIA - Indonesia Bali 2019 We will held an International Event in Sept 2019, it is PostgreSQL Conference Asia in Bali 2019. Please come there, meet and greet with Developers, Architects, Geeks, Hackers, Beaches, Suns, etc