Postgres: the centerpiece for
modernising IT infrastructure
Gaby Schilders - EDB
Agenda
• Open source, Postgres and EDB origins
• Digitalization, competition and open source
• Postgres as a platform of innovation in a multi-model
data world
• The role of digital business applications in digital
business initiatives
• Postgres and the DevOps motion: PaaS and IaaS
• The role of the DBA in a DevOps enabled, enterprise
class open source-based data management strategy
2
Timeline Open Source Software
3
Gnu’s not Unix
Linux is not your
dad’s Unix
Open source is not
business as usual
80’s
90’s
Open source database
is not a toy
00’s
10’s
• Most mature open source DBMS technology
• Enterprise-class features (built like Oracle, DB2, SQL Server)
• Strong, independent community driving rapid innovation, e.g.,
JSON, PostGIS
4
Fully ACID Compliant
MVCC
Point in Time Recovery (PITR)
Data and Index Partitioning
Bitmap Indexes
ANSI Constraints
Triggers & Stored Functions
Views & Data Types
Nested Transactions
Online Backup
Online Reorganization
Foreign Keys
Streaming Replication
Multi-Core Support
JSON Support
HStore
Postgres: A Proven Track Record
The Gartner report, Magic Quadrant
for Operational Database
Management Systems, by Nick
Heudecker, Donald Feinberg, Merv
Adrian, Terilyn Palanca, Rick
Greenwald was published October
5, 2016.
This graphic was published by Gartner, Inc. as part of a
larger research document and should be evaluated in the
context of the entire document. The Gartner document is
available upon request from EnterpriseDB.
Gartner does not endorse any vendor, product or service
depicted in its research publications, and does not advise
technology users to select only those vendors with the
highest ratings or other designation. Gartner research
Publications consist of the opinions of Gartner's research
Organization and should not be construed as statements of
fact. Gartner disclaims all warranties, expressed or implied,
with respect to this research, including any warranties of
Merchantability or fitness for a particular purpose.
Gartner MQ: EDB is the Leading OSS-
based DBMS
Digitalization
The integrated use of analytics, big data, the cloud, the
Internet of Things, mobile, and the application culture.
6
Digital Transformation
How enterprises apply digital technology to their
businesses and operational processes enabling new
types of products and services rather than simply
enhancing existing systems.
7
Digitalization Makes Competition a Higher Stakes Game
Open Source is Critical to Your IT Strategy
“Open-source software (OSS) industry saturation is complete: today, 95%
of mainstream IT organizations leverage nontrivial open-source software
assets within their mission-critical IT portfolios — whether they know it or
not.”
-Hype Cycle for Open-Source Software, 2016, Mark Driver, 11 July 2016
“Add open-source RDBMSs to your organization's DBMS standards for
new uses, and to replace commercial RDBMSs where these are not
specifically required.”
-Emerging Technology Trends Create Opportunities for DBMS Cost Optimization, Donald Feinberg, Adam
Ronthal, 21 April 2016
Speed
Agility
Flexibility
Big ROI
Low TCO
The DBA in Digital Business Initiatives
• Digital Business Applications are developed in schema
less modes
• Data models ‘emerge’ during the Agile Process
• DevOps frameworks support automated provisioning,
scaling, integration ad recovery of highly available data
base solutions
• Commercial vendor with high-end hardware help open
source scale
• Where does that leave the DBA?
10
The DBA in Digital Business Initiatives
• Old:
• Create/manage data models
• Add tables, columns, indexes, foreign keys
• Instantiate data bases
• Manage failover and recovery
• New
• Focus on data as a critical business asset
• Manage data origination, data quality, data sharing and data integrity
• Facilitate the integration of data across business applications
• Focus on creating value instead of managing systems
• Focus on acceleration infrastructure (DBaaS/IaaS, schema less
development)
11
Polyglot Persistence
It’s a fact not one DBMS technology
dominates
Event capture or caching of
transactions on the edge
Analysis of large data sets in the
Hadoop ecosystem
Transactional systems are still at the
heart
Existing systems have to be
leveraged rather than replaced in
order to move forward efficiently
12
84%AT&T
84%AT&T
84%AT&T
Big Data
§  Hadoop
§  Map-reduce
§  HDFS
Legacy
Systems
§  ERP
§  CRM
Data Warehouse
Event Data Capture
Highly Available & Scalable
ACID Multi-model DB
§  SQL
§  Key/value
§  JSON
§  Geospatial
Integration
§  Hadoop
§  Mongo
§  MySQL
Oracle compatibility
Replication to/from
•  SQL – Server
•  Oracle
• Schema-less development
for faster application
development
• Add structure to
unstructured data to ensure
integrity
• Run SQL queries across all
data types
Relational
Key-Value
(Hstore)
Document
(JSON)
Multi-Model DBMS
New application models require greater flexibility
EDB Postgres Integration
XDB support for replication
from and to Oracle and SQL
Server
FDWs for:
• HDFS
• Hive
• Spark
• Mongo
• MySQL
14
84%AT&T
84%AT&T
84%AT&T
Big Data
§  Hadoop
§  Map-reduce
§  HDFS
Legacy
Systems
§  ERP
§  CRM
Data Warehouse
Event Data Capture
Highly Available & Scalable
ACID Multi-model DB
§  SQL
§  Key/value
§  JSON
§  Geospatial
Integration
§  Hadoop
§  Mongo
§  MySQL
Oracle compatibility
Replication to/from
•  SQL – Server
•  Oracle
Patterns
Replication of data from ERP/CRM to EDB
• BOM
• Personnel & Org info
• Customer Info
Integration back to HDFS
Integration back to Data Warehouse
John Rhymer of Forrester talks about Hybrid Extend
• Build out new digital capability as an extension of existing apps
• Leverage what you have
We support that as well or better than any DBMS system and we do it more
cost effectively
15
Why Dev/Ops and Micro-services?
When product becomes digital, the innovation rate accelerates and competition
is continuous
• What’s that mean?
• Competition comes out with a new feature on their self-service web page and you have to
respond, not tomorrow, today
• You have to differentiate on an ongoing basis because your competition is always
catching up
• The positive side is that you can add value in new ways and deliver it to
the market place faster pulling revenue towards you
Micro-services makes the unit of update contained and easily updated
New Dev/Ops models like Continuous Integration and Delivery (CICD) allow
operations and developers to work together and deliver a stream of updates
and new innovation. Daily updates and new capabilities.
16
Private Cloud with Public Cloud Capabilities
17
Value Drivers for Hybrid Cloud Management of the
Database
• IT Operations need to manage, control and understand resource utilizations
• DBAs need to define templates for deployments
• End users require self-service and easy to use interfaces
• Organizations require support for multiple clouds
• Production deployments need elastic scalability and auto backup
• DevOps motions require PaaS integration
EDB Confidential
Delivering DBaaS to Private Cloud
Ark for:
• OpenStack
• AWS
• Azure (soon)
• Azure Stack (later)
Integration of Ark with PaaS
• Pivotal Cloud Foundry
• OpenShift
• Docker
19
EDB Postgres
Backup and Recovery
EDB Backup and Recovery
EDB Postgres Master
pgPool
EDB Advanced Server
PEM Agent
EDB Failover Manager
EDB Postgres Replica
pgPool
EDB Advanced Server
PEM Agent
EDB Failover Manager
EDB Postgres Enterprise
Manager
PEM Server
PostgreSQL
Persistent
Volumes
/pgdata
/pgxlog
/pglog
/pgbackup
App	“A”	
Service	Broker		Cloud	Controller	
Cloud	Controller	API	
Catalog	
Provision	
Bind	
Unbind	
Deprovision	
Service	
Broker	API	
App	Environment	
App	“B”	
App	Environment	
EDB	DBaaS	
Binding	
Binding	
Catalog	
Provision	
Bind	
Unbind	
Deprovision	
Cloud	Foundry	
Elas1c	Run1me	
Cloud	Controller	DB	
PostgreSQL		
or	EDB	Postgres	
Advanced	Server	
	
	
	
	
A	
B
Supporting DevOps with a DBaaS Service
• Address the tension between developers and operations
• Developers want
• Agility
• Speed to deploy
• Flow through tool chain
• Operations wants
• Visibility
• Control
• Budgeted resources
• Cost
• Data models
• Efficient use of resources
20
EDB PostgreSQL
DBaaS Cloud Management for Hybrid Clouds
EDB Ark
Production
Clusters
Development
instances
EDB Ark provisions and manages robust, elastic, HA Postgres clusters in multiple clouds
EDB Ark – Provisioning a database in 10 minutes or less
Automated, fast, simple, management visibility and reliable.
1 Scale replicas in or out manually
2 Clone cluster for new app development
3 Upgrade Postgres version on your schedule
4 Scale server class up or down manually
5 Transaction or Recovery preferred failover
6 Multi-node clusters with automatic replication,
connection pooling and load balancing
7 User controlled auto-scaling thresholds
8 Auto-backup policies including PITR
9 Monitoring and Events panels
1
2
3
4
5
9
7 8
6
Console
EDB’s Value Propositions
23
• Multi-Model
• Polyglot Persistence
• Native JSON
development
• Enterprise manageability
• Roadmaps
• QA and certifications
• World leading support &
expertise
• Open source value
• Oracle compatibility
• Sub-capacity licensing
• EDB Ark
• Elasticity
• Private, public, hybrid
cloud
• License mobility
Cloud
Management
Flexibility
Low TCO-
with Big
ROI
DBMS for
Digital
Business
Enterprise
Postgres
EDB Postgres Platform 2017
24
Database Platform For Digital Business
Edb Postgres And EDB Ark
25
THANK YOU

OPEN'17_4_Postgres: The Centerpiece for Modernising IT Infrastructures

  • 1.
    Postgres: the centerpiecefor modernising IT infrastructure Gaby Schilders - EDB
  • 2.
    Agenda • Open source,Postgres and EDB origins • Digitalization, competition and open source • Postgres as a platform of innovation in a multi-model data world • The role of digital business applications in digital business initiatives • Postgres and the DevOps motion: PaaS and IaaS • The role of the DBA in a DevOps enabled, enterprise class open source-based data management strategy 2
  • 3.
    Timeline Open SourceSoftware 3 Gnu’s not Unix Linux is not your dad’s Unix Open source is not business as usual 80’s 90’s Open source database is not a toy 00’s 10’s
  • 4.
    • Most matureopen source DBMS technology • Enterprise-class features (built like Oracle, DB2, SQL Server) • Strong, independent community driving rapid innovation, e.g., JSON, PostGIS 4 Fully ACID Compliant MVCC Point in Time Recovery (PITR) Data and Index Partitioning Bitmap Indexes ANSI Constraints Triggers & Stored Functions Views & Data Types Nested Transactions Online Backup Online Reorganization Foreign Keys Streaming Replication Multi-Core Support JSON Support HStore Postgres: A Proven Track Record
  • 5.
    The Gartner report,Magic Quadrant for Operational Database Management Systems, by Nick Heudecker, Donald Feinberg, Merv Adrian, Terilyn Palanca, Rick Greenwald was published October 5, 2016. This graphic was published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from EnterpriseDB. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research Publications consist of the opinions of Gartner's research Organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of Merchantability or fitness for a particular purpose. Gartner MQ: EDB is the Leading OSS- based DBMS
  • 6.
    Digitalization The integrated useof analytics, big data, the cloud, the Internet of Things, mobile, and the application culture. 6
  • 7.
    Digital Transformation How enterprisesapply digital technology to their businesses and operational processes enabling new types of products and services rather than simply enhancing existing systems. 7
  • 8.
  • 9.
    Open Source isCritical to Your IT Strategy “Open-source software (OSS) industry saturation is complete: today, 95% of mainstream IT organizations leverage nontrivial open-source software assets within their mission-critical IT portfolios — whether they know it or not.” -Hype Cycle for Open-Source Software, 2016, Mark Driver, 11 July 2016 “Add open-source RDBMSs to your organization's DBMS standards for new uses, and to replace commercial RDBMSs where these are not specifically required.” -Emerging Technology Trends Create Opportunities for DBMS Cost Optimization, Donald Feinberg, Adam Ronthal, 21 April 2016 Speed Agility Flexibility Big ROI Low TCO
  • 10.
    The DBA inDigital Business Initiatives • Digital Business Applications are developed in schema less modes • Data models ‘emerge’ during the Agile Process • DevOps frameworks support automated provisioning, scaling, integration ad recovery of highly available data base solutions • Commercial vendor with high-end hardware help open source scale • Where does that leave the DBA? 10
  • 11.
    The DBA inDigital Business Initiatives • Old: • Create/manage data models • Add tables, columns, indexes, foreign keys • Instantiate data bases • Manage failover and recovery • New • Focus on data as a critical business asset • Manage data origination, data quality, data sharing and data integrity • Facilitate the integration of data across business applications • Focus on creating value instead of managing systems • Focus on acceleration infrastructure (DBaaS/IaaS, schema less development) 11
  • 12.
    Polyglot Persistence It’s afact not one DBMS technology dominates Event capture or caching of transactions on the edge Analysis of large data sets in the Hadoop ecosystem Transactional systems are still at the heart Existing systems have to be leveraged rather than replaced in order to move forward efficiently 12 84%AT&T 84%AT&T 84%AT&T Big Data §  Hadoop §  Map-reduce §  HDFS Legacy Systems §  ERP §  CRM Data Warehouse Event Data Capture Highly Available & Scalable ACID Multi-model DB §  SQL §  Key/value §  JSON §  Geospatial Integration §  Hadoop §  Mongo §  MySQL Oracle compatibility Replication to/from •  SQL – Server •  Oracle
  • 13.
    • Schema-less development forfaster application development • Add structure to unstructured data to ensure integrity • Run SQL queries across all data types Relational Key-Value (Hstore) Document (JSON) Multi-Model DBMS New application models require greater flexibility
  • 14.
    EDB Postgres Integration XDBsupport for replication from and to Oracle and SQL Server FDWs for: • HDFS • Hive • Spark • Mongo • MySQL 14 84%AT&T 84%AT&T 84%AT&T Big Data §  Hadoop §  Map-reduce §  HDFS Legacy Systems §  ERP §  CRM Data Warehouse Event Data Capture Highly Available & Scalable ACID Multi-model DB §  SQL §  Key/value §  JSON §  Geospatial Integration §  Hadoop §  Mongo §  MySQL Oracle compatibility Replication to/from •  SQL – Server •  Oracle
  • 15.
    Patterns Replication of datafrom ERP/CRM to EDB • BOM • Personnel & Org info • Customer Info Integration back to HDFS Integration back to Data Warehouse John Rhymer of Forrester talks about Hybrid Extend • Build out new digital capability as an extension of existing apps • Leverage what you have We support that as well or better than any DBMS system and we do it more cost effectively 15
  • 16.
    Why Dev/Ops andMicro-services? When product becomes digital, the innovation rate accelerates and competition is continuous • What’s that mean? • Competition comes out with a new feature on their self-service web page and you have to respond, not tomorrow, today • You have to differentiate on an ongoing basis because your competition is always catching up • The positive side is that you can add value in new ways and deliver it to the market place faster pulling revenue towards you Micro-services makes the unit of update contained and easily updated New Dev/Ops models like Continuous Integration and Delivery (CICD) allow operations and developers to work together and deliver a stream of updates and new innovation. Daily updates and new capabilities. 16
  • 17.
    Private Cloud withPublic Cloud Capabilities 17
  • 18.
    Value Drivers forHybrid Cloud Management of the Database • IT Operations need to manage, control and understand resource utilizations • DBAs need to define templates for deployments • End users require self-service and easy to use interfaces • Organizations require support for multiple clouds • Production deployments need elastic scalability and auto backup • DevOps motions require PaaS integration EDB Confidential
  • 19.
    Delivering DBaaS toPrivate Cloud Ark for: • OpenStack • AWS • Azure (soon) • Azure Stack (later) Integration of Ark with PaaS • Pivotal Cloud Foundry • OpenShift • Docker 19 EDB Postgres Backup and Recovery EDB Backup and Recovery EDB Postgres Master pgPool EDB Advanced Server PEM Agent EDB Failover Manager EDB Postgres Replica pgPool EDB Advanced Server PEM Agent EDB Failover Manager EDB Postgres Enterprise Manager PEM Server PostgreSQL Persistent Volumes /pgdata /pgxlog /pglog /pgbackup App “A” Service Broker Cloud Controller Cloud Controller API Catalog Provision Bind Unbind Deprovision Service Broker API App Environment App “B” App Environment EDB DBaaS Binding Binding Catalog Provision Bind Unbind Deprovision Cloud Foundry Elas1c Run1me Cloud Controller DB PostgreSQL or EDB Postgres Advanced Server A B
  • 20.
    Supporting DevOps witha DBaaS Service • Address the tension between developers and operations • Developers want • Agility • Speed to deploy • Flow through tool chain • Operations wants • Visibility • Control • Budgeted resources • Cost • Data models • Efficient use of resources 20
  • 21.
    EDB PostgreSQL DBaaS CloudManagement for Hybrid Clouds EDB Ark Production Clusters Development instances EDB Ark provisions and manages robust, elastic, HA Postgres clusters in multiple clouds
  • 22.
    EDB Ark –Provisioning a database in 10 minutes or less Automated, fast, simple, management visibility and reliable. 1 Scale replicas in or out manually 2 Clone cluster for new app development 3 Upgrade Postgres version on your schedule 4 Scale server class up or down manually 5 Transaction or Recovery preferred failover 6 Multi-node clusters with automatic replication, connection pooling and load balancing 7 User controlled auto-scaling thresholds 8 Auto-backup policies including PITR 9 Monitoring and Events panels 1 2 3 4 5 9 7 8 6 Console
  • 23.
    EDB’s Value Propositions 23 •Multi-Model • Polyglot Persistence • Native JSON development • Enterprise manageability • Roadmaps • QA and certifications • World leading support & expertise • Open source value • Oracle compatibility • Sub-capacity licensing • EDB Ark • Elasticity • Private, public, hybrid cloud • License mobility Cloud Management Flexibility Low TCO- with Big ROI DBMS for Digital Business Enterprise Postgres
  • 24.
  • 25.
    Database Platform ForDigital Business Edb Postgres And EDB Ark 25
  • 26.