Greenplum Experts Panel, Greenplum Operations at Scale - Greenplum Summit 2019
Report
VMware TanzuFollow
Mar. 25, 2019•0 likes•2,247 views
Greenplum Experts Panel, Greenplum Operations at Scale - Greenplum Summit 2019
Mar. 25, 2019•0 likes•2,247 views
Download to read offline
Report
Software
Greenplum Summit 2019 Greg Chase @GregChase
VMware TanzuFollow
Recommended
How to Meet Enhanced Data Security Requirements with Pivotal GreenplumVMware Tanzu
Distributing big astronomical catalogues with Greenplum - Greenplum Summit 2019VMware Tanzu
Greenplum for Kubernetes - Greenplum Summit 2019VMware Tanzu
Pivotal Greenplum in Action on AWS, Azure, and GCP - Greenplum Summit 2018VMware Tanzu
Greenplum-PXF November 2018KongYew Chan, MBA
The Fastest Way to Redis on Pivotal Cloud FoundryVMware Tanzu
More Related Content
What's hot
Containerized StorageRed_Hat_Storage
Remote DBA Service: Powering your DBA needsEDB
BI on Big Data with instant response times at VerizonDataWorks Summit
Lessons learned processing 70 billion data points a day using the hybrid cloudDataWorks Summit
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...InfluxData
New Approaches to Integrating Oracle and Postgres Database StrategiesEDB
Similar to Greenplum Experts Panel, Greenplum Operations at Scale - Greenplum Summit 2019
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid Cloud Hosting
PGConf.ASIA 2019 Bali - Full-throttle Running on Terabytes Log-data - Kohei K...Equnix
20190909_PGconf.ASIA_KaiGaiKohei KaiGai
Denver Big Data Analytics DayZivaro Inc
Light-weighted HDFS disaster recoveryDataWorks Summit
AMD EPYC 7002 Launch World RecordsAMD
More from VMware Tanzu
Make the Right Thing the Obvious Thing at Cardinal Health 2023VMware Tanzu
Enhancing DevEx and Simplifying Operations at ScaleVMware Tanzu
Spring Update | July 2023VMware Tanzu
Platforms, Platform Engineering, & Platform as a ProductVMware Tanzu
Building Cloud Ready AppsVMware Tanzu
Spring Boot 3 And BeyondVMware Tanzu
Recently uploaded
Digital Marketing Course in Chandigarh (1).pdfBest Digital Marketing
advanced java.pdfAli Bozkurt
Database storage engine internals.pptxAdewumiSunkanmi
Top Benefits of Web based Systems. sarasiva4
ASE2023_SCPatcher_Presentation_V5.pptxjzyNick
Taming Cloud Sprawl - XConf Europe 2023 - Kief.pdfKief Morris
Greenplum Experts Panel, Greenplum Operations at Scale - Greenplum Summit 2019
- 2. © Copyright 2019 Pivotal Software, Inc. All rights Reserved. Greg Chase, Moderator @GregChase Greenplum Experts Panel Greenplum Operations at Scale
- 3. Introducing our Panel… ● Ronald Scott Smith, VP of Data Warehousing, Conversant ● Ailun Quin, VP of Global Operations, Morgan Stanley Technology ● Eran Shaked, Product Owner, Verint ● Dmitry Pavlov, Chief Product Officer, Arenadata
- 4. © Copyright 2019 Pivotal Software, Inc. All rights Reserved.© Copyright 2019 Pivotal Software, Inc. All rights Reserved. Conversant Ronald Scott Smith, VP Data Warehouse rsmith@conversantmedia.com PostgresConf 2019 | Greenplum Summit 2019
- 5. Per Server Per Cluster Cluster Name # Segment Servers Segment Server Type CPU RAM (Gb) Data Disk Useable File System (Tb) Segs/Node CPU RAM (Gb) Current Storage Used (Tb) Total Primary Segs GPB 192 R730 2 x CPU E5-2680 v3 @ 2.50GHz (12c) 256 558.38 x 24 10.8 12 384 (4608c) 49152 581.38 1152 GPC 192 R730 2 x CPU E5-2680 v3 @ 2.50GHz (12c) 256 558.38 x 24 10.8 12 384 (4608c) 49152 703.39 1152 GPD 16 R730 2 x CPU E5-2695 v3 @ 2.30GHz (14c) 128 558.38 x 12 4.4 12 32 (448c) 2048 7.3 96 GPE 26 R740 2 x Gold 6140 CPU @ 2.30GHz (18c) 352 837.75 x 24 18 12 52 (936c) 9152 191.28 156 GPF 26 R740 2 x Gold 6140 CPU @ 2.30GHz (18c) 384 837.75 x 24 18 12 52 (936c) 9984 43.44 156 GPV2 144 R720 2 x CPU E5-2660 0 @ 2.20GHz (8c) 256 278.46 x 24 5.4 12 288 (2304) 36864 55.45 864 GPCloud1 12 r4.4xlarge Platinum 8175M CPU @ 2.50GHz (8c) 128 340 x 4 1.3 8 24 (192) 1536 1.1 48 GPCloud2 12 r4.4xlarge Platinum 8175M CPU @ 2.50GHz (8c) 128 340 x 4 1.3 8 24 (192) 1536 3 48 1586.34
- 6. Conversant: Examples of Monitoring GP-Prod Storage GP-Prod Connect and Usability
- 7. © Copyright 2019 Pivotal Software, Inc. All rights Reserved.© Copyright 2019 Pivotal Software, Inc. All rights Reserved. Morgan Stanley Ailun Quin, VP of Global Operations ailun.quin@morganstanley.com PostgresConf 2019 | Greenplum Summit 2019
- 8. • 51 Clusters; 1077 Nodes; Thousands of Cores (based on contract); Hundreds of Users – 25 Production Instances – 12 QA Instances – 14 Test Instances – A Typical Production Instances are compromised of a 22 or 40 host node setup. 756 GB of MemoryPer Segment Hosts Between 600 to 1200 TB Per Plant 400 to 1800 CPU Cores Per Plant 10 Gig Network Interconnect A prod Pairing that have equal data content and hardware metrics. App teams use dual ETA to keep DB’s in sync. – Current Software Versions are on GP 5.X and GP 4.3.30.X. – Hardware models are Dell/Lenovo and VMware for new Dev/QA systems – GP Physical systems use local disk & Raid 5 config Greenplum Plant at Morgan Stanley
- 9. © Copyright 2019 Pivotal Software, Inc. All rights Reserved.© Copyright 2019 Pivotal Software, Inc. All rights Reserved. Verint Eran Shaked, Product Owner eran.shaked@verint.com PostgresConf 2019 | Greenplum Summit 2019
- 10. Verint inclusion of Greenplum ● 20 Deployments of Verint Application with Greenplum worldwide ● Largest customer deployment ● 8 racks ● 128 servers, 1024 Postgres processes, 32768 CPU ● Continuously loading 6B records a day!
- 11. © Copyright 2019 Pivotal Software, Inc. All rights Reserved.© Copyright 2019 Pivotal Software, Inc. All rights Reserved. Arenadata Dmitry Pavlov, Chief Product Officer pds@arenadata.io PostgresConf 2019 | Greenplum Summit 2019
- 17. #ScaleMatters © Copyright 2019 Pivotal Software, Inc. All rights Reserved.