SlideShare a Scribd company logo
1 of 21
Download to read offline
2007.DB
                         http://www.ospn.jp/osc2007.db/




PostgreSQL 8.3 Update
      8.3


    PostgreSQL       / NTT OSS



             2007.6.23

                                                             1
8.1 8.3


                                    autovacuum
8.1

                fillfactor   GIN
8.2

                 HOT         XML   autovacuum
8.3



                                                2
8.1 8.2


                                    autovacuum
8.1

                fillfactor   GIN
8.2

                 HOT         XML   autovacuum
8.3



                                                3
CPU
バ                                         TPC-C(OLTP)           CPU
ー       5
ジ                                                        8.2
ョ                      8.0
ン                                                       8CPU
ご       4              8.1
と                      8.2                                                        NUMA
の
、
C       3
P
U
1
個       2                                      8.1              SMP
に                                             4CPU
対                                                               (8CPU   )
す       1
る                                 8.0
相                                2CPU
対
性       0
能                 1          2          4           8      12     16    20   24    28    32
                                                                                              core
    Scaling PostgreSQL on SMP Architectures
    Doug Tolbert (Unisys), PGCon 2007, Ottawa, 2007-05-24                                 4
    http://www.pgcon.org/2007/schedule/events/16.en.html
• tsearch2
    : SELECT isbn,title FROM books
        WHERE fts @@ to_tsquery(‘word1 & word2’);
        – GiST, GIN:                               2
        –                                  ,

          tsearch2 GiST               GIN


      GiST       112ms          280ms             176s 146MB
                                                               •   → GiST
      GIN          39ms 3344ms                    532s 306MB
                                                               •   → GIN
                 ×0.35 ×11.94                  ×3.02 ×2.10


  •
Full-Text Search in PostgreSQL
Oleg Bartunov PGCon 2007, Ottawa, 2007/5/23                             5
http://www.pgcon.org/2007/schedule/events/13.en.html
VACUUM
•       UPDATE
    –
    –




                  VACUUM




                           6
PostgreSQL 8.3
1.
     –   HOT OLTP

2.
     –

3.
     –              WAL

4. VACUUM
     –   VACUUM      autovacuum


                                  7
(1) 8.3
•          HOT                         FillFactor
                                      Fill Factor           TPS
                                TPS
    –                           280
    – pgbench
                                260
                   40%
                                240
•
                                220                         40%UP!
    –
                                200
    – VACUUM
       • VACUUM                 180
                                160
                                                   HOT
•           FillFactor          140
    –                           120                HOT
    – 100%(           )         100
      90~95%                          70    75     80 85 90 95 100
       • ALTER TABLE name                          Fill Factor (%)
         SET (fillfactor=95);
                                           pgbench -s400 (5GB)
                                           NTT OSS Center
                                                                     8
HOT                   (1)
• 8.2   UPDATE

              ID
              001   A    10         …

              002   B   8→7
              003   C    20
              004   D    12




                                        9
HOT                     (2)
• 8.2        UPDATE

                 ID
                 001   A   10
                 002   B   8
                 003   C   20   UPDATE
                 004   D   12
        ×2       002   B   7
(CPU)


        ×3
(I/O)

                                         10
HOT                          (3)
• 8.3 HOT UPDATE

        →           ID
                                     1
                    001   A   10
                    002   B   8
                                   UPDATE
            Heap    002   B   7
            Only    003   C   20
            Tuple
                    004   D   12
 HOT
            ×1
(CPU)
                               1/2
            ×1
(I/O)                                1/3
                                               11
HOT                   (4)
• 8.3 HOT UPDATE
                              HOT
              ID             VACUUM

              001   A   10
              002   B   6
                             UPDATE
              002   B   7
              003   C   20
              004   D   12
HOT
        ×1
(CPU)

        ×1     VACUUM
(I/O)
                                      12
HOT
• UPDATE
    – DELETE+INSERT
•
    –
    –
•
    – FillFactor
    –      VACUUM


                    VACUUM   13
PostgreSQL 8.3
1.
     –   HOT OLTP

2.
     –

3.
     –              WAL

4. VACUUM
     –   VACUUM      autovacuum


                                  14
(2) 8.3
 •                                       (LDC)




EnterpriseDB Performance Testing                 15
http://community.enterprisedb.com/ldc/
•
    –                  (write)
    –                   (fsync)

    8.2

    8.3


          PostgreSQL
               I/O
           I/O
                                  16
PostgreSQL 8.3
1.
     –   HOT OLTP

2.
     –

3.
     –              WAL

4. VACUUM
     –   VACUUM      autovacuum


                                  17
(3) 8.3
•
    – WAL                               I/O                 1/2

                                                                  BEGIN;
                                                                  TRUNCATE t;
                                        35%
                                                                  COPY t FROM …;
          0       20        40   60          80                   COMMIT;
        pgbench -i -s30 (             COPY              )
                                         NTT OSS Center


•                           (                       )
    –
          • InfoFrame DB Maintenance (NEC)
          • pg_bulkload (           , pgFoundry)                   8.3

                                                                              18
(4) 8.3      VACUUM
• autovacuum           VACUUM
  –                         (autovacuum_max_workers)

          1
  8.2   → VACUUM
                            8.3
                                A           B

              VACUUM




                                                19
autovacuum
8.1

      fillfactor   GIN
8.2

       HOT         XML   autovacuum
8.3



                                  20
PostgreSQL 8.3
 –
     • HOT               OLTP
 –
     • VACUUM, Background Writer (            )
 –
     • SQL/XML,                      ,   , etc.




                                                  21

More Related Content

Similar to PostgreSQL 8.3 Update

BFS Distribution Via DCM
BFS Distribution Via DCMBFS Distribution Via DCM
BFS Distribution Via DCMowenlin
 
Adaptive Query Execution: Speeding Up Spark SQL at Runtime
Adaptive Query Execution: Speeding Up Spark SQL at RuntimeAdaptive Query Execution: Speeding Up Spark SQL at Runtime
Adaptive Query Execution: Speeding Up Spark SQL at RuntimeDatabricks
 
110604 2nd SyoueneIT Workshop
110604 2nd SyoueneIT Workshop110604 2nd SyoueneIT Workshop
110604 2nd SyoueneIT WorkshopKensuke SAEKI
 
customization of a deep learning accelerator, based on NVDLA
customization of a deep learning accelerator, based on NVDLAcustomization of a deep learning accelerator, based on NVDLA
customization of a deep learning accelerator, based on NVDLAShien-Chun Luo
 
Top500 11/2011 BOF Slides
Top500 11/2011 BOF SlidesTop500 11/2011 BOF Slides
Top500 11/2011 BOF Slidestop500
 
Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014Xiao Qin
 
Original PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On Semiconductor
Original PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On SemiconductorOriginal PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On Semiconductor
Original PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On Semiconductorauthelectroniccom
 
Cuda 6 performance_report
Cuda 6 performance_reportCuda 6 performance_report
Cuda 6 performance_reportMichael Zhang
 
The Data Center and Hadoop
The Data Center and HadoopThe Data Center and Hadoop
The Data Center and HadoopDataWorks Summit
 
計算力学シミュレーションに GPU は役立つのか?
計算力学シミュレーションに GPU は役立つのか?計算力学シミュレーションに GPU は役立つのか?
計算力学シミュレーションに GPU は役立つのか?Shinnosuke Furuya
 
Exploring the Huawei HG8010H GPON ONT
Exploring the Huawei HG8010H GPON ONTExploring the Huawei HG8010H GPON ONT
Exploring the Huawei HG8010H GPON ONTMarco d'Itri
 
Oracle goldengate 11g schema replication from standby database
Oracle goldengate 11g schema replication from standby databaseOracle goldengate 11g schema replication from standby database
Oracle goldengate 11g schema replication from standby databaseuzzal basak
 
Researching postgresql
Researching postgresqlResearching postgresql
Researching postgresqlFernando Ike
 
コミュニティ開発に参加しよう!
コミュニティ開発に参加しよう!コミュニティ開発に参加しよう!
コミュニティ開発に参加しよう!Takahiro Itagaki
 

Similar to PostgreSQL 8.3 Update (20)

PostgreSQL 8.4 Update
PostgreSQL 8.4 UpdatePostgreSQL 8.4 Update
PostgreSQL 8.4 Update
 
8051 MICROCONTROLLER
8051 MICROCONTROLLER 8051 MICROCONTROLLER
8051 MICROCONTROLLER
 
BFS Distribution Via DCM
BFS Distribution Via DCMBFS Distribution Via DCM
BFS Distribution Via DCM
 
Adaptive Query Execution: Speeding Up Spark SQL at Runtime
Adaptive Query Execution: Speeding Up Spark SQL at RuntimeAdaptive Query Execution: Speeding Up Spark SQL at Runtime
Adaptive Query Execution: Speeding Up Spark SQL at Runtime
 
110604 2nd SyoueneIT Workshop
110604 2nd SyoueneIT Workshop110604 2nd SyoueneIT Workshop
110604 2nd SyoueneIT Workshop
 
customization of a deep learning accelerator, based on NVDLA
customization of a deep learning accelerator, based on NVDLAcustomization of a deep learning accelerator, based on NVDLA
customization of a deep learning accelerator, based on NVDLA
 
Example Application of GPU
Example Application of GPUExample Application of GPU
Example Application of GPU
 
67WS Event FIO Primer
67WS Event FIO Primer67WS Event FIO Primer
67WS Event FIO Primer
 
microprocessor
microprocessormicroprocessor
microprocessor
 
Top500 11/2011 BOF Slides
Top500 11/2011 BOF SlidesTop500 11/2011 BOF Slides
Top500 11/2011 BOF Slides
 
25l8005
25l800525l8005
25l8005
 
Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014Thermal modeling and management of cluster storage systems xunfei jiang 2014
Thermal modeling and management of cluster storage systems xunfei jiang 2014
 
Original PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On Semiconductor
Original PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On SemiconductorOriginal PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On Semiconductor
Original PNP Transistors PZT2907A PZT2907 2907 P2F SOT22-3 New On Semiconductor
 
Cuda 6 performance_report
Cuda 6 performance_reportCuda 6 performance_report
Cuda 6 performance_report
 
The Data Center and Hadoop
The Data Center and HadoopThe Data Center and Hadoop
The Data Center and Hadoop
 
計算力学シミュレーションに GPU は役立つのか?
計算力学シミュレーションに GPU は役立つのか?計算力学シミュレーションに GPU は役立つのか?
計算力学シミュレーションに GPU は役立つのか?
 
Exploring the Huawei HG8010H GPON ONT
Exploring the Huawei HG8010H GPON ONTExploring the Huawei HG8010H GPON ONT
Exploring the Huawei HG8010H GPON ONT
 
Oracle goldengate 11g schema replication from standby database
Oracle goldengate 11g schema replication from standby databaseOracle goldengate 11g schema replication from standby database
Oracle goldengate 11g schema replication from standby database
 
Researching postgresql
Researching postgresqlResearching postgresql
Researching postgresql
 
コミュニティ開発に参加しよう!
コミュニティ開発に参加しよう!コミュニティ開発に参加しよう!
コミュニティ開発に参加しよう!
 

More from Takahiro Itagaki

PostgreSQL 9.0 in OSC@Tokyo,Okinawa
PostgreSQL 9.0 in OSC@Tokyo,OkinawaPostgreSQL 9.0 in OSC@Tokyo,Okinawa
PostgreSQL 9.0 in OSC@Tokyo,OkinawaTakahiro Itagaki
 
問合せ最適化インサイド
問合せ最適化インサイド問合せ最適化インサイド
問合せ最適化インサイドTakahiro Itagaki
 
Wish list from PostgreSQL - Linux Kernel Summit 2009
Wish list from PostgreSQL - Linux Kernel Summit 2009Wish list from PostgreSQL - Linux Kernel Summit 2009
Wish list from PostgreSQL - Linux Kernel Summit 2009Takahiro Itagaki
 
PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~
PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~
PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~Takahiro Itagaki
 
PostgreSQLのこれまで、9.0、そしてこれから
PostgreSQLのこれまで、9.0、そしてこれからPostgreSQLのこれまで、9.0、そしてこれから
PostgreSQLのこれまで、9.0、そしてこれからTakahiro Itagaki
 

More from Takahiro Itagaki (6)

textsearch groonga v0.1
textsearch groonga v0.1textsearch groonga v0.1
textsearch groonga v0.1
 
PostgreSQL 9.0 in OSC@Tokyo,Okinawa
PostgreSQL 9.0 in OSC@Tokyo,OkinawaPostgreSQL 9.0 in OSC@Tokyo,Okinawa
PostgreSQL 9.0 in OSC@Tokyo,Okinawa
 
問合せ最適化インサイド
問合せ最適化インサイド問合せ最適化インサイド
問合せ最適化インサイド
 
Wish list from PostgreSQL - Linux Kernel Summit 2009
Wish list from PostgreSQL - Linux Kernel Summit 2009Wish list from PostgreSQL - Linux Kernel Summit 2009
Wish list from PostgreSQL - Linux Kernel Summit 2009
 
PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~
PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~
PostgreSQL 9.0 Update ~ホット・スタンバイがやってきた!~
 
PostgreSQLのこれまで、9.0、そしてこれから
PostgreSQLのこれまで、9.0、そしてこれからPostgreSQLのこれまで、9.0、そしてこれから
PostgreSQLのこれまで、9.0、そしてこれから
 

Recently uploaded

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 

Recently uploaded (20)

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 

PostgreSQL 8.3 Update

  • 1. 2007.DB http://www.ospn.jp/osc2007.db/ PostgreSQL 8.3 Update 8.3 PostgreSQL / NTT OSS 2007.6.23 1
  • 2. 8.1 8.3 autovacuum 8.1 fillfactor GIN 8.2 HOT XML autovacuum 8.3 2
  • 3. 8.1 8.2 autovacuum 8.1 fillfactor GIN 8.2 HOT XML autovacuum 8.3 3
  • 4. CPU バ TPC-C(OLTP) CPU ー 5 ジ 8.2 ョ 8.0 ン 8CPU ご 4 8.1 と 8.2 NUMA の 、 C 3 P U 1 個 2 8.1 SMP に 4CPU 対 (8CPU ) す 1 る 8.0 相 2CPU 対 性 0 能 1 2 4 8 12 16 20 24 28 32 core Scaling PostgreSQL on SMP Architectures Doug Tolbert (Unisys), PGCon 2007, Ottawa, 2007-05-24 4 http://www.pgcon.org/2007/schedule/events/16.en.html
  • 5. • tsearch2 : SELECT isbn,title FROM books WHERE fts @@ to_tsquery(‘word1 & word2’); – GiST, GIN: 2 – , tsearch2 GiST GIN GiST 112ms 280ms 176s 146MB • → GiST GIN 39ms 3344ms 532s 306MB • → GIN ×0.35 ×11.94 ×3.02 ×2.10 • Full-Text Search in PostgreSQL Oleg Bartunov PGCon 2007, Ottawa, 2007/5/23 5 http://www.pgcon.org/2007/schedule/events/13.en.html
  • 6. VACUUM • UPDATE – – VACUUM 6
  • 7. PostgreSQL 8.3 1. – HOT OLTP 2. – 3. – WAL 4. VACUUM – VACUUM autovacuum 7
  • 8. (1) 8.3 • HOT FillFactor Fill Factor TPS TPS – 280 – pgbench 260 40% 240 • 220 40%UP! – 200 – VACUUM • VACUUM 180 160 HOT • FillFactor 140 – 120 HOT – 100%( ) 100 90~95% 70 75 80 85 90 95 100 • ALTER TABLE name Fill Factor (%) SET (fillfactor=95); pgbench -s400 (5GB) NTT OSS Center 8
  • 9. HOT (1) • 8.2 UPDATE ID 001 A 10 … 002 B 8→7 003 C 20 004 D 12 9
  • 10. HOT (2) • 8.2 UPDATE ID 001 A 10 002 B 8 003 C 20 UPDATE 004 D 12 ×2 002 B 7 (CPU) ×3 (I/O) 10
  • 11. HOT (3) • 8.3 HOT UPDATE → ID 1 001 A 10 002 B 8 UPDATE Heap 002 B 7 Only 003 C 20 Tuple 004 D 12 HOT ×1 (CPU) 1/2 ×1 (I/O) 1/3 11
  • 12. HOT (4) • 8.3 HOT UPDATE HOT ID VACUUM 001 A 10 002 B 6 UPDATE 002 B 7 003 C 20 004 D 12 HOT ×1 (CPU) ×1 VACUUM (I/O) 12
  • 13. HOT • UPDATE – DELETE+INSERT • – – • – FillFactor – VACUUM VACUUM 13
  • 14. PostgreSQL 8.3 1. – HOT OLTP 2. – 3. – WAL 4. VACUUM – VACUUM autovacuum 14
  • 15. (2) 8.3 • (LDC) EnterpriseDB Performance Testing 15 http://community.enterprisedb.com/ldc/
  • 16. – (write) – (fsync) 8.2 8.3 PostgreSQL I/O I/O 16
  • 17. PostgreSQL 8.3 1. – HOT OLTP 2. – 3. – WAL 4. VACUUM – VACUUM autovacuum 17
  • 18. (3) 8.3 • – WAL I/O 1/2 BEGIN; TRUNCATE t; 35% COPY t FROM …; 0 20 40 60 80 COMMIT; pgbench -i -s30 ( COPY ) NTT OSS Center • ( ) – • InfoFrame DB Maintenance (NEC) • pg_bulkload ( , pgFoundry) 8.3 18
  • 19. (4) 8.3 VACUUM • autovacuum VACUUM – (autovacuum_max_workers) 1 8.2 → VACUUM 8.3 A B VACUUM 19
  • 20. autovacuum 8.1 fillfactor GIN 8.2 HOT XML autovacuum 8.3 20
  • 21. PostgreSQL 8.3 – • HOT OLTP – • VACUUM, Background Writer ( ) – • SQL/XML, , , etc. 21