Practice http://weibo.com/viadea 2011.07.24 商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXPUB 主办
All of these are my own opinion, not for any company. Feel free to correct me if I am wrong. 商业智能研讨沙龙-上海站  ITPUB ChinaUnix...
商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Architecture – share nothing(MPP) 商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXPUB 主办
Query Worker Processes 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Resource Queue 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Data Mirror 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Master Mirror 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Parallel Backup 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Non-Parallel Restore 商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXPUB 主办
Non-Parallel Restore 商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXPUB 主办
Q&A <ul><li>Before going further, here comes Q&A </li></ul>商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXPUB 主办
1.Managing Roles and Privileges <ul><li>Role=User+Group </li></ul>商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXPUB 主办
2. Configuring Client Authentication <ul><li>pg_hba.conf </li></ul><ul><li>local all gpadmin trust </li></ul><ul><li>host ...
3. Managing Workload and Resources <ul><li>Resource queue </li></ul><ul><li>CREATE RESOURCE QUEUE executive WITH (ACTIVE_S...
4. Defining Database Objects <ul><li>Multi-level Partition Design </li></ul><ul><li>Check constraint </li></ul>商业智能研讨沙龙-上海...
5. Managing Data <ul><li>Vacuuming the Database </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
6. Loading and Unloading Data <ul><li>gpload </li></ul><ul><li>YAML file </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
7. High Availability <ul><li>Segment failure </li></ul><ul><li>gprecoverseg </li></ul><ul><li>Master failure </li></ul><ul...
8. Backup and restore <ul><li>gp_dump and gp_restore </li></ul><ul><li>pg_dump </li></ul>商业智能研讨沙龙-上海站  ITPUB ChinaUnix IXP...
9. Expanding a Greenplum System <ul><li>gpexpand </li></ul><ul><li>To interactively create an expansion input file: </li><...
Q&A <ul><li>Before going further and further, here comes Q&A </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Troubleshooting(1) <ul><li>SIGSEGVs </li></ul><ul><li>gp_reraise_signal </li></ul><ul><li>If enabled, will attempt to dump...
Troubleshooting(2) <ul><li>Out of memory </li></ul><ul><li>gp_vmem_protect_limit </li></ul><ul><li>Sets the amount of memo...
Troubleshooting(3) <ul><li>Hung query </li></ul><ul><li>pg_locks </li></ul><ul><li>pg_stat_activity </li></ul><ul><li>psta...
Troubleshooting(4) <ul><li>Orphan process </li></ul><ul><li>In version 4.1: </li></ul><ul><li>pg_locks. gp_segment_id </li...
Troubleshooting(5) <ul><li>Catalog problem </li></ul><ul><li>pg_stat_operations </li></ul><ul><li>The view pg_stat_operati...
Q&A <ul><li>Before going further and further and further, here comes Q&A </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Let’s stop here for now 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
Upcoming SlideShare
Loading in...5
×

Greenplum管理实践

3,261

Published on

Greenplum管理实践

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,261
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
61
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Greenplum管理实践

  1. 1. Practice http://weibo.com/viadea 2011.07.24 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  2. 2. All of these are my own opinion, not for any company. Feel free to correct me if I am wrong. 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  3. 3. 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  4. 4. Architecture – share nothing(MPP) 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  5. 5. Query Worker Processes 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  6. 6. Resource Queue 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  7. 7. Data Mirror 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  8. 8. Master Mirror 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  9. 9. Parallel Backup 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  10. 10. Non-Parallel Restore 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  11. 11. Non-Parallel Restore 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  12. 12. Q&A <ul><li>Before going further, here comes Q&A </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  13. 13. 1.Managing Roles and Privileges <ul><li>Role=User+Group </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  14. 14. 2. Configuring Client Authentication <ul><li>pg_hba.conf </li></ul><ul><li>local all gpadmin trust </li></ul><ul><li>host all gpadmin 127.0.0.1/32 password </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  15. 15. 3. Managing Workload and Resources <ul><li>Resource queue </li></ul><ul><li>CREATE RESOURCE QUEUE executive WITH (ACTIVE_STATEMENTS=3, PRIORITY=MAX); </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  16. 16. 4. Defining Database Objects <ul><li>Multi-level Partition Design </li></ul><ul><li>Check constraint </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  17. 17. 5. Managing Data <ul><li>Vacuuming the Database </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  18. 18. 6. Loading and Unloading Data <ul><li>gpload </li></ul><ul><li>YAML file </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  19. 19. 7. High Availability <ul><li>Segment failure </li></ul><ul><li>gprecoverseg </li></ul><ul><li>Master failure </li></ul><ul><li>gpactivatestandby </li></ul><ul><li>Standby master out of sync </li></ul><ul><li>gpinitstandby </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  20. 20. 8. Backup and restore <ul><li>gp_dump and gp_restore </li></ul><ul><li>pg_dump </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  21. 21. 9. Expanding a Greenplum System <ul><li>gpexpand </li></ul><ul><li>To interactively create an expansion input file: </li></ul><ul><li>gpexpand -f hosts_file </li></ul><ul><li>To initialize segments and create expansion schema: </li></ul><ul><li>gpexpand -i input_file -D database_name </li></ul><ul><li>To redistribute tables: </li></ul><ul><li>gpexpand -d duration </li></ul><ul><li>To remove the expansion schema: </li></ul><ul><li>gpexpand -c </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  22. 22. Q&A <ul><li>Before going further and further, here comes Q&A </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  23. 23. Troubleshooting(1) <ul><li>SIGSEGVs </li></ul><ul><li>gp_reraise_signal </li></ul><ul><li>If enabled, will attempt to dump core if a fatal server error occurs. </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  24. 24. Troubleshooting(2) <ul><li>Out of memory </li></ul><ul><li>gp_vmem_protect_limit </li></ul><ul><li>Sets the amount of memory (in number of MBs) that all postgres processes of a segment instance can consume. </li></ul><ul><li>Work_mem </li></ul><ul><li>Specifies the amount of memory to be used by internal sort operations and hash tables before switching to temporary disk files. </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  25. 25. Troubleshooting(3) <ul><li>Hung query </li></ul><ul><li>pg_locks </li></ul><ul><li>pg_stat_activity </li></ul><ul><li>pstack </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  26. 26. Troubleshooting(4) <ul><li>Orphan process </li></ul><ul><li>In version 4.1: </li></ul><ul><li>pg_locks. gp_segment_id </li></ul><ul><li>The Greenplum segment id (dbid) where the lock is held. </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  27. 27. Troubleshooting(5) <ul><li>Catalog problem </li></ul><ul><li>pg_stat_operations </li></ul><ul><li>The view pg_stat_operations shows details about the last operation performed on a database object (such as a table, index, view or database) or a global object (such as a role). </li></ul><ul><li>$GPHOME/bin/lib/gpcheckcat </li></ul><ul><li>Check the system catalog tables for inconsistencies. </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  28. 28. Q&A <ul><li>Before going further and further and further, here comes Q&A </li></ul>商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  29. 29. Let’s stop here for now 商业智能研讨沙龙-上海站 ITPUB ChinaUnix IXPUB 主办
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×