SlideShare a Scribd company logo
Copyright © 2008 The Apache Software Foundation. All rights reserved.
BookKeeper Administrator's Guide
Setup Guide
by
Table of contents
1 Deployment........................................................................................................................ 2
1.1 System requirements.....................................................................................................2
1.2 Running bookies........................................................................................................... 2
1.3 ZooKeeper Metadata.....................................................................................................3
BookKeeper Administrator's Guide
Page 2Copyright © 2008 The Apache Software Foundation. All rights reserved.
1 Deployment
This section contains information about deploying BookKeeper and covers these topics:
• System requirements
• Running bookies
• ZooKeeper Metadata
The first section tells you how many machines you need. The second explains how to
bootstrap bookies (BookKeeper storage servers). The third section explains how we use
ZooKeeper and our requirements with respect to ZooKeeper.
1.1 System requirements
A typical BookKeeper installation comprises a set of bookies and a set of ZooKeeper
replicas. The exact number of bookies depends on the quorum mode, desired throughput, and
number of clients using this installation simultaneously. The minimum number of bookies
is three for self-verifying (stores a message authentication code along with each entry) and
four for generic (does not store a message authentication codewith each entry), and there is
no upper limit on the number of bookies. Increasing the number of bookies, in fact, enables
higher throughput.
For performance, we require each server to have at least two disks. It is possible to run a
bookie with a single disk, but performance will be significantly lower in this case. Of course,
it works with one disk, but performance is significantly lower.
For ZooKeeper, there is no constraint with respect to the number of replicas. Having a single
machine running ZooKeeper in standalone mode is sufficient for BookKeeper. For resilience
purposes, it might be a good idea to run ZooKeeper in quorum mode with multiple servers.
Please refer to the ZooKeeper documentation for detail on how to configure ZooKeeper with
multiple replicas
1.2 Running bookies
To run a bookie, we execute the following command:
java -cp .:./zookeeper-<version>-bookkeeper.jar:./
zookeeper-<version>.jar :../log4j/apache-log4j-1.2.15/
log4j-1.2.15.jar -Dlog4j.configuration=log4j.properties
org.apache.bookkeeper.proto.BookieServer 3181 127.0.0.1:2181 /
path_to_log_device/ /path_to_ledger_device/
The parameters are:
• Port number that the bookie listens on;
• Comma separated list of ZooKeeper servers with a hostname:port format;
BookKeeper Administrator's Guide
Page 3Copyright © 2008 The Apache Software Foundation. All rights reserved.
• Path for Log Device (stores bookie write-ahead log);
• Path for Ledger Device (stores ledger entries);
Ideally, /path_to_log_device/ and /path_to_ledger_device/ are each in a
different device.
1.3 ZooKeeper Metadata
For BookKeeper, we require a ZooKeeper installation to store metadata, and to pass
the list of ZooKeeper servers as parameter to the constructor of the BookKeeper class (
org.apache.bookkeeper.client,BookKeeper). To setup ZooKeeper, please
check the ZooKeeper documentation.

More Related Content

What's hot

How to Upgrade Openfire on CentOS 7
How to Upgrade Openfire on CentOS 7How to Upgrade Openfire on CentOS 7
How to Upgrade Openfire on CentOS 7
VCP Muthukrishna
 
How To Manage Services on RHEL 7 or CentOS 7
How To Manage Services on RHEL 7 or CentOS 7How To Manage Services on RHEL 7 or CentOS 7
How To Manage Services on RHEL 7 or CentOS 7
VCP Muthukrishna
 
How To Install and Configure SNMP on RHEL 7 or CentOS 7
How To Install and Configure SNMP on RHEL 7 or CentOS 7How To Install and Configure SNMP on RHEL 7 or CentOS 7
How To Install and Configure SNMP on RHEL 7 or CentOS 7
VCP Muthukrishna
 
How to Fix Duplicate Packages in YUM on CentOS 7
How to Fix Duplicate Packages in YUM on CentOS 7How to Fix Duplicate Packages in YUM on CentOS 7
How to Fix Duplicate Packages in YUM on CentOS 7
VCP Muthukrishna
 
The Elastic PU
The Elastic PUThe Elastic PU
The Elastic PU
Shay Hassidim
 
How To Create EBS Snapshot and Restore EBS Snapshot – Linux Instance
How To Create EBS Snapshot and Restore EBS Snapshot – Linux InstanceHow To Create EBS Snapshot and Restore EBS Snapshot – Linux Instance
How To Create EBS Snapshot and Restore EBS Snapshot – Linux Instance
VCP Muthukrishna
 
Nginx bind() to 0.0.0.0:9080 failed
Nginx bind() to 0.0.0.0:9080 failedNginx bind() to 0.0.0.0:9080 failed
Nginx bind() to 0.0.0.0:9080 failed
VCP Muthukrishna
 
How To Install and Configure AWS CLI on RHEL 7
How To Install and Configure AWS CLI on RHEL 7How To Install and Configure AWS CLI on RHEL 7
How To Install and Configure AWS CLI on RHEL 7
VCP Muthukrishna
 
Install Active Directory PowerShell Module on Windows 10
Install Active Directory PowerShell Module on Windows 10Install Active Directory PowerShell Module on Windows 10
Install Active Directory PowerShell Module on Windows 10
VCP Muthukrishna
 
How To Check IE Enhanced Security Is Enabled Windows PowerShell
How To Check IE Enhanced Security Is Enabled Windows PowerShellHow To Check IE Enhanced Security Is Enabled Windows PowerShell
How To Check IE Enhanced Security Is Enabled Windows PowerShell
VCP Muthukrishna
 
ZooKeeper JMX
ZooKeeper JMXZooKeeper JMX
ZooKeeper JMX
Jeff Smith
 
How To View Current Execution Policy PowerShell
How To View Current Execution Policy PowerShellHow To View Current Execution Policy PowerShell
How To View Current Execution Policy PowerShell
VCP Muthukrishna
 
Mule esb db component
Mule esb db componentMule esb db component
Mule esb db component
D.Rajesh Kumar
 
Fetch records from mysql using mule esb
Fetch records from mysql using mule esbFetch records from mysql using mule esb
Fetch records from mysql using mule esb
AnilKumar Etagowni
 
Monitoring and tuning your chef server - chef conf talk
Monitoring and tuning your chef server - chef conf talk Monitoring and tuning your chef server - chef conf talk
Monitoring and tuning your chef server - chef conf talk
Andrew DuFour
 
Windows PowerShell Basics - How To List PSDrive Info
Windows PowerShell Basics - How To List PSDrive InfoWindows PowerShell Basics - How To List PSDrive Info
Windows PowerShell Basics - How To List PSDrive Info
VCP Muthukrishna
 
How To Manage Yum Cache
How To Manage Yum CacheHow To Manage Yum Cache
How To Manage Yum Cache
VCP Muthukrishna
 
VMWare Tools Installation and Troubleshooting Guide
VMWare Tools Installation and Troubleshooting GuideVMWare Tools Installation and Troubleshooting Guide
VMWare Tools Installation and Troubleshooting Guide
VCP Muthukrishna
 
How to install and configure firewall on ubuntu os
How to install and configure firewall on ubuntu osHow to install and configure firewall on ubuntu os
How to install and configure firewall on ubuntu os
VCP Muthukrishna
 

What's hot (19)

How to Upgrade Openfire on CentOS 7
How to Upgrade Openfire on CentOS 7How to Upgrade Openfire on CentOS 7
How to Upgrade Openfire on CentOS 7
 
How To Manage Services on RHEL 7 or CentOS 7
How To Manage Services on RHEL 7 or CentOS 7How To Manage Services on RHEL 7 or CentOS 7
How To Manage Services on RHEL 7 or CentOS 7
 
How To Install and Configure SNMP on RHEL 7 or CentOS 7
How To Install and Configure SNMP on RHEL 7 or CentOS 7How To Install and Configure SNMP on RHEL 7 or CentOS 7
How To Install and Configure SNMP on RHEL 7 or CentOS 7
 
How to Fix Duplicate Packages in YUM on CentOS 7
How to Fix Duplicate Packages in YUM on CentOS 7How to Fix Duplicate Packages in YUM on CentOS 7
How to Fix Duplicate Packages in YUM on CentOS 7
 
The Elastic PU
The Elastic PUThe Elastic PU
The Elastic PU
 
How To Create EBS Snapshot and Restore EBS Snapshot – Linux Instance
How To Create EBS Snapshot and Restore EBS Snapshot – Linux InstanceHow To Create EBS Snapshot and Restore EBS Snapshot – Linux Instance
How To Create EBS Snapshot and Restore EBS Snapshot – Linux Instance
 
Nginx bind() to 0.0.0.0:9080 failed
Nginx bind() to 0.0.0.0:9080 failedNginx bind() to 0.0.0.0:9080 failed
Nginx bind() to 0.0.0.0:9080 failed
 
How To Install and Configure AWS CLI on RHEL 7
How To Install and Configure AWS CLI on RHEL 7How To Install and Configure AWS CLI on RHEL 7
How To Install and Configure AWS CLI on RHEL 7
 
Install Active Directory PowerShell Module on Windows 10
Install Active Directory PowerShell Module on Windows 10Install Active Directory PowerShell Module on Windows 10
Install Active Directory PowerShell Module on Windows 10
 
How To Check IE Enhanced Security Is Enabled Windows PowerShell
How To Check IE Enhanced Security Is Enabled Windows PowerShellHow To Check IE Enhanced Security Is Enabled Windows PowerShell
How To Check IE Enhanced Security Is Enabled Windows PowerShell
 
ZooKeeper JMX
ZooKeeper JMXZooKeeper JMX
ZooKeeper JMX
 
How To View Current Execution Policy PowerShell
How To View Current Execution Policy PowerShellHow To View Current Execution Policy PowerShell
How To View Current Execution Policy PowerShell
 
Mule esb db component
Mule esb db componentMule esb db component
Mule esb db component
 
Fetch records from mysql using mule esb
Fetch records from mysql using mule esbFetch records from mysql using mule esb
Fetch records from mysql using mule esb
 
Monitoring and tuning your chef server - chef conf talk
Monitoring and tuning your chef server - chef conf talk Monitoring and tuning your chef server - chef conf talk
Monitoring and tuning your chef server - chef conf talk
 
Windows PowerShell Basics - How To List PSDrive Info
Windows PowerShell Basics - How To List PSDrive InfoWindows PowerShell Basics - How To List PSDrive Info
Windows PowerShell Basics - How To List PSDrive Info
 
How To Manage Yum Cache
How To Manage Yum CacheHow To Manage Yum Cache
How To Manage Yum Cache
 
VMWare Tools Installation and Troubleshooting Guide
VMWare Tools Installation and Troubleshooting GuideVMWare Tools Installation and Troubleshooting Guide
VMWare Tools Installation and Troubleshooting Guide
 
How to install and configure firewall on ubuntu os
How to install and configure firewall on ubuntu osHow to install and configure firewall on ubuntu os
How to install and configure firewall on ubuntu os
 

Viewers also liked

North carolina neuroscience social flyer
North carolina neuroscience social flyerNorth carolina neuroscience social flyer
North carolina neuroscience social flyerdegas96
 
Job hunting mistakes to avoid
Job hunting mistakes to avoidJob hunting mistakes to avoid
Job hunting mistakes to avoid
HipCV
 
Como se usa autocad 2D
Como se usa autocad 2DComo se usa autocad 2D
Como se usa autocad 2D
Grupo de Estudio Heisenberg
 
Educación Infantil e 1º Ciclo
Educación  Infantil e 1º CicloEducación  Infantil e 1º Ciclo
Educación Infantil e 1º Ciclo
flolodi
 
Gomi pops liderasgo
Gomi pops  liderasgoGomi pops  liderasgo
Gomi pops liderasgoKathe Jaimes
 
Gullivers resor (W.H)
Gullivers resor (W.H)Gullivers resor (W.H)
Gullivers resor (W.H)frokenjohanna
 

Viewers also liked (8)

North carolina neuroscience social flyer
North carolina neuroscience social flyerNorth carolina neuroscience social flyer
North carolina neuroscience social flyer
 
Job hunting mistakes to avoid
Job hunting mistakes to avoidJob hunting mistakes to avoid
Job hunting mistakes to avoid
 
Como se usa autocad 2D
Como se usa autocad 2DComo se usa autocad 2D
Como se usa autocad 2D
 
Educación Infantil e 1º Ciclo
Educación  Infantil e 1º CicloEducación  Infantil e 1º Ciclo
Educación Infantil e 1º Ciclo
 
Gomi pops liderasgo
Gomi pops  liderasgoGomi pops  liderasgo
Gomi pops liderasgo
 
Gullivers resor (W.H)
Gullivers resor (W.H)Gullivers resor (W.H)
Gullivers resor (W.H)
 
Pilot plantscaleupof parentrals
Pilot plantscaleupof parentralsPilot plantscaleupof parentrals
Pilot plantscaleupof parentrals
 
6 els fòssils
6 els fòssils6 els fòssils
6 els fòssils
 

Similar to BookKeeper Administrator's Guide

Oracle Analytics Server Infrastructure Tuning guide v2.pdf
Oracle Analytics Server Infrastructure Tuning guide v2.pdfOracle Analytics Server Infrastructure Tuning guide v2.pdf
Oracle Analytics Server Infrastructure Tuning guide v2.pdf
sivakodali7
 
Webapp2 2.2
Webapp2 2.2Webapp2 2.2
Webapp2 2.2
Sergi Duró
 
Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2
Sal Marcus
 
Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2Sal Marcus
 
Jenkins log monitoring with elk stack
Jenkins log monitoring with elk stackJenkins log monitoring with elk stack
Jenkins log monitoring with elk stack
Subhasis Roy
 
Openobject install
Openobject installOpenobject install
Openobject installAli Mashduqi
 
ZooKeeper Quota's Guide
ZooKeeper Quota's GuideZooKeeper Quota's Guide
ZooKeeper Quota's Guide
Jeff Smith
 
digital marketing training in bangalore
digital marketing training in bangaloredigital marketing training in bangalore
digital marketing training in bangalore
Venus Tech Inc.
 
B28654oas10g best pracitice
B28654oas10g best praciticeB28654oas10g best pracitice
B28654oas10g best pracitice
Caipei Chen
 
VMware Networking 5.0
VMware Networking 5.0VMware Networking 5.0
VMware Networking 5.0
rashedmasood
 
Ansible Study Guide ToC
Ansible Study Guide ToCAnsible Study Guide ToC
Ansible Study Guide ToC
Manish Chopra
 
zookeeperProgrammers
zookeeperProgrammerszookeeperProgrammers
zookeeperProgrammersHiroshi Ono
 
Bews command line_en
Bews command line_enBews command line_en
Bews command line_enOm Pal
 
Percona XtraDB 集群文档
Percona XtraDB 集群文档Percona XtraDB 集群文档
Percona XtraDB 集群文档
YUCHENG HU
 
fusion eclipse manual
fusion eclipse manualfusion eclipse manual
fusion eclipse manualIra Lukhezo
 
Oracle dba-concise-handbook
Oracle dba-concise-handbookOracle dba-concise-handbook
Oracle dba-concise-handbooksasi777
 

Similar to BookKeeper Administrator's Guide (20)

Oracle Analytics Server Infrastructure Tuning guide v2.pdf
Oracle Analytics Server Infrastructure Tuning guide v2.pdfOracle Analytics Server Infrastructure Tuning guide v2.pdf
Oracle Analytics Server Infrastructure Tuning guide v2.pdf
 
Webapp2 2.2
Webapp2 2.2Webapp2 2.2
Webapp2 2.2
 
Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2
 
Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2Maa wp sun_apps11i_db10g_r2-2
Maa wp sun_apps11i_db10g_r2-2
 
Jenkins log monitoring with elk stack
Jenkins log monitoring with elk stackJenkins log monitoring with elk stack
Jenkins log monitoring with elk stack
 
Openobject install
Openobject installOpenobject install
Openobject install
 
Installation d openerp
Installation d openerpInstallation d openerp
Installation d openerp
 
ZooKeeper Quota's Guide
ZooKeeper Quota's GuideZooKeeper Quota's Guide
ZooKeeper Quota's Guide
 
digital marketing training in bangalore
digital marketing training in bangaloredigital marketing training in bangalore
digital marketing training in bangalore
 
B28654oas10g best pracitice
B28654oas10g best praciticeB28654oas10g best pracitice
B28654oas10g best pracitice
 
VMware Networking 5.0
VMware Networking 5.0VMware Networking 5.0
VMware Networking 5.0
 
Ansible Study Guide ToC
Ansible Study Guide ToCAnsible Study Guide ToC
Ansible Study Guide ToC
 
zookeeperProgrammers
zookeeperProgrammerszookeeperProgrammers
zookeeperProgrammers
 
Bews command line_en
Bews command line_enBews command line_en
Bews command line_en
 
Percona XtraDB 集群文档
Percona XtraDB 集群文档Percona XtraDB 集群文档
Percona XtraDB 集群文档
 
Bugzilla guide
Bugzilla guideBugzilla guide
Bugzilla guide
 
fusion eclipse manual
fusion eclipse manualfusion eclipse manual
fusion eclipse manual
 
Oracle dba-concise-handbook
Oracle dba-concise-handbookOracle dba-concise-handbook
Oracle dba-concise-handbook
 
Selenium documentation 1.0
Selenium documentation 1.0Selenium documentation 1.0
Selenium documentation 1.0
 
Rhel Tuningand Optimizationfor Oracle V11
Rhel Tuningand Optimizationfor Oracle V11Rhel Tuningand Optimizationfor Oracle V11
Rhel Tuningand Optimizationfor Oracle V11
 

More from Jeff Smith

vi-vim-cheat-sheet.pdf
vi-vim-cheat-sheet.pdfvi-vim-cheat-sheet.pdf
vi-vim-cheat-sheet.pdf
Jeff Smith
 
dfgdgsdg
dfgdgsdgdfgdgsdg
dfgdgsdg
Jeff Smith
 
3yudh.pdf
3yudh.pdf3yudh.pdf
3yudh.pdf
Jeff Smith
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
Jeff Smith
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
Jeff Smith
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
Jeff Smith
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
Jeff Smith
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
Jeff Smith
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
Jeff Smith
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
Jeff Smith
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
Jeff Smith
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
Jeff Smith
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
Jeff Smith
 
0nba4.pdf
0nba4.pdf0nba4.pdf
0nba4.pdf
Jeff Smith
 
0nba4.pdf
0nba4.pdf0nba4.pdf
0nba4.pdf
Jeff Smith
 
4wa4i.pdf
4wa4i.pdf4wa4i.pdf
4wa4i.pdf
Jeff Smith
 
7k3gy.pdf
7k3gy.pdf7k3gy.pdf
7k3gy.pdf
Jeff Smith
 
b33t2.pdf
b33t2.pdfb33t2.pdf
b33t2.pdf
Jeff Smith
 
cqqk2.pdf
cqqk2.pdfcqqk2.pdf
cqqk2.pdf
Jeff Smith
 
ebcbe.docx
ebcbe.docxebcbe.docx
ebcbe.docx
Jeff Smith
 

More from Jeff Smith (20)

vi-vim-cheat-sheet.pdf
vi-vim-cheat-sheet.pdfvi-vim-cheat-sheet.pdf
vi-vim-cheat-sheet.pdf
 
dfgdgsdg
dfgdgsdgdfgdgsdg
dfgdgsdg
 
3yudh.pdf
3yudh.pdf3yudh.pdf
3yudh.pdf
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
 
nvjiz.pdf
nvjiz.pdfnvjiz.pdf
nvjiz.pdf
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
 
mctpr.pdf
mctpr.pdfmctpr.pdf
mctpr.pdf
 
0nba4.pdf
0nba4.pdf0nba4.pdf
0nba4.pdf
 
0nba4.pdf
0nba4.pdf0nba4.pdf
0nba4.pdf
 
4wa4i.pdf
4wa4i.pdf4wa4i.pdf
4wa4i.pdf
 
7k3gy.pdf
7k3gy.pdf7k3gy.pdf
7k3gy.pdf
 
b33t2.pdf
b33t2.pdfb33t2.pdf
b33t2.pdf
 
cqqk2.pdf
cqqk2.pdfcqqk2.pdf
cqqk2.pdf
 
ebcbe.docx
ebcbe.docxebcbe.docx
ebcbe.docx
 

Recently uploaded

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 

BookKeeper Administrator's Guide

  • 1. Copyright © 2008 The Apache Software Foundation. All rights reserved. BookKeeper Administrator's Guide Setup Guide by Table of contents 1 Deployment........................................................................................................................ 2 1.1 System requirements.....................................................................................................2 1.2 Running bookies........................................................................................................... 2 1.3 ZooKeeper Metadata.....................................................................................................3
  • 2. BookKeeper Administrator's Guide Page 2Copyright © 2008 The Apache Software Foundation. All rights reserved. 1 Deployment This section contains information about deploying BookKeeper and covers these topics: • System requirements • Running bookies • ZooKeeper Metadata The first section tells you how many machines you need. The second explains how to bootstrap bookies (BookKeeper storage servers). The third section explains how we use ZooKeeper and our requirements with respect to ZooKeeper. 1.1 System requirements A typical BookKeeper installation comprises a set of bookies and a set of ZooKeeper replicas. The exact number of bookies depends on the quorum mode, desired throughput, and number of clients using this installation simultaneously. The minimum number of bookies is three for self-verifying (stores a message authentication code along with each entry) and four for generic (does not store a message authentication codewith each entry), and there is no upper limit on the number of bookies. Increasing the number of bookies, in fact, enables higher throughput. For performance, we require each server to have at least two disks. It is possible to run a bookie with a single disk, but performance will be significantly lower in this case. Of course, it works with one disk, but performance is significantly lower. For ZooKeeper, there is no constraint with respect to the number of replicas. Having a single machine running ZooKeeper in standalone mode is sufficient for BookKeeper. For resilience purposes, it might be a good idea to run ZooKeeper in quorum mode with multiple servers. Please refer to the ZooKeeper documentation for detail on how to configure ZooKeeper with multiple replicas 1.2 Running bookies To run a bookie, we execute the following command: java -cp .:./zookeeper-<version>-bookkeeper.jar:./ zookeeper-<version>.jar :../log4j/apache-log4j-1.2.15/ log4j-1.2.15.jar -Dlog4j.configuration=log4j.properties org.apache.bookkeeper.proto.BookieServer 3181 127.0.0.1:2181 / path_to_log_device/ /path_to_ledger_device/ The parameters are: • Port number that the bookie listens on; • Comma separated list of ZooKeeper servers with a hostname:port format;
  • 3. BookKeeper Administrator's Guide Page 3Copyright © 2008 The Apache Software Foundation. All rights reserved. • Path for Log Device (stores bookie write-ahead log); • Path for Ledger Device (stores ledger entries); Ideally, /path_to_log_device/ and /path_to_ledger_device/ are each in a different device. 1.3 ZooKeeper Metadata For BookKeeper, we require a ZooKeeper installation to store metadata, and to pass the list of ZooKeeper servers as parameter to the constructor of the BookKeeper class ( org.apache.bookkeeper.client,BookKeeper). To setup ZooKeeper, please check the ZooKeeper documentation.