Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Exhibitor
Netflix’s ZooKeeper Management System




                           Jordan Zimmerman
                           ...
The Problem
• ZooKeeper is statically configured
• Limited tools for managing the ensemble
• Backup/restore is sometimes needed
• Visua...
The Goal
Chaos Monkey-able
• See http://techblog.netflix.com/2011/07/
   netflix-simian-army.html
 A tool that randomly disables our ...
Features
Instance Monitoring
Each Exhibitor instance monitors the
ZooKeeper server running on the same
server. If ZooKeeper is not ...
Log Cleanup
In versions prior to ZooKeeper 3.4.x, log file
maintenance is necessary. Exhibitor will
periodically do this ma...
Backup/Restore
Backups in a ZooKeeper ensemble are more complicated
than for a traditional data store (e.g. aRDBMS). Gener...
Cluster-wide
        Configuration
Exhibitor presents a single console for your
entire ZooKeeper ensemble. Configuration
cha...
Rolling Ensemble
          Changes
Exhibitor can update the servers in the
ensemble in a rolling fashion so that the
ZooKe...
Visualizer
Exhibitor provides a graphical tree view of
the ZooKeeper ZNode hierarchy.
ZooKeeper Data
       Mutation
When enabled, Exhibitor can create/update/
delete nodes in the ZooKeeper hierarchy.
Curator Integration
Exhibitor and Curator (Cur/Ex!) can be
configured to work together so that Curator
instances are update...
How it Works
Shared Configuration
                             • S3
                             • File System
                 Shared  ...
Coming Soon...
• Auto-register new instances
• Auto-remove old instances
• Alerting
• ???
Using / Integration
• Stand alone application
                   - or -


• Library/JAR
REST API
• https://github.com/Netflix/exhibitor/wiki/
  REST-Introduction
Demos

Q&A
Exhibitor Introduction
Exhibitor Introduction
Exhibitor Introduction
Exhibitor Introduction
Upcoming SlideShare
Loading in …5
×

of

Exhibitor Introduction Slide 1 Exhibitor Introduction Slide 2 Exhibitor Introduction Slide 3 Exhibitor Introduction Slide 4 Exhibitor Introduction Slide 5 Exhibitor Introduction Slide 6 Exhibitor Introduction Slide 7 Exhibitor Introduction Slide 8 Exhibitor Introduction Slide 9 Exhibitor Introduction Slide 10 Exhibitor Introduction Slide 11 Exhibitor Introduction Slide 12 Exhibitor Introduction Slide 13 Exhibitor Introduction Slide 14 Exhibitor Introduction Slide 15 Exhibitor Introduction Slide 16 Exhibitor Introduction Slide 17 Exhibitor Introduction Slide 18 Exhibitor Introduction Slide 19 Exhibitor Introduction Slide 20 Exhibitor Introduction Slide 21 Exhibitor Introduction Slide 22 Exhibitor Introduction Slide 23 Exhibitor Introduction Slide 24 Exhibitor Introduction Slide 25 Exhibitor Introduction Slide 26 Exhibitor Introduction Slide 27
Upcoming SlideShare
Curator intro
Next
Download to read offline and view in fullscreen.

8 Likes

Share

Download to read offline

Exhibitor Introduction

Download to read offline

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Exhibitor Introduction

  1. 1. Exhibitor Netflix’s ZooKeeper Management System Jordan Zimmerman Senior Platform Engineer Netflix, Inc. jzimmerman@netflix.com @rangalt
  2. 2. The Problem
  3. 3. • ZooKeeper is statically configured • Limited tools for managing the ensemble • Backup/restore is sometimes needed • Visualization is desperately needed • Prior to 3.4.x, periodic cleanup needed
  4. 4. The Goal
  5. 5. Chaos Monkey-able • See http://techblog.netflix.com/2011/07/ netflix-simian-army.html A tool that randomly disables our production instances to make sure we can survive common types of failure without any customer impact. • Completely unmanned • Bringing up a new ensemble should be turn-key/push-button
  6. 6. Features
  7. 7. Instance Monitoring Each Exhibitor instance monitors the ZooKeeper server running on the same server. If ZooKeeper is not running, Exhibitor will write the zoo.cfg file, etc. and start it. If ZooKeeper crashes for some reason, Exhibitor will restart it.
  8. 8. Log Cleanup In versions prior to ZooKeeper 3.4.x, log file maintenance is necessary. Exhibitor will periodically do this maintenance.
  9. 9. Backup/Restore Backups in a ZooKeeper ensemble are more complicated than for a traditional data store (e.g. aRDBMS). Generally, most of the data in ZooKeeper is ephemeral. It would be harmful to blindly restore an entire ZooKeeper data set. What is needed is selective restoration to prevent accidental damage to a subset of the data set. Exhibitor enables this. Exhibitor will periodically backup the ZooKeeper transaction files. Once backed up, you can index any of these transaction files. Once indexed, you can search for individual transactions and “replay” them to restore a given ZNode to ZooKeeper.
  10. 10. Cluster-wide Configuration Exhibitor presents a single console for your entire ZooKeeper ensemble. Configuration changes made in Exhibitor will be applied to the entire ensemble.
  11. 11. Rolling Ensemble Changes Exhibitor can update the servers in the ensemble in a rolling fashion so that the ZooKeeper ensemble can stay up and in quorum while the changes are being made.
  12. 12. Visualizer Exhibitor provides a graphical tree view of the ZooKeeper ZNode hierarchy.
  13. 13. ZooKeeper Data Mutation When enabled, Exhibitor can create/update/ delete nodes in the ZooKeeper hierarchy.
  14. 14. Curator Integration Exhibitor and Curator (Cur/Ex!) can be configured to work together so that Curator instances are updated for changes in the ensemble. Exhibitor Exhibitor Exhibitor A B ... Round Robin - periodic query for servers list Curator Clients Curator Clients Curator Clients
  15. 15. How it Works
  16. 16. Shared Configuration • S3 • File System Shared • Etc. Config Exhibitor Exhibitor Exhibitor A B ...
  17. 17. Coming Soon...
  18. 18. • Auto-register new instances • Auto-remove old instances • Alerting • ???
  19. 19. Using / Integration
  20. 20. • Stand alone application - or - • Library/JAR
  21. 21. REST API
  22. 22. • https://github.com/Netflix/exhibitor/wiki/ REST-Introduction
  23. 23. Demos Q&A
  • sissiyam

    May. 23, 2018
  • cmvelo

    Jun. 7, 2017
  • JoydeepBanikRoy

    Dec. 9, 2016
  • alexmanh

    Mar. 1, 2016
  • fatpanda01

    Jul. 21, 2015
  • ssuser1e6793

    Jan. 28, 2015
  • sebasbad

    Nov. 18, 2014
  • ibrahimelsanosi

    Nov. 7, 2014

Views

Total views

8,559

On Slideshare

0

From embeds

0

Number of embeds

64

Actions

Downloads

107

Shares

0

Comments

0

Likes

8

×