GD2 is a new management system for Gluster 4.0 written in Go that provides better scalability, integration and maintenance compared to the previous version. It provides basic cluster and volume management capabilities currently through commands, HTTP API, and GRPC. Future versions will focus on stabilizing features and adding capabilities like automatic volume management, migration support and centralized logging.

1. GLUSTERD-2.0
WHAT'S HAPPENING?

2. WHAT IS GD2?

3. GD2
New management system for Gluster-4.0
Not backwards compatible
From scratch rewrite, written in Go
Better scalability, integration and maintenance

4. GLUSTER-4.0
Feature parity with GD1
Stabilize
Recovery
Preliminary automatic volume creation
Merge into GlusterFS tree
No migration support

5. GLUSTER-4.1+
Stabilize more
Document everything
Support migration
Fully automatic volume management
Automatic cluster formation
Centralized logging and tracing

6. WORK DONE TILL NOW

7. GD2 AT THE MOMENT
Basic cluster management
Basic volume management
CLI

8. TODOS

9. IMPORTANT TODOS FOR 4.0
Implement rest of the commands
Preliminary automatic volume management
Recovery steps

10. BASIC CLUSTER MANAGEMENT

11. BASIC CLUSTER MANAGEMENT
Expand and shrink cluster
Automatic store/etcd management
HTTP API server
GRPC server

12. AUTOMATIC STORE
Embedded ETCD
Automatic ETCD cluster formation
auto scaling with elastic algorithm
External ETCD clusters supported

13. HTTP API SERVER
HTTP1 API server
ReST like
JSON request and response
Initial TLS support
Port 24007

14. GRPC SERVER
Internal communications
Cluster management
Transaction
Port 24008

15. BASIC VOLUME MANAGEMENT

16. BASIC VOLUME MANAGEMENT
Create, start, stop, delete volumes
Distribute, Replicate, Dist-Rep
Flexible transaction engine
Dynamic volume set
Flexible volgen
Daemon manager
SunRPC server and client

17. TRANSACTION ENGINE
Runs steps across the cluster
only where required
Supports undo on failure
Free form sequence of steps

18. FLEXIBLE VOLGEN
Graph structure defined using text files
Generic graph building functions
Minimal specialized functions when required

19. DYNAMIC VOLUME SET
Build options table at runtime from xlators
Extended xlator options table and struct
(A few) Xlators updated to add new information
New keys for many options (mainly new prefixes)

20. DAEMON MANAGER
Single framework for managing daemons
Defines a daemon interface
Start, stop, communicate with daemons

21. SUNRPC
Pure Go SunRPC/XDR server and client
Used for clients
fetch volfile, portmap
Used for daemons
fetch volfile, daemon communication
Port 24007

22. CLI

23. CLI
`glustercli`
Uses HTTP management API
Management API package
Basic commands implemented
Some changes to syntax

24. SYNTAX CHANGES
Changes to improve parse-ability
Only slight changes to existing syntax
Built-in old to new translator

25. MANAGEMENT API PACKAGE
Go package
Implements GD2 HTTP API
Available for external users

26. OTHER STUFF
Structured logging
Plugins
E2E test framework
RPMs

27. THE END

28. P.S.
GD2 is developed on Github
https://github.com/gluster/glusterd2
Questions/queries?
Find kshlm, ppai, aravindavk on #gluster-dev