KubeFuse - A File-System for Kubernetes
•
2 likes•1,008 views
This document introduces KubeFuse, an open source tool that provides a file system view of Kubernetes resources. KubeFuse allows users to interact with Kubernetes objects like pods, replication controllers and services using standard Linux file system tools by mounting a FUSE file system. This makes tasks like exploration, troubleshooting and backups of Kubernetes clusters easier. The document discusses the motivation, features and implementation of KubeFuse.
More Related Content
What's hot
What's hot (20)
Viewers also liked
Similar to KubeFuse - A File-System for Kubernetes
Similar to KubeFuse - A File-System for Kubernetes (20)
Recently uploaded
Recently uploaded (20)
KubeFuse - A File-System for Kubernetes
- 2. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Hello! Lead consultant at OpenCredo Doing infrastructure, automation, CI/CD, DevOps, ... Semi-specialised in container based infrastructures
- 3. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ OpenCredo High-end consultancy in London Delivery of highly scalable systems Early adopters of CloudFoundry, Docker, Mesos, Kubernetes, … And also CQRS, Big Data, micro-services architectures, CI/CD, ...
- 4. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ The past year ● Kubernetes! ● Kubernetes! ● Kubernetes! ● Kubernetes! ● Kubernetes!
- 5. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ The next year (probably) ● Kubernetes! ● Kubernetes! ● Kubernetes! ● Kubernetes! ● Kubernetes!
- 6. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ What is Kubernetes anyway? ● A cluster manager inspired by Google’s Borg
- 7. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ What is a Cluster Manager anyway? ● A resource (CPU, Memory, Disk) aware scheduler ● Control loops For example: deploy an application and give it two cores and four Gb of RAM, and make sure there are always ten copies running
- 8. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Why use one? ● Improved resource utilisation
- 9. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Why use one? ● Improved resource utilisation ● Fault-tolerant
- 10. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Why use one? ● Improved resource utilisation ● Fault tolerant ● Homogenous
- 11. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Why use one? ● Improved resource utilisation ● Fault tolerant ● Homogenous ● Enables automation API
- 12. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Kubernetes Master Node Node Node Master
- 13. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Key features ● Pods and services abstraction ● Flat network ● Load balancing and service discovery ● Cloud integration ● Industry backing
- 14. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Pods ● One abstraction above containers ● We can group multiple containers together ● They share the same IP and volumes ● Like a pseudo virtual machine
- 15. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Replication Controllers ● Replicate pods ● Control loop ● Restart stopped pods
- 16. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Services ● Load balancer for pods ● Service discovery for pods ● Exposing pods outside the cluster
- 17. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Namespaces ● Logically group our resources in namespaces ● To separate different teams, environments, organisations, … ● Nice, but slightly awkward tooling
- 18. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Kubectl ● We usually interact with Kubernetes using kubectl ● A command line tool that consumes the REST API For example: kubectl get pods --namespace=dev
- 19. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ KubeFuse ● A file-system view of Kubernetes resources ● Read/write pods, replication controllers, services, secrets, volumes, etc.
- 20. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Why? ● Less typing (+ tab completion) ● Context in paths ● Enables standard Linux tools (ls, cat, less, vim, find, ….) ● Easy backups/exports ● Continuous Deployment???
- 21. https://github.com/opencredo/kubefuse/ Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Context in path KubeFuse cd ~/kubernetes/dev/pods ls cd my-pod cat describe Kubectl kubectl get pods --namespace=dev kubectl describe pod my-pod -- namespace=dev
- 22. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ The KubeFuse Model A KubeFuse path can be broken down like this: /namespace/resource_type/object_id/action Examples: /default/svc/nginx/json /default/volumes/data/describe /dev/pod/my-cheeky-app-buu43/logs
- 23. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Use case - Exploration For example: Listing pods, rcs, services, … ls ~/kubernetes/default/pods Listing all objects in the default namespace: find ~/kubernetes/default -type d -mindepth 2
- 24. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Use case - Troubleshooting For example: Get logs from a graphite pod: cat ~/kubernetes/default/pod/graphite-i3bb2/logs
- 25. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Use case - Quick tweaks For example: Update the number of DNS replicas: vim ~/kubernetes/kube-system/rc/kube-dns-v11/yaml
- 26. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Use case - Backup For example: Export all services as YAML: find ~/kubernetes/default/svc -name yaml | while read line ; do cat $line ; echo "----n" ; done
- 27. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Use case - Continuous Delivery-ish Coming soon! Copy from one KubeFuse mount to the next: cp ~/kubernetes-dev/default/pods/my-pod/json ~/kubernetes-stage/default/pods/my-pod/json
- 28. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Use case - Griefing Coming soon! Recursively delete everything in your cluster! rm -rf ~/kubernetes/default/
- 29. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ How does it work? ● KubeFuse is written in Python ● Relies heavily on FUSE and kubectl ● FUSE gives us a way to implement a file system in user space ● Kubectl gives us a the Kubernetes resources ● KubeFuse translates between the two
- 30. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ How does it work? Caching, dealing with concurrency, permissions, modification dates, ... More implementation details on our website: https://opencredo.com/introducing- kubefuse-file-system-kubernetes/
- 31. Bart Spaans @Work_of_Bart https://github.com/opencredo/kubefuse/ Testing Using Myna to simulate kubectl in tests with fast feedback. Heavily inspired by SpectoLabs’ Hoverfly, which simulates HTTP Donated to SpectoLabs https://github.com/SpectoLabs/myna https://github.com/SpectoLabs/hoverfly