Download as PDF, PPTX
![Ransack Inventory
"community": [
"123456-community.res.rackspace.com"
],
"corpvm": [
"123456-corpvm1.rackspace.com"
],
"db": [
"db1.prod.rackspace.com",
"db2.prod.rackspace.com"
]](https://image.slidesharecdn.com/ansiblefest-140520102945-phpapp02/75/Ransack-an-Application-Built-on-Ansible-s-API-for-Rackspace-AnsibleFest-NYC-2014-22-2048.jpg)
Uploaded byPaul Durivage
Ransack, an Application Built on Ansible's API for Rackspace -- AnsibleFest NYC 2014
Ransack is an application built on Ansible's API that was created by Rackspace to automate repetitive tasks on customer servers. It uses Ansible's inventory and dynamic inventory features to access servers via Rackspace's APIs. The Ransack CLI was developed to provide a custom interface for Rackspace users, with sane defaults and self-documenting arguments. Initial launch problems stemmed from complex installation processes, but images and Docker helped address this. Future plans include offering Ransack as a service and improving deployment frequency.
More Related Content
Similar to Ransack, an Application Built on Ansible's API for Rackspace -- AnsibleFest NYC 2014
![Vibe Coding vs. Spec-Driven Development [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/vibecodingvsspecdrivendevelopment-251209105622-43f455e7-thumbnail.jpg?width=640&height=640&fit=bounds)
Ransack, an Application Built on Ansible's API for Rackspace -- AnsibleFest NYC 2014
- 1. Ransack An Application Builton Ansible’s API
- 2. Paul Durivage • DevOpsEngineer at Rackspace • Ansible Contributor • Aspiring Pythonista • Army Veteran @angstwad angstwad
- 3. Rackspace • Dedicated Hosting •Cloud Hosting • *aaS Offerings • Fanatical Support
- 4. DevOps from Scratch •Shell Scripts • Fabric • Cook* *This is a pseudo name for prominent config management tool Our team of three was formed to figure out exactly how to be “DevOpsy”. The goal was to write applications that we thought added value to the business unit and for our customers, to consume all the latest and greatest products and to give our experience back to customers. Is this everyone’s story in the room? Eventually, we had many web applications and needed to figure out how to get them all deployed. We started with simple shell scripts and some Upstart jobs — it sucked. We used Fabric because it was familiar, and filled in all the gaps weren’t well-solved by mere shell. Along came “Cook”…
- 5. Cook* made mefeel stupid. *This is a pseudo name for prominent config management tool I took the two-day course and wasn’t able to accomplish anything by the time I was done. Cook made me feel stupid. I knew this was not the way forward.
- 6. Ansible THE SOLUTION TOALL OUR PROBLEMS. ! We could use this everywhere — automate everything.
- 7. The Problem (is notAnsible) Tickets come in. Customers ask us to manage their servers: add this user, add this package, configure this vhost, fetch this log file. Some of this is tedious, boring work. Rackspace has many Sys Ads — smart people. Accelerating their work pleases customers and saves money. How do we automate away tedious, repeatable, error-prone work?
- 8. Example: I want toadd a user to a number of machines…
- 9. Jim writes ashell script… SysAd Jim writes a shell script that adds a specific GID, adds a user, then updates the password. Using current tools, this script runs serially and takes about an hour to work on 100 machines.
- 10. Bob writes ashell script…. Bob writes a script that does something similar, but adds some SSH key functionality into his.
- 11. Billy wrote one,too… Add a user with a password with some sudo privs.
- 12. Oh, great, anotherscript… This user attempts to change the password of an existing user, and then does some weird grep stuff to find a username inside files on the root partition.
- 13. Now we have4 shell scripts which attempt (more or less) to do the same thing. All were written independently of one another, vary wildly in functionality, offer pretty poor validation, none incorporated testing… ! We need to write fewer shell scripts. So how do we do that?
- 14. Let’s Multiplex LET’S NOT Thetime it takes to set up all these sessions is wasted; every keystroke is essentially gone, unless we want to scrape shell history files, record sessions, or use some other magical, nonsensical tool. The work isn’t repeatable! This is not the answer!
- 15. We can dobetter. We have programming languages and APIs, secure connection protocols, and software. Why are we working so hard to manage systems?
- 16. We can dobetter. Ransack So we built Ransack.
- 17. Ransack • Uses internalRackspace APIs • Implements Ansible API • Creates a new CLI Ransack is custom Ansible. It’s the paring of custom inventory scripts, to gather information about our customers, with a CLI that is more appropriate for our workflow.
- 18. Ansible • Extensible • Inventory •API • Modules • Parallelization • Consistency • Idempotency • Community So let’s talk about why Ansible makes sense for this by talking about some of the features it provides. ! For time, we’re skipping over a lot of the reasons why we chose Ansible. :) !
- 19. Inventory • What IsIt? • Why Start With Inventory? • Two types • Static • Dynamic What is inventory? It’s “stuff” to be managed. Servers, VMs, containers. We started with inventory because it’s the first logical step to getting Ansible to do work on Rackspace machines. There are two types, static and dynamic, but we’re primarily concerned with getting data at runtime which is all about dynamic inventory.
- 20. Dynamic Inventory ! • Talkto APIs • Create Ansible-specific data • Serialize data • Caching • Logically group hosts Scripts, create data, talk to APIs, serialize to JSON, while logically grouping hosts
- 21. Ransack Inventory $ ACCOUNT=12345ransack-inventory-core --list $ ACCOUNT=cloud_acct ransack-inventory-cloud --list Running the scripts manually.
- 22. Ransack Inventory "community": [ "123456-community.res.rackspace.com" ], "corpvm":[ "123456-corpvm1.rackspace.com" ], "db": [ "db1.prod.rackspace.com", "db2.prod.rackspace.com" ]
- 23. Ransack Inventory ! $ ACCOUNT=8271ansible-playbook -i ransack-inventory-core site.yml Ansible commands and playbooks work! Having inventory scripts available means that anyone comfortable with Ansible can go ahead and run any playbook using Rackpsace inventory.
- 24. Ansible • Extensible • Inventory •API • Modules • Parallelization • Consistency • Idempotency • Community That’s inventory. Now it’s time to talk about the Ansible API. !
- 25. API Ansible’s first commit.API usage is equal citizen to CLI. REMOTE EXECUTION LIBRARY.
- 26. API • Classes • ansible.inventory.Inventory •ansible.runner.Runner • ansible.playbook.PlayBook • References for use We are deep in code. Ransack uses the Inventory, Runner, and Playbook classes. Basically we hook in at the core of the API, gather inventory from our dynamic inventory scripts, and then instantiate a Runner or Playbook to go out and do the work. The “ansible” command is the reference implementation of the API, though there are some docs to get you started. ! !
- 27. Ransack Sane Defaults forAnsible The CLI provides SANE DEFAULTS for Ansible in order to play nicely with our customer’s SSH configurations, our internal networks. Suppress warnings (like ControlPersist messages) Implement best practices (always SSH, no pipelining, longer timeout) Play nicely with our changes (modules, scripts)
- 28. Ransack CLI ! $ ransack-core--args ACCOUNT LIMIT MODULE --module-args $ ransack-cloud --args ACCOUNT LIMIT MODULE --module-args The API is used so we can provide a “custom” interface that provides reasonable arguments like account information, inventory/limit specs, modules and module args.
- 29. Ransack CLI Self-Documenting And wewanted our API to be self-documenting. Problematic because we had to carefully pick out a subset of modules to wrap argparse around, so that we could document like this. In the future we’ll probably parse module documentation dynamically to make every module (with limited exceptions) available.
- 30. Ransack CLI ! ransack-core --as-root8271 334141 user --name bob --password --update-password always Command example adding a user to account 8271 on device 334141. Notice the —as-root flag to keep SysAds from worrying about HOW to escalate privileges.
- 31.
- 32. Launch Day We launchedand immediately had problems — almost all of them related to the installation process. ! Installation was drastically impacting usage.
- 33. Installation We began installationfirst by offering various shell scripts that would set up a virtualenv, install Ransack. Later this was consolidated into the “super mega installer” to cover OS X, Gentoo, Ubuntu, EL 6, Fedora, Debian, and Arch. This method sucks, primarily because of pyrax dependencies (PBR) dependencies, issues with versions of pip and distribute.
- 34. Installation Virtual machines: wecreated two images, one a TinyCore Linux VM which is 92 MB, and Ubuntu 12.04, which is 620 MB. We control the environment and ship an appliance. Works really well.
- 35. Installation Next we createda Docker image that could be launched on a local machine without the need to install a heavy VM or Hypervisor. This is problematic, however, because Docker usage across our SysAd audience is still pretty low.
- 36. The Future ofRansack Ransack as a Service Dynamically pick up all modules Deploying more often (We use Drone for CI/CD today) API/middleware
- 37. I wanted totalk about… • Packer • Docker • SSH • ssh-agent • SSH “Bastions” • Drone • Testing • Issue Tracking • Data collection • Updates but I ran out of time.
- 38.