Download to read offline
Uploaded byKirsten Hunter
Git store
The document discusses using Git as a database to address slow API access issues, noting that while traditional databases have infrastructure and maintenance challenges, Git is lightweight and designed for text files. It outlines the structure of the system, including how properties and versions are managed, and presents various Git commands and tools for effective data manipulation. The process allows quick retrieval of new versions while maintaining historical data, providing an efficient solution for API read operations.
More Related Content
![Vibe Coding vs. Spec-Driven Development [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/vibecodingvsspecdrivendevelopment-251209105622-43f455e7-thumbnail.jpg?width=640&height=640&fit=bounds)
Git store
- 1. Using Git asa Database Solving slow API access and other problems Kirsten Hunter @synedra http://www.princesspolymath.com store
- 2. Kirsten Hunter @synedra http://www.princesspolymath.com Introduction Kirsten Hunter KirstenHunter @synedra http://www.princesspolymath.com
- 3. Kirsten Hunter @synedra http://www.princesspolymath.com What’s thetrouble? API Evangelist for Akamai Powerful, write-based API for configuration Very slow for reads Amazing available data
- 4. Kirsten Hunter @synedra http://www.princesspolymath.com Crawling theData • Account Groups (Akamai DevRel) -> 1 call • Group Properties (Kirsten Hunter) -> 1 call / group (tens/hundreds)
- 5. Kirsten Hunter @synedra http://www.princesspolymath.com Still Crawling •Properties (www.princesspolymath.com) -> 1 call / property (tens/hundreds/thousands) • Versions (1) -> 3 calls/version (tens/hundreds/thousands)
- 6. Kirsten Hunter @synedra http://www.princesspolymath.com API Goals •Writing configuration changes • Creating new properties/versions • Updating metadata • Internal data IDs, not user friendly names
- 7. Kirsten Hunter @synedra http://www.princesspolymath.com API ReadBehavior • Very, very restful • No way to expand data • Several seconds/call
- 8. Kirsten Hunter @synedra http://www.princesspolymath.com What doCustomers Want? • Diff between properties and versions • Properties with particular billing codes • Properties with particular behaviors • Changes since date
- 9. Kirsten Hunter @synedra http://www.princesspolymath.com Why Nota Database? • Need to have infrastructure • Not designed for diff • Complicated to query on multiple things ad hoc • Maintenance becomes an issue
- 10.
- 11. Kirsten Hunter @synedra http://www.princesspolymath.com Why Git? •Lightweight system ideal for storing text • Portable data store • Designed with tools for manipulating text files
- 12. Kirsten Hunter @synedra http://www.princesspolymath.com Structure • Propertyname -> Branch • Version -> Commit • Rules file • Hostnames file • Metadata file
- 13. Kirsten Hunter @synedra http://www.princesspolymath.com Tags • Propertyversions • princesspolymath.com@2 • Easy to interface • Also LATEST, STAGING, PRODUCTION
- 14. Kirsten Hunter @synedra http://www.princesspolymath.com Useful GitCommands • git diff princesspolymath.com@2 princesspolymath.com@LATEST • git branch -a | tr -d * | xargs git grep '"<cpcode>' • git diff $(git rev-list -n1 --after=06-01-2015 princesspolymath.com)
- 15. Kirsten Hunter @synedra http://www.princesspolymath.com Git Tools •gitk - graphical diff and interface • git desktop applications • gitweb
- 16. Kirsten Hunter @synedra http://www.princesspolymath.com Process • Runonce to grab all the versions -> Can be very long • Run again to grab new versions -> Quite quick • Can schedule to run every 5 minutes
- 17.
- 18. Kirsten Hunter @synedra http://www.princesspolymath.com Family Tree •master -> you • branch -> surname • commit -> individual • sub-branch -> surname…
- 19. Kirsten Hunter @synedra http://www.princesspolymath.com Gollum • git-backedwiki • Runs git pages • Simple to use and setup • Again, text files… git is designed for them
- 20. Kirsten Hunter @synedra http://www.princesspolymath.com Questions? Thoughts? Ideas?http://www.princesspolymath.com KirstenHunter @synedra http://www.princesspolymath.com