Download as PDF, PPTX
Uploaded bymosa siru
Go, memcached, microservices
The document discusses the complexities of caching in microservices, specifically focusing on cache invalidation challenges and techniques such as TTL (time-to-live) and handling thundering herd problems. It also reviews various caching solutions, including memcached and redis, and compares different Go clients for these caching systems. The author shares insights from experience, highlighting issues and potential improvements within existing libraries.
![[261] 실시간 추천엔진 머신한대에 구겨넣기](https://cdn.slidesharecdn.com/ss_thumbnails/216-150915054828-lva1-app6891-thumbnail.jpg?width=640&height=640&fit=bounds)
Go, memcached, microservices
- 1.
- 2.
- 3. @mosa_siru as engineer •DeNA • Gunosy • CTO
- 4. 1. 2. cache 3. cache 4.microservices
- 5.
- 6. • Cache Invalidation •There are only two hard things in Computer Science: cache invalidation and naming things. -- Phil Karlton • • TTL • • thundering herd
- 7.
- 8.
- 9.
- 10. Cache Invalidation • DB memcached •( API memcached ) TTL
- 11.
- 12.
- 13.
- 14.
- 15. • 2016/06 KDDI • •
- 16.
- 17.
- 18.
- 19.
- 20. (2) 1. local memd 2. remote 4.local set 3.
- 21. (3) 1. local memd 2. remote 6.local set 4. 3. DB 5. remote set
- 22. • TTL (5s-60s) TTL (60s-1h) invalidation updatedelete
- 23. • local memd •DB thundering herd • local memd TTL invalidation local memd
- 24.
- 26. • memcached • redis •go process cache • go groupcache • File DB
- 27.
- 28. Go process cache • • •local, remote • remote
- 29. Go groupcache • googlememd local/remote • • expire …
- 30. File DB • File DB(LevelDB) • • •
- 31. memcached • • • AWS Elasticache •JSON msgpack
- 32.
- 33. go memcached client • 1.bradfitz/gomemcache 2. douban/golibmc
- 34. 1. gomemcache Pros •(600star) • go
- 35. 1. gomemcache Cons •1 issue, PR • memcached • SetMulti, DeleteMulti
- 36. 1. gomemcache Cons •TCP 2 (2 ) • 2 configurable PR • memcached •
- 37. 2. golibmc Pros •C • SetMulti • ”noreply" (TCP 1 ) • issue PR 2
- 38. 2. golibmc Cons •Python libmc (320start) golibmc • C
- 39. 2. golibmc Cons •goroutine 1Client 1 • • Client gomemcache
- 40. • golibmc • • issuePR 2 • SetMulti • •
- 41.
- 42. 1. local memd 2. remote 6.local set 4. 3. DB 5. remote set
- 43. 1 get multi get multi select… where id in … set multi set multi ID( ) get, set 1
- 44. • https://github.com/mosasiru/memd • • GetOrSet •GetOrSetMulti
- 45.
- 46.
- 47. mosasiru/memd • ver0.1 …patch is welcome!!!!
- 48.
- 50. microservices • • API • DB •AWS security group/IAM •
- 51.
- 52.
- 53. invalidation • (DB) writeread • cache invalidation write read
- 54. invalidation • cache read/write1 • cache key 1 • consistent hash 1 write DELETE /hoge/cache delete Worker API …
- 55. CDN • CDN • URLinvalidation https://...?t=1474969378
- 57.
- 58.