Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
카카오 전사 모니터링/로깅
/알람플랫폼 KEMI
issac at ccc
issac.lim@kakaocorp.com
Who am I?
Issac(임성국)
2007~2009: Mobile Health Care
2009~2010: Open API 서비스 플랫폼
2010~2014: KT Open API 플랫폼
2014 ~: Kakao Op...
KEMI?
(Kakao Event Metering & monItoring)
카카오의 모든 리소스(baremetal, private cloud, public cloud, container)에
서 발생하는 데이터를 수집하고...
왜 KEMI를?
구글 has StackDriver
Netflix has Genie and atlas
kakao?
왜 KEMI를?
for Production Service on
the openstack
KAKAO infra(CMDB)와도 자동 연
동된 모니터링/알람이 필수!
Ceilometer, monasca, cacti,
nagios, …
CMDB기반으로 자동화된 툴을 만들어보
자!
KEMI는?
수집
조회/알람
제어
-> Realtime/Batch
RealTime
Batch
Set by API & UI
Log는?
Realtime & Batch
Issue…
save & query large time series data(more than year)
- slow query & cluster hang
-> restructuring
origin hbase key:
[salt]<...
Elasticsearch Log Indexing:
no replica, more shards, ES on
Hadoop
kafka Msg Corruption:
invalid message exception
handling
Is it enough?
Automatic Resource Mgmt
Prediction
More features
& Open source…
Thanks
(@hardy, @jenny, @joanne,
@andrew & @@ccc)
카카오 전사 모니터링/로깅/알람플랫폼 KEMI
Upcoming SlideShare
Loading in …5
×

카카오 전사 모니터링/로깅/알람플랫폼 KEMI

2,965 views

Published on

KEMI Overview at openstack korea community

Published in: Software
  • Login to see the comments

카카오 전사 모니터링/로깅/알람플랫폼 KEMI

  1. 1. 카카오 전사 모니터링/로깅 /알람플랫폼 KEMI issac at ccc issac.lim@kakaocorp.com
  2. 2. Who am I? Issac(임성국) 2007~2009: Mobile Health Care 2009~2010: Open API 서비스 플랫폼 2010~2014: KT Open API 플랫폼 2014 ~: Kakao Openstack, CMDB, Logging, Monitoring, …
  3. 3. KEMI? (Kakao Event Metering & monItoring) 카카오의 모든 리소스(baremetal, private cloud, public cloud, container)에 서 발생하는 데이터를 수집하고, 필요한 이벤트를 만들어 필요한 곳으로 전달하자!
  4. 4. 왜 KEMI를? 구글 has StackDriver Netflix has Genie and atlas kakao?
  5. 5. 왜 KEMI를? for Production Service on the openstack KAKAO infra(CMDB)와도 자동 연 동된 모니터링/알람이 필수!
  6. 6. Ceilometer, monasca, cacti, nagios, … CMDB기반으로 자동화된 툴을 만들어보 자!
  7. 7. KEMI는?
  8. 8. 수집 조회/알람 제어 -> Realtime/Batch
  9. 9. RealTime
  10. 10. Batch
  11. 11. Set by API & UI
  12. 12. Log는?
  13. 13. Realtime & Batch
  14. 14. Issue…
  15. 15. save & query large time series data(more than year) - slow query & cluster hang -> restructuring origin hbase key: [salt]<metric_uid><timestamp><tagk1><tagv1>[… <tagkN><tagvN>] -> [salt]<resource_id><timestamp><metric_uid><met ric value1>[…<tagkN><tagvN>]
  16. 16. Elasticsearch Log Indexing: no replica, more shards, ES on Hadoop kafka Msg Corruption: invalid message exception handling
  17. 17. Is it enough?
  18. 18. Automatic Resource Mgmt Prediction More features & Open source…
  19. 19. Thanks (@hardy, @jenny, @joanne, @andrew & @@ccc)

×