Lambda Architecture: Hot & Cold

1. Lambda architecture:
Hot & Cold
ivan.kosianenko@appsflyer.com

2. ● Life time value
● Reports: cohorts,
retention, daily activity
● Export raw data: instant
and scheduled
Real Time Dashboard

3. Data is mutable

4. Lambda Architecture

7. Kafka: raw data
● Lags
● 24h retention
● 15TB daily
● Clicks
● Impressions
● Installs
● In-app events
● and more ...

8. Pinterest Secor
● Reads data from kafka (raw
jsons)
● Writes to S3 (sequence file)
● Commits offsets

9. Apache Spark: Sulak

10. Mojito

11. Apache Zeppelin

12. Reports
● LTV
● Retention
● Cohorts

13. Memsql Rebuild
● Discrepancies
● Out of memory

14. Monitoring
● Grafana
● Kibana
● End-2-end tests

16. appsflyer.com/jobs

17. ivan.kosianenko@appsflyer.com