Real Time Serverless Data Pipelines on AWS discusses how to build data pipelines on AWS using serverless technologies. It presents solutions for recording, processing, structuring and storing events seamlessly using services like Lambda, Kinesis, DynamoDB, S3 and Redshift. The talk emphasizes experimenting continuously and confidently with serverless technologies to build scalable, componentized solutions for predictive apps and tailored data strategies.

1. Real Time Serverless Data Pipelines on AWS
record , process, structure and store events seamlessly
Farzad Senart - CTO, co-founder at Alsanium
TIAD CAMP - April 27th 2017 - Paris, FR

2. Alsanium
Cloud engineering Data engineering
Amazon Web Services
Company

3. Holistic data strategies require tailored solutions.
Scaling tailored solutions implies componentization.
Problem

4. Solution
Predictive Apps
Amazon Web Services
Data Pipelines
Data Apps
Datasinks

5. Statistics
900 M 6 200 H 280 M 1 TB

6. Statistics
900 M 6 200 H 280 M 1 TB
$ 5 000

7. Technology
IAM KMS CloudWatchCloudFormation
CodeBuild GitHub CodePipeline
Organizations
APIGateway Lambda SNS Kinesis
DynamoDB S3 Redshift

8. Credo
Experiment confidently.
Experiment fearlessly.
Experiment continuously.

9. CI/CD
Deliverer DeployerDeveloper

10. History
Monolithic Microservices

11. Service Oriented Data Pipeline

12. Service Oriented Data Pipeline

13. Service Oriented Data Pipeline

14. Service Oriented Data Pipeline

15. Dynamic Redshift

16. Open Source

17. Open Source

18. Conclusion
What is serverless?

19. It’s definitely not about servers!
Conclusion

20. It may be about composing primitives to create components
and aggregating them to create solutions, at scale.
Conclusion