The document discusses streaming data opportunities and challenges, and outlines Expedia's streaming data ecosystem. It describes how Expedia uses a Kafka streaming data ecosystem to enable decoupled systems and roadmaps, and make it easy for teams to publish and consume streaming data. Key components of Expedia's ecosystem include a centralized data depot, self-service tools, elastic components, and monitoring of velocity and lag. The ecosystem provides producers with an HTTP ingestor to publish to Kafka and S3, and consumers can create apps using built-in Kafka integration. Example use cases of streaming analytics on this ecosystem are also mentioned.

1. Streaming Data
Ecosystems
Brandon O’Brien
@hakczar
Expedia, Inc

2. Outline
 Streaming Data Opportunities & Challenges
 Streaming Data Ecosystem at Expedia
 Use Cases
 Questions?

3. Outline
 Streaming Data Opportunities & Challenges
 Streaming Data Ecosystem at Expedia
 Use Cases
 Questions?

4. Streaming Data: Opportunities
 Data -> Insights -> Data Products -> $$$
 Fresher data = better
 However…

5. Streaming Data: Challenges
 Today’s Challenge: System integration
 N^2 integrations
 Team roadmaps need to align

6. Streaming Data: Solutions
 Solution:
 Kafka with Streaming Data Ecosystem
 Decoupled systems & roadmaps
 Easy publish
 Easy consume
 Central data depot
 Talk Focus:
 Streaming Data Ecosystem that makes life easier for
Kafka producers and consumers

7. Outline
 Streaming Data Opportunities & Challenges
 Streaming Data Ecosystem at Expedia
 Use Cases
 Questions?

8. Ecosystem Architecture

9. Streaming Data Ecosystem
 Self-Service
 Centralized Data Depot (logical)
 Primer, CICD, Cloud
 Elastic Components
 Monitoring: Velocity, Lag

10. Streaming Data Ecosystem cont’d
 Producers
 Publish data to HTTP Ingestor endpoint
 Ingestor -> Kafka
 Ingestor -> S3
 Consumers
 Create skeleton apps with built-in Kafka integration
 CICD pipeline for deployments

11. Outline
 Streaming Data Opportunities & Challenges
 Streaming Data Ecosystem at Expedia
 Use Cases
 Questions?

12. Use Case: Streaming Analytics

13. Streaming Data
Ecosystems
Brandon O’Brien
@hakczar
Expedia, Inc
Questions?