The vast amount of big data that today’s companies generate makes it difficult to separate the signal from the noise. Organizations need to derive meaningful insights into operations and business to take action. TrueCar needed a better way to manage, search, and analyze their hybrid environment. In this webinar, you’ll learn how TrueCar centralized all of their data in one place using Amazon Kinesis and Splunk Cloud, gaining deep visibility, scalability, and the ability to monitor and troubleshoot operational issues – all while migrating to AWS.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
October 18, 2017 | 9:00 AM PT
How TrueCar Gains Actionable
Insights with Splunk Cloud
© 2017, Amazon Web Services, Inc. or its affiliates. All rights reserved.

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Today’s Presenters
Ray Zhu, Sr. Product Manager, Amazon Kinesis
Kara Gillis, Sr. Product Marketing Manager – Partners, IT Marketing,
Splunk
David Giffin, SVP, Technology Platform, TrueCar

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Today’s Agenda
• An overview of Amazon Web Services (AWS) big data services
• An overview of AWS streaming data service, Amazon Kinesis
• Overview of Splunk on AWS
• TrueCar success story with Amazon Kinesis and Splunk
• Q&A/Discussion

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Put your data to work with big
data services from AWS and
Splunk
Build highly scalable and secure big data applications fast.
No hardware to procure, no infrastructure to maintain.

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why AWS for Big Data?
Immediately
Available
Broad and Deep
Capabilities
Trusted and
Secure
Scalable

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Collect, Store, Analyze, and Visualize
It’s easy to get data to AWS, store it securely, and analyze it with the engine of your choice,
without any long-term commitment or vendor lock-in.
Collect
Import/Export
Snowball
Direct Connect
VM Import/Export
Store
Amazon S3
Amazon EMR
Amazon Glacier
Amazon Redshift
DynamoDB
Analyze
Amazon Kinesis
Lambda
Amazon EMR
EC2

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming Data – Most Data is Produced
Continuously
Mobile Apps Web Clickstream Application Logs
Metering
Records
IoT Sensors Smart Buildings
[Wed Oct 11 14:32:52
2000] [error] [client
127.0.0.1] client
denied by server
configuration:
/export/home/live/ap/h
tdocs/test

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Diminishing Value of Data
Value
Time

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Processing Real-Time, Streaming Data
• Durable
• Continuous
• Fast
• Correct
• Reactive
• Reliable
What are the key requirements?
Ingest Transform Analyze React Persist

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis – Makes it Easy to Work with
Real-Time Streaming Data
Kinesis
Firehose
Load streaming
data into Amazon
S3, Amazon
Redshift, and
Amazon
Elasticsearch
Service
Kinesis
Analytics
Analyze data
streams using
standard SQL
queries
Kinesis Streams
Stores data as a
continuous replay-
able stream for
custom applications

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Streams
• Reliably ingest and durably store streaming data at low cost
• Build custom real-time applications to process streaming data

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Firehose
• Reliably ingest, transform, and deliver batched, compressed, and
encrypted data to S3, Amazon Redshift, and Amazon Elasticsearch
Service
• Point and click setup with zero administration and seamless elasticity
Beta

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Analytics
• Interact with streaming data in real-time using SQL
• Build fully managed and elastic stream processing applications that
process data for real-time visualizations and alarms

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Customers

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Splunk for Big Data
Delivering New Visibility and Analytics Tools

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Escalating IT Complexity…
SaaS/PaaS
IaaS
VIRTUALIZATION
STORAGE
PACKAGED
APPLICATIONS
CUSTOM
APPLICATIONS
HR
Email
Finance
App Svr
DB
Web Svr
INFRASTRUCTURE
APPLICATIONS
VPN
IP Phone
Identify
SERVERS NETWORKING

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
… Plaguing IT Operations
SaaS/PaaS
IaaS
VIRTUALIZATION
STORAGE
PACKAGED
APPLICATIONS
CUSTOM
APPLICATIONS
HR
Email
Finance
App Svr
DB
Web Svr
INFRASTRUCTURE
APPLICATIONS
VPN
IP Phone
Identify
SERVERS NETWORKING
Complex, silo-based technologies
Disconnected and outdated point solutions
Over 80% of time on maintaining, not innovating
Reactive brute-force problem resolution

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Platform for Machine Data
Enterprise
Scalability
Operational Intelligence
Search and
Investigation
Proactive
Monitoring
Operational
Visibility
Real-Time
Business
Insights
Index Untapped Data: Any Source, Type, Volume
On-Premises
Cloud
Storage
Online
Shopping Cart
Telecoms
Desktops
Security
Web
Services
Networks
Containers
Web
Clickstreams
RFID
Smartphones
and Devices
Servers
Messaging
GPS
Location
Packaged
Applications
Custom
Applications
Online
Services
DatabasesCall Detail
Records
Energy Meters
Firewall
Intrusion
Prevention

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Splunk Differentiators
Capture, retain, correlate, and analyze data
Reduced MTTR
From proactive monitoring to correlation and operational analytics Improved user
experience
Index data once for multiple uses: capacity planning, help desk support, security,
troubleshooting, audit, SLA reporting, change tracking
Reduced costs
Scale to handle the largest, most complex datacenters
Greater productivity
Fast Time-to-Value
Scales From Desktop to Enterprise
Real-Time Architecture

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Index and Analyze Data Across Your Technology
Stack
App Performance
Monitoring
API
SDKs UI
Server, Storage,
Network
Virtualization,
Containers
Operating Systems
and Databases
Custom
Applications
Business
Applications
Cloud Services
Operations and
Service Desks
Mobile Applications
Web Intelligence
No rigid schemas – add in data from any other source.
Stream
DB Connect
Splunk Add-Ons, Templates, and Apps Accelerate Value From Machine Data

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
▶ Fastest time to value
▶ Eliminates infrastructure requirements
▶ Maximizes value from limited resources
The benefits of Splunk Enterprise as a service

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Splunk App and Add-On for AWS
Operational, security and economic insights across your AWS environment
Splunk Add-on for AWS
Explore AnalyzeDashboard Alert
Splunk App for AWS
EC2
Amazon EMR
Kinesis
Route 53
Amazon VPC
ELB
Amazon S3
CloudFront
CloudTrail
CloudWatch
Amazon Redshift
SNS
API Gateway
AWS Config
RDS
Amazon
CloudFormation
IAM
Lambda

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
End-to-End Visibility with AWS and Splunk
Billing Reports
Amazon
S3 Access Logs
AWS
CloudTrail Logs
ELB Access Logs Amazon
CloudFront Access Logs
Application Logs
AWS Config Snapshots
& History Files
Other Service Logs
Amazon
SQS
AWS
Lambda
Amazon
RDS
Amazon
Redshift
AWS
CloudTrail
Amazon
SNS
Amazon
S3
Amazon
CloudWatch
Metrics
Amazon
CloudWatch
Events
Amazon
CloudWatch
Logs
AWS
Config
Amazon ElastiCache
Cluster Events
AWS
CloudFormation
Stack Events
Amazon
CloudWatch
Alarms
ELB Metrics
Amazon CloudFront
Metrics
Amazon
EC2 Metrics
Amazon
EBS Metrics
Amazon
ECS Metrics
Amazon
DynamoDB
Metrics
Amazon
EMR Metrics
Amazon
Kinesis
Metrics
AWS Lambda Metrics
Amazon
API Gateway
Metrics
Amazon
S3 Metrics
Amazon
Route 53 Metrics
Amazon
SNS Metrics
Amazon
RDS
Metrics
AWS
Add-on
DB
Connect
Amazon
VPC Flow Logs
AWS
Lambda Logs
Amazon
API Gateway Logs
AWS IoT
API Gateway
Custom Events
DynamoDB
Table Updates
Amazon
S3 Events
Amazon Cognito Events
Custom
Config Rules
AWS CodeCommit
Repo Events
Amazon
EC2 System
Manager Events
Amazon
ECS Container & Task
State Changes
Amazon
EBS Volume & Snapshot
Notifications
Amazon
EMR Cluster & Instance
State Changes
Auto Scaling Group
State Changes
AWS
CodeDeploy
Instance & Deployment
State Changes
AWS Management
Console
Sign-In Events
AWS Health &
Trusted Advisor Events
AWS
KMS Events
HTTP Event
Collector
Amazon Kinesis
Firehose
Amazon
Kiinesis
Stream
Amazon
Macie Alerts

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
TrueCar
The automotive marketplace providing ultimate price transparency

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Challenge
While migrating its technology infrastructure to the cloud, TrueCar
required a log management and infrastructure monitoring solution that
could scale and support cross-functional searching and reporting to
manage and troubleshoot its complex environment.

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Logging at TrueCar
Applications log to STDOUT / STDERR and are processed by docker
All logs are consolidated into streams and shipped to a log store
All logs are formatted as JSON

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Previous Solution
• Only 21 days of log retention with ELK
• ELK often became unresponsive, requiring restart
• In-house team to manage the cluster
• No third–party integrations with applications like New Relic

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
New
Apps in
AWS
Legacy
Data-
centre Kafka
App
Logs
(Log-
Stash)
Kinesis
S3 Log
Buckets
Kinesis
Firehose
Cloudwatch
Alarms
Cloudtrail
EVents
S3
Storage
Splunk

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Implementing Splunk Cloud
Integrated with Okta allowing employees access to Splunk Cloud
Used heavy forwarder to read via Lambda from Amazon Kinesis
Streams
Forwarded logs to Splunk Cloud
Leveraged the Universal Forwarder for additional data center logs

30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Success Story with Splunk
Since deploying Splunk Cloud TrueCar has seen benefits including:
• Deployed Splunk Cloud in one day
• Historical insights with additional data retention
• Better visibility into AWS billing
• Security insights and threat detection
• Accelerated software development

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Next steps and further information
• Sign up for Kinesis Firehose to Splunk Beta:
• https://www.amazon.com/firehosesplunk
• Launch Splunk on AWS Marketplace:
• https://aws.amazon.com/marketplace/pp/B018SV687Q
• Learn more about Amazon Kinesis:
• https://aws.amazon.com/kinesis/
• Learn more about Splunk on AWS:
• https://aws.amazon.com/marketplace/seller-profile?id=6a766d61-5a6a-4c97-83f4-
8bfe02b74914

37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Q & A

38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!