Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Data @ Streak
How we use the Google Cloud Platform

Aleem Mawani, aleem@streak.com, @aloo
What is Streak?
What do we use Google Cloud Platform for?

1. Serve our app and run business logic
AppEngine + Prediction API + Search API...
Streak on Google Cloud

App Engine

...

app
data

Datastore +
Memcache
Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

...

app
data

Datastore +
Memcache
Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

...

app
data

Datastore +
Memcache

ap...
Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

...

app
data

Datastore +
Memcache

ap...
Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

Cloud
Storage

ata

pd

Translation API...
Streak on Google Cloud

t

ta
lo

g

ta

da

da

App Engine

dat
a

ata
nt d

en

log

event d
ata

eve

ev

Logstore

Big...
BigQuery Demo
Thanks!

Like big data? Streak.com is hiring!
jobs@streak.com
Summary

Benefits
● Move fast and build lean!
● Google quality infrastructure for everyone
● Ask critical business questio...
Streak + Google Cloud Platform
Streak + Google Cloud Platform
Upcoming SlideShare
Loading in …5
×

Streak + Google Cloud Platform

702 views

Published on

How to use the Google Cloud Platform - as used at Streak

Published in: Technology, Business
  • Be the first to comment

Streak + Google Cloud Platform

  1. 1. Data @ Streak How we use the Google Cloud Platform Aleem Mawani, aleem@streak.com, @aloo
  2. 2. What is Streak?
  3. 3. What do we use Google Cloud Platform for? 1. Serve our app and run business logic AppEngine + Prediction API + Search API 2. Store and Analyze user data AppEngine Datastore + Memcache + Cloud Storage + BigQuery 3. Record and analyze every UI action BigQuery (Streaming + Bigquery Extension) 4. Record and analyze all server logs BigQuery (Streaming + Bigquery Extension) 5. Record and analyze all client logs BigQuery (Streaming + Bigquery Extension)
  4. 4. Streak on Google Cloud App Engine ... app data Datastore + Memcache
  5. 5. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery ... app data Datastore + Memcache
  6. 6. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery ... app data Datastore + Memcache app data Cloud Storage Prediction API
  7. 7. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery ... app data Datastore + Memcache app data Cloud Storage ata pd ap App Engine Search API Prediction API
  8. 8. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery Cloud Storage ata pd Translation API & Human Translators app data ap n Datastore + Memcache i18 ... app data App Engine Search API Prediction API
  9. 9. Streak on Google Cloud t ta lo g ta da da App Engine dat a ata nt d en log event d ata eve ev Logstore BigQuery Cloud Storage ata pd Translation API & Human Translators app data ap n Datastore + Memcache i18 ... app data App Engine Search API Prediction API
  10. 10. BigQuery Demo
  11. 11. Thanks! Like big data? Streak.com is hiring! jobs@streak.com
  12. 12. Summary Benefits ● Move fast and build lean! ● Google quality infrastructure for everyone ● Ask critical business questions Tradeoffs ● Need to move data incrementally ● Need to make your pipelines fault tolerant at scale Tips ● Mirror your data in multiple systems, storage is cheap! ● Build systems incrementally

×