The document discusses Treasure Data's mobile SDK. It allows mobile apps to easily collect and upload user event data to Treasure Data's backend without requiring their own server. The SDK buffers events locally then uploads them through HTTPS, retrying if needed. This ensures events are collected reliably and with strong guarantees of being processed. The document outlines the SDKs for iOS, Android, and Unity and describes Treasure Data's backend systems for processing uploaded events at scale from mobile apps.

1. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
Treasure Data Mobile SDK
Mitsunori Komatsu, Treasure Data
March 12, 2015

2. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
Who am I?
•Software
Engineer
at
Treasure
Data
(Backend
-­‐>
MPP
team)
•Presto,
PlazmaDB,
Mobile
SDK,
Embedded
SDK,
Hadoop,
Hive,
Pig,
Impala
•Formerly:
•Ex
LINE
Android
development
leader
at
NAVER
Japan
(LINE)
•github:komamitsu,
twitter:@komamitsu_tw
•MessagePack
Java
(Mainly
jackson-­‐dataformat-­‐msgpack)

3. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
Outline
•What's
Treasure
Data
mobile
SDK?
•iOS/Android/Unity
SDK
•SDK
Backend

4. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
Treasure
Data
What's TD mobile SDK?
Android/iOS
User
Application
Mobile
SDK
Add
event
Local
Storage
(File
/
SQLite)
Buffering
Add
event
Add
event
Upload
events
OKDelete
events
(With
encryption) HTTPS
Retrying…
No
need
to
have
your
own
server!
Almost
exactly
once
Device
UUID,
SessionID,
OS/Device
info

5. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
iOS/Android SDK
•Nothing
to
do
talk
about
iOS/Android
SDK
(straightforward
implementation)
•Buffer
events
to
local
storage
with
encryption
•Retry
uploading
if
it
fails
•Device
ID,
Session
ID,
OS/Device
information

6. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
Unity SDK
•Native
plugin
•Includes
iOS/Android
SDKs
and
calls
them
using
DllImport/JNI
•Really
annoying
to
develop
and
test
Unity
SDK
(We
should've
developed
it
in
pure
C#...)

7. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
ELB
SDK Backend
SDK
Backend
server
JS
SDK
Android/
iOS
SDK
SaaS
Fluentd
Input
plugin
• Validation
• De-­‐duplication
• File
buffering
Output
plugin
• Backup
files
to
S3
• Import
files
to
TD
API
File
chunks
Redis
De-­‐duplication
TD
API
server
Import
AWS
S3
File
backup

8. Copyright
©2014
Treasure
Data.
All
Rights
Reserved.
TODO
•Improve
the
performance
of
backend
•Use
reverse
proxy
on
each
server
to
use
CPUs
•Should
replace
Ruby?
•Add
new
features
to
SDK
•Collect
and
store
crash
reports
•Collect
records
from
other
SaaS
•Please
join
us
as
a
Integration
Engineer!