In this talk, we will use Rockset, a serverless search and analytics engine, to demonstrate how developers can easily plug in alternative data and build apps on those data sets. Specifically, we will work with the JSON data stream from Twitter’s Firehose streams API and NASDAQ’s Company Lookup directory exported in CSV format. Using Rockset, we will demonstrate how these two data sets can be loaded, and immediately queried and joined using SQL, without any upfront data preparation or complex data pipelines. Rockset is founded by former members of Facebook’s online data team, who helped create RocksDB, Facebook’s TAO, Unicorn, and HDFS.

1. Version 1.0
Build Applications Without Pipelines:
Shortest Path from Complex Data to
Live Applications
Anirudh Ramanathan
Product Engineering @ Rockset

2. Getting from Data to Apps Is Hard!
2
Web/Mobile
Email/Docs
Sensors
OLTP
Social Data Lake
Dashboards
Notebooks
Apps
Multiple data sources + different data formats require complicated data pipelines

3. But data pipelines are difficult to
3
1
3 Manage
● Schema changes
● New sources
● App iterations
2
4 Scale
● Data spikes
● Server & storage sizing
Set up
● Data preparation
● Schema modelling
Use
● Multiple data stores
● Different query languages

4. Rockset is a serverless search and analytics engine
that provides fast SQL directly on raw data for
operational apps and interactive data science
4

5. 5
Shortest Path from Data to Applications

6. 6
Start with raw data
Data of any structure—JSON, XML, CSV, Parquet, structured
From real-time streams, data lakes, databases, and data warehouses

7. 7
Ingest
No fixed schema needed
Continuous sync of new
data from data sources
Query Build
Use familiar SQL across
both structured and
semi-structured data
Serve fast queries at
scale to power your
apps

8. Demo
Building a Serverless Microservice
8

9. Disaggregated, Cloud-Native Architecture
9
Continuous
Ingest
Real-time
Indexing
Distributed
SQL Engine

10. Smart Schemas
● Fast strongly typed queries run against
indexes
● Each value has a type information
associated with it
● Unnest nested data while keeping
original structure in index
10

11. 11
Other Use Cases

12. 12
Get Started Free

13. Thank You
Anirudh Ramanathan anirudh@rockset.com
13