Presentation from OpenStack Trove Day 2014 by Keith Newstadt, Technical Director, Symantec Corporation

1. August 19, 2014
MagnetoDB
Scaling Your Data Horizontally on OpenStack
Keith Newstadt
Technical Director, Symantec Corporation
@knewstadt

2. Management Platform
Norton Family
Identity Notifications Storage Data Sync Events
Infrastructure
8/19/14 tesora.com 2

3. Symantec Cloud Platform Engineering
Platform Services
Storage Databases Big Data Monitoring Deployment
Infrastructure as a Service
Servers Networks Disks Images Ops Identity
Infrastructure
8/19/14 tesora.com 3

4. What Kinds of Databases Do We Need?
Relational
Scales well horizontally
Learning curve
Can be difficult to operate
NoSQL
Good for relational data
In teams’ comfort zone
Can be difficult to operate
8/19/14 tesora.com 4

5. What Kinds of Models Do We Need?
Customer
Operated As a
Platform provides
the database itself
Service
Platform provides
operational services
8/19/14 tesora.com 5

6. MagnetoDB – NoSQL + as a Service
• Open source, OpenStack standards
• Large data sets
• Throughput, availability, latency
• Secure multi-tenant
• Integrated with Keystone
Load
Index
Query Scan
Create Tables
Configurable
Consistency
Data Types
(maps, sets,
etc.)
Conditional
Operations
MagnetoDB
8/19/14 tesora.com 6

7. MagnetoDB – A Simple Architecture
API Proxy Layer
MagnetoDB Driver Layer
Database Layer
• Simple ReST (ish) Web service API
• Modeled after DynamoDB, plus…
• Supports different backend databases
• We’re using Cassandra
• HBase also in the works
8/19/14 tesora.com 7

8. Some Symantec Use Cases
MagnetoDB
User Profile Data
Searchable Swift Object
Metadata
Real-time Metrics
Import from Big Data
Processes
8/19/14 tesora.com 8

9. Demo
Using MagnetoDB
8/19/14

10. Demo – Top 100 Music Charts
http://bullfrogspond.com/
Songs
Key Schema Secondary Index
Artist Artist
Track High
Charts
Key Schema
Year
Week-Position
MagnetoDB
• Tables
• Queries
8/19/14 tesora.com 10

11. Local VM
Environment
MagnetoDB
https://wiki.openstack.org/wiki/MagnetoDB/QA/Tests_on_env_with_devstack
8/19/14 tesora.com 11

12. Q&A
Keith Newstadt
@knewstadt
keith_newstadt@symantec.com
8/19/14