Introducing TokuMX
Fractal Tree Indexing with
MongoDB
Zardosht Kasheff
@zkasheff
@tokutek
What is TokuMX?
• TokuMX = MongoDB with improved storage
• Drop in replacement for MongoDB v2.2 applications
(including sh...
TokuMX Benefits
• Improved write performance on large data
o Much faster on data > RAM
o Significantly reduced I/O
o Don't...
TokuMX comes from TokuDB
TokuMX v. 1.0:
• Performance
• Compression
• No fragmentation (no
compact)
• Transactions
TokuDB ...
TokuMX: How?
Built a storage core from the ground up, with Fractal Tree indexes, a
data structure designed with large data...
TokuDB Customer case
• One of the leading partners of the software,
movie and music industry.
• Traces copyright infringem...
TokuDB Customer case
Translation:
• Needed indexes on data > RAM to query the data in a
variety of ways
• Needed compressi...
TokuDB Customer case
Results:
• Dramatic I/O reduction
• over 3X compression
• downtime periods previously spent running
"...
TokuDB: compression
Levels of compression depend on how naturally
compressible your data is.
9x compression
7x compression
TokuMX
tokutek.com/products/downloads
• tokumx-user@googlegroups.com
• tokumx-dev@googlegroups.com
For evaluations or ente...
Upcoming SlideShare
Loading in …5
×

Introducing TokuMX - MongoDB with Fractal Tree Indexing

2,147 views

Published on

Lighting Talk on TokuMX from MongoDB New York User Group 7/16/2013.

TokuMX integrates fractal tree indexes into MongoDB. Fractal tree indexes are the technology behind the TokuDB storage engine for MySQL. The big benefits:
- reduced I/O utilization on writes for large data
- compression
- faster and more indexing
- no fragmentation (no compact)

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,147
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
25
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Introducing TokuMX - MongoDB with Fractal Tree Indexing

  1. 1. Introducing TokuMX Fractal Tree Indexing with MongoDB Zardosht Kasheff @zkasheff @tokutek
  2. 2. What is TokuMX? • TokuMX = MongoDB with improved storage • Drop in replacement for MongoDB v2.2 applications (including sharding and replication) o Same data model o Same query language o Drivers just work • Open source
  3. 3. TokuMX Benefits • Improved write performance on large data o Much faster on data > RAM o Significantly reduced I/O o Don't need to keep working set in RAM o Maintaining indexes uses less resources • Compression! (up to 10x) • No fragmentation (Deprecated compact!) • Transactions (MVCC + multi-statement) Bottom line: TokuMX makes MongoDB applications stable and fast for large databases.
  4. 4. TokuMX comes from TokuDB TokuMX v. 1.0: • Performance • Compression • No fragmentation (no compact) • Transactions TokuDB v. 7.0: • Performance • Compression • No fragmentation (no optimize table) • Agility (online schema changes) TokuMX uses the same core storage code as TokuDB for MySQL. This base provides the general improvements.
  5. 5. TokuMX: How? Built a storage core from the ground up, with Fractal Tree indexes, a data structure designed with large data in mind. Key attributes: • Buffers usedto batch up writes, so write I/O is drastically reduced • large blocks of data, so compressionis great • large blocks prevent fragmentation
  6. 6. TokuDB Customer case • One of the leading partners of the software, movie and music industry. • Traces copyright infringements and illegal file sharing in P2P networks. • logs IP addresses while also performing a connect to each peer. Fetch data to match it to the copyrighted material for proof of copyright violation. • Ingest large amount of logging information each hour for parallel processing and storage
  7. 7. TokuDB Customer case Translation: • Needed indexes on data > RAM to query the data in a variety of ways • Needed compression so that they could store larger volumes of data on a single server
  8. 8. TokuDB Customer case Results: • Dramatic I/O reduction • over 3X compression • downtime periods previously spent running "optimize table" eliminated
  9. 9. TokuDB: compression Levels of compression depend on how naturally compressible your data is. 9x compression 7x compression
  10. 10. TokuMX tokutek.com/products/downloads • tokumx-user@googlegroups.com • tokumx-dev@googlegroups.com For evaluations or enterprise support: support@tokutek.com We’re hiring: Senior QA engineer, Tech Support engineer, tokutek.com/careers zardosht@tokutek.com, @zkasheff on twitter

×