Successfully reported this slideshow.
Your SlideShare is downloading. ×

Aerospike Roadmap Overview - Meetup Dec 2019

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Loading in …3
×

Check these out next

1 of 8 Ad

Aerospike Roadmap Overview - Meetup Dec 2019

Download to read offline

A presentation by Andy Gooding, Aerospike VP Engineering, describing the latest changes done in 2019 and the road map for 2020.

Topics include: scale and speed (performance) improvements XDR, scans and query, and other features to come

A presentation by Andy Gooding, Aerospike VP Engineering, describing the latest changes done in 2019 and the road map for 2020.

Topics include: scale and speed (performance) improvements XDR, scans and query, and other features to come

Advertisement
Advertisement

More Related Content

Similar to Aerospike Roadmap Overview - Meetup Dec 2019 (20)

Advertisement

Recently uploaded (20)

Advertisement

Aerospike Roadmap Overview - Meetup Dec 2019

  1. 1. Product Update December 2019 Andy Gooding VP of Engineering, Aerospike
  2. 2. 2 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ Enterprise Edition 4.5.3 (May 14 2019) ▪ Compression for Replica Writes and Migrations ▪ Flat format storage used as the wire format ▪ Ship compressed records as-is for replica writes and migrations ▪ Compression now also applies to inter-node communication (fabric) ▪ Enterprise Edition 4.6.0 (August 9 2019) ▪ Nested CDT operations, Bitwise Blob operations ▪ CDT comparison operations speed boost ▪ Enterprise Edition 4.7.0 (September 30 2019) ▪ ADQ support. Demonstrated 15M TPS on one node ▪ Ripped out Transaction Queues ▪ Scans in parallel with RPS throttling ▪ Enterprise Edition 4.8.0 (December 12 2019) ▪ Data in Persistent Memory (PMEM) ▪ Compression for Client-Server communication ▪ Separate write buffers for masters, replica and migrations Aerospike Enterprise Edition – Performance Improvements “Infrastructure for Speed at Scale”
  3. 3. 3 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ XDR Milestone 1 – (2020 Q1) ▪ Integrate into core database and eliminate separate digest log ▪ Enable independent shipping from single source to target data centers ▪ Dynamic configuration of shipping information ▪ Improved correctness in failure situations ▪ Support for shipping from past timestamp for reliable data sync across clusters ▪ Ship non-durable deletes ▪ Replace HTTP connector into a native one for performance boost ▪ Scans – (2020 Q1) ▪ Scan correctness in the presence of node failures ▪ Concurrent and parallel scan execution ▪ Ability to restart scan from previous location (‘cursors’) Aerospike Enterprise Edition – Core (Upcoming in Q4 '19, Q1 '20) “Infrastructure for Speed at Scale”
  4. 4. 4 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ XDR Milestone 2 – (2020 Q2) ▪ Record/Bin level filters ▪ Secondary Index Milestone 1 – (2020 Q2) ▪ 3x reduction in index size ▪ 4x improvement in performance ▪ Improved garbage collection of index entries ▪ XDR Milestone 3 – (2020 Q3) ▪ Support for strong consistency in active/passive setup ▪ Optimizations to improve shipping performance (delta LUT-based shipping) ▪ Support seamless data movement across clusters ▪ Secondary Index Milestone 2 – (2020 Q3) ▪ Ability to query accurately in the presence of cluster changes ▪ Support for restarting queries from a specific point (‘cursors’) Aerospike Enterprise Edition – Core (Upcoming in Q2 '20, Q3 '20) “Infrastructure for Speed at Scale”
  5. 5. 5 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ Secondary Index Milestone 3 – (2020 Q4) ▪ SLAB style allocation ▪ Warm start for secondary indexes ▪ Store secondary indexes in Flash ▪ Store secondary indexes in Persistent Memory (PMEM) ▪ Client protocol Milestone 2 – (2020 Q4) ▪ Pipelining ▪ Security: Key Management – (Unscheduled, 2020) ▪ KMS integration – KMIP 3 and Vault ▪ Improved support for Extended Strong Consistency clusters in WAN environments – (Unscheduled, 2020) ▪ Performance improvements – (Unscheduled, 2020) ▪ async IO – non-blocking device reads ▪ Redoing fabric to run on service threads ▪ Support for changing replication factor dynamically Aerospike Enterprise Edition – Core (Upcoming in Q4 '20, More) “Infrastructure for Speed at Scale”
  6. 6. 6 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ Multi level complex data types (CDT) – Enterprise Edition 4.6.0 (August 9 2019) ▪ Extends the ability to apply map and list operations to elements nested at an arbitrarily depth ▪ Improved efficiency of all list and map operations ▪ Bitwise operations – Enterprise Edition 4.6.0 (August 9 2019) ▪ Atomic bitwise operations on the BLOB data type ▪ Modeling with BLOBs should be highly compressible ▪ Conditional key-value, batch and UDF operations – Enterprise Edition 4.7.0 (September 30 2019) ▪ Conditionally execute a put() or multi-operation transaction only if a predicate filter is satisfied ▪ Only read a single record if a predicate filter is satisfied (e.g., last updated under N seconds ago) ▪ Filter records of a batch-read using a specified predicate filter (aligns batch-reads with scan and query) ▪ Delete Record operation – Enterprise Edition 4.7.0 (September 30 2019) ▪ Let's a developer combine a read and delete in a single record transaction (multi-op) ▪ Background scans applying multi-operation transactions – Enterprise Edition 4.7.0 (September 30 2019) ▪ High performance alternative for background scan UDFs. The operate() is applied to each record scanned. ▪ Record per-second control for scans Aerospike Enterprise Edition – Developer API Improvements “Increase applicability to the widest possible set of use cases”
  7. 7. 7 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ Paginated scans – (2020 Q1) ▪ Ability to restart a scan from a previous location (‘cursors’); Enables paginated scans ▪ Fast and efficient queries – (2020 Q2) ▪ Ability to use secondary indexes more intensively due to a reduction in memory use and speed improvements ▪ Paginated queries – (2020 Q3) ▪ Ability to restart a query from a previous location (‘cursors’); ▪ XDR Conflict Resolution – (2020 Q3) ▪ Better conflict resolution using bin-level metadata ▪ Last Write Wins and potentially user-defined resolution ▪ New Client-Server protocol: Pipelining – (2020 Q4) ▪ Probabilistic Data Types – (Unscheduled, 2020) ▪ HyperLogLog and friends Aerospike Enterprise Edition – Developer API (Upcoming) “Increase applicability to the widest possible set of use cases”
  8. 8. 8 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc. ▪ Native aggregate functions ▪ Ditching stream UDFs for native COUNT, SUM, MIN, MAX, AVG, etc ▪ Predicate Filters modernization ▪ Adding nested list and map operations, bitwise operations to predicate filters ▪ Indexing capability for deeply nested elements ▪ Record UDF Overhaul ▪ Exposing list, map, bitwise, integer, string operations as an API you can call from the UDF ▪ Possibly replacing Lua as a UDF language ▪ SQL support ▪ Potentially via Presto ▪ Timeseries database Aerospike Enterprise Edition – Developer API (Upcoming) What would you like to see in Aerospike?

×