Aerospike - fast and furious caching @ Burgasconf 2016

Tihomir Trifonov
Tihomir TrifonovMaster Of Code at Receipt Bank
Aerospike –
the fast and furious cache Burgas Conf @ 2016
What is Aerospike
• Fast
• Scalable
• ACID compliant
• Open Source
• Schema-less
• Querying
• Aggregations/MapReduce using UDF
Burgas Conf @ 2016
What means fast?
• Flash/SSD optimized.
• Simple AWS test to make 1 million TPS on one r3.8xlarge instance.
• 10 million keys, 100 byte string values, 50% read and 50% write
Burgas Conf @ 2016
Scalable
• Automatic cluster node discovery
• Supports UDP/TCP.
• Replication factor
• Distributed reads/writes.
• Self-managed – auto-heal, automatic data balancing, recovery
from partition split.
Burgas Conf @ 2016
ACID
• Atomicity
• Data is read/written on 'master'.
• Consistency
• A record is considered successfully written if all replicas acknowledge write.
• Isolation
• Read-committed isolation level. Applying CaS (Check and Set or Test and
Set) concurrency scheme to allow parallel read-modify-write cycles.
• Durability
• Data persisting on flash storage. Rack-aware replication. Cross data-center
(XDR) replication for enterprise users.
Burgas Conf @ 2016
Open Source
• Aerospike Server - GNU Affero General Public License version 3
(AGPLv3) since June 2014.
• Aerospike Client – Apache License.
Burgas Conf @ 2016
Schema-less
• Basically a Key-Value store, but...
Burgas Conf @ 2016
Schema-less: Namespaces
Burgas Conf @ 2016
Schema-less: Sets
Burgas Conf @ 2016
Schema-less: Record structure
• Key
• Metadata
• TTL
• Generation (auto-increment id)
• Bins a.k.a. Columns
• Types: integer, string, bytes, double, list, map, GeoJSON, native-language
serialized (blobs), LDT (over 1MB of data).
Burgas Conf @ 2016
Querying - AQL
Burgas Conf @ 2016
Querying - AQL
Burgas Conf @ 2016
Querying - API
• Client libraries:
• Java
• C
• C#
• Python
• Ruby
• NodeJS
• Go
• Perl
• PHP
• Erlang
Burgas Conf @ 2016
Aggregations/MapReduce
• UDF (User-defined functions) written on Lua script.
Burgas Conf @ 2016
UDF (User-defined functions)
Burgas Conf @ 2016
Using UDF with AQL
Burgas Conf @ 2016
Application and use-cases
• Ad tech – fast sub-second ad selection on page load.
• Gaming.
• Fast/real-time data manipulation
• Statistics
Burgas Conf @ 2016
Q & A
Burgas Conf @ 2016
Thank you!
Tihomir Trifonov
t.trifonov@gmail.com
https://bg.linkedin.com/in/tisho
Burgas Conf @ 2016
1 of 19

Recommended

HBaseCon2017 Efficient and portable data processing with Apache Beam and HBase by
HBaseCon2017 Efficient and portable data processing with Apache Beam and HBaseHBaseCon2017 Efficient and portable data processing with Apache Beam and HBase
HBaseCon2017 Efficient and portable data processing with Apache Beam and HBaseHBaseCon
729 views30 slides
hbaseconasia2017: HBase on Beam by
hbaseconasia2017: HBase on Beamhbaseconasia2017: HBase on Beam
hbaseconasia2017: HBase on BeamHBaseCon
1.3K views26 slides
Austin bdug 2011_01_27_small_and_big_data by
Austin bdug 2011_01_27_small_and_big_dataAustin bdug 2011_01_27_small_and_big_data
Austin bdug 2011_01_27_small_and_big_dataAlex Pinkin
3.3K views17 slides
SOLR Power FTW: short version by
SOLR Power FTW: short versionSOLR Power FTW: short version
SOLR Power FTW: short versionAlex Pinkin
3.4K views20 slides
Why You Definitely Don’t Want to Build Your Own Time Series Database by
Why You Definitely Don’t Want to Build Your Own Time Series DatabaseWhy You Definitely Don’t Want to Build Your Own Time Series Database
Why You Definitely Don’t Want to Build Your Own Time Series DatabaseInfluxData
360 views67 slides
ACDKOCHI19 - Become Thanos of the Lambda Land: Wield all the Infinity Stones by
ACDKOCHI19 - Become Thanos of the Lambda Land: Wield all the Infinity StonesACDKOCHI19 - Become Thanos of the Lambda Land: Wield all the Infinity Stones
ACDKOCHI19 - Become Thanos of the Lambda Land: Wield all the Infinity StonesAWS User Group Kochi
112 views27 slides

More Related Content

What's hot

Rolling Out Apache HBase for Mobile Offerings at Visa by
Rolling Out Apache HBase for Mobile Offerings at Visa Rolling Out Apache HBase for Mobile Offerings at Visa
Rolling Out Apache HBase for Mobile Offerings at Visa HBaseCon
2.6K views39 slides
Uber Real Time Data Analytics by
Uber Real Time Data AnalyticsUber Real Time Data Analytics
Uber Real Time Data AnalyticsAnkur Bansal
2.4K views71 slides
MongoDB Capacity Planning by
MongoDB Capacity PlanningMongoDB Capacity Planning
MongoDB Capacity PlanningNorberto Leite
2.1K views62 slides
Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col... by
Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col...Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col...
Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col...Lviv Startup Club
82 views29 slides
Become Thanos of the LambdaLand - Wield All the Infinity Stones by
Become Thanos of the LambdaLand - Wield All the Infinity StonesBecome Thanos of the LambdaLand - Wield All the Infinity Stones
Become Thanos of the LambdaLand - Wield All the Infinity StonesKonfHubTechConferenc
124 views33 slides
Scaling Up with PHP and AWS by
Scaling Up with PHP and AWSScaling Up with PHP and AWS
Scaling Up with PHP and AWSHeath Dutton ☕
144 views41 slides

What's hot(20)

Rolling Out Apache HBase for Mobile Offerings at Visa by HBaseCon
Rolling Out Apache HBase for Mobile Offerings at Visa Rolling Out Apache HBase for Mobile Offerings at Visa
Rolling Out Apache HBase for Mobile Offerings at Visa
HBaseCon2.6K views
Uber Real Time Data Analytics by Ankur Bansal
Uber Real Time Data AnalyticsUber Real Time Data Analytics
Uber Real Time Data Analytics
Ankur Bansal2.4K views
MongoDB Capacity Planning by Norberto Leite
MongoDB Capacity PlanningMongoDB Capacity Planning
MongoDB Capacity Planning
Norberto Leite2.1K views
Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col... by Lviv Startup Club
Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col...Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col...
Yaroslav Nedashkovsky - "Data Engineering in Information Security: how to col...
Become Thanos of the LambdaLand - Wield All the Infinity Stones by KonfHubTechConferenc
Become Thanos of the LambdaLand - Wield All the Infinity StonesBecome Thanos of the LambdaLand - Wield All the Infinity Stones
Become Thanos of the LambdaLand - Wield All the Infinity Stones
Drill architecture 20120913 by jasonfrantz
Drill architecture 20120913Drill architecture 20120913
Drill architecture 20120913
jasonfrantz10.2K views
Hadoop Summit 2014 - recap by UserReport
Hadoop Summit 2014 - recapHadoop Summit 2014 - recap
Hadoop Summit 2014 - recap
UserReport465 views
RGW S3: Features vs deep compatibility - Robin Johnson by Ceph Community
RGW S3: Features vs deep compatibility  - Robin JohnsonRGW S3: Features vs deep compatibility  - Robin Johnson
RGW S3: Features vs deep compatibility - Robin Johnson
Ceph Community 87 views
Data- How Does It Work- by Boyang Niu
Data- How Does It Work-Data- How Does It Work-
Data- How Does It Work-
Boyang Niu127 views
HBaseCon2017 Analyzing cryptocurrencies in real time with hBase, Kafka and St... by HBaseCon
HBaseCon2017 Analyzing cryptocurrencies in real time with hBase, Kafka and St...HBaseCon2017 Analyzing cryptocurrencies in real time with hBase, Kafka and St...
HBaseCon2017 Analyzing cryptocurrencies in real time with hBase, Kafka and St...
HBaseCon606 views
Avoiding Data Hotspots at Scale by ScyllaDB
Avoiding Data Hotspots at ScaleAvoiding Data Hotspots at Scale
Avoiding Data Hotspots at Scale
ScyllaDB462 views
Putting Kafka Together with the Best of Google Cloud Platform by confluent
Putting Kafka Together with the Best of Google Cloud Platform Putting Kafka Together with the Best of Google Cloud Platform
Putting Kafka Together with the Best of Google Cloud Platform
confluent2.7K views
CosmosDB for DBAs & Developers by Niko Neugebauer
CosmosDB for DBAs & DevelopersCosmosDB for DBAs & Developers
CosmosDB for DBAs & Developers
Niko Neugebauer1.6K views
RedisConf17 - Home Depot - Turbo charging existing applications with Redis by Redis Labs
RedisConf17 - Home Depot - Turbo charging existing applications with RedisRedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Redis Labs978 views

Viewers also liked

Proxy arp by
Proxy arpProxy arp
Proxy arpMarian Marinov
1.1K views14 slides
PRESENTACION DE GOOGLE DRIVE by
PRESENTACION DE GOOGLE DRIVEPRESENTACION DE GOOGLE DRIVE
PRESENTACION DE GOOGLE DRIVEhugogalindocorrea
95 views4 slides
1204b5b3823a6947345193ce2af71230 by
1204b5b3823a6947345193ce2af712301204b5b3823a6947345193ce2af71230
1204b5b3823a6947345193ce2af71230LybaS1974
302 views48 slides
Verder kijken dan de traditionele G-sport by
Verder kijken dan de traditionele G-sportVerder kijken dan de traditionele G-sport
Verder kijken dan de traditionele G-sportRotterdam Sportsupport
599 views22 slides
Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum... by
Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum...Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum...
Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum...Nicola Canestrini
654 views23 slides
"Me dicen el clandestino" by
"Me dicen el clandestino""Me dicen el clandestino"
"Me dicen el clandestino"Nicola Canestrini
550 views23 slides

Viewers also liked(10)

1204b5b3823a6947345193ce2af71230 by LybaS1974
1204b5b3823a6947345193ce2af712301204b5b3823a6947345193ce2af71230
1204b5b3823a6947345193ce2af71230
LybaS1974302 views
Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum... by Nicola Canestrini
Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum...Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum...
Introduzione sulla Corte europea dei diritti dell'uomo (European Court of Hum...
Nicola Canestrini654 views
Giudicato e ne bis in idem (Res iudicata and double jeopardy) by Nicola Canestrini
Giudicato e ne bis in idem (Res iudicata and double jeopardy)Giudicato e ne bis in idem (Res iudicata and double jeopardy)
Giudicato e ne bis in idem (Res iudicata and double jeopardy)
Nicola Canestrini728 views
U-Man Belgium: Training & coaching met een passie voor mensen by U-Man Belgium
U-Man Belgium: Training & coaching met een passie voor mensenU-Man Belgium: Training & coaching met een passie voor mensen
U-Man Belgium: Training & coaching met een passie voor mensen
U-Man Belgium862 views

Similar to Aerospike - fast and furious caching @ Burgasconf 2016

Scalable Web Apps by
Scalable Web AppsScalable Web Apps
Scalable Web AppsPiotr Pelczar
6.6K views40 slides
Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K... by
Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K...Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K...
Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K...Lviv Startup Club
1.4K views29 slides
What's new in Hadoop Common and HDFS by
What's new in Hadoop Common and HDFS What's new in Hadoop Common and HDFS
What's new in Hadoop Common and HDFS DataWorks Summit/Hadoop Summit
2.9K views28 slides
Azure CosmosDb - Where we are by
Azure CosmosDb - Where we areAzure CosmosDb - Where we are
Azure CosmosDb - Where we areMarco Parenzan
121 views42 slides
High Concurrency Architecture and Laravel Performance Tuning by
High Concurrency Architecture and Laravel Performance TuningHigh Concurrency Architecture and Laravel Performance Tuning
High Concurrency Architecture and Laravel Performance TuningAlbert Chen
20K views59 slides
Machine Learning With H2O vs SparkML by
Machine Learning With H2O vs SparkMLMachine Learning With H2O vs SparkML
Machine Learning With H2O vs SparkMLArnab Biswas
239 views39 slides

Similar to Aerospike - fast and furious caching @ Burgasconf 2016(20)

Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K... by Lviv Startup Club
Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K...Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K...
Vitalii Bondarenko - “Azure real-time analytics and kappa architecture with K...
Lviv Startup Club1.4K views
Azure CosmosDb - Where we are by Marco Parenzan
Azure CosmosDb - Where we areAzure CosmosDb - Where we are
Azure CosmosDb - Where we are
Marco Parenzan121 views
High Concurrency Architecture and Laravel Performance Tuning by Albert Chen
High Concurrency Architecture and Laravel Performance TuningHigh Concurrency Architecture and Laravel Performance Tuning
High Concurrency Architecture and Laravel Performance Tuning
Albert Chen20K views
Machine Learning With H2O vs SparkML by Arnab Biswas
Machine Learning With H2O vs SparkMLMachine Learning With H2O vs SparkML
Machine Learning With H2O vs SparkML
Arnab Biswas239 views
Global Big Data Conference Sept 2014 AWS Kinesis Spark Streaming Approximatio... by Chris Fregly
Global Big Data Conference Sept 2014 AWS Kinesis Spark Streaming Approximatio...Global Big Data Conference Sept 2014 AWS Kinesis Spark Streaming Approximatio...
Global Big Data Conference Sept 2014 AWS Kinesis Spark Streaming Approximatio...
Chris Fregly3.6K views
MongoDB Internals by Siraj Memon
MongoDB InternalsMongoDB Internals
MongoDB Internals
Siraj Memon1.2K views
Seattle Spark Meetup Mobius CSharp API by shareddatamsft
Seattle Spark Meetup Mobius CSharp APISeattle Spark Meetup Mobius CSharp API
Seattle Spark Meetup Mobius CSharp API
shareddatamsft866 views
Apache Arrow: Cross-language Development Platform for In-memory Data by Wes McKinney
Apache Arrow: Cross-language Development Platform for In-memory DataApache Arrow: Cross-language Development Platform for In-memory Data
Apache Arrow: Cross-language Development Platform for In-memory Data
Wes McKinney6.6K views
Getting started with postgresql by botsplash.com
Getting started with postgresqlGetting started with postgresql
Getting started with postgresql
botsplash.com1.6K views
Azure Cosmos DB: Features, Practical Use and Optimization " by GlobalLogic Ukraine
Azure Cosmos DB: Features, Practical Use and Optimization "Azure Cosmos DB: Features, Practical Use and Optimization "
Azure Cosmos DB: Features, Practical Use and Optimization "
GlobalLogic Ukraine2.6K views
Azure Cosmos DB - The Swiss Army NoSQL Cloud Database by BizTalk360
Azure Cosmos DB - The Swiss Army NoSQL Cloud DatabaseAzure Cosmos DB - The Swiss Army NoSQL Cloud Database
Azure Cosmos DB - The Swiss Army NoSQL Cloud Database
BizTalk360483 views
Efficient State Management With Spark 2.0 And Scale-Out Databases by Jen Aman
Efficient State Management With Spark 2.0 And Scale-Out DatabasesEfficient State Management With Spark 2.0 And Scale-Out Databases
Efficient State Management With Spark 2.0 And Scale-Out Databases
Jen Aman1.8K views
Efficient State Management With Spark 2.x And Scale-Out Databases by SnappyData
Efficient State Management With Spark 2.x And Scale-Out DatabasesEfficient State Management With Spark 2.x And Scale-Out Databases
Efficient State Management With Spark 2.x And Scale-Out Databases
SnappyData354 views
Ucx an open source framework for hpc network ap is and beyond by inside-BigData.com
Ucx  an open source framework for hpc network ap is and beyondUcx  an open source framework for hpc network ap is and beyond
Ucx an open source framework for hpc network ap is and beyond
ApacheCon2019 Talk: Kafka, Cassandra and Kubernetes at Scale – Real-time Ano... by Paul Brebner
ApacheCon2019 Talk: Kafka, Cassandra and Kubernetesat Scale – Real-time Ano...ApacheCon2019 Talk: Kafka, Cassandra and Kubernetesat Scale – Real-time Ano...
ApacheCon2019 Talk: Kafka, Cassandra and Kubernetes at Scale – Real-time Ano...
Paul Brebner572 views
3 apache-avro by zafargilani
3 apache-avro3 apache-avro
3 apache-avro
zafargilani20.3K views

Recently uploaded

A first look at MariaDB 11.x features and ideas on how to use them by
A first look at MariaDB 11.x features and ideas on how to use themA first look at MariaDB 11.x features and ideas on how to use them
A first look at MariaDB 11.x features and ideas on how to use themFederico Razzoli
45 views36 slides
DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme... by
DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme...DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme...
DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme...Deltares
5 views28 slides
Software evolution understanding: Automatic extraction of software identifier... by
Software evolution understanding: Automatic extraction of software identifier...Software evolution understanding: Automatic extraction of software identifier...
Software evolution understanding: Automatic extraction of software identifier...Ra'Fat Al-Msie'deen
7 views33 slides
Copilot Prompting Toolkit_All Resources.pdf by
Copilot Prompting Toolkit_All Resources.pdfCopilot Prompting Toolkit_All Resources.pdf
Copilot Prompting Toolkit_All Resources.pdfRiccardo Zamana
8 views4 slides
Software testing company in India.pptx by
Software testing company in India.pptxSoftware testing company in India.pptx
Software testing company in India.pptxSakshiPatel82
7 views9 slides
Headless JS UG Presentation.pptx by
Headless JS UG Presentation.pptxHeadless JS UG Presentation.pptx
Headless JS UG Presentation.pptxJack Spektor
7 views24 slides

Recently uploaded(20)

A first look at MariaDB 11.x features and ideas on how to use them by Federico Razzoli
A first look at MariaDB 11.x features and ideas on how to use themA first look at MariaDB 11.x features and ideas on how to use them
A first look at MariaDB 11.x features and ideas on how to use them
Federico Razzoli45 views
DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme... by Deltares
DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme...DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme...
DSD-INT 2023 Salt intrusion Modelling of the Lauwersmeer, towards a measureme...
Deltares5 views
Software evolution understanding: Automatic extraction of software identifier... by Ra'Fat Al-Msie'deen
Software evolution understanding: Automatic extraction of software identifier...Software evolution understanding: Automatic extraction of software identifier...
Software evolution understanding: Automatic extraction of software identifier...
Copilot Prompting Toolkit_All Resources.pdf by Riccardo Zamana
Copilot Prompting Toolkit_All Resources.pdfCopilot Prompting Toolkit_All Resources.pdf
Copilot Prompting Toolkit_All Resources.pdf
Riccardo Zamana8 views
Software testing company in India.pptx by SakshiPatel82
Software testing company in India.pptxSoftware testing company in India.pptx
Software testing company in India.pptx
SakshiPatel827 views
Headless JS UG Presentation.pptx by Jack Spektor
Headless JS UG Presentation.pptxHeadless JS UG Presentation.pptx
Headless JS UG Presentation.pptx
Jack Spektor7 views
Advanced API Mocking Techniques by Dimpy Adhikary
Advanced API Mocking TechniquesAdvanced API Mocking Techniques
Advanced API Mocking Techniques
Dimpy Adhikary19 views
MariaDB stored procedures and why they should be improved by Federico Razzoli
MariaDB stored procedures and why they should be improvedMariaDB stored procedures and why they should be improved
MariaDB stored procedures and why they should be improved
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ... by Donato Onofri
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Donato Onofri795 views
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J... by Deltares
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...
Deltares9 views
Navigating container technology for enhanced security by Niklas Saari by Metosin Oy
Navigating container technology for enhanced security by Niklas SaariNavigating container technology for enhanced security by Niklas Saari
Navigating container technology for enhanced security by Niklas Saari
Metosin Oy13 views
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action by Márton Kodok
Gen Apps on Google Cloud PaLM2 and Codey APIs in ActionGen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action
Márton Kodok5 views
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h... by Deltares
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
Deltares5 views
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium... by Lisi Hocke
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Lisi Hocke28 views
SUGCON ANZ Presentation V2.1 Final.pptx by Jack Spektor
SUGCON ANZ Presentation V2.1 Final.pptxSUGCON ANZ Presentation V2.1 Final.pptx
SUGCON ANZ Presentation V2.1 Final.pptx
Jack Spektor22 views
Airline Booking Software by SharmiMehta
Airline Booking SoftwareAirline Booking Software
Airline Booking Software
SharmiMehta5 views
DSD-INT 2023 Delft3D FM Suite 2024.01 1D2D - Beta testing programme - Geertsema by Deltares
DSD-INT 2023 Delft3D FM Suite 2024.01 1D2D - Beta testing programme - GeertsemaDSD-INT 2023 Delft3D FM Suite 2024.01 1D2D - Beta testing programme - Geertsema
DSD-INT 2023 Delft3D FM Suite 2024.01 1D2D - Beta testing programme - Geertsema
Deltares17 views

Aerospike - fast and furious caching @ Burgasconf 2016