Addressing performance issues in titan+cassandraNakul Jeirath
Slides from presentation at Graph Day Texas discussing some of the problems we faced and what we did to fix them to keep our customer facing response times low and our data ingestion pipeline humming.
Build a Recommendation Engine using Amazon Machine Learning in Real-timeAmazon Web Services
Amazon Machine Learning is a service that makes it easy for developers of all skill levels to use machine learning technology. In this session, we will introduce how to use Amazon Machine Learning to create a data model, and use it to generate the real-time prediction for your application.
Using AWS to Build a Graph-Based Product Recommendation System (BDT303) | AWS...Amazon Web Services
Magazine Luiza, one of the largest retail chains in Brazil, developed an in-house product recommendation system, built on top of a large knowledge Graph. AWS resources like Amazon EC2, Amazon SQS, Amazon ElastiCache and others made it possible for them to scale from a very small dataset to a huge Cassandra cluster. By improving their big data processing algorithms on their in-house solution built on AWS, they improved their conversion rates on revenue by more than 25 percent compared to market solutions they had used in the past.
9. NoSQL と RDBMS との本当の関係
RDBMS でも NoSQL でも設計を深く突き詰めると同じ
そもそも CPU の処理量は DB に関係なく一定
↓
CPU 処理量の配分の最適化が大切
↓
NoSQL :フロント (オンライン)
RDBMS :バックヤード (オフライン)
ログ解析など(← SQL が活きる!)
↑
「 Not Only SQL 」風の構成とは真逆が正解
10. NoSQL と RDBMS との本当の関係
WEB APP ● 従来型
→DB に負荷集中
WEB APP
RDBMS
WEB APP RDBMS
WEB APP
WEB APP
11. NoSQL と RDBMS との本当の関係
WEB APP NoSQL
NoSQL
WEB APP
RDBMS
WEB APP RDBMS
WEB APP
● 負荷を軽減しようと・・・
→NoSQL でキャッシュ
WEB APP →DB の書き込み負荷は減らない
これが今の「 Not Only SQL 」の構成
12. NoSQL と RDBMS との本当の関係
ここを売るのは先が細い
WEB APP NoSQL
NoSQL
WEB APP
RDBMS
WEB APP RDBMS
WEB APP
● 負荷を軽減しようと・・・
→NoSQL でキャッシュ
WEB APP →DB の書き込み負荷は減らない
現在の「 Not Only SQL 」の構成
13. NoSQL と RDBMS との本当の関係
WEB APP NoSQL
NoSQL
WEB APP
RDBMS
WEB APP RDBMS
WEB APP
● ボトルネック部分を削ってみる
WEB APP
14. NoSQL と RDBMS との本当の関係
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
15. NoSQL と RDBMS との本当の関係
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
16. NoSQL と RDBMS との本当の関係
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
● 自然と NoSQL クラスタに行き着く
17. NoSQL と RDBMS との本当の関係
WEB APP NoSQL
RDBMS
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL
WEB APP NoSQL ● 最適なシステム構成
→NoSQL はフロント
→ RDBMS はバックヤード