How Rakuten Reduced Database Management Spending by 90% through Clustrix impl...Rakuten Group, Inc.
Session slide at db tech showcase 2012
How Rakuten Reduced Database Management Spending by 90% through Clustrix implementation
- About Rakuten
- Rakuten database environment and operational issues
- What is Clustrix?
- Clustrix verification results and implementation effectiveness
- Summary
NewSQL databases seek to provide the same scalable performance as NoSQL databases for online transaction processing workloads, while still maintaining the ACID guarantees of a traditional SQL database. NewSQL databases use new architectures like multi-version concurrency control and partition-level locking to allow for horizontal scaling and high availability without sacrificing consistency. They also provide highly optimized SQL engines to query data in a distributed environment.
How Rakuten Reduced Database Management Spending by 90% through Clustrix impl...Rakuten Group, Inc.
Session slide at db tech showcase 2012
How Rakuten Reduced Database Management Spending by 90% through Clustrix implementation
- About Rakuten
- Rakuten database environment and operational issues
- What is Clustrix?
- Clustrix verification results and implementation effectiveness
- Summary
NewSQL databases seek to provide the same scalable performance as NoSQL databases for online transaction processing workloads, while still maintaining the ACID guarantees of a traditional SQL database. NewSQL databases use new architectures like multi-version concurrency control and partition-level locking to allow for horizontal scaling and high availability without sacrificing consistency. They also provide highly optimized SQL engines to query data in a distributed environment.
This document discusses how to make software more green and environmentally friendly. It defines green software as software that is carbon efficient, energy efficient, hardware efficient, and carbon aware. It provides recommendations for various roles within an organization on driving green initiatives, including focusing on efficiency for CxOs, architects, infrastructure engineers, and developers. Examples include optimizing resource usage, using public clouds effectively, prioritizing equipment standardization, and developing applications that can run more efficiently.
Simple and Effective Knowledge-Driven Query Expansion for QA-Based Product At...Rakuten Group, Inc.
The document proposes a knowledge-driven query expansion approach for question answering (QA)-based product attribute extraction. It trains QA models using attribute-value pairs from training data as knowledge, while mimicking imperfect knowledge at test time through techniques like knowledge dropout and token mixing. This helps induce better query representations, especially for rare and ambiguous attributes. Experiments on a cleaned product attribute dataset show the proposed approach with all techniques outperforms baseline methods in both macro and micro F1 scores.
This document summarizes Andrew Hajinikitas' work developing Rakuten's private cloud infrastructure. It describes the key components of Rakuten's infrastructure including metal instances, microservers, and GPU servers. It provides details on Rakuten's software stack and their goals to expand managed services. Currently, Rakuten operates 9 data centers in Japan and overseas providing around 30,000 servers to support their ecosystem. Their future plans include extending network self-service, making GPU resources available as a platform service, and improving efficiency through optimized hardware selection.
The document discusses the Travel & Leisure Platform Dept and its responsibilities related to data and platform management. It provides an overview of the technical stack including private/public clouds, databases, containers, and automation/monitoring tools. It then discusses recent projects involving business continuity, containerization, alert integration, and automation. Finally, it describes open roles for a DBA and DevOps position and their responsibilities related to database provisioning, backup/recovery, infrastructure as code, and providing platforms and tools for developers.
This presentation introduces the OWASP Top 10:2021.
It explains how to look at the data related to OWASP Top 10:2021, and provides detailed explanations of items with distinctive data. It also introduces the OWASP Project related to each item.
Gora API Group technology provides a microservices architecture and APIs for Rakuten's golf course reservation system, improving the user experience and increasing customer loyalty and annual golf rounds. The architecture migrates the monolithic reservation system to microservices using Kotlin, Spring Boot, and other technologies, exposing APIs for the frontend and new products while sustaining the legacy system through services, queues, continuous delivery, and operations monitoring.
Generating Automatic Feedback on UI Mockups with Large Language Models
How Rakuten Reduced Database Management Spending by 90%
1. 楽天事例紹介: Clustrix導入
によるDB管理コストの削減
How Rakuten Reduced Database
Management Spending by 90%
October 17th, 2012
Ryutaro Yada(矢田 龍太郎)
Database Platform Group
Global Infrastructure Development Dept.
Rakuten, Inc.
29. 耐障害検証
Failure Test Items Downtime
1 Front network
(port1) No
2 Front network
(port2) No
3 Internal network
(primary) < 12s
4 Internal network
(standby) No Front SW1 Front SW2
5 MySQL instance < 4s 1
6 Node OS < 4s
11
7 Online data disk
(SSD) failure < 5s 2
DB DB DB DB
8 Log/work data disk
(SATA) failure No 5,6 7,8
4 12
9 Infiniband switch
(primary) < 12s 3
10 Infiniband switch
(standby) No
10
9
11 Front network
(port1&2) < 18s
Infiniband SW1 Infiniband SW2
12 Internal network
(primary&standby) < 12s 28
30. オンラインメンテナンス実行時間
テーブル行数とサイズ
small medium large
row 50,000 500,000 5,000,000
size(byte) 113,639,424 1,063,190,528 10,696,130,560
実行時間
Small Medium Large
create column 1.6s 13.5 149.8
create index 1.6s 13.0s 172.7s
drop column 1.5s 13.8s 125.5s
drop index 0.5s 0.5s 0.5s
29
37. バックアップ構成
Clustrix
DB DB DB
…
Node 1 Node 2 Node 3
Replication
Slave as first
backup
Backup by mysqldump
MySQL
DB
NFS
NAS
36
38. データ移行のやり方
DEVへレプリケーションして検証
PROへレプリケーションしてデータ移行
アプリのアクセス先をPROに変更
MySQL
DB
Replication
Replication
Clustrix DEV
Clustrix PRO DB DB DB
DB DB DB
37
43. Clustrixセッションのご紹介
• Robin Purohit, CEO of Clustrix
18 October at 11:00 in Room B
Session: Drive the New Wave of Big Data Applications
with the Clustrix Relational Database Solution
• Parrish
19 October at 11:00 in Room B
Technical Session: The Architecture of a Distributed
Database for High Performance Applications
• If you have questions, you can talk with Clustrix
representatives at the Clustrix booth
42