Rakuten Technology Conference 2014 "Rakuten Travel Architecture and Development Process" Shunsuke Hoshino, Mitsuru Saito (Rakuten)

1. Rakuten Travel Architecture and
Development Process
October/25/2014
Shunsuke Hoshino / Mitsuru Saito
Travel Development Department, Rakuten Inc.
http://travel.rakuten.co.jp/

2. 2
History of Rakuten Travel
Service started on January 1996 as “ホテルの窓口” with just 2 PCs.
Started with just 2 PCs
 Network : 128Kbps
 Browser : Netscape 2.0
 Fax by Manual => Automatic
Process by Windows3.1

3. 3
History of Rakuten Travel
1996 - 1999
ホテルの窓口
1999 - 2004
My trip net
2001 - 2004
Rakuten Travel
http://www.mytrip.net/
2003
M&A by
Rakuten Inc.
2004
Integration into
Rakuten Travel
Business Model by 旅の窓口
Service Name by 楽天トラベル
http://travel.rakuten.co.jp/
Integration of Rakuten Travel

4. 4
Increasing Rate of Servers
Server
Server

5. 5
Rakuten Travel Services
Domestic Hotels
Overseas Hotels

6. 6
Rakuten Travel Services
Highway Bus
Rental Cars

7. 7
Rakuten Travel Services
Air (ANA, JAL) + Hotel Overseas Air+Hotel

8. 8
Multilingual Site
Rakuten Travel Services

9. 9
Rakuten Travel Services
Native Application for Smart Devices

10. 10
Rakuten Travel Services
Web Booking ASP
for Original Home Page
Corporate Travel
Call Center
Open API
http://travel.rakuten.co.jp/corporation/demand.html
http://travel.rakuten.co.jp/callcenter/
http://travel.rakuten.co.jp/webservice/

11. Overseas Website
Travel Mail
Platform
11
Product Map of Travel
Product
Private APIc
DB/KVS/BigData
Hotel
(package)
Search Engine
Booking
Process
Vacant Search
Smartphone
Apps
AD
FAX
Mobile
Review
Keyword
Search
Retargeting/
Personalization
Booking
Sight
seeing
Hotel’s
Extranet
R-with
Bus
Car Rental
In-house
tool
Overseas
air
Overseas
hotel
Overseas
DP
JAL
Raku-pack
ANA
Raku-Pack
R-connect
(Connect hotels)
SearchAPI
Rakuten
ID
Point
Coupon
Payment
API
DB/DataStore
Product
My Page
Corporate
Booking
Accounting
Prize
Mail-magazine
R-mail
Master
Inventory
Price
Log Review
room
Car Rental
Hotel
(overseas)
Booking
Confirmation
・・・
OEM
Open
Platform
Affiliate
WTS GMO ECON
Airline Company/ Whole Seller/ outside engine
Chain Hotels
BI Tool
Car Rental
connect API
Car Rental
Company
DWH
inventory
pricing
BookingAPI
Booking
Air ticket
Management
Review
・・・
Amazon
SAP

12. Search Engine(plsql)
Solr
Qsol
roma
fee
Stock
Info
Rsv
Rakuten
Web Service
DB
Review
Timesten
Overseas Website
API
Database
Product
R-connect
Hotel
Web Service
…
…
External API
ana
jal
GMO
ECON
WTS
MIKI
GTA
ANA
JAL
Overseas
DP
Overseas
hotel
Overseas
PMS
Data Sync
API Data Sync
API
DP
air-ws
rax-api
Data Store
Personal Page
api
ID
Point
Coupon
Payment
Rakuten
Review
Keyword
Search
Ashiato
Hotel
Management
In-house
tool
Rent a car Bus R-with
Reservation
Japan Hotel Search
Date Map Station
Overseas
air
F
R-download
Download
Racco
Mailmagazine R-mail
Prize
AD
Coupon
Access Log
Internal Operation Tool
EJC/iNu
Sales Accountant BU
FAX
API
Travel Mail Platform
F
Air Hotel DP
fee
Stock
Info
Rsv
Review
…
…
China DB
F F
F
VPN
Booking
MQ
F
F
Ainori
...
App
Zenrin
Google
Private Cloud
PaaS
Tabi Note
F
System Overview of Rakuten Travel
Amazon
Hadoop
Data Warehouse
SAP

13. 13
System Overview of Rakuten Travel

14. 14
Challenges of Recent Travel
System Complexity
Old Technology(PL/SQL, C)
Dependency on Single Technology
Non transparent product development
Too Many Manual Processes

15. 15
Challenges of Recent Travel
System Complexity
Old Technology(PL/SQL, C)
Dependency on A Single Technology
Non Transparent Product Development
Too Many Manual Process

16. Search Engine(plsql)
Solr
Qsol
roma
fee
Stock
Info
Rsv
Rakuten
Web Service
DB
Review
Timesten
Overseas Website
API
Database
Product
R-connect
Hotel
Web Service
…
…
External API
ana
jal
GMO
ECON
WTS
MIKI
GTA
ANA
JAL
Overseas
DP
Overseas
hotel
Overseas
PMS
Data Sync
API Data Sync
API
DP
air-ws
rax-api
Data Store
Personal Page
api
ID
Point
Coupon
Payment
Rakuten
Review
Keyword
Search
Ashiato
Hotel
Management
In-house
tool
Rent a car Bus R-with
Reservation
Japan Hotel Search
Date Map Station
Overseas
air
F
R-download
Download
Racco
Mailmagazine R-mail
Prize
AD
Coupon
Access Log
Internal Operation Tool
EJC/iNu
Sales Accountant BU
FAX
API
Travel Mail Platform
F
Air Hotel DP
fee
Stock
Info
Rsv
Review
…
…
China DB
F F
F
VPN
Booking
MQ
F
F
Ainori
...
App
Zenrin
Google
Private Cloud
PaaS
Tabi Note
F
System Overview of Rakuten Travel
Amazon
Data Warehouse
SAP
Many services are dependent
Hadoop

17. 17
Platform Strategy
User Smart Phone Server
Layer
Travel
Front
services
PC
API I/F
for alliance Domestic Overseas Transport
Etc.
Search API Booking API
Inventory
API
Hotel API Etc.
Inside
Travel
APIs
Connect to Travel services
Data
Inventory
Search
Update
Inventory
Hotel
Information
Enhance API layer

18. 18
Example of API-nization
Master
Slave
Oracle
User
Multilingual Travel Site
Hotel Extranet
Booking API, Search API Inventory API
Memory Bus
NoSQL DB

19. 19
Challenges of Recent Travel
System Complexity
Old Technology(PL/SQL, C)
Dependency on A Single Technology
Non Transparent Product Development
Too Many Manual Process

20. Search Engine(plsql)
Solr
Qsol
roma
fee
Stock
Info
Rsv
Rakuten
Web Service
DB
Review
Timesten
Overseas Website
API
Database
Product
R-connect
Hotel
Web Service
…
…
External API
ana
jal
GMO
ECON
WTS
MIKI
GTA
ANA
JAL
Overseas
DP
Overseas
hotel
Overseas
PMS
Data Sync
API Data Sync
API
DP
air-ws
rax-api
Data Store
Personal Page
api
ID
Point
Coupon
Payment
Rakuten
Review
Keyword
Search
Ashiato
Hotel
Management
In-house
tool
Rent a car Bus R-with
Reservation
Japan Hotel Search
Date Map Station
Overseas
air
F
R-download
Download
Racco
Mailmagazine R-mail
Prize
AD
Coupon
Access Log
Internal Operation Tool
EJC/iNu
Sales Accountant BU
FAX
API
Travel Mail Platform
F
Air Hotel DP
fee
Stock
Info
Rsv
Review
…
…
China DB
F F
F
VPN
Booking
MQ
F
F
Ainori
...
App
Zenrin
Google
Private Cloud
PaaS
Tabi Note
F
System Overview of Rakuten Travel
Amazon
Data Warehouse
SAP
Many P/L SQL and C
Hadoop

21. 21
Elimination of Legacy System
Convert

22. 22
Challenges of Recent Travel
System Complexity
Old Technology(PL/SQL, C)
Dependency on A Single Technology
Non Transparent Product Development
Too Many Manual Process

23. 23
Current Search Architecture
English site
To Japan
Booking
Domestic
Search
Domestic
DP Search
Hotel Info
Other Travel Service
For PL/SQL
Sync
DB Link
 Inefficiency of cost
 Difficulty of scale out

24. 24
Architecture NoSQL DB
Shard 1 Shard 2 Shard 3

25. 25
NoSQL DB for Multilingual Site
Search API
FRONT Service
Booking
Cancel
Inventory Core
Queue
Documents
Stock/Price
Get Documents
Search / Result
dirver
Stock
Price
Documents

26. 26
Challenges of Recent Travel
System Complexity
Old Technology(PL/SQL, C)
Dependency on A Single Technology
Non Transparent Product Development
Too Many Manual Process

27. 27
Non Transparent Product Development
Non clear responsibilities
Short sight vision
No definition of the products
Random process to develop
Lower quality products and services

28. Clear Responsibilities
• High level talent per role is required
PDM
Designer
Engineer
Tester

29. 29
Rakuten Travel PDM
Define and design products and services
that delight customers
and add strategic value to Rakuten

30. 30
Rakuten Travel PDM Mission

31. 31
PDM Cycle for Great Products
Framing
Ideations
Spec
Keeping
Rhythm
Customer
review
Evangelization

32. Development Process
Documents
Wishlist PRD
Dev
Spec
Test
Spec
Actions
Develop Test Release

33. Product Requirements Document
• Clear definition of requirements
• Sign-off process with managers
• Base document for dev spec and test spec

34. The volume of members
34
Quality Assurance
QA team
2014 12
2015 20

35. What Has Been Improved So Far
• Easier to prioritize projects
• No extra tasks for designers and developers
• Test cases are easier to write
• No back and forth development
We are managing over
60 projects!

36. 36
Challenges of Recent Travel
System Complexity
Old Technology(PL/SQL, C)
Dependency on A Single Technology
Non Transparent Product Development
Too Many Manual Process

37. 37
Automation
Design
Development
Improvement/
Measurement
Release QA
Full-swing
introduction in All
services.
Staging

38. 38
Revise The Process
Design
Implement
Test
Test

39. 39
Jenkins

40. 40
Next Challenge of Rakuten Travel
24/5 Development
T.R.I.P.
DEV-OPS

41. 41
24/5 Global Development Team
Travel development team aims to develop all over the world for 24/5 development.
France
India
Japan We are planning to establish
development team.
1. India development team
(From mid of 2015)
2. France development team
(From 2016)

42. 42
T.R.I.P
We start to use Rakuten DC from 2015
Osaka DC
Tokyo DC
Virtualization Ration
Osaka DC Tokyo DC
Real 67% 21%
VM 33% 79%
・Increase the Virtualization
・New Infrastructure Architecture