This document discusses in-memory database systems and high performance computing. It begins with an overview of domestic and international in-memory databases like Altibase, Oracle TimesTen, McObject ExtremeDB, and KX Systems KDB+. It then discusses the advantages of in-memory architectures for achieving ultra-low latency. The rest of the document covers technologies that enable high performance like NUMA, SSDs, InfiniBand, message queues, and complex event processing. It concludes by discussing in-memory computing and high performance computing technologies.

1. FB lee.hyeongchae

2. About me
국산 DBMSs MobileLite
 이너비트 Embedded In-Memory DBMS
 NHN ( CUBRID )
 텔코웨어 CUBRID
 알티베이스 Object Oriented DBMS
 티베로
 리얼타임테크 Telcobase
 아키스 In-Memroy DBMS
국산 DBs Altibase
 선재소프트 In-Memroy DBMS
 유엔젤

3. Agenda
In-Memory DBMS !!
Altibase, TimesTen, ExtremeDB, KDB+, C-ISAM …
Why ?!
Ultra & Extreme low latency AND Exture+
How ?!
NUMA, SSD, Infiniband, Compiler, MQ, Tick, CEP …
Best ?!
In-Memory Computing ?!
Best Of Best !!
High Performance Computing !!

5. In-Memory Architecture

6. In-Memory Database System
 High Performance
 Low Latency
 No Jitter
Disk-Based RDBMS vs Oracle TimesTen
( Simple Architecture )

7. Modern DBMS
≒
In-Memory DBMS

8. In-Memory Database System
4G
3G
2G
1G

9. Altibase HDB & XDB
장점
 국내개발 및 기술지원
 증권사 레퍼런스
 MVCC 지원
단점
 성능한계 & 메모리 이슈
 고급 엔지니어 부재

10. Oracle TimesTen & Coherence
장점
 오라클 & 레퍼런스
 성능
 DA ( Direct Attach )
단점
 DA ( Direct Attach ) 한계
 MVCC 미지원
 Durability 이슈
 엔지니어 및 기술지원 부제

11. McObject ExtremeDB & FE
장점
 성능
 해외 통신 & 증권 레퍼런스
 STAC Member Join
단점
 임베디드 전문 회사
 국내 기술지원
 FE ( Financial Edition ) 검증

12. KX Systems KDB+
장점
 WORLD BEST
 QL ( Q Language )
 STAC-M3 Leader
단점
 가격
 국내 기술지원

13. IBM Informix C-ISAM
장점
 OLD BEST
 성능 & 가격
 Zero Configuration & Admin
단점
 File DB
 ACID 미지원
 유지보수 및 기술지원

15. second
㎳
㎳~㎲
㎲
2 digit ㎲~㎱

16. Ultra & Extreme Low Lantecy

17. Exture+ RFP

18. Exture+ RFP

19. Exture+ RFP

20. Exture vs Exture+

21. Sync vs Async

22. Pub-Sub Architecture

23. Exture+ Dev ?!

24. Exture+ Dev ?!

25. Exture+ Dev ?!

26. Exture+ Dev ?!

28. NUMA Architecture

29. NUMA Architecture
Using McObject’s 64-bit eXtremeDB-64, the application creates a 1.17
Terabyte, 15.54 billion row database on a 160-core Linux based
SGI® Altix® 4700 server.

30. NUMA Architecture
It supports up to 512 * sockets or 1024 cores under one instance of
Linux and as much as 128TB of globally addressable
memory.

31. NUMA Architecture
CPU-Socket-Isolation via PhysicalNIC / PhysicalCPU pairing.
Multiple CPU sockets holding multiple CPUs should be used like multiple
machines. Avoid inter-CPU communication

32. NUMA Architecture
8-socket Nehalem-EX: architecture
8-socket Nehalem-EX: memory bandwidth matrix

33. InfiniBand & 10GbE
In computer networking, Server Message Block (SMB), also known as Common
Internet File System (CIFS, /ˈsɪfs/) operates as an application-layer network protocol[1]
mainly used for providing shared access to files, printers, serial ports, and
miscellaneous communications between nodes on a network.

34. InfiniBand & 10GbE

35. SSD

36. SSD is very very difficult.
SSD (DRAM/NVRAM/flash/SLC/MLC) is Blah Blah !!

37. Compiler & *.[so|a] Library

38. Message Queue
ZeroMQ
 Crazy fast
 Brokerless architecture
 In-process library
 Lower latencies
 Very simple to use
 No persistence – requiring higher
layers to manage persistence
RabbitMQ
 VMware vFabric
 AMQP compliant
 Written in erlang
 Small footprint and seemingly fewer
lines of code in comparison to other
AMQP compliant queue managers

39. OpenMAMA is high performance
Middleware Agnostic Messaging API

40. Tick & Time series database
eXtremeDB Financial Edition meets the specialized requirements of
handling market data with several powerful features:
Flexible data layout. eXtremeDB Financial Edition implements columnar data
layout for fields of type ‘sequence’. Sequences can be combined to form a time series, ideal
for working with tick streams, historical quotes and other sequential data. The technology
supports database designs that combine row-based and column-based layouts, to best
leverage L1/L2 cache speed.
Traditional DBMSs bring rows of data into L1/L2 cache for processing. But financial data –
such as trades and quotes – are better handled by a column-based layout that avoids
flooding the cache with unwanted data.
Vector-based statistical function library. Vector-based statistical
functions provide high efficiency by executing over all or part of one or more sequences and
supporting assembly lines of operations on sequences, for statistical/quantitative analysis
eXtremeDB Financial Edition provides a rich library of vector-basedstatistical functions that
execute over sequence to accelerate management of time series data.
Handles real-time and historical data. eXtremeDB Financial Edition’s
in-memory storage is ideal for real-time data, while developers can easily specify persistent
tables for historical data with a simple notation in the database schema. eXtremeDB
programming skills are fully interchangeable between in-memory and persistent database
designs (developers needn’t learn two database system products for real-time and historical
data).

41. Complex Event Processing
우리는 대용량 고속 데이터에 대한 통찰력을 가지기 위한 복합 이벤트 처리
기술(CEP), 인-메모리 기반 분석 기술, 대용량 데이터 베이스 및 저장 기술 등 고급 기술
세트를 제공합니다. 복합 이벤트 분석(Complex Event Analytics) 솔루션은 실시간
대용량 정보 소스(Source)로부터 통찰과 함께 즉시 의사 결정을 지원하는 혁신적인
솔루션입니다.

43. In-Memory Computing

44. In-Memory Computing
!=
No-Disk Computing

46. TOP500 - 1 st
Blue Gene is an IBM project aimed at designing supercomputers that can reach operating speeds in
the PFLOPS (petaFLOPS) range, with low power consumption.

47. High Performance Computing

48. HPI ( Hasso Plattner Institut )

49. Q?!A
FB lee.hyeongchae
hyeongchae@G+