This document discusses real-time big data analytics and how GigaSpaces' products address related challenges. It provides an overview of Shay Hassidim as GigaSpaces' US CTO, examples of GigaSpaces customers, and how their product has evolved from scaling data to enabling application clouds and virtual data centers. It then demonstrates a Twitter analytics engine built on their platform that can analyze 300 million tweets per day without hot spots by using light event processing, map-reduce, and asynchronous persistence to big data stores.

1. Real-Time Big Data Analytics
Shay Hassidim, Deputy CTO
Shay@gigaspaces.com

2. ABOUT MYSELF – SHAY HASSIDIM
 GigaSpaces US CTO
 More than 20 years of SW development
 Java , .Net , C++ , you name it…
 Almost 10 years with GigaSpaces
 From the time we have been startup at the garage…
 Oversight the entire technical operations within the Americas
 Located in GigaSpaces NY HQ
2

3. GIGASPACES BUSINESS CARD
Healthcare
300+ Direct Customers 75+ Cloud Customers
40+ Fortune 500 + Organization 25+ ISVs
Founded 2000
3

4. CUSTOMERS SAMPLES
• Credit risk / pricing systems
• Credit card services
• Trading (equities / energy / fixed income / forex/high
frequency) systems
• Cloud/Virtualization Platforms
• User web portal systems
• Market Data systems
• Reconciliation systems
4

5. GIGASPACES PRODUCT EVOLUTION
FROM DATA, TO APPLICATION, TO VIRTUAL DATA CENTER
PaaS
Enablement:
Application • Run & manage
Cloud multiple apps, of
End to End Enablement: any kind, on
Application • Run your XAP
private & public
Data Scaling Scaling clouds
app on private &
• Scale your • Scale your entire public clouds
application’s application:
data tier web, BL, data, m
essaging
5

6. WHAT ARE OUR CHALLENGES?
Real-Time Big Data Analytics
6

7. SPEED
7

8. SCALABILITY
8

9. SIMPLE
9

10. THE DEMO
What are the most popular
words on Twitter ?
10

11. WHAT ARE THE MOST 3 POPULAR WORDS ON TWITTER ?
Just
Found
Love
11

12. TWITTER REAL-TIME ANALYTICS ENGINE
 300 million tweets/day
 On avg - 8,000 tweets/sec
 On peak - 25,000 tweets/sec
 Scale linearly
 Elastic
 Facebook gets 100 billion hits per
day
12

13. ARCHITECTURE HOT SPOTS
CPU bottleneck
Network bottleneck
Counters contention
Database bottleneck
13

14. REAL-TIME FLOW
14

15. NO HOT SPOTS….
No CPU bottleneck
No Network bottleneck
No Counters contention
No Database bottleneck
15

16. SOLUTION FEATURES
• Light Event Processing
• Map-reduce
• Event-driven
• Execute code with data
• Transactional
• Schema-less
• Secured
• Elastic
• Asynchronous persistence to big data store
16

17. Shay Hassidim – CTO, USA Norm Leitman – Sales Engineer
shay@gigaspaces.com nleitman@gigaspaces.com
17
917-723-1415 732-672-2707