Real-Time Big Data Analytics                     Shay Hassidim, Deputy CTO                            Shay@gigaspaces.com
ABOUT MYSELF – SHAY HASSIDIM GigaSpaces US CTO More than 20 years of SW development     Java , .Net , C++ , you name it...
GIGASPACES BUSINESS CARD                                                             Healthcare          300+ Direct Custo...
CUSTOMERS SAMPLES    • Credit risk / pricing systems    • Credit card services    • Trading (equities / energy / fixed inc...
GIGASPACES PRODUCT EVOLUTION    FROM DATA, TO APPLICATION, TO VIRTUAL DATA CENTER                                         ...
WHAT ARE OUR CHALLENGES?               Real-Time Big Data Analytics6
SPEED7
SCALABILITY8
SIMPLE9
THE DEMO     What are the most popular        words on Twitter ?10
WHAT ARE THE MOST 3 POPULAR WORDS ON TWITTER ?JustFoundLove11
TWITTER REAL-TIME ANALYTICS ENGINE 300 million tweets/day On avg - 8,000 tweets/sec On peak - 25,000 tweets/sec Scale ...
ARCHITECTURE HOT SPOTS     CPU bottleneck     Network bottleneck     Counters contention     Database bottleneck13
REAL-TIME FLOW14
NO HOT SPOTS….     No CPU bottleneck     No Network bottleneck     No Counters contention     No Database bottleneck15
SOLUTION FEATURES•    Light Event Processing•    Map-reduce•    Event-driven•    Execute code with data•    Transactional•...
Shay Hassidim – CTO, USA   Norm Leitman – Sales Engineer     shay@gigaspaces.com        nleitman@gigaspaces.com17     917-...
Upcoming SlideShare
Loading in …5
×

July NY Enterprise Technology Meetup

425 views

Published on

July NY Enterprise Technology Meetup
http://www.meetup.com/ny-enterprise-tech/events/69794792/

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

July NY Enterprise Technology Meetup

  1. 1. Real-Time Big Data Analytics Shay Hassidim, Deputy CTO Shay@gigaspaces.com
  2. 2. ABOUT MYSELF – SHAY HASSIDIM GigaSpaces US CTO More than 20 years of SW development  Java , .Net , C++ , you name it… Almost 10 years with GigaSpaces  From the time we have been startup at the garage… Oversight the entire technical operations within the Americas Located in GigaSpaces NY HQ2
  3. 3. GIGASPACES BUSINESS CARD Healthcare 300+ Direct Customers 75+ Cloud Customers 40+ Fortune 500 + Organization 25+ ISVs Founded 20003
  4. 4. CUSTOMERS SAMPLES • Credit risk / pricing systems • Credit card services • Trading (equities / energy / fixed income / forex/high frequency) systems • Cloud/Virtualization Platforms • User web portal systems • Market Data systems • Reconciliation systems4
  5. 5. GIGASPACES PRODUCT EVOLUTION FROM DATA, TO APPLICATION, TO VIRTUAL DATA CENTER PaaS Enablement: Application • Run & manage Cloud multiple apps, of End to End Enablement: any kind, on Application • Run your XAP private & public Data Scaling Scaling clouds app on private & • Scale your • Scale your entire public clouds application’s application: data tier web, BL, data, m essaging5
  6. 6. WHAT ARE OUR CHALLENGES? Real-Time Big Data Analytics6
  7. 7. SPEED7
  8. 8. SCALABILITY8
  9. 9. SIMPLE9
  10. 10. THE DEMO What are the most popular words on Twitter ?10
  11. 11. WHAT ARE THE MOST 3 POPULAR WORDS ON TWITTER ?JustFoundLove11
  12. 12. TWITTER REAL-TIME ANALYTICS ENGINE 300 million tweets/day On avg - 8,000 tweets/sec On peak - 25,000 tweets/sec Scale linearly Elastic  Facebook gets 100 billion hits per day12
  13. 13. ARCHITECTURE HOT SPOTS CPU bottleneck Network bottleneck Counters contention Database bottleneck13
  14. 14. REAL-TIME FLOW14
  15. 15. NO HOT SPOTS…. No CPU bottleneck No Network bottleneck No Counters contention No Database bottleneck15
  16. 16. SOLUTION FEATURES• Light Event Processing• Map-reduce• Event-driven• Execute code with data• Transactional• Schema-less• Secured• Elastic• Asynchronous persistence to big data store16
  17. 17. Shay Hassidim – CTO, USA Norm Leitman – Sales Engineer shay@gigaspaces.com nleitman@gigaspaces.com17 917-723-1415 732-672-2707

×