Your SlideShare is downloading. ×
0
ACCELERATING BIG DATA: IOMEMORY, CISCO UCS AND NOSQLAshok Joshi, Senior Director – Oracle NoSQL development, OracleSumeet ...
AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business  perspective▸ NoSQL ...
VOLUME, VELOCITY, VARIETY, VALUEBig Data characteristics▸ Terabytes, Petabytes▸ Multiple sources for data▸ Text, images, X...
WHO USES BIG DATA?Web Services                Big Energy                                 Telco• Clickstream Analysis      ...
BIG DATA BUSINESS BENEFITS                                                           GLOBAL PERSONAL    EUROPE PUBLICUS HE...
AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business  perspective▸ NoSQL ...
NOSQL DATABASE ARCHITECTUREHighlights                                               Application      Application▸ Availabl...
AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business  perspective▸ NoSQL ...
NOSQL DB AND CISCO UCS COLLABORATIONWHY DOES IT MATTER▸ Many components: network, processors, memory,  software, storage –...
NOSQL DB AND FUSION-IO COLLABORATIONWHY DOES IT MATTER▸ Speed (latency) is critical  • Amazon study:    Every 100 millisec...
ORACLE NOSQL DB, CISCO UCS, FUSION-IO▸ Commercial grade solution and support▸ Tested, tuned, optimized for real-time data ...
AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business  perspective▸ NoSQL ...
SYSTEM UNDER TEST▸ YCSB (Yahoo! Cloud  Serving Benchmark)  • 10 client machines    generate load  • Mixed workload    (5% ...
CONFIGURATION DETAILS                             Client machine (YCSB driver)                                            ...
PERFORMANCE TEST RESULTS Number of shards                2                       4      8           10 Mixed workload (95 ...
PUTTING PERFORMANCE IN CONTEXTHighlights▸ For Example, Twitter: ~150K  API calls/sec▸ We can achieve that  performance on ...
AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business  perspective▸ NoSQL ...
CUT-THROUGH ARCHITECTURE AND VSLFOR EXTREME THROUGHPUT AND LOW LATENCY▸ Sophisticated architecture     Host  • maximum per...
SOFTWARE DEVELOPMENT KIT ADVANTAGESFOR GREATER PERFORMANCE OPTIMIZATION   APPLICAT ION   Application source code          ...
TYPES OF IOMEMORYFor Cisco UCS B-Series Blade Servers   For Cisco UCS C-Series Rack Servers                               ...
BIG DATA ANALYTICS - HADOOP                         October 1, 2012   21
COMPLETE BIG DATA SOLUTION▸ Right Partners – Cisco and Fusion-io▸ Multiple technologies for a comprehensive big data  solu...
T H AN K Y O U
Upcoming SlideShare
Loading in...5
×

Accelerating big data with ioMemory and Cisco UCS and NOSQL

1,043

Published on

When great companies work together, an even greater outcome is possible. I am presenting this at the Oracle Open World 2012 at the Cisco theatre. Could one possibly support a twitter-like workload with just one server and few iodrives? Its all here.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,043
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
28
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Accelerating big data with ioMemory and Cisco UCS and NOSQL"

  1. 1. ACCELERATING BIG DATA: IOMEMORY, CISCO UCS AND NOSQLAshok Joshi, Senior Director – Oracle NoSQL development, OracleSumeet Bansal, Principal Solutions Architect, Fusion-io
  2. 2. AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business perspective▸ NoSQL testing with YCSB▸ The Fusion-io value October 1, 2012 2
  3. 3. VOLUME, VELOCITY, VARIETY, VALUEBig Data characteristics▸ Terabytes, Petabytes▸ Multiple sources for data▸ Text, images, XML, JSON, sensor readings…▸ Not “master” data, but important for business▸ “Real-time” needs October 1, 2012 3
  4. 4. WHO USES BIG DATA?Web Services Big Energy Telco• Clickstream Analysis • Granular rate plans • Churn reduction• Abuse Prevention • Grid management • Network optimizationStorage Financial Services Government• Cost efficient • Customer loyalty • Regulatory compliance• Analytics-ready • Risk • Environmental monitoring• Data Store • Trading • Cyber security• Scalable • Fraud• Distributed • Compliance • Credit scoringLarge-scale, E-commerce• Recommendation engines• Cross-channel analytics• Golden path to purchase October 1, 2012 4
  5. 5. BIG DATA BUSINESS BENEFITS GLOBAL PERSONAL EUROPE PUBLICUS HEALTH CARE US RETAIL MANUFACTURING LOCATION DATA SECTOR ADMIN$300 B 60+% -50% $100 B €250 BIncrease industry Increase net Decrease dev., Increase service Increase industryvalue per year margin assembly costs provider revenue value per year “In a big data world, a competitor that fails to sufficiently develop its capabilities will be left behind.” October 1, 2012 5
  6. 6. AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business perspective▸ NoSQL testing with YCSB▸ The Fusion-io value October 1, 2012 6
  7. 7. NOSQL DATABASE ARCHITECTUREHighlights Application Application▸ Available; scalable; fast NoSQL Database NoSQL Database NoSQL Database▸ Simple administration, key- Driver Driver Driver value data model; transaction support▸ Transparent load balancing; elastic▸ Commercial grade software and support▸ Integrated with related Oracle technologies Storage Nodes Storage Nodes October 1, 2012 7
  8. 8. AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business perspective▸ NoSQL testing with YCSB▸ The Fusion-io value October 1, 2012 8
  9. 9. NOSQL DB AND CISCO UCS COLLABORATIONWHY DOES IT MATTER▸ Many components: network, processors, memory, software, storage – tested, tuned and optimized▸ Business can focus on core competency and leveraging benefits of big data October 1, 2012 9
  10. 10. NOSQL DB AND FUSION-IO COLLABORATIONWHY DOES IT MATTER▸ Speed (latency) is critical • Amazon study: Every 100 millisecond increase in latency costs 1% in sales http://highscalability.com/latency-everywhere-and-it-costs-you-sales-how-crush-it▸ ioMemory enables consistent, extremely low latency and extreme throughput October 1, 2012 10
  11. 11. ORACLE NOSQL DB, CISCO UCS, FUSION-IO▸ Commercial grade solution and support▸ Tested, tuned, optimized for real-time data management▸ For equivalent performance, much lower CapEx and OpEx compared to commodity (DIY) solutions October 1, 2012 11
  12. 12. AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business perspective▸ NoSQL testing with YCSB▸ The Fusion-io value October 1, 2012 12
  13. 13. SYSTEM UNDER TEST▸ YCSB (Yahoo! Cloud Serving Benchmark) • 10 client machines generate load • Mixed workload (5% updates/95% reads)▸ 15 UCS C240 M3 Rack Servers▸ 30 Fusion’s ioDrive2▸ 2TB of data October 1, 2012 13
  14. 14. CONFIGURATION DETAILS Client machine (YCSB driver) UCS 240 M3 server 1 2 1 2 1 2 NoSQL Database on ioDrive2Note: only two shards are shown in the illustration October 1, 2012 14
  15. 15. PERFORMANCE TEST RESULTS Number of shards 2 4 8 10 Mixed workload (95 read/5 302,152 558,569 1,028,868 1,244,550 write) throughput (ops/sec) Read latency (milliseconds) 0.76 0.79 0.85 0.88 Mixed workload update 3.08 3.82 4.29 4.47 latency (milliseconds) October 1, 2012 15
  16. 16. PUTTING PERFORMANCE IN CONTEXTHighlights▸ For Example, Twitter: ~150K API calls/sec▸ We can achieve that performance on a single UCS c240 server using two ioDrive2s▸ Plenty of capacity to handle fluctuating demand without compromising performancehttp://blog.programmableweb.com/2011/05/25/who-belongs-to-the-api-billionaires-club/ October 1, 2012 16
  17. 17. AGENDA▸ Big Data overview▸ Oracle NoSQL Database overview▸ Real-time big data management – a business perspective▸ NoSQL testing with YCSB▸ The Fusion-io value October 1, 2012 17
  18. 18. CUT-THROUGH ARCHITECTURE AND VSLFOR EXTREME THROUGHPUT AND LOW LATENCY▸ Sophisticated architecture Host • maximum performance Virtualization ioMemory DRAM / Tables Memory / CPU and cores Operating System and▸ Intelligent software Application Memory • advanced features Virtual Storage Layer T RANSFERS (VSL) DAT A Commands PCIe Applications/Databases ioDrive ioMemory File System Data-Path Controller Kernel Banks Virtual Storage Layer (VSL) Channels Wide ioMemory October 1, 2012 18
  19. 19. SOFTWARE DEVELOPMENT KIT ADVANTAGESFOR GREATER PERFORMANCE OPTIMIZATION APPLICAT ION Application source code Conventional access Direct access I/O Memory access Transactional Native Key-Value Auto-Commit Logging Block File Pair Memory™ Simple Network Simple Block File BlockProprietary Storage OS Native Flash Translation Layer Storage Media Storage MediaTraditional Storage Software Defined Storage October 1, 2012 19
  20. 20. TYPES OF IOMEMORYFor Cisco UCS B-Series Blade Servers For Cisco UCS C-Series Rack Servers 365 GB, 785 GB, 1.2 TB Mezzanine Card 365 GB, 785 GB 2.4 TB October 1, 2012 20
  21. 21. BIG DATA ANALYTICS - HADOOP October 1, 2012 21
  22. 22. COMPLETE BIG DATA SOLUTION▸ Right Partners – Cisco and Fusion-io▸ Multiple technologies for a comprehensive big data solution – NoSQL, map-reduce, relational▸ Tested, integrated, optimized, commercially supported solution delivered by leaders▸ Cost-effective, reliable, ready for the enterprise October 1, 2012 22
  23. 23. T H AN K Y O U
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×