InfiniBand cabling
Oracle exaData & Exalitics




Johan Louwers
Oracle exaData

 The Exadata Database Machine X2-8 is designed for database
 deployments that require very large amounts of data, delivering
 extreme performance and scalability for all applications including
 Online Transaction Processing (OLTP), Data Warehousing (DW) and
 consolidation of mixed workloads. It comes complete with two 8-
 socket database servers, 14 Oracle Exadata Storage Servers,
 InfiniBand switches and more than 5 terabytes of Exadata Smart
 Flash Cache to support extremely fast transaction response times
 and high throughput.




                                                                                              Presentation Title | Date

                                                                      Copyright © Capgemini 2012. All Rights Reserved     2
Oracle exaLytics

 The Oracle Exalytics In-Memory Machine is the industry‟s first engineered in
 memory analytics machine that delivers no-limit, extreme performance for
 Business Intelligence and Enterprise Performance Management applications.


 The Oracle Exalytics In-Memory Machine hardware is a single server that is
 optimally configured for in-memory analytics for business intelligence workloads
 and includes powerful compute capacity, abundant memory, and fast networking
 options.


 The Oracle Exalytics In-Memory Machine features an optimized Oracle BI
 Foundation suite (Oracle BI Foundation) and Oracle TimesTen In-Memory
 Database for Exalytics.


 Business Intelligence Foundation takes advantage of large memory, processors,
 concurrency, storage, networking, operating system, kernel, and system
 configuration of the Oracle Exalytics hardware. This optimization results in better
 query responsiveness, higher user scalability and markedly lower TCO compared
 to standalone software. The TimesTen In-Memory Database for Exalytics is an
 optimized in-memory analytic database, with features exclusively available on
 Oracle Exalytics platform.




                                                                                                               Presentation Title | Date

                                                                                       Copyright © Capgemini 2012. All Rights Reserved     3
InfiniBand

 InfiniBand is a switched fabric communications link used in high-performance
 computing and enterprise data centers. Its features include high throughput,
 low latency, quality of service and failover, and it is designed to be scalable.
 The InfiniBand architecture specification defines a connection between
 processor nodes and high performance I/O nodes such as storage devices.
 Infiniband host bus adapters and network switches are manufactured by
 Mellanox and Intel
                                                                 Source: wikipedia




                                                                                     Source : http://www.hpcwire.com

                                                                                                               Presentation Title | Date

                                                                                       Copyright © Capgemini 2012. All Rights Reserved     4
Oracle exaData full rack InfiniBand cabling

                                                   Spine switch


  8 Database servers                                                                       8 Database servers




                              Leaf switch 1                          Leaf switch 2




                                              7 inter-switch links
           14 storage cells                                                          14 storage cells




                                                                                                                 Presentation Title | Date

                                                                                         Copyright © Capgemini 2012. All Rights Reserved     5
Oracle exaData full rack InfiniBand cabling

Sun Datacenter InfiniBand Switch 36




                                     Leaf switches




                                     Spine switch



                                                                             Presentation Title | Date

                                                     Copyright © Capgemini 2012. All Rights Reserved     6
Oracle exaData InfiniBand connect to Exalytics

                                                   Spine switch


  8 Database servers                                                                       8 Database servers




                              Leaf switch 1                          Leaf switch 2




                                              7 inter-switch links
           14 storage cells                                                          14 storage cells




                                                    Exalytics



                                                                                                                 Presentation Title | Date

                                                                                         Copyright © Capgemini 2012. All Rights Reserved     7
Oracle exaData InfiniBand connect to Exalytics

 For high availability purposes,
 connect the two ports of the
 InfiniBand card, which is installed
 in the Oracle Oracle Exalytics In-
 Memory Machine, to separate leaf
 switches of the Oracle Exadata
 Database Machine.




                                                               Presentation Title | Date

                                       Copyright © Capgemini 2012. All Rights Reserved     8
Contact information



           Johan Louwers - Oracle                 Capgemini Expert on:   Contact me:
           and Cloud Computing
                                                  • Cloud Computing            Johan.Louwers@capgemini.com
           I am spearheading innovation within    • Oracle
           the Capgemini Group by developing                                   @johanlouwers
           the ‘Capgemini Oracle Run’ hosting
           and computing cloud and ensuring our                                http://johanlouwers.blogspot.com
           clients have a completely managed
           enterprise IT environment.                                          http://www.capgemini.com/experts/
                                                                               oracle-and-cloud-computing/johan-
                                                                               louwers




                                                                                                   Presentation Title | Date

                                                                           Copyright © Capgemini 2012. All Rights Reserved     9
About Capgemini
With more than 120,000 people in 40 countries, Capgemini is one
of the world's foremost providers of consulting, technology and
outsourcing services. The Group reported 2011 global revenues
of EUR 9.7 billion.
Together with its clients, Capgemini creates and delivers
business and technology solutions that fit their needs and drive
the results they want. A deeply multicultural organization,
Capgemini has developed its own way of working, the
Collaborative Business ExperienceTM, and draws on Rightshore ®,
its worldwide delivery model.

Rightshore® is a trademark belonging to Capgemini
                                                                   www.capgemini.com

                                                                    The information contained in this presentation is proprietary.
                                                                                        © 2012 Capgemini. All rights reserved.

Oracle infiniband cabling for Oracle appliances

  • 1.
    InfiniBand cabling Oracle exaData& Exalitics Johan Louwers
  • 2.
    Oracle exaData TheExadata Database Machine X2-8 is designed for database deployments that require very large amounts of data, delivering extreme performance and scalability for all applications including Online Transaction Processing (OLTP), Data Warehousing (DW) and consolidation of mixed workloads. It comes complete with two 8- socket database servers, 14 Oracle Exadata Storage Servers, InfiniBand switches and more than 5 terabytes of Exadata Smart Flash Cache to support extremely fast transaction response times and high throughput. Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 2
  • 3.
    Oracle exaLytics TheOracle Exalytics In-Memory Machine is the industry‟s first engineered in memory analytics machine that delivers no-limit, extreme performance for Business Intelligence and Enterprise Performance Management applications. The Oracle Exalytics In-Memory Machine hardware is a single server that is optimally configured for in-memory analytics for business intelligence workloads and includes powerful compute capacity, abundant memory, and fast networking options. The Oracle Exalytics In-Memory Machine features an optimized Oracle BI Foundation suite (Oracle BI Foundation) and Oracle TimesTen In-Memory Database for Exalytics. Business Intelligence Foundation takes advantage of large memory, processors, concurrency, storage, networking, operating system, kernel, and system configuration of the Oracle Exalytics hardware. This optimization results in better query responsiveness, higher user scalability and markedly lower TCO compared to standalone software. The TimesTen In-Memory Database for Exalytics is an optimized in-memory analytic database, with features exclusively available on Oracle Exalytics platform. Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 3
  • 4.
    InfiniBand InfiniBand isa switched fabric communications link used in high-performance computing and enterprise data centers. Its features include high throughput, low latency, quality of service and failover, and it is designed to be scalable. The InfiniBand architecture specification defines a connection between processor nodes and high performance I/O nodes such as storage devices. Infiniband host bus adapters and network switches are manufactured by Mellanox and Intel Source: wikipedia Source : http://www.hpcwire.com Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 4
  • 5.
    Oracle exaData fullrack InfiniBand cabling Spine switch 8 Database servers 8 Database servers Leaf switch 1 Leaf switch 2 7 inter-switch links 14 storage cells 14 storage cells Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 5
  • 6.
    Oracle exaData fullrack InfiniBand cabling Sun Datacenter InfiniBand Switch 36 Leaf switches Spine switch Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 6
  • 7.
    Oracle exaData InfiniBandconnect to Exalytics Spine switch 8 Database servers 8 Database servers Leaf switch 1 Leaf switch 2 7 inter-switch links 14 storage cells 14 storage cells Exalytics Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 7
  • 8.
    Oracle exaData InfiniBandconnect to Exalytics For high availability purposes, connect the two ports of the InfiniBand card, which is installed in the Oracle Oracle Exalytics In- Memory Machine, to separate leaf switches of the Oracle Exadata Database Machine. Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 8
  • 9.
    Contact information Johan Louwers - Oracle Capgemini Expert on: Contact me: and Cloud Computing • Cloud Computing Johan.Louwers@capgemini.com I am spearheading innovation within • Oracle the Capgemini Group by developing @johanlouwers the ‘Capgemini Oracle Run’ hosting and computing cloud and ensuring our http://johanlouwers.blogspot.com clients have a completely managed enterprise IT environment. http://www.capgemini.com/experts/ oracle-and-cloud-computing/johan- louwers Presentation Title | Date Copyright © Capgemini 2012. All Rights Reserved 9
  • 10.
    About Capgemini With morethan 120,000 people in 40 countries, Capgemini is one of the world's foremost providers of consulting, technology and outsourcing services. The Group reported 2011 global revenues of EUR 9.7 billion. Together with its clients, Capgemini creates and delivers business and technology solutions that fit their needs and drive the results they want. A deeply multicultural organization, Capgemini has developed its own way of working, the Collaborative Business ExperienceTM, and draws on Rightshore ®, its worldwide delivery model. Rightshore® is a trademark belonging to Capgemini www.capgemini.com The information contained in this presentation is proprietary. © 2012 Capgemini. All rights reserved.