IBM: The Linux Ecosystem

IBM Power8 and the Linux Ecosystem
Luca Comparini
ISV & Business Development – IBM Global Business Partners
Power Linux Leader Europe
@lucacomparini

@lucacomparini
Before we start: do you know who is this kid?
© 2014 International Business Machines Corporation 2

@lucacomparini
Before we start: do you know who said that?
“Linux is a cancer that attaches itself
in an intellectual property sense to
everything it touches (…)”

@lucacomparini
Before we start: have you seen this before?

@lucacomparini
Some history and facts on IBM & Open Source
“is getting smarter every day” (2003)
Credits to Michel Teyssedre (2006) – now CTO IBM France
IBM began participating in the community development of Linux in 1999
and Open Source, resulting in:
§ All the IBM servers support Linux operating system
§ Over 500 IBM software products run on Linux
§ A full line of implementation, support and migration services
Active participation in 150+ projects, including:
§ Eclipse, Apache Foundation, Mozilla Firefox,
OpenOffice.org, Samba, PHP…
§ Apache Hadoop, Apache UIMA, KVM,
Openstack, Cloudfoundry…
“$1 billion commitment” on Linux and Open
Source technologies (2001, 2013)
IBM Linux Technology Centers in Bejing,
Austin, New York, Montpellier, Tokyo

@lucacomparini
Open Source Trend
Diffusion and interest
2M projects by 2014;; x2 in last 2y.
140% increase in interest
purchasing open source software
57% of companies using open
source will collaborate with
competitors.
41% of people plan to deploy open
source solution in 1-2 years.
* “free is free only if your time has no value”
Business dimension
OpenSource Venture investments:
+80% between 2011 and 2012
OpenSource means free*?
~2B$ in open source sales in 2013
http://blog.gogrid.com/2014/04/08/2014-year-open-source/

@lucacomparini
Linux trend
476 of the Top 500 supercomputers run Linux (2013)
Four of the Top 10 supercomputers run on Power Systems. (2014)
Linux for Mission-Critical Workloads (2013)
http://www.linuxfoundati on.org/infographics/2013-enterprise-end-user-report

@lucacomparini
Power paradigm:
same technology excellence for scale-up and scale-out systems
Design point is “purposeful”:
Enterprise / Mission-Critical workloads
(OLTP, ERP, SAP, Big Data, Analytics…)
Design Goals: “consolidate”
Consistency, Availability, Reliability, Security
Extreme performance (throughput per core)
>> Less Operational & Licenses Costs
Design point:
General Purpose, Cloud, Computing Grids
Design Goals: “distribute”
TCA, Standardization (at cost of under-utilization)
Performance (throughput per node)
>> Affordable acquisition costs, scale is incremental
Systems of Record
Structured data from operational systems
20% of all data generated
Systems of Engagement
Data that “connects” companies with their
customers, partners and employees
80% of all data generated
Power technology fuels:
100% of the top10 Banks & Telcos
80% of the top 10 Insurers & Retailers

@lucacomparini
Power8 is designed for data: dynamic SMT
Intel HyperThreading: 2 x Threads per Core
Power Simultaneous Multi-Threading: 1 / 2 / 4 / 8 x Threads per Core
+ 1.6 times single thread performance of Power7+

@lucacomparini
Power8 is designed for data: memory bandwidth
Power8: 230GB/s sustained memory bandwidth
96 MB L3 cache, 128 MB L4 cache

@lucacomparini
Unusual transport
unfortunately, moving data is a different story

@lucacomparini
Power8 vs Intel comparison (for geeks)
*Intel calls this Hyper-Threading Technology
*32KB running in Non-RAS mode, Only 16KB in RAS mode
Sandy Bridge
EP E5-26xx
Ivy Bridge EP
E5-26xx v2
Haswell EP
E5-26xx v3
Ivy Bridge EX
E7-88xx v2
POWER 7+ POWER8
Clock rates 1.8–3.6GHz 1.7-3.7GHz 1.7-3.7GHz 1.9-3.4 GHz 3.1-4.4 GHz 3.0-4.15 GHz
SMT options 1,2* 1, 2* 1, 2* 1, 2* 1, 2, 4 1, 2, 4, 8
Cores per socket 8 12 18 15 8 12
Max Threads / socket 16 24 36 30 32 96
Max L1 Cache 32KB 32KB* 32KB* 32KB* 32KB 64KB
Max L2 Cache 256 KB 256 KB 256 KB 256 KB 256 KB 512 KB
Max L3 Cache 20 MB 30 MB 45 MB 37.5 MB 80 MB 96 MB
Max L4 Cache 0 0 0 0 0 128 MB
Memory Bandwidth 31.4-51.2 GB/s 42.6-59.7 GB/s 51.2-68.3 GB/s 68-85 GB/s
100 – 180
GB/sec
190-230 GB/sec

@lucacomparini
Performance comparisons
Java – SPECjbb2013 (Max-jOPS)
4.1x Performance
ERP – SAP 2-Tier (Users)
2.4x Performance
SPECint_rate2006
2.0x Performance
SPECfp_rate2006
2.2x Performance
• Results are based on best published per core results on Xeon E7-8890 processor.
• SAP results are based on the two-tier SAP SD standard application benchmark running SAP enhancementpackage 5 for the SAP ERP 6.0 application. Results valid as of October 3, 2014.IBM Power Enterprise System E870 on
the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 80 cores / 640 threads, POWER8; 4.19GHz, 2048 GB memory, 79,750 SD benchmark
users running AIX® 7.1 and DB2® 10.5, Certification #: 2014034 Result valid as of October 3, 2014.Source: http://www.sap.com/benchmark. IBM System x3950 X6 on the two-tier SAP SD standard application benchmark
running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors/ 120 cores/ 240 threads, Intel Xeon Processor 8890 v2;2.80 GHz, 1024 GB memory; 49,000 SD benchmark users, running Windows Server
2012 Standard Edition and DB2 10; Certification # 2014024.Source: http://www.sap.com/benchmark .
• SPECjbb2013 results are valid as of 10/2/2014. For more information go to http://www.specbench.org/jbb2013/results/ All IBM benchmark results will be submitted to spec.org on October 15,2014.
• SPECcpu2006 results are submitted as of 10/2/2014. For more information go to http://www.specbench.org/cpu2006/results/ All IBM benchmark results will be submitted to spec.org on October 6, 2014.
Intel Xeon E7-8890 v2
IBM x3950 X6
Win 2012 / DB2
8s/120c/240t
POWER8
IBM E870
8s/80c/640t
HP Converged System
8s/120c/240t
POWER8
IBM E870
AIX / DB2
8s/80c/640t
POWER8
IBM E870
8s/80c/640t
Fujitsu PRIMEQUEST2800E
8s/120c/240t
POWER8
IBM E870
8s/80c/640t
Huawei RH8100 V3
8s/120c/240t
0
200
400
600
800
1000
1200
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
0
10
20
30
40
50
60
70
80
90
0
10
20
30
40
50
60
70

@lucacomparini
The rise of
Performance
of leading POWER architecture
Broadens the capability and
performance of POWER
Open Development
OpenPOWER enables greater
innovation through open software
and open hardware
Collaboration
across multiple thought leaders
Collaborative development model
drives collective thought leadership,
across multiple disciplines
- Members can build custom servers
(custom-tuned for specific applications)
- Members can provide feedback to the ecosystem,
influencing future developments
Context: Growing trend among datacenter operators
who design their own hardware, instead of buying
August 2013 (announced OpenPower)
1. Create ecosystem
2. Make POWER IP licensable to members
3. Open POWER Firmware to members
- Innovation injected into the community
- Innovation available for POWER customers
&

@lucacomparini
April 2014: Open Standard introduced on
Native PCI-Express 3.0 Support
- replacing proprietary GX/Bridge
Transport Layer for CAPI protocol
- Coherently Attach Devices connect to
processor via PCIe
- Protocol encapsulated in PCIe
FPGA and GPU accelerators
Bi-Endian platform
Support for PowerKVM Hypervisor
OpenPOWER Foundation Chairman Gordon MacKean
displayed an early system design architecture that Google,
through its leadership in OpenPOWER, is investigating as
an alternative for large scale data centers with massive data
requirements
At the same time

@lucacomparini
Coherently Attached Protocol Interface (CAPI)… so what?
For each I/O: 40X Fewer Instructions with CAPI
500 vs. 20,000 instructions
With CAPI, an accelerator based on GPUs, DSPs, or FPGAs that
resides on a PCI card can link into the Power8 processor and
memory complex and look like what is in effect a “hollow core”
that has the same access to the memory hierarchy as the
actual Power8 cores. What this means is that these
accelerators do not have to move data back and forth between
the CPU and the accelerator;; both devices address the same
memory space.
http://www.enterprisetech.com/2014/10/02/ibm-accelerates-pow er8-clusters-gpus-fpgas-flash/
IBM Confidential

@lucacomparini
Coherently Attached Protocol Interface (CAPI)… so what?
IBM Confidential
Identical hardware with 2 different paths to data
http://techstacks.io/tech/redis
24:1 consolidation
12x less energy
6x less space
3x lower price
40TB Power vs 24TB Intel
infrastructure consolidation savings vs. Intel Xeon for in-memory data

@lucacomparini
FPGA and GPU… so what?
NVIDIA acceleration built into IBM Power S824L
8x faster than x86 Ivy Bridge on pattern extraction
82x faster for Cognos BI and DB2 BLU
Altera FPGA acceleration and IBM CAPI
Monte Carlo 250x faster than POWER8 core
alone, reduced C code 40x over non-CAPI FPGA
CAPI dev kit with FPGA card from Nallatech
US Dept of Energy $325M super computing
contract awarded to IBM, Mellanox, and NVIDIA
DoE systems for science and
stockpile stewardship
Sierra and Summit systems to be
>100 PF, 2 GB/core main memory,
local NVRAM, and science
performance 4x-8x Titan or Sequoia

@lucacomparini
FPGA and GPU… so what?
Performance
of java.util.Arrays#sort(int[]) on
NVIDIA Tesla K40 GPU (ECC
enabled) and IBM Power8 CPU.
Up to 48x performance improvement

@lucacomparini
PowerKVM… so what?

@lucacomparini
PowerKVM… so what?
OVH was founded in 1999
#1 Internet Hosting in Europe (#3 WW)
17 Data Centers (1st biggestWW)
180.000 Physical Servers
700.000 Customers WW

@lucacomparini
Founded in 1998
Founder of OpenStack
9 datacenters
#1 hosting for Internet Retailers
#1 hosting OpenStack private cloud
Aaron Sullivan (Director Infrastructure Strategy)
shows off Rackspace POWER8 OpenCompute
Form Factor Planar
Cloud Ecosystem
Founded in 1999
#1 Internet Hosting in Europe (#3 WW)
17 Data Centers (1st biggestWW)
180.000 Physical Servers
https://cloud.runabove.com/signup/?launch=power8

@lucacomparini
Cloud Ecosystem
Coming soon: POWER8 Bare Metal as a Service
3 Fixed Configurations + SDD, deployed < 30 mins
Suitable for:
§ Big data & Analytics for optimal cost/performance
§ Optimized e-commerce & contentmanagement
§ Hybrid Cloud & Bluemix integration
§ Cloud service provider & database services
TYAN TN71-BP012 Collaborator: Tyan, Mellanox
With planned availability second quarter 2015, the TYAN
TN71-BP012 servers are designed for large scale cloud
deployments and follow Tyan’s highly successful
OpenPOWER customer reference system introduced in
October 2014. IBM will be among the first to deploy the new
servers as part of its SoftLayer infrastructure, utilizing them
for a new bare metal service offering.

@lucacomparini
So what? The Linux on Power8 ecosystem at a glance
New. DB2 with BLU
Acceleration
Update: SAP HANA
Ramp-Up program
New. SoftLayer – POWER-based Bare
Metal offerings
New. Rackspace joins the
OpenPOWER Foundation
Superior Cloud
Economics
New. Docker for
Power Systems
Update: OpenStack
HEAT and Chef
Server for Power
New. Bluemix with Power for
SOE/SOR integration
113 members
New. Red Hat in LE
mode, RHEV
New. Veristorm
open source
Hadoop offering
Cloud Open Innovation Big Data & Analytics
Cognos BI already
available (BE);; BI and
TM1 coming (LE)
SPSS Modeler and
Analytics coming (LE)
BPM Advanced 8.5.5
Business Monitor 8.5.5
WebSphere Application
Server 8.5.5.3
WebSphere Extreme
Scale 8.6.0.6
Caching
WebSphere MQ 8.0.0.1
WebSphere MQ MFT Ed 7
Reliable Messaging
IBM MobileFirst
Platform Foundation 6.3Middleware
IBM Hadoop solutions:
BigInsights and
Veristorm
OpenSource focus

@lucacomparini

@lucacomparini
Open Source Ecosystem: Relational Databases
https://www-
304.ibm.com/partnerworld/wps/servlet/download/D ownloadServlet?id=LQPehnUMv8ei PCA$cnt&
attachmentName=ibm_power_systems_solution_for_postgr esql.pdf
https://www.flamingspork.com/blog/2014/06/03/1-million-sql-queries-per-second-mysql-5-7-on-power8/

@lucacomparini
Open Source Ecosystem: Turbo LAMP

@lucacomparini
Magento benchmark on IBM TurboLAMP
Independent testing has shown that Magento Enterprise Edition
demonstrates a substantial 2.5-3x performance improvement on the
POWER8 architecture with its ability to process up to 8 multiple
parallel threads per core versus similar priced Intel architectures on
the IBM Turbo LAMP stack. Magento serves more than 240,000
retailers worldwide, and enables retailers and brands to create
customized, innovative, commerce experiences to accelerate their
growth.
Craig Hayman , President - eBay Enterprise Business
TCA = $19,885
$3.98 /user/hour
TCA = $45,100
$1.88 /user/hour
4x Dell servers (Sandy Bridge)
Open Source LAMP, bare metal
PHP Server, MySQL, CentOS
Magento Benchmark Test (JMeter driven)
A test is considered “successful” if 90% of the user interactions (page load)
complete in less than 2 seconds
For a given Users Per Hour Load, simulated User Roles:
- 30% browse the catalog
- 62% view products and add them to the shopping cart but abandon it
- 4% checkout as guest
- 4 % checkout as a named user

@lucacomparini
The IBM Linux Commercial from 2003.
https://www.youtube.com/watch?v=x7ozaFbqg00

IBM: The Linux Ecosystem

More Related Content

What's hot

Similar to IBM: The Linux Ecosystem

More from Kangaroot

Recently uploaded

IBM: The Linux Ecosystem