Industry standard benchmarks have played a crucial role in advancing the computing industry by enabling healthy competition that drives product improvements and new technologies. Major benchmarking organizations like TPC, SPEC, and SPC have developed numerous benchmarks over time to keep up with industry needs. Looking ahead, new benchmarks are needed to address emerging technologies like cloud, big data, and the internet of things. International conferences and workshops bring together experts to collaborate on developing these new, relevant benchmarks.
Task allocation on many core-multi processor distributed systemDeepak Shankar
Migration of software from a single to multi-core, single to multi-thread, and integrated into a distributed system requires a knowledge of the system and scheduling algorithms. The system consists of a combination of hardware, RTOS, network, and traffic profiles. Of the 100+ popular scheduling algorithms, the majority use First Come-First Server with priority and preemption, Weight Round Robin, and Slot-based. The task allocation must take into consideration a number of factors including the hardware configuration, the RTOS scheduling, task dependency, parallel partitioning, shared resources, and memory access. Additionally, embedded system architectures always have the possibility of using custom hardware to implement tasks that may be associated with Artificial Intelligence, diagnostic or image processing.
In this Webinar, we will show you how to conduct trade-offs using a system model of the tasks and the target resources. You will learn to make decisions based on the hardware and network statistics. The statistics will assist in identifying deadlocks, bottlenecks, possible failures and hardware requirements. To estimate the best task allocation and partitioning, a discrete-event simulation with both time- and quantity-shared resource modeling is essential. The software must be defined as a UML or a task graph.
Web: www.mirabilisdesign.com
Webinar Youtube Link: https://youtu.be/ZrV39SYTWSc
Zero downtime upgrate for dcs migration Thermo SystemsBrian Thomas
Review and discuss DCS replacement in a 24/7 Critical District Energy Facility. Pepco Energy Services (customer) partnered with Thermo Systems, a Rockwell Automation Solution Partner, to design, build, deploy and commission a turnkey replacement of its aging DCS system serving the district energy system in Midtown Atlantic City. The successful migration included zero customer downtime, ease of service, increased operational efficiency, billing accuracy, and expansion possibilities moving forward.
Task allocation on many core-multi processor distributed systemDeepak Shankar
Migration of software from a single to multi-core, single to multi-thread, and integrated into a distributed system requires a knowledge of the system and scheduling algorithms. The system consists of a combination of hardware, RTOS, network, and traffic profiles. Of the 100+ popular scheduling algorithms, the majority use First Come-First Server with priority and preemption, Weight Round Robin, and Slot-based. The task allocation must take into consideration a number of factors including the hardware configuration, the RTOS scheduling, task dependency, parallel partitioning, shared resources, and memory access. Additionally, embedded system architectures always have the possibility of using custom hardware to implement tasks that may be associated with Artificial Intelligence, diagnostic or image processing.
In this Webinar, we will show you how to conduct trade-offs using a system model of the tasks and the target resources. You will learn to make decisions based on the hardware and network statistics. The statistics will assist in identifying deadlocks, bottlenecks, possible failures and hardware requirements. To estimate the best task allocation and partitioning, a discrete-event simulation with both time- and quantity-shared resource modeling is essential. The software must be defined as a UML or a task graph.
Web: www.mirabilisdesign.com
Webinar Youtube Link: https://youtu.be/ZrV39SYTWSc
Zero downtime upgrate for dcs migration Thermo SystemsBrian Thomas
Review and discuss DCS replacement in a 24/7 Critical District Energy Facility. Pepco Energy Services (customer) partnered with Thermo Systems, a Rockwell Automation Solution Partner, to design, build, deploy and commission a turnkey replacement of its aging DCS system serving the district energy system in Midtown Atlantic City. The successful migration included zero customer downtime, ease of service, increased operational efficiency, billing accuracy, and expansion possibilities moving forward.
Storage Networking Solutions for High Performance Databases by QLogicJone Smith
QLogic storage networking solutions, designed for high I/O throughput performance and fine grain QoS with dynamic bandwidth provisioning is well suited for data warehouse deployments.
Efficient Data Center Virtualization with QLogic 10GbE Solutions from HPJone Smith
QLogic 10GbE network solutions from HP delivers significant operational savings, high performance, reduced management complexity and improved scalability for virtualized data center deployments.
A Dynamic Programming Approach to Energy-Efficient Scheduling on Multi-FPGA b...TELKOMNIKA JOURNAL
This paper has been studied an important issue of energy-efficient scheduling on multi-FPGA systems. The main challenges are integral allocation, reconfiguration overhead and exclusiveness and energy minimization with deadline constraint. To tackle these challenges, based on the theory of dynamic programming, we have designed and implemented an energy-efficient scheduling on multi-FPGA systems. Differently, we have presented a MLPF algorithm for task placement on FPGAs. Finally, the experimental results have demonstrated that the proposed algorithm can successfully accommodate all tasks without violation of the deadline constraint. Additionally, it gains higher energy reduction 13.3% and 26.3% than that of Particle Swarm Optimization and fully balanced algorithm, respectively.
The Oil and Natural Gas Value Chain; PETROLEUM INDUSTRY STRUCTURE; THE AMERICAN PETROLEUM INSTITUTE CLASSIFICATION OF THE PETROLEUM INDUSTRY; UPSTREAM OIL AND GAS SECTOR; Business Cycle of Upstream; Components of the Upstream Sector; Upstream Oil Company Targets; MIDSTREAM SECTOR; DOWNSTREAM PROCESS AND SECTOR; Distribution of Refined Products; PETROLEUM REFINING; Distillation of Crude Oil; PETROLEUM COMPANIES TYPES; International Oil Companies (IOCs); Nation Oil Companies (NOCs); Operator Companies (or Exploration and Production (E &P) Companies); Types of exploration and production companies; Service Petroleum Companies; Types of service companies; MAIN PETROLEUM COMPANIES PARTICIPANTS IN THE INTERNATIONAL OIL MARKET; SEVEN SISTERS (or ANGLO-SAXON) ; Composition and history; New Seven Sisters
These slides are developed for a part of the undergraduate course in Petroleum Refinery Engineering. The slides are also helpful for Masters level introductory course.
Professional PowerPoint template for oil and gas presentations.
This is a fully customizable template with individual graphic elements and images. You are free to adjust cover, divider, and content slider header layouts.
Download at: http://www.powerpointteam.com/oil-industry-powerpoint-template.html
Available in standard and widescreen format.
Your comments will be highly appreciated. Thank you!
Storage Networking Solutions for High Performance Databases by QLogicJone Smith
QLogic storage networking solutions, designed for high I/O throughput performance and fine grain QoS with dynamic bandwidth provisioning is well suited for data warehouse deployments.
Efficient Data Center Virtualization with QLogic 10GbE Solutions from HPJone Smith
QLogic 10GbE network solutions from HP delivers significant operational savings, high performance, reduced management complexity and improved scalability for virtualized data center deployments.
A Dynamic Programming Approach to Energy-Efficient Scheduling on Multi-FPGA b...TELKOMNIKA JOURNAL
This paper has been studied an important issue of energy-efficient scheduling on multi-FPGA systems. The main challenges are integral allocation, reconfiguration overhead and exclusiveness and energy minimization with deadline constraint. To tackle these challenges, based on the theory of dynamic programming, we have designed and implemented an energy-efficient scheduling on multi-FPGA systems. Differently, we have presented a MLPF algorithm for task placement on FPGAs. Finally, the experimental results have demonstrated that the proposed algorithm can successfully accommodate all tasks without violation of the deadline constraint. Additionally, it gains higher energy reduction 13.3% and 26.3% than that of Particle Swarm Optimization and fully balanced algorithm, respectively.
The Oil and Natural Gas Value Chain; PETROLEUM INDUSTRY STRUCTURE; THE AMERICAN PETROLEUM INSTITUTE CLASSIFICATION OF THE PETROLEUM INDUSTRY; UPSTREAM OIL AND GAS SECTOR; Business Cycle of Upstream; Components of the Upstream Sector; Upstream Oil Company Targets; MIDSTREAM SECTOR; DOWNSTREAM PROCESS AND SECTOR; Distribution of Refined Products; PETROLEUM REFINING; Distillation of Crude Oil; PETROLEUM COMPANIES TYPES; International Oil Companies (IOCs); Nation Oil Companies (NOCs); Operator Companies (or Exploration and Production (E &P) Companies); Types of exploration and production companies; Service Petroleum Companies; Types of service companies; MAIN PETROLEUM COMPANIES PARTICIPANTS IN THE INTERNATIONAL OIL MARKET; SEVEN SISTERS (or ANGLO-SAXON) ; Composition and history; New Seven Sisters
These slides are developed for a part of the undergraduate course in Petroleum Refinery Engineering. The slides are also helpful for Masters level introductory course.
Professional PowerPoint template for oil and gas presentations.
This is a fully customizable template with individual graphic elements and images. You are free to adjust cover, divider, and content slider header layouts.
Download at: http://www.powerpointteam.com/oil-industry-powerpoint-template.html
Available in standard and widescreen format.
Your comments will be highly appreciated. Thank you!
Introduction to Oil and Gas Industry from Upstream (Exploration & Production), Midstream (Transportation & Storage), to Downstream (Refining, Petrochemical, & Marketing)
Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2qoUklo.
Mark Price talks about techniques for making performance testing a first-class citizen in a Continuous Delivery pipeline. He covers a number of war stories experienced by the team building one of the world's most advanced trading exchanges. Filmed at qconlondon.com.
Mark Price is a Senior Performance Engineer at Improbable.io, working on optimizing and scaling reality-scale simulations. Previously, he worked as Lead Performance Engineer at LMAX Exchange, where he helped to optimize the platform to become one of the world's fastest FX exchanges.
Radisys' CTO, Andrew Alleman, was one of the featured speakers at the OCP Telco Engineering Workshop during the 2017 Big Communications Event. Andrew discussed carrier-grade open rack architecture (CG-OpenRack-19), the future of open hardware standards and commercial products in the OCP pipeline during his presentation.
Plan with confidence: Route to a successful Do178c multicore certificationMassimo Talia
The modern approach Multi-Processor in the civil and military Embedded equipments certification. The Processor assessment is conduct by Rockwell Collins Inc., the operating system selection is conducted by Windriver Inc.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
2. • Cisco Distinguished Engineer, Chief Architect, Big Data Solutions, Cisco
• General Chair, TPC’s International Conference Series on Performance
Evaluation and Benchmarking (TPCTC)
• Chairman, TPC Big Data Committee
• Industry Chair, IEEE Big Data 2013, ICPE 2014
• Board Member TPC, WBDB, BigDataTop100
2
4. • Synthetic Benchmarks
Simulate functions that yield an indicative measure of the
subsystem performance
Widely adapted in the industry and academic community
Several open source tools
• Application Benchmarks
Developed and administered by application vendors
VMmark, SAP and Oracle application benchmarks
• Industry Standard Benchmarks
Driven by industry standard consortia which are represented by
vendors, customers, and research organizations
Democratic procedures for all key decision making
TPC, SPEC and SPC
4
5. • Industry standard benchmarks have played, and continue to
play, a crucial role in the advancement of the computing
industry
• Demands for them have existed since buyers were first
confronted with the choice between purchasing one system
over another
• Historically we have seen that industry standard
benchmarks enable healthy competition that results in
product improvements and the evolution of brand new
technologies
Better products,
Lower PricePerformance
5
6. Critical to Vendors, Customers and Researchers
• Vendor
Demonstrate competitiveness of their products
Monitor release-to-release progress of their products under
development
• Customer
Cross-vendor evaluation of technologies and products in terms of
performance, price-performance, energy efficiency
• Researcher
Known, measurable, and repeatable workloads to develop and enhance
relevant technologies
6
7. Major Activities
Benchmark Development Process
• Development of new benchmarks
• Publication of benchmark results
• Refinement of existing benchmarks
• Resolution of disputes and challenges
Source: Raghunath Nambiar, Meikel Poess: The Making of TPC-DS. VLDB
2006: 1049-1058
7
8. • The TPC is a non-profit, vendor-neutral organization,
established in August 1988
• Reputation of providing the most credible performance
results to the industry.
• Role of “consumer reports” for the computing industry
• Solid foundation for complete system-level performance
• Methodology for calculating total-system-price and price-
performance
• Methodology for measuring energy efficiency of complete
system
Source: Raghunath Nambiar, Matthew Lanken, Nicholas Wakou, Forrest Carman, Michael Majdalany: Transaction Processing Performance Council
(TPC): Twenty Years Later - A Look Back, a Look Ahead, First TPC Technology Conference, TPCTC 2009, Lyon, France, ISBN 978-3-642-10423-7
8
9. Benchmark Standards
TPC-A
TPC-B
TPC-C
TPC-D
TPC-R
TPC-H
TPC-W
TPC-App
TPC-E
TPC-DS
TPC-VMS
Common Specifications
Pricing
Energy
Developments in Progress
TPC-DI
TPC-VMC
TPC-V
Source: Raghunath Nambiar, Meikel Poess, Andrew Masland, H. Reza Taheri, Matthew Emmerton, Forrest Carman,
Michael Majdalany: TPC Benchmark Roadmap 2012, 4th TPC Technology Conference, TPCTC 2012, Istanbul, Turkey,
ISBN 978-3-642-36726-7
•
Obsolete
•
Active
•
Common Specifications
•
In Progress
•
•
•
Developed 11 Benchmark Standards
5 Standards are current
What’s new ?
•
TPC-VMS – new standard for measuring database
performance in a virtualized environment
TPC-DI - standard for measuring data integration
performance. Expected to be standard in 2014
TPC-Big Data committee was formed in October 2013
•
•
9
10. Universities and research organizations are encouraged to join the TPC as Associate
Members.
To join the TPC: http://www.tpc.org/information/about/join.asp
10
11. • The Standard Performance Evaluation Corporation (SPEC) is a non-
profit organization established in 1988
• Develop standards for system level performance measurements
• History of developing relevant benchmarks to the industry in a timely
manner
• Four diverse groups - Graphics and Workstation Performance Group
(GWPG), High Performance Group (HPG), Open Systems Group
(OSG) and Research Group (RG)
• Represented by system and software vendors and a number of
academic and research organizations
11
12. • SPEC CPU2006 is designed to measure the compute power of systems, contains two
benchmark suites: CINT2006 for measuring and comparing compute-intensive integer
performance, and CFP2006 for measuring and comparing compute-intensive floating
point performance
• SPEC MPI2007 is designed for evaluating MPI-parallel, floating point, and computeintensive performance across a wide range of cluster and SMP hardware
• SPECjbb2013 measures server performance based on the Java application features
by emulating a three-tier client/server system
• SPECjEnterprise2010 measures system performance for Java Enterprise Edition
based application servers, databases, and supporting infrastructure
• SPECsfs2008 is designed to evaluate the speed and request-handling capabilities of
file servers utilizing the NFSv3 and CIFS protocols
• SPECpower_ssj2008 evaluates the power and performance characteristics of volume
server class computers
• SPECvirt_sc2010 measures the end-to-end performance of all system components,
including the hardware, virtualization platform, virtualized guest operating system, and
application software
12
13. • The Storage Performance Council (SPC) is a vendor-neutral
consortia established in 2000
• Focused on industry standards for storage system
performance
• Serve as a catalyst for performance improvement in storage
subsystems
• Robust methodology measuring, auditing, and publishing
performance, price-performance, and energy-efficiency
metrics for storage systems
• Major systems and storage vendors are members of the
SPC
13
14. •
SPC Benchmark 1 (SPC-1) consists of a single workload designed to demonstrate the performance of a storage
subsystem under OLTP workloads characterized by random reads and writes
•
SPC Benchmark 1/Energy (SPC-1/E) is an extension of SPC-1 that consists of the complete set of SPC-1
performance measurement and reporting plus the measurement and reporting of energy consumption
•
SPC Benchmark 2 (SPC-2) consists of three distinct workloads: large file processing, large database queries, and
video on-demand simulating the concurrent large-scale sequential movement of data
•
SPC Benchmark 2/Energy (SPC-2/E) is extension of SPC-2 that consists of the complete set of SPC-2
performance measurement and reporting plus the measurement and reporting of energy consumption
•
SPC Benchmark 1C (SPC-1C) is based on SPC-1 for storage component products such as disk drives, host bus
adapters, storage enclosures, and storage software stacks such as volume managers
•
SPC Benchmark 1C/Energy (SPC-1C/E) is an extension of SPEC-1C that consists of the complete set of SPC-1C
performance measurements and reporting plus measurement and reporting of energy consumption
•
SPC Benchmark 2C (SPC-2C) is based on SPC-2, predominately by large I/Os organized into one or more
concurrent sequential patterns for storage component products
•
SPC Benchmark 2C/Energy (SPC-2C/E) is an extension of SPC-2C that consists of the complete set of SPC-2
performance measurement and reporting plus the measurement and reporting of energy consumption
14
15. TPC-C Performance 1992-2010
Average tpmC/Processor
1000000
Average tpmC per processor
Moore's Law
First result using solid state drives (SDD)
First result using 15K RPM SAS SFF disk drives
100000
First result using 15K RPM disk drives
First Linux result
First multi core result
10000
Intel introduces multi threading
TPC-C Revision 5 and First x86-64 bit result
First storage area network (SAN) based result
First result using 7.2K RPM disk drives
1000
First clustered result
TPC-C Revision 3, First Windows result and first x86 result
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
2000
1999
1998
1997
1996
1995
1994
100
1993
TPC-C Revision 2
Publication Year
Source: Nambiar R., Poess M. (2010). Transaction Performance vs. Moore’s Law. Performance Evaluation, Measurement and Characterization of
Complex Systems. Lecture Notes in Computer Science 6417, Springer 2011, ISBN 978-3-642-18205-1
15
16. TPC-C Price-Performance 1992-2010
10000
Price per NtpmC
TPC-C Revision 2
1000
Price per NtpmC
Moore's Law
TPC-C Revision 3, First Windows result and first x86 result
First clustered result
First result using 7.2 RPM disk drives
First storage area network (SAN) based result
100
TPC-C Revision 5 and First x86-64 bit result
Intel introduces multi threading
First multi core result
First Linux result
10
First result using 15 K RPM disk drives
First result using 15K RPM SAS SFF disk drives
1
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
2000
1999
1998
1997
1996
1995
1994
0.1
1993
First result using solid state drives SDD
Publication Year
Source: Nambiar R., Poess M. (2010). Transaction Performance vs. Moore’s Law. Performance Evaluation, Measurement and Characterization of
Complex Systems. Lecture Notes in Computer Science 6417, Springer 2011, ISBN 978-3-642-18205-1
16
17. • IT 1.0: 1980-2000
Transaction Processing, Data Warehousing, File
server, Web server, Multi-tier Applications
• IT 2.0: 2000-2010
Internet centric, Massive scale-out systems,
Virtualization, Energy efficient systems
• IT 3.0: 2010
Industry
Standard
Committees
have done a
great job
Call for new
standards
Cloud, Big Data, Internet of things, Software
defined and application centric infrastructure
17
19. 34.3% of World’s Population
have internet access today
50% by 2020
19
20. 60
50 Billion
40
20
15 Billion
0
2012
2020
Connected Devices
There are 15 billion devices connected to the Internet
that’s 2.2 devices for every man, woman, and child on the planet earth
50 Billion devices by 2020
Trillion+ with IOT.
Source: Cisco, webpronews.com
......
20
22. 1.
Were a country …
2.
India (1.218 billion)
3.
Facebook (1 billion)
4.
If
China (1.339 billion)
United States (311 million)
5.
Indonesia (237 million)
6.
Brazil (190 billion)
7.
Pakistan (175 million)
8.
Nigeria (158 million)
9.
Bangladesh (150 million)
10. Russia (142 million)
......
22
23. The third generation of
IT platform driven by
new applications and
services built on cloud,
mobile devices, social
media, IoTs and more
Intelligent Economy
Big Data/
Social
Analytics
Business
Mobile Cloud
of “Things”
BroadbandServices
Mobile
Billions
Millions
Devices
of Users
of Apps
and Apps
Trillions
2011
Hundreds of Millions
Examples: Recommendation engines,
Personalized contents, Crowd-sourcing
LAN/ ClientInternet Server
Tens of Thousands
PC
of Users
of Apps
1986
Millions
of Users
Thousands
of Apps
Source: IDC
23
24. 2008
0.5 Zettabyte
2011
2.5 Zettabytes
1 Zettabyte
2020
35 Zettabytes
= 1 099 511 627 776 Gigabytes
= 1 Billion 1TB Disk Drives
How many disk drives were sold in 2012 ?
Source: IDC, EMC
24
25. Global IP Traffic
616EB
Per Capita Internet Traffic
Per Capita IP Traffic
Per Capita
Internet Traffic
In 2016, equivalent of all movies ever made will cross global IP networks every 3 minutes
Source: Cisco
25
27. • Big Data is becoming integral part of IT ecosystem across all major
verticals
• One of the most talked about topics in research and government sectors
• Big Data challenges can be summed up in 5V’s: Volume, Velocity, Varity,
Value, Veracity
• Big Data is becoming center of 3I’s: Investments, Innovation,
Improvization*
* Source: http://blogs.cisco.com/datacenter/ieee-bigdata/
27
30. State of the Nature - early 1980's
the industry began a race that has accelerated over time: automation of daily end-user
business transactions. The first application that received wide-spread focus was
automated teller transactions (ATM), but we've seen this automation trend ripple through
almost every area of business, from grocery stores to gas stations. As opposed to the
batch-computing model that dominated the industry in the 1960's and 1970's, this new
online model of computing had relatively unsophisticated clerks and consumers directly
conducting simple update transactions against an on-line database system. Thus, the online transaction processing industry was born, an industry that now represents billions of
dollars in annual sales.
Early Attempts at Civilized Competition
In the April 1, 1985 issue of Datamation, Jim Gray in collaboration with 24 others from
academy and industry, published (anonymously) an article titled, "A Measure of
Transaction Processing Power." This article outlined a test for on-line transaction
processing which was given the title of "DebitCredit." Unlike the TP1 benchmark, Gray's
DebitCredit benchmark specified a true system-level benchmark where the network and
user interaction components of the workload were included. In addition, it outlined several
other key features of the benchmarking process that were later incorporated into the TPC
process:
The TPC Lays Down the Law
While Gray's DebitCredit ideas were widely praised by industry opinion makers, the
DebitCredit benchmark had the same success in curbing bad benchmarking as the
prohibition did in stopping excessive drinking. In fact, according to industry analysts like
Omri Serlin, the situation only got worse. Without a standards body to supervise the
testing and publishing, vendors began to publish extraordinary marketing claims on both
TP1 and DebitCredit. They often deleted key requirements in DebitCredit to improve their
performance results.
From 1985 through 1988, vendors used TP1 and DebitCredit--or their own interpretation
of these benchmarks--to muddy the already murky performance waters. Omri Serlin had
had enough. He spearheaded a campaign to see if this mess could be straightened out.
On August 10, 1988, Serlin had successfully convinced eight companies to form the
Transaction Processing Performance Council (TPC).
30
31. • Performance
• Cost of ownership
• Energy efficiency
• Floor space efficiency
• Manageability
• User experience
31
32. • Relevant
• Repeatable
• Understandable
• Fair
• Verifiable
• Economical
Reference: K. Huppler, The Art of Building a Good Benchmark, Performance Evaluation and Benchmarking, LNCS vol. 5895, Springer 2009
• Time to Market – Long development cycle is not acceptable
32
33. • Business Case
• Data Definition and Data Generation
• Workload
• Execution Rules
• Metric
• Audit Rules
• Full Disclosure Report
33
34. • TPC International Technology Conference
Series on Performance Evaluation and
Benchmarking (TPCTC)
• Workshop Series on Big Data Benchmarking
(WBDB)
• TPC - Big Data Benchmark Work Group (TPC-
BD)
34
35. TPC International Technology Conference Series on
Performance Evaluation and Benchmarking (TPCTC)
Accelerate the development of relevant benchmark standards
Enable collaboration between industry experts and researchers
Collocated with International Conference on Very Large Data
Bases (VLDB) since 2009
TPCTC 2009 in conjunction with VLDB 2009, Lyon, France
TPCTC 2010 in conjunction with VLDB 2010, Singapore
TPCTC 2011 in conjunction with VLDB 2011, Seattle, Washington
TPCTC 2012 in conjunction with VLDB 2012, Istanbul, Turkey
TPCTC 2013 in conjunction with VLDB 2013, Riva Del Garda, Italy
TPCTC 2014 – will collocate with VLDB 2014 in Hangzhou, China (More information
available at http://www.tpc.org/tpctc/
35
36. Workshop Series on Big Data Benchmarking
(WBDB)
• A first important step towards the development of a set of
benchmarks for providing objective measures of the effectiveness
of hardware and software systems dealing with Big Data
applications
• Open forum for discussions issues related to Big Data
benchmarking
• WBDB Workshops
WBDB 2012, San Jose
WBDB 2012.in, Pune
WBDB 2013.cn, Xi’an
WBDB 2013, San Jose
WBDB 2014, Potsdam, Germany (August 5-6, 2014)
• BigData100
36
38. • Evaluate big data workload(s) and make recommendations
• Four workloads under evaluation
• Additional workloads will be considered
• Accept one or more benchmarks to address various Big
Data use cases
• More information: http://www.tpc.org/tpcbd/
38
39. • TPC is an international organization. Vendors, Customers,
Universities, and Research Institutions are invited to join
• Membership Benefits
Influence in the TPC benchmarking development process
Timely access to ongoing proceedings
Product Improvement
• Memberships
Full membership - Participate in all aspects of the TPC's work, including development
of benchmark standards and setting strategic direction.
Associate Membership – Reserved for non-profit, educational institutions, market
researchers, publishers, consultants, governments, businesses who do not create,
market or sell computer products or services.
Promotional membership for new members
• More Information: http://www.tpc.org/information/about/join.asp
39