The second class in CIS222, Introduction to UNIX/Linux.
Prepares for Virtualbox installation, and brief overview of default Linux installation.
Overview of main points of BIOS, Virtualization.
The second class in CIS222, Introduction to UNIX/Linux.
Prepares for Virtualbox installation, and brief overview of default Linux installation.
Overview of main points of BIOS, Virtualization.
TAE Technologies is working to develop commercial, cutting-
edge nuclear fusion power. This research depends on a network
of equipment to create an ultra-high vacuum within their plasma
generator. A single day of downtime costs up to $150,000, so they
require a control system that is reliable and flexible enough to
simplify the addition of new equipment. Using ControlLogix®,
Studio 5000® programming environment and FactoryTalk®
View SE, TAE has developed a distributed and structured control
system and has not experienced a day of downtime for the past
eight years
Intelligent Network Services through Active Flow ManipulationTal Lavian Ph.D.
Active Flow Manipulation Abstractions:
Aggregate data into traffic flows
Flows whose characteristics can be identified in real-time
E.g., “all UDP packets to a particular service”, “all TCP packets from a particular machine”.
Actions to be performed in the traffic flows
Actions that can be performed in real-time
E.g., “Change the priority of all traffic destined to a particular service on a particular machine”, “Stop all traffic out of a particular link of a router”.
This work is about the design and configuration of service-oriented communication on top of Ethernet TSN. The first objective is to present takeaways from the design and implementation of the Renault E/E Service-Oriented Architecture (SOA) called FACE. In particular, we discuss technological, design and configuration choices made for the SOA, such as how to segment messages (UDP with multiple events, TCP, SOME/IP TP), and the technical possibilities to shape the transmission of the packets on the Ethernet network.
The second objective is to study how to ensure the Quality of Service (QoS) required by services. Indeed, services introduce specific challenges, be it only the sheer amount of traffic they generate and if there is a growing body of experiences in the use of TSN QoS mechanisms most of what has been learned so far is mostly about meeting the requirements of individual streams. Less is known for services that involve the transmission of several, possibly segmented, messages with more complex transmission patterns. We show on the FACE architecture how SOME/IP messages were mapped to TSN QoS mechanisms in a manual then automated manner so as to meet the individual requirements of the services in terms of timing, and the system’s requirements in terms of memory usage.
TAE Technologies is working to develop commercial, cutting-
edge nuclear fusion power. This research depends on a network
of equipment to create an ultra-high vacuum within their plasma
generator. A single day of downtime costs up to $150,000, so they
require a control system that is reliable and flexible enough to
simplify the addition of new equipment. Using ControlLogix®,
Studio 5000® programming environment and FactoryTalk®
View SE, TAE has developed a distributed and structured control
system and has not experienced a day of downtime for the past
eight years
Intelligent Network Services through Active Flow ManipulationTal Lavian Ph.D.
Active Flow Manipulation Abstractions:
Aggregate data into traffic flows
Flows whose characteristics can be identified in real-time
E.g., “all UDP packets to a particular service”, “all TCP packets from a particular machine”.
Actions to be performed in the traffic flows
Actions that can be performed in real-time
E.g., “Change the priority of all traffic destined to a particular service on a particular machine”, “Stop all traffic out of a particular link of a router”.
This work is about the design and configuration of service-oriented communication on top of Ethernet TSN. The first objective is to present takeaways from the design and implementation of the Renault E/E Service-Oriented Architecture (SOA) called FACE. In particular, we discuss technological, design and configuration choices made for the SOA, such as how to segment messages (UDP with multiple events, TCP, SOME/IP TP), and the technical possibilities to shape the transmission of the packets on the Ethernet network.
The second objective is to study how to ensure the Quality of Service (QoS) required by services. Indeed, services introduce specific challenges, be it only the sheer amount of traffic they generate and if there is a growing body of experiences in the use of TSN QoS mechanisms most of what has been learned so far is mostly about meeting the requirements of individual streams. Less is known for services that involve the transmission of several, possibly segmented, messages with more complex transmission patterns. We show on the FACE architecture how SOME/IP messages were mapped to TSN QoS mechanisms in a manual then automated manner so as to meet the individual requirements of the services in terms of timing, and the system’s requirements in terms of memory usage.
TPCx-HS is the first vendor-neutral benchmark focused on big data systems – which have become a critical part of the enterprise IT ecosystem.
Watch the video presentation: http://wp.me/p3RLHQ-cLY
Learn more: http://www.tpc.org/tpcx-hs
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxEduSkills OECD
Andreas Schleicher presents at the OECD webinar ‘Digital devices in schools: detrimental distraction or secret to success?’ on 27 May 2024. The presentation was based on findings from PISA 2022 results and the webinar helped launch the PISA in Focus ‘Managing screen time: How to protect and equip students against distraction’ https://www.oecd-ilibrary.org/education/managing-screen-time_7c225af4-en and the OECD Education Policy Perspective ‘Students, digital devices and success’ can be found here - https://oe.cd/il/5yV
The Indian economy is classified into different sectors to simplify the analysis and understanding of economic activities. For Class 10, it's essential to grasp the sectors of the Indian economy, understand their characteristics, and recognize their importance. This guide will provide detailed notes on the Sectors of the Indian Economy Class 10, using specific long-tail keywords to enhance comprehension.
For more information, visit-www.vavaclasses.com
Model Attribute Check Company Auto PropertyCeline George
In Odoo, the multi-company feature allows you to manage multiple companies within a single Odoo database instance. Each company can have its own configurations while still sharing common resources such as products, customers, and suppliers.
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
This is a presentation by Dada Robert in a Your Skill Boost masterclass organised by the Excellence Foundation for South Sudan (EFSS) on Saturday, the 25th and Sunday, the 26th of May 2024.
He discussed the concept of quality improvement, emphasizing its applicability to various aspects of life, including personal, project, and program improvements. He defined quality as doing the right thing at the right time in the right way to achieve the best possible results and discussed the concept of the "gap" between what we know and what we do, and how this gap represents the areas we need to improve. He explained the scientific approach to quality improvement, which involves systematic performance analysis, testing and learning, and implementing change ideas. He also highlighted the importance of client focus and a team approach to quality improvement.
The Art Pastor's Guide to Sabbath | Steve ThomasonSteve Thomason
What is the purpose of the Sabbath Law in the Torah. It is interesting to compare how the context of the law shifts from Exodus to Deuteronomy. Who gets to rest, and why?
3. Benchmarks: What and Why
What is a benchmark?
Domain specific
No single metric possible
The more general the benchmark, the less useful it is for anything in
particular.
A benchmark is a distillation of the essential attributes of a workload
Desirable attributes
Relevant meaningful within the target domain
Understandable
Good metric(s) linear, orthogonal, monotonic
Scaleable applicable to a broad spectrum of hardware/architecture
Coverage does not oversimplify the typical environment
Acceptance Vendors and Users embrace it
4. Benefits and Liabilities
Good benchmarks
Define the playing field
Accelerate progress
Engineers do a great job once objective is
measureable and repeatable
Set the performance agenda
Measure release-to-release progress
Set goals (e.g., 100,000 tpmC, < 10 $/tpmC)
Something managers can understand (!)
Benchmark abuse
Benchmarketing
Benchmark wars
more $ on ads than development
5. Benchmarks have a Lifetime
Good benchmarks drive industry and technology forward.
At some point, all reasonable advances have been made.
Benchmarks can become counter productive by encouraging
artificial optimizations.
So, even good benchmarks become obsolete over time.
7. What is the TPC?
TPC = Transaction Processing Performance Council
Founded in Aug/88 by Omri Serlin and 8 vendors.
Membership of 40-45 for last several years
Everybody who’s anybody in software & hardware
De facto industry standards body for OLTP performance
Administered by:
Shanley Public Relations ph: (408) 295-8894
650 N. Winchester Blvd, Suite 1 fax: (408) 271-6648
San Jose, CA 95128 email: shanley@tpc.org
Most TPC specs, info, results are on the web page:
http: www.tpc.org
8. Two Seminal Events Leading to TPC
Anon, et al, “A Measure of Transaction Processing Power”,
Datamation, April fools day, 1985.
Anon = Jim Gray (Dr. E. A. Anon)
Sort: 1M 100 byte records
Mini-batch: copy 1000 records
DebitCredit: simple ATM style transaction
Tandem TopGun Benchmark
DebitCredit
212 tps on NonStop SQL in 1987 (!)
Audited by Tom Sawyer of Codd and Date (A first)
Full Disclosure of all aspects of tests (A first)
Started the ET1/TP1 Benchmark wars of ’87-’89
9. TPC Milestones
1989: TPC-A ~ industry standard for Debit Credit
1990: TPC-B ~ database only version of TPC-A
1992: TPC-C ~ more representative, balanced OLTP
1994: TPC requires all results must be audited
1995: TPC-D ~ complex decision support (query)
1995: TPC-A/B declared obsolete by TPC
Non-starters:
TPC-E ~ “Enterprise” for the mainframers
TPC-S ~ “Server” component of TPC-C
Both failed during final approval in 1996
1999: TPC-D replaced by TPC-H and TPC-R
10. TPC vs. SPEC
SPEC (System Performance Evaluation Cooperative)
SPECMarks
SPEC ships code
Unix centric
CPU centric
TPC ships specifications
Ecumenical
Database/System/TP centric
Price/Performance
The TPC and SPEC happily coexist
There is plenty of room for both
12. TPC-A Legacy
First results in 1990: 38.2 tpsA, 29.2K$/tpsA (HP)
Last results in 1994: 3700 tpsA, 4.8 K$/tpsA (DEC)
WOW! 100x on performance and 6x on price in five years!!!
TPC cut its teeth on TPC-A/B; became functioning,
representative body
Learned a lot of lessons:
If benchmark is not meaningful, it doesn’t matter how many numbers
or how easy to run (TPC-B).
How to resolve ambiguities in spec
How to police compliance
Rules of engagement
13. TPC-A Established OLTP Playing Field
TPC-A criticized for being irrelevant, unrepresentative,
misleading
But, truth is that TPC-A drove performance, drove
price/performance, and forced everyone to clean up their
products to be competitive.
Trend forced industry toward one price/performance,
regardless of size.
Became means to achieve legitimacy in OLTP for some.
15. TPC-C Overview
Moderately complex OLTP
The result of 2+ years of development by the TPC
Application models a wholesale supplier managing orders.
Order-entry provides a conceptual model for the benchmark;
underlying components are typical of any OLTP system.
Workload consists of five transaction types.
Users and database scale linearly with throughput.
Spec defines full-screen end-user interface.
Metrics are new-order txn rate (tpmC) and
price/performance ($/tpmC)
Specification was approved July 23, 1992.
16. TPC-C’s Five Transactions
OLTP transactions:
New-order: enter a new order from a customer
Payment: update customer balance to reflect a payment
Delivery: deliver orders (done as a batch transaction)
Order-status: retrieve status of customer’s most recent order
Stock-level: monitor warehouse inventory
Transactions operate against a database of nine tables.
Transactions do update, insert, delete, and abort;
primary and secondary key access.
Response time requirement: 90% of each type of transaction
must have a response time ≤ 5 seconds, except stock-level
which is ≤ 20 seconds.
18. 22
TPC-C Workflow
11
Select txn from menu:Select txn from menu:
1. New-Order1. New-Order 45%45%
2. Payment2. Payment 43%43%
3. Order-Status3. Order-Status 4%4%
4. Delivery4. Delivery 4%4%
5. Stock-Level5. Stock-Level 4%4%
Input screenInput screen
Output screenOutput screen
Measure menu Response TimeMeasure menu Response Time
Measure txn Response TimeMeasure txn Response Time
Keying time
Think time
33
Go back to 1Go back to 1
Cycle Time DecompositionCycle Time Decomposition
(typical values, in seconds,(typical values, in seconds,
for weighted average txn)for weighted average txn)
Menu = 0.3Menu = 0.3
Keying = 9.6Keying = 9.6
Txn RT = 2.1Txn RT = 2.1
Think = 11.4Think = 11.4
Average cycle time = 23.4Average cycle time = 23.4
19. Data Skew
NURand - Non Uniform Random
NURand(A,x,y) = (((random(0,A) | random(x,y)) + C) % (y-x+1)) + x
Customer Last Name: NURand(255, 0, 999)
Customer ID: NURand(1023, 1, 3000)
Item ID: NURand(8191, 1, 100000)
bitwise OR of two random values
skews distribution toward values with more bits on
75% chance that a given bit is one (1 - ½ * ½)
skewed data pattern repeats with period of smaller random number
20. NURand Distribution
T P C - C N U R a n d fu n c tio n : fre q u e n c y v s 0 ... 2 5 5
R e c o rd Id e n titiy [0 . .2 5 5 ]
RelativeFrequencyofAccess
toThisRecord
0
0 .01
0 .02
0 .03
0 .04
0 .05
0 .06
0 .07
0 .08
0 .09
0 .1
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
200
210
220
230
240
250
c u m u la tiv e
d is trib u tio n
21. ACID Tests
TPC-C requires transactions be ACID.
Tests included to demonstrate ACID properties met.
Atomicity
Verify that all changes within a transaction commit or abort.
Consistency
Isolation
ANSI Repeatable reads for all but Stock-Level transactions.
Committed reads for Stock-Level.
Durability
Must demonstrate recovery from
Loss of power
Loss of memory
Loss of media (e.g., disk crash)
22. 1-1001-100
Transparency
TPC-C requires that all data partitioning be fully transparent
to the application code. (See TPC-C Clause 1.6)
Both horizontal and vertical partitioning is allowed
All partitioning must be hidden from the application
Most DBMS’s do this today for single-node horizontal partitioning.
Much harder: multiple-node transparency.
For example, in a two-node cluster:
Warehouses:Warehouses:
Node ANode A
select *select *
from warehousefrom warehouse
where W_ID = 150where W_ID = 150
Node BNode B
select *select *
from warehousefrom warehouse
where W_ID = 77where W_ID = 77
Any DML operation must beAny DML operation must be
able to operate against theable to operate against the
entire database, regardless ofentire database, regardless of
physical location.physical location.
100-200100-200
23. Transparency (cont.)
How does transparency affect TPC-C?
Payment txn: 15% of Customer table records are non-local to the
home warehouse.
New-order txn: 1% of Stock table records are non-local to the home
warehouse.
In a distributed cluster, the cross warehouse traffic causes
cross node traffic and either 2 phase commit, distributed lock
management, or both.
For example, with distributed txns:
Number of nodesNumber of nodes % Network Txns% Network Txns
11 00
22 5.55.5
33 7.37.3
nn → ∞→ ∞ 10.910.9
24. TPC-C Rules of Thumb
1.2 tpmC per User/terminal (maximum)
10 terminals per warehouse (fixed)
65-70 MB/tpmC priced disk capacity (minimum)
~ 0.5 physical IOs/sec/tpmC (typical)
100-700 KB main memory/tpmC (how much $ do you have?)
So use rules of thumb to size 5000 tpmC system:
How many terminals?
How many warehouses?
How much memory?
How much disk capacity?
How many spindles?
» 4170 = 5000 / 1.2» 4170 = 5000 / 1.2
» 417 = 4170 / 10» 417 = 4170 / 10
» 1.5 - 3.5 GB» 1.5 - 3.5 GB
» 325 GB = 5000 * 65» 325 GB = 5000 * 65
» Depends on MB capacity vs. physical IO.» Depends on MB capacity vs. physical IO.
Capacity: 325 / 18 = 18 or 325 / 9 = 36 spindlesCapacity: 325 / 18 = 18 or 325 / 9 = 36 spindles
IO: 5000*.5 / 18 = 138 IO/secIO: 5000*.5 / 18 = 138 IO/sec TOO HOT!TOO HOT!
IO: 5000*.5 / 36 = 69 IO/secIO: 5000*.5 / 36 = 69 IO/sec OKOK
25. Response TimeResponse Time
measured heremeasured here
Typical TPC-C Configuration (Conceptual)
DatabaseDatabase
ServerServer
......
ClientClient
C/S
LAN
Term.
LAN
Presentation ServicesPresentation Services Database FunctionsDatabase FunctionsEmulated User LoadEmulated User Load
HardwareHardware
RTERTE, e.g.:, e.g.:
Performix,Performix,
LoadRunner,LoadRunner,
or proprietaryor proprietary
SoftwareSoftware
TPC-C application +TPC-C application +
Txn Monitor and/orTxn Monitor and/or
database RPC librarydatabase RPC library
e.g., Tuxedo, ODBCe.g., Tuxedo, ODBC
TPC-C applicationTPC-C application
(stored procedures) +(stored procedures) +
Database engineDatabase engine
e.g., SQL Servere.g., SQL Server
Driver SystemDriver System
28. The Complete Guide to TPC-C
In the spirit of The Compleat Works of Wllm Shkspr (Abridged)…
The Complete Guide to TPC-C:
First, do several years of prep work. Next,
Install OS
Install and configure database
Build TPC-C database
Install and configure TPC-C application
Install and configure RTE
Run benchmark
Analyze results
Publish
Typical elapsed time: 2 – 6 months
The Challenge: Do it all in the next 30 minutes!
29. ResponseTimeResponseTime
measuredheremeasuredhere
TPC-C Demo Configuration
DB ServerDB Server
......
C/S
LANBrowser
LAN
Presentation ServicesPresentation Services Database FunctionsDatabase FunctionsEmulated User LoadEmulated User Load
Driver SystemDriver System ClientClient
COM+COM+
RemoteRemote
TerminalTerminal
EmulatorEmulator
(RTE)(RTE)
COMPONENTCOMPONENT
ODBC APPODBC APP
UI APPUI APP
ODBCODBC
SQLSQL
ServerServerWeb ServerWeb Server
New-OrderNew-Order
PaymentPayment
DeliveryDelivery
Stock-LevelStock-Level
Order-StatusOrder-Status
Application CodeApplication Code
ProductsProducts
Legend:Legend:
30. TPC-C Current Results - 1996
Best Performance is 30,390 tpmC @ $305/tpmC (Digital)
Best Price/Perf. is 6,185 tpmC @ $111/tpmC (Compaq)
$0
$50
$100
$150
$200
$250
$300
$350
$400
0 5000 10000 15000 20000 25000 30000 35000
CompaqCompaq
DigitalDigital
HPHPIBMIBM
SunSun
$100/tpmC not yet. Soon!
31. $0
$20
$40
$60
$80
$100
$120
$140
$160
0 20,000 40,000 60,000 80,000 100,000 120,000
Sun
IBM
Compaq
Sequent
HP
Unisys
TPC-C Current Results
Best Performance is 115,395 tpmC @ $105/tpmC (Sun)
Best Price/Perf. is 20,195 tpmC @ $15/tpmC (Compaq)
$10/tpmC not yet. Soon!
32. TPC-C Summary
Balanced, representative OLTP mix
Five transaction types
Database intensive; substantial IO and cache load
Scaleable workload
Complex data: data attributes, size, skew
Requires Transparency and ACID
Full screen presentation services
De facto standard for OLTP performance
33. Preview of TPC-C rev 4.0
Rev 4.0 is major revision. Previous results will not be
comparable; dropped from result list after six months.
Make txns heavier, so fewer users compared to rev 3.
Add referential integrity.
Adjust R/W mix to have more read, less write.
Reduce response time limits (e.g., 2 sec 90th
%-tile vs 5 sec)
TVRand – Time Varying Random – causes workload activity
to vary across database
35. TPC-H/R Overview
Complex Decision Support workload
Originally released as TPC-D
the result of 5 years of development by the TPC
Benchmark models ad hoc queries (TPC-H) or
reporting (TPC-R)
extract database with concurrent updates
multi-user environment
Workload consists of 22 queries and 2 update streams
SQL as written in spec
Database is quantized into fixed sizes (e.g., 1, 10, 30, … GB)
Metrics are Composite Queries-per-Hour (QphH or QphR),
and Price/Performance ($/QphH or $/QphR)
TPC-D specification was approved April 5, 1995
TPC-H/R specifications were approved April, 1999
37. TPC-H/R Database Scaling and Load
Database size is determined from fixed Scale Factors (SF):
1, 10, 30, 100, 300, 1000, 3000, 10000 (note that 3 is missing, not a typo)
These correspond to the nominal database size in GB.
(i.e., SF 10 is approx. 10 GB, not including indexes and temp tables.)
Indices and temporary tables can significantly increase the total disk
capacity. (3-5x is typical)
Database is generated by DBGEN
DBGEN is a C program which is part of the TPC-H/R specs
Use of DBGEN is strongly recommended.
TPC-H/R database contents must be exact.
Database Load time must be reported
Includes time to create indexes and update statistics.
Not included in primary metrics.
38. How are TPC-H and TPC-R Different?
Partitioning
TPC-H: only on primary keys, foreign keys, and date columns; only
using “simple” key breaks
TPC-R: unrestricted for horizontal partitioning
Vertical partitioning is not allowed
Indexes
TPC-H: only on primary keys, foreign keys, and date columns; cannot
span multiple tables
TPC-R: unrestricted
Auxiliary Structures
What? materialized views, summary tables, join indexes
TPC-H: not allowed
TPC-R: allowed
39. TPC-H/R Query Set
22 queries written in SQL92 to implement business questions.
Queries are pseudo ad hoc:
Substitution parameters are replaced with constants by QGEN
QGEN replaces substitution parameters with random values
No host variables
No static SQL
Queries cannot be modified -- “SQL as written”
There are some minor exceptions.
All variants must be approved in advance by the TPC
40. TPC-H/R Update Streams
Update 0.1% of data per query stream
About as long as a medium sized TPC-H/R query
Implementation of updates is left to sponsor, except:
ACID properties must be maintained
Update Function 1 (RF1)
Insert new rows into ORDER and LINEITEM tables
equal to 0.1% of table size
Update Function 2 (RF2)
Delete rows from ORDER and LINEITEM tables
equal to 0.1% of table size
41. Database Build
Timed and reported, but not a primary metric
Power Test
Queries submitted in a single stream (i.e., no concurrency)
Sequence:
TPC-H/R Execution
RF1RF1
QueryQuery
Set 0Set 0 RF2RF2
Timed SequenceTimed Sequence
Build Database (timed)Build Database (timed)
CreateCreate
DBDB
LoadLoad
DataData
BuildBuild
IndexesIndexes Proceed directly toProceed directly to
Power TestPower Test
Proceed directly toProceed directly to
Throughput TestThroughput Test
42. TPC-H/R Execution (cont.)
Throughput Test
Multiple concurrent query streams
Number of Streams (S) is determined by Scale Factor (SF)
e.g.: SF=1 S=2; SF=100 S=5; SF=1000 S=7
Single update stream
Sequence:
Query Set 1Query Set 1
Query Set 2Query Set 2
Query Set NQuery Set N
RF1 RF2 RF1 RF2 … RF1 RF2RF1 RF2 RF1 RF2 … RF1 RF2
1 2 … N1 2 … N
Updates:Updates:
....
..
43. TPC-H/R Secondary Metrics
Power Metric
Geometric queries per hour times SF
Throughput Metric
Linear queries per hour times SF
24
22
1
2
1
)0,()0,(
3600
@
∏ ∏
=
=
=
=
•
•
=
i
i
j
j
jRIiQI
SF
SizePower
where
QI(i,0) ≡ Timing Interval for Query i, stream 0
RI(j,0) ≡ Timing Interval for refresh function RFj
SF ≡ Scale Factor
44. TPC-R/H Primary Metrics
Composite Query-Per-Hour Rating (QphH or QphR)
The Power and Throughput metrics are combined to get
the composite queries per hour.
Reported metrics are:
Composite: QphH@Size
Price/Performance: $/QphH@Size
Availability Date
Comparability:
Results within a size category (SF) are comparable.
Comparisons among different size databases are strongly discouraged.
SizeThroughputSizePowerSizeQphH @@@ •=
45. TPC-H/R Results
No TPC-R results yet.
One TPC-H result:
Sun Enterprise 4500 (Informix), 1280 QphH@100GB,
816 $/QphH@100GB, available 11/15/99
Too early to know how TPC-H and TPC-R will fare
In general, hardware vendors seem to be more interested in TPC-H
47. Next TPC Benchmark: TPC-W
TPC-W (Web) is a transactional web benchmark.
TPC-W models a controlled Internet Commerce environment
that simulates the activities of a business oriented web server.
The application portrayed by the benchmark is a Retail Store
on the Internet with a customer browse-and-order scenario.
TPC-W measures how fast an E-commerce system completes
various E-commerce-type transactions
48. TPC-W Characteristics
TPC-W features:
The simultaneous execution of multiple transaction types that span a
breadth of complexity.
On-line transaction execution modes.
Databases consisting of many tables with a wide variety of sizes, attributes,
and relationship.
Multiple on-line browser sessions.
Secure browser interaction for confidential data.
On-line secure payment authorization to an external server.
Consistent web object update.
Transaction integrity (ACID properties).
Contention on data access and update.
24x7 operations requirement.
Three year total cost of ownership pricing model.
49. TPC-W Metrics
There are three workloads in the benchmark, representing
different customer environments.
Primarily shopping (WIPS). Representing typical browsing, searching
and ordering activities of on-line shopping.
Browsing (WIPSB). Representing browsing activities with dynamic
web page generation and searching activities.
Web-based Ordering (WIPSO). Representing intranet and business to
business secure web activities.
Primary metrics are: WIPS rate (WIPS), price/performance
($/WIPS), and the availability date of the priced configuration.
50. TPC-W Public Review
TPC-W specification is currently available for public review
on TPC web site.
Approved standard likely in Q1/2000
51. Reference Material
Jim Gray, The Benchmark Handbook for Database and
Transaction Processing Systems, Morgan Kaufmann, San
Mateo, CA, 1991.
Raj Jain, The Art of Computer Systems Performance Analysis:
Techniques for Experimental Design, Measurement, Simulation,
and Modeling, John Wiley & Sons, New York, 1991.
William Highleyman, Performance Analysis of Transaction
Processing Systems, Prentice Hall, Englewood Cliffs, NJ, 1988.
TPC Web site: www.tpc.org
IDEAS web site: www.ideasinternational.com
54. TPC-A Overview
Transaction is simple bank account debit/credit
Database scales with throughput
Transaction submitted from terminal
Read 100 bytes including Aid, Tid, Bid, Delta from terminal (see Clause 1.3)
BEGIN TRANSACTION
Update Account where Account_ID = Aid:
Read Account_Balance from Account
Set Account_Balance = Account_Balance + Delta
Write Account_Balance to Account
Write to History:
Aid, Tid, Bid, Delta, Time_stamp
Update Teller where Teller_ID = Tid:
Set Teller_Balance = Teller_Balance + Delta
Write Teller_Balance to Teller
Update Branch where Branch_ID = Bid:
Set Branch_Balance = Branch_Balance + Delta
Write Branch_Balance to Branch
COMMIT TRANSACTION
Write 200 bytes including Aid, Tid, Bid, Delta, Account_Balance to terminal
TPC-A TransactionTPC-A Transaction
55. TPC-A Database Schema
LegendLegend
Table NameTable Name
<cardinality><cardinality>
one-to-manyone-to-many
relationshiprelationship
BranchBranch
BB
AccountAccount
B*100KB*100K
100K100K
HistoryHistory
B*2.6MB*2.6M
TellerTeller
B*10B*101010
10 Terminals per Branch row10 Terminals per Branch row
10 second cycle time per terminal10 second cycle time per terminal
1 transaction/second per Branch row1 transaction/second per Branch row
56. TPC-A Transaction
Workload is vertically aligned with Branch
Makes scaling easy
But not very realistic
15% of accounts non-local
Produces cross database activity
What’s good about TPC-A?
Easy to understand
Easy to measured
Stresses high transaction rate, lots of physical IO
What’s bad about TPC-A?
Too simplistic! Lends itself to unrealistic optimizations
57. TPC-A Design Rationale
Branch & Teller
in cache, hotspot on branch
Account
too big to cache ⇒ requires disk access
History
sequential insert
hotspot at end
90-day capacity ensures reasonable ratio of disk to cpu
58. RTE ⇔ SUT
RTE - Remote Terminal Emulator
Emulates real user behavior
Submits txns to SUT, measures RT
Transaction rate includes think time
Many, many users (10 x tpsA)
SUT - System Under Test
All components except for terminal
Model of system:
T
T
T - C
Network*
C
L
I
E
N
T
C - S
Network*
SUTRTE
Response Time Measured Here
Host System(s)
S - S
Network*
S
E
R
V
E
R
59. TPC-A Metric
tpsA = transactions per second, average rate over 15+ minute
interval, at which 90% of txns get <= 2 second RT
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Response time (seconds)
NumberofTransactions
Average Response Time
90th Percentile
Response Time
60. TPC-A Price
Price
5 year Cost of Ownership: hardware, software, maintenance
Does not include development, comm lines, operators, power, cooling,
etc.
Strict pricing model ⇒ one of TPC’s big contributions
List prices
System must be orderable & commercially available
Committed ship date
61. Differences between TPC-A and TPC-B
TPC-B is database only portion of TPC-A
No terminals
No think times
TPC-B reduces history capacity to 30 days
Less disk in priced configuration
TPC-B was easier to configure and run, BUT
Even though TPC-B was more popular with vendors,
it did not have much credibility with customers.
62. TPC Loopholes
Pricing
Package pricing
Price does not include cost of five star wizards needed to get optimal
performance, so performance is not what a customer could get.
Client/Server
Offload presentation services to cheap clients, but report performance
of server
Benchmark specials
Discrete transactions
Custom transaction monitors
Hand coded presentation services