SlideShare a Scribd company logo
WWW.THETECHFIRM.CO
M
© 2016, The Technology Firm
Measuring Performance
Quickstart
Tony Fortunato
The Technology Firm
www.Thetechfirm.com
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Goal
 Measuring performance is not a straight forward exercise because:
• Many variables need to be documented
• Many other variables will be missed
• Choosing the appropriate methodology is key
• Tool selection is also important
 Choosing what type of performance you want to measure is your first step.
• Observing existing traffic.
• Generate your own traffic
 Regardless of performance type, you should always start with a local baseline
2
© 2016, The Technology Firm WWW.THETECHFIRM.COM
What Makes A Tool Effective
© 2016, The Technology Firm WWW.THETECHFIRM.COM
USB 3.0 to Gigabit Ethernet NIC Network Adapter
USB 2.0 120 to 300 Mbps
USB 3.0 5 Gbit/s
Is there anything wrong with this
USB 2.0 to Gigabit Ethernet NIC Network Adapter
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Network Latency Analysis
• To truly understand if you have an issue with latency, you must have a
point of reference to compare your results to
• Over time, you will learn your true latency values
Packet Transmit Time Chart
Packet Size
Bandwidth 48 64 512 1024 1518 2048 4096
9,600 0.04000000 0.05333333 0.42666667
19,200 0.02000000 0.02666667 0.21333333
56,000 0.00685714 0.00914286 0.07314286
64,000 0.00600000 0.00800000 0.06400000 0.1280000 0.1897500 0.2560000 0.5120000
128,000 0.00300000 0.00400000 0.03200000 0.0640000 0.0948750 0.1280000 0.2560000
1,024,000 0.00037500 0.00050000 0.00400000 0.0080000 0.0118594 0.0160000 0.0320000
1,544,000 0.00024870 0.00033161 0.00265285 0.0053057 0.0078653 0.0106114 0.0212228
4,000,000 0.00012800 0.00102400 0.0020480 0.0030360 0.0040960 0.0081920
16,000,000 0.00003200 0.00025600 0.0005120 0.0007590 0.0010240 0.0020480
10,000,000 0.00005120 0.00040960 0.0008192 0.0012144
100,000,000 0.00000512 0.00004096 0.0000819 0.0001214
1,000,000,000 0.00000051 0.00000410 0.0000082 0.0000121 0.0000164 0.0000328
155,000,000 0.00000248 0.00000330 0.00002643 0.00005285 0.00007835 0.00010570 0.00021141
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Observing Existing Traffic
 The following items need to be documented when considering this task:
• Date/Time
• Any business events – year end, tax season, etc.
• Duration of test
• Application information
• Client computer specifications/Operating system
• Software overview (SQL, WEB, multi-tier)
• How you will intercept data (span, tap, hub)
• Test script (manual)
• Can you automate the test (autoit, macros)
• How many tests are you performing
 I do 5, drop the high/low and average the 3
6
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Generate your own Traffic
 The following items need to be documented when considering this task:
• Date/Time
• Any business events – year end, tax season, etc.
• Duration of test
• Application information
• Client computer specifications/Operating system
• Are you using the disk – local or network drive
• If you are using a file, what is the size
• What is the slowest link between hosts
• How long do you want to test for
• What is the direction of traffic generation (upload vs download vs both)
• Can the test be automated
• What protocol/application do you want to use
• How many tests are you performing
 I do 5, drop the high/low and average the 3
7
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Don’t guess at file sizes
Determining Proper File Size
To get an approximate idea of the proper file size:
• Bandwidth of the slowest link between the client server
• Divide by 8 (bits in a Byte)
• Multiply by number of seconds
• Example:
• 100 Mbps / 8 = 12.5 MBps x 10 seconds = 125 MB file
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Always Start With A Local Baseline
9
In this example I used iperf, opened 2 command prompts and performed an upload test using the
application defaults.
i.e TCP port 5001, upload, 64K TCP Window Size, 10 seconds
© 2016, The Technology Firm WWW.THETECHFIRM.COM
A Local Baseline Can Also Be a VM Baseline
10
In this example I used iperf, opened 1 command prompt in the VM Host and Guest and performed
an upload test using the application defaults.
i.e TCP port 5001, upload, 64K TCP Window Size, 10 seconds
Guest VM
Host VM
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Back to Back (or as close as possible)
Generate traffic
1 GB full duplex
Local test avg throughput = 5 Gbps Local test avg throughput = 2 Gbps
Average test throughput: 955 Mbps
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Back to Back (or as close as possible)
1 GB full duplex
Local test avg throughput = 5 Gbps Local test avg throughput = 2 Gbps
Average test throughput: 955 Mbps
No measurable change
Same VLAN
Generate traffic
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Back to Back (or as close as possible)
1 GB full duplex
Average test throughput: 15 Mbps
Items to document
-Distance to AP
-Channel, RSSI, Noise
-How many other devices on AP
-Etc…
2.4 Ghz 802.11n
Generate traffic
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Ways to Automate Traffic Generation (Windows)
 To test from RAM
• Iperf + batch file
 To test from Disk
• Iperf + batch file
• Use -F, --fileinput <name> Option
• To test FTP
• Microsoft ftp supports the –s option that uses a text file where you can login, download, upload a file
• To test http
• Use a utility such as wget
• To test SQL/DB2
• Microsofts sqlcmd
• Many db2 and SQL vendors have utilities already available to work from the command line
• Another technical option is to use Telnet and the application port number
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Iperf Command line Example
Generates the file test.txt with the following output
15
Using >> appends to the file test.txt
© 2016, The Technology Firm WWW.THETECHFIRM.COM
Iperf Batch File Example
16
© 2016, The Technology Firm WWW.THETECHFIRM.COM
ftp example
 The –s option with microsoft’s FTP client allows you to script a test
 i.e ftp -s:ftp_test.ftp
 To send the output to a file use >
17
© 2016, The Technology Firm WWW.THETECHFIRM.COM
wget To Measure Throughput With HTTP
D:softwarewget>wget http://churchill/300mb
--2013-09-27 21:24:05-- http://churchill/300mb
Resolving churchill... 10.44.10.94
Connecting to churchill|10.44.10.94|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 333202944 (318M) [application/octet-stream]
Saving to: `300mb'
100%[======================================>] 333,202,944 1.47M/s in 3m 20s
2013-09-27 21:27:25 (1.59 MB/s) - `300mb' saved [333202944/333202944]
D:softwarewget>wget http://churchill/8mb
--2013-09-27 21:35:07-- http://churchill/8mb
Resolving churchill... 10.44.10.94
Connecting to churchill|10.44.10.94|:80... connected
HTTP request sent, awaiting response... 200 OK
Length: 9062704 (8.6M) [application/octet-stream]
Saving to: `8mb.1'
100%[======================================>] 9,062,704 1.38M/s in 6.9s
2013-09-27 21:35:14 (1.25 MB/s) - `8mb.1' saved [9062704/9062704]

More Related Content

What's hot

2015 02 24 lmtv baselining
2015 02 24 lmtv baselining2015 02 24 lmtv baselining
2015 02 24 lmtv baselining
Tony Fortunato
 
Wireshark
WiresharkWireshark
Wiresharkbtohara
 
Wireshark, Tcpdump and Network Performance tools
Wireshark, Tcpdump and Network Performance toolsWireshark, Tcpdump and Network Performance tools
Wireshark, Tcpdump and Network Performance tools
Sachidananda Sahu
 
Building the Internet of Things with Thingsquare and Contiki - day 2 part 2
Building the Internet of Things with Thingsquare and Contiki - day 2 part 2Building the Internet of Things with Thingsquare and Contiki - day 2 part 2
Building the Internet of Things with Thingsquare and Contiki - day 2 part 2
Adam Dunkels
 
Silverlight Wireshark Analysis
Silverlight Wireshark AnalysisSilverlight Wireshark Analysis
Silverlight Wireshark Analysis
Yoss Cohen
 
Innovation is back in the transport and network layers
Innovation is back in the transport and network layersInnovation is back in the transport and network layers
Innovation is back in the transport and network layers
Olivier Bonaventure
 
TCP and UDP
TCP and UDP TCP and UDP
TCP and UDP
Ramesh Giri
 
Packet analyzing with wireshark-basic of packet analyzing - Episode_02
Packet analyzing with wireshark-basic of packet analyzing - Episode_02Packet analyzing with wireshark-basic of packet analyzing - Episode_02
Packet analyzing with wireshark-basic of packet analyzing - Episode_02
Dhananja Kariyawasam
 
Ch 03 --- the OpenFlow protocols
Ch 03 --- the OpenFlow protocolsCh 03 --- the OpenFlow protocols
Ch 03 --- the OpenFlow protocols
Yoram Orzach
 
TCP/IP and UDP protocols
TCP/IP and UDP protocolsTCP/IP and UDP protocols
TCP/IP and UDP protocols
Dawood Faheem Abbasi
 
Wireshark
WiresharkWireshark
Wireshark
Vijay kumar
 
Chapter 3 : User Datagram Protocol (UDP)
Chapter 3 : User Datagram Protocol (UDP)Chapter 3 : User Datagram Protocol (UDP)
Chapter 3 : User Datagram Protocol (UDP)
Ministry of Higher Education
 
TCP Theory
TCP TheoryTCP Theory
TCP Theory
soohyunc
 
Wireshark - Basics
Wireshark - BasicsWireshark - Basics
Wireshark - Basics
Yoram Orzach
 
Overview of tcp ip
Overview of tcp ipOverview of tcp ip
Overview of tcp ip
Computing Cage
 
TCPLS presentation @ietf 109
TCPLS presentation @ietf 109TCPLS presentation @ietf 109
TCPLS presentation @ietf 109
Olivier Bonaventure
 
Module 1 slides
Module 1 slidesModule 1 slides
Module 1 slides
AnaniaKapala
 
Future Internet protocols
Future Internet protocolsFuture Internet protocols
Future Internet protocols
Olivier Bonaventure
 
User Datagram protocol For Msc CS
User Datagram protocol For Msc CSUser Datagram protocol For Msc CS
User Datagram protocol For Msc CSThanveen
 
Multipath TCP
Multipath TCPMultipath TCP
Multipath TCP
Olivier Bonaventure
 

What's hot (20)

2015 02 24 lmtv baselining
2015 02 24 lmtv baselining2015 02 24 lmtv baselining
2015 02 24 lmtv baselining
 
Wireshark
WiresharkWireshark
Wireshark
 
Wireshark, Tcpdump and Network Performance tools
Wireshark, Tcpdump and Network Performance toolsWireshark, Tcpdump and Network Performance tools
Wireshark, Tcpdump and Network Performance tools
 
Building the Internet of Things with Thingsquare and Contiki - day 2 part 2
Building the Internet of Things with Thingsquare and Contiki - day 2 part 2Building the Internet of Things with Thingsquare and Contiki - day 2 part 2
Building the Internet of Things with Thingsquare and Contiki - day 2 part 2
 
Silverlight Wireshark Analysis
Silverlight Wireshark AnalysisSilverlight Wireshark Analysis
Silverlight Wireshark Analysis
 
Innovation is back in the transport and network layers
Innovation is back in the transport and network layersInnovation is back in the transport and network layers
Innovation is back in the transport and network layers
 
TCP and UDP
TCP and UDP TCP and UDP
TCP and UDP
 
Packet analyzing with wireshark-basic of packet analyzing - Episode_02
Packet analyzing with wireshark-basic of packet analyzing - Episode_02Packet analyzing with wireshark-basic of packet analyzing - Episode_02
Packet analyzing with wireshark-basic of packet analyzing - Episode_02
 
Ch 03 --- the OpenFlow protocols
Ch 03 --- the OpenFlow protocolsCh 03 --- the OpenFlow protocols
Ch 03 --- the OpenFlow protocols
 
TCP/IP and UDP protocols
TCP/IP and UDP protocolsTCP/IP and UDP protocols
TCP/IP and UDP protocols
 
Wireshark
WiresharkWireshark
Wireshark
 
Chapter 3 : User Datagram Protocol (UDP)
Chapter 3 : User Datagram Protocol (UDP)Chapter 3 : User Datagram Protocol (UDP)
Chapter 3 : User Datagram Protocol (UDP)
 
TCP Theory
TCP TheoryTCP Theory
TCP Theory
 
Wireshark - Basics
Wireshark - BasicsWireshark - Basics
Wireshark - Basics
 
Overview of tcp ip
Overview of tcp ipOverview of tcp ip
Overview of tcp ip
 
TCPLS presentation @ietf 109
TCPLS presentation @ietf 109TCPLS presentation @ietf 109
TCPLS presentation @ietf 109
 
Module 1 slides
Module 1 slidesModule 1 slides
Module 1 slides
 
Future Internet protocols
Future Internet protocolsFuture Internet protocols
Future Internet protocols
 
User Datagram protocol For Msc CS
User Datagram protocol For Msc CSUser Datagram protocol For Msc CS
User Datagram protocol For Msc CS
 
Multipath TCP
Multipath TCPMultipath TCP
Multipath TCP
 

Viewers also liked

2015 03 06 lmtv wtf http webcast
2015 03 06 lmtv wtf http webcast2015 03 06 lmtv wtf http webcast
2015 03 06 lmtv wtf http webcast
Tony Fortunato
 
6 app-tcp
6 app-tcp6 app-tcp
Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...
Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...
Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...Dani Indra Kumara
 
network performance measurement using Iperf
network performance measurement using Iperfnetwork performance measurement using Iperf
network performance measurement using Iperf
shravankumar bhat
 
Wireshar training
Wireshar trainingWireshar training
Wireshar training
Luke Luo
 
95960910 atoll-getting-started-umts-310-en-v1
95960910 atoll-getting-started-umts-310-en-v195960910 atoll-getting-started-umts-310-en-v1
95960910 atoll-getting-started-umts-310-en-v1Oshin Neeh
 
Network Packet Analysis
Network Packet AnalysisNetwork Packet Analysis
Network Packet AnalysisAmmar WK
 
Computer Networking : Principles, Protocols and Practice - lesson 1
Computer Networking : Principles, Protocols and Practice - lesson 1Computer Networking : Principles, Protocols and Practice - lesson 1
Computer Networking : Principles, Protocols and Practice - lesson 1
Olivier Bonaventure
 
Atoll 3.1.2 automatic cell planning module
Atoll 3.1.2 automatic cell planning moduleAtoll 3.1.2 automatic cell planning module
Atoll 3.1.2 automatic cell planning module
AnthonyPeters01
 
95763406 atoll-3-1-0-user-manual-lte
95763406 atoll-3-1-0-user-manual-lte95763406 atoll-3-1-0-user-manual-lte
95763406 atoll-3-1-0-user-manual-lte
arif budiman
 
LTE RF Planning Tool - Atoll
LTE RF Planning Tool - AtollLTE RF Planning Tool - Atoll
LTE RF Planning Tool - Atoll
Justin MA (馬嘉昌)
 
Network planning and optimization using atoll
Network  planning  and optimization  using  atollNetwork  planning  and optimization  using  atoll
Network planning and optimization using atoll
Hamed Almsafer
 
Wireshark Inroduction Li In
Wireshark Inroduction  Li InWireshark Inroduction  Li In
Wireshark Inroduction Li In
mhaviv
 
Wireshark
WiresharkWireshark
Wireshark
Sourav Roy
 
AAA & RADIUS Protocols
AAA & RADIUS ProtocolsAAA & RADIUS Protocols
AAA & RADIUS Protocols
Peter R. Egli
 

Viewers also liked (20)

OSI Layering
OSI Layering OSI Layering
OSI Layering
 
2015 03 06 lmtv wtf http webcast
2015 03 06 lmtv wtf http webcast2015 03 06 lmtv wtf http webcast
2015 03 06 lmtv wtf http webcast
 
6 app-tcp
6 app-tcp6 app-tcp
6 app-tcp
 
Cipc
CipcCipc
Cipc
 
Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...
Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...
Wcdma rno handover algorithm analysis and parameter configurtaion guidance 20...
 
network performance measurement using Iperf
network performance measurement using Iperfnetwork performance measurement using Iperf
network performance measurement using Iperf
 
Wireshar training
Wireshar trainingWireshar training
Wireshar training
 
95960910 atoll-getting-started-umts-310-en-v1
95960910 atoll-getting-started-umts-310-en-v195960910 atoll-getting-started-umts-310-en-v1
95960910 atoll-getting-started-umts-310-en-v1
 
Network Packet Analysis
Network Packet AnalysisNetwork Packet Analysis
Network Packet Analysis
 
Iperf Tutorial
Iperf Tutorial Iperf Tutorial
Iperf Tutorial
 
Computer Networking : Principles, Protocols and Practice - lesson 1
Computer Networking : Principles, Protocols and Practice - lesson 1Computer Networking : Principles, Protocols and Practice - lesson 1
Computer Networking : Principles, Protocols and Practice - lesson 1
 
Atoll 3.1.2 automatic cell planning module
Atoll 3.1.2 automatic cell planning moduleAtoll 3.1.2 automatic cell planning module
Atoll 3.1.2 automatic cell planning module
 
Wireshark
WiresharkWireshark
Wireshark
 
95763406 atoll-3-1-0-user-manual-lte
95763406 atoll-3-1-0-user-manual-lte95763406 atoll-3-1-0-user-manual-lte
95763406 atoll-3-1-0-user-manual-lte
 
LTE RF Planning Tool - Atoll
LTE RF Planning Tool - AtollLTE RF Planning Tool - Atoll
LTE RF Planning Tool - Atoll
 
Network planning and optimization using atoll
Network  planning  and optimization  using  atollNetwork  planning  and optimization  using  atoll
Network planning and optimization using atoll
 
Wireshark Inroduction Li In
Wireshark Inroduction  Li InWireshark Inroduction  Li In
Wireshark Inroduction Li In
 
IPCRF presentation
IPCRF presentationIPCRF presentation
IPCRF presentation
 
Wireshark
WiresharkWireshark
Wireshark
 
AAA & RADIUS Protocols
AAA & RADIUS ProtocolsAAA & RADIUS Protocols
AAA & RADIUS Protocols
 

Similar to Performance test

TechTalk: Report Bugs Like a Boss
TechTalk: Report Bugs Like a BossTechTalk: Report Bugs Like a Boss
TechTalk: Report Bugs Like a Boss
Lizzy Guido (she/her)
 
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
TEST Huddle
 
Performance Tuning Oracle Weblogic Server 12c
Performance Tuning Oracle Weblogic Server 12cPerformance Tuning Oracle Weblogic Server 12c
Performance Tuning Oracle Weblogic Server 12c
Ajith Narayanan
 
Praxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloudPraxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloud
Roman Weber
 
PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux
Neotys
 
Website & Internet + Performance testing
Website & Internet + Performance testingWebsite & Internet + Performance testing
Website & Internet + Performance testing
Roman Ananev
 
Tech trends 2018 2019
Tech trends 2018 2019Tech trends 2018 2019
Tech trends 2018 2019
Johan Norm
 
Mulesoft Meetup Milano #9 - Batch Processing and CI/CD
Mulesoft Meetup Milano #9 - Batch Processing and CI/CDMulesoft Meetup Milano #9 - Batch Processing and CI/CD
Mulesoft Meetup Milano #9 - Batch Processing and CI/CD
Gonzalo Marcos Ansoain
 
Fundamentals Performance Testing
Fundamentals Performance TestingFundamentals Performance Testing
Fundamentals Performance Testing
Bhuvaneswari Subramani
 
SDAccel Design Contest: Vivado HLS
SDAccel Design Contest: Vivado HLSSDAccel Design Contest: Vivado HLS
SDAccel Design Contest: Vivado HLS
NECST Lab @ Politecnico di Milano
 
Using JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous TestingUsing JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous Testing
Jennifer Finney
 
measuring and monitoring client side performance / Nir Nahum
measuring and monitoring client side performance / Nir Nahummeasuring and monitoring client side performance / Nir Nahum
measuring and monitoring client side performance / Nir Nahum
geektimecoil
 
NVMe and NVMe-oF Plugfest Webinar 9
NVMe and NVMe-oF Plugfest Webinar 9NVMe and NVMe-oF Plugfest Webinar 9
NVMe and NVMe-oF Plugfest Webinar 9
UNH InterOperability Lab
 
Tools. Techniques. Trouble?
Tools. Techniques. Trouble?Tools. Techniques. Trouble?
Tools. Techniques. Trouble?
Testplant
 
Assessing Network Readiness
Assessing Network ReadinessAssessing Network Readiness
Assessing Network Readiness
rAVe [PUBS]
 
Machine Data Is EVERYWHERE: Use It for Testing
Machine Data Is EVERYWHERE: Use It for TestingMachine Data Is EVERYWHERE: Use It for Testing
Machine Data Is EVERYWHERE: Use It for Testing
TechWell
 
Streaming in the Wild with Apache Flink
Streaming in the Wild with Apache FlinkStreaming in the Wild with Apache Flink
Streaming in the Wild with Apache Flink
DataWorks Summit/Hadoop Summit
 
INT_Ch17.pptx
INT_Ch17.pptxINT_Ch17.pptx
INT_Ch17.pptx
NguyenLong773850
 
Streaming in the Wild with Apache Flink
Streaming in the Wild with Apache FlinkStreaming in the Wild with Apache Flink
Streaming in the Wild with Apache Flink
Kostas Tzoumas
 

Similar to Performance test (20)

TechTalk: Report Bugs Like a Boss
TechTalk: Report Bugs Like a BossTechTalk: Report Bugs Like a Boss
TechTalk: Report Bugs Like a Boss
 
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
 
Performance Tuning Oracle Weblogic Server 12c
Performance Tuning Oracle Weblogic Server 12cPerformance Tuning Oracle Weblogic Server 12c
Performance Tuning Oracle Weblogic Server 12c
 
Praxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloudPraxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloud
 
PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux
 
Website & Internet + Performance testing
Website & Internet + Performance testingWebsite & Internet + Performance testing
Website & Internet + Performance testing
 
Tech trends 2018 2019
Tech trends 2018 2019Tech trends 2018 2019
Tech trends 2018 2019
 
Mulesoft Meetup Milano #9 - Batch Processing and CI/CD
Mulesoft Meetup Milano #9 - Batch Processing and CI/CDMulesoft Meetup Milano #9 - Batch Processing and CI/CD
Mulesoft Meetup Milano #9 - Batch Processing and CI/CD
 
Fundamentals Performance Testing
Fundamentals Performance TestingFundamentals Performance Testing
Fundamentals Performance Testing
 
SDAccel Design Contest: Vivado HLS
SDAccel Design Contest: Vivado HLSSDAccel Design Contest: Vivado HLS
SDAccel Design Contest: Vivado HLS
 
Using JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous TestingUsing JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous Testing
 
measuring and monitoring client side performance / Nir Nahum
measuring and monitoring client side performance / Nir Nahummeasuring and monitoring client side performance / Nir Nahum
measuring and monitoring client side performance / Nir Nahum
 
NVMe and NVMe-oF Plugfest Webinar 9
NVMe and NVMe-oF Plugfest Webinar 9NVMe and NVMe-oF Plugfest Webinar 9
NVMe and NVMe-oF Plugfest Webinar 9
 
Tools. Techniques. Trouble?
Tools. Techniques. Trouble?Tools. Techniques. Trouble?
Tools. Techniques. Trouble?
 
Assessing Network Readiness
Assessing Network ReadinessAssessing Network Readiness
Assessing Network Readiness
 
Machine Data Is EVERYWHERE: Use It for Testing
Machine Data Is EVERYWHERE: Use It for TestingMachine Data Is EVERYWHERE: Use It for Testing
Machine Data Is EVERYWHERE: Use It for Testing
 
Streaming in the Wild with Apache Flink
Streaming in the Wild with Apache FlinkStreaming in the Wild with Apache Flink
Streaming in the Wild with Apache Flink
 
JMeter
JMeterJMeter
JMeter
 
INT_Ch17.pptx
INT_Ch17.pptxINT_Ch17.pptx
INT_Ch17.pptx
 
Streaming in the Wild with Apache Flink
Streaming in the Wild with Apache FlinkStreaming in the Wild with Apache Flink
Streaming in the Wild with Apache Flink
 

Recently uploaded

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 

Recently uploaded (20)

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 

Performance test

  • 1. WWW.THETECHFIRM.CO M © 2016, The Technology Firm Measuring Performance Quickstart Tony Fortunato The Technology Firm www.Thetechfirm.com
  • 2. © 2016, The Technology Firm WWW.THETECHFIRM.COM Goal  Measuring performance is not a straight forward exercise because: • Many variables need to be documented • Many other variables will be missed • Choosing the appropriate methodology is key • Tool selection is also important  Choosing what type of performance you want to measure is your first step. • Observing existing traffic. • Generate your own traffic  Regardless of performance type, you should always start with a local baseline 2
  • 3. © 2016, The Technology Firm WWW.THETECHFIRM.COM What Makes A Tool Effective
  • 4. © 2016, The Technology Firm WWW.THETECHFIRM.COM USB 3.0 to Gigabit Ethernet NIC Network Adapter USB 2.0 120 to 300 Mbps USB 3.0 5 Gbit/s Is there anything wrong with this USB 2.0 to Gigabit Ethernet NIC Network Adapter
  • 5. © 2016, The Technology Firm WWW.THETECHFIRM.COM Network Latency Analysis • To truly understand if you have an issue with latency, you must have a point of reference to compare your results to • Over time, you will learn your true latency values Packet Transmit Time Chart Packet Size Bandwidth 48 64 512 1024 1518 2048 4096 9,600 0.04000000 0.05333333 0.42666667 19,200 0.02000000 0.02666667 0.21333333 56,000 0.00685714 0.00914286 0.07314286 64,000 0.00600000 0.00800000 0.06400000 0.1280000 0.1897500 0.2560000 0.5120000 128,000 0.00300000 0.00400000 0.03200000 0.0640000 0.0948750 0.1280000 0.2560000 1,024,000 0.00037500 0.00050000 0.00400000 0.0080000 0.0118594 0.0160000 0.0320000 1,544,000 0.00024870 0.00033161 0.00265285 0.0053057 0.0078653 0.0106114 0.0212228 4,000,000 0.00012800 0.00102400 0.0020480 0.0030360 0.0040960 0.0081920 16,000,000 0.00003200 0.00025600 0.0005120 0.0007590 0.0010240 0.0020480 10,000,000 0.00005120 0.00040960 0.0008192 0.0012144 100,000,000 0.00000512 0.00004096 0.0000819 0.0001214 1,000,000,000 0.00000051 0.00000410 0.0000082 0.0000121 0.0000164 0.0000328 155,000,000 0.00000248 0.00000330 0.00002643 0.00005285 0.00007835 0.00010570 0.00021141
  • 6. © 2016, The Technology Firm WWW.THETECHFIRM.COM Observing Existing Traffic  The following items need to be documented when considering this task: • Date/Time • Any business events – year end, tax season, etc. • Duration of test • Application information • Client computer specifications/Operating system • Software overview (SQL, WEB, multi-tier) • How you will intercept data (span, tap, hub) • Test script (manual) • Can you automate the test (autoit, macros) • How many tests are you performing  I do 5, drop the high/low and average the 3 6
  • 7. © 2016, The Technology Firm WWW.THETECHFIRM.COM Generate your own Traffic  The following items need to be documented when considering this task: • Date/Time • Any business events – year end, tax season, etc. • Duration of test • Application information • Client computer specifications/Operating system • Are you using the disk – local or network drive • If you are using a file, what is the size • What is the slowest link between hosts • How long do you want to test for • What is the direction of traffic generation (upload vs download vs both) • Can the test be automated • What protocol/application do you want to use • How many tests are you performing  I do 5, drop the high/low and average the 3 7
  • 8. © 2016, The Technology Firm WWW.THETECHFIRM.COM Don’t guess at file sizes Determining Proper File Size To get an approximate idea of the proper file size: • Bandwidth of the slowest link between the client server • Divide by 8 (bits in a Byte) • Multiply by number of seconds • Example: • 100 Mbps / 8 = 12.5 MBps x 10 seconds = 125 MB file
  • 9. © 2016, The Technology Firm WWW.THETECHFIRM.COM Always Start With A Local Baseline 9 In this example I used iperf, opened 2 command prompts and performed an upload test using the application defaults. i.e TCP port 5001, upload, 64K TCP Window Size, 10 seconds
  • 10. © 2016, The Technology Firm WWW.THETECHFIRM.COM A Local Baseline Can Also Be a VM Baseline 10 In this example I used iperf, opened 1 command prompt in the VM Host and Guest and performed an upload test using the application defaults. i.e TCP port 5001, upload, 64K TCP Window Size, 10 seconds Guest VM Host VM
  • 11. © 2016, The Technology Firm WWW.THETECHFIRM.COM Back to Back (or as close as possible) Generate traffic 1 GB full duplex Local test avg throughput = 5 Gbps Local test avg throughput = 2 Gbps Average test throughput: 955 Mbps
  • 12. © 2016, The Technology Firm WWW.THETECHFIRM.COM Back to Back (or as close as possible) 1 GB full duplex Local test avg throughput = 5 Gbps Local test avg throughput = 2 Gbps Average test throughput: 955 Mbps No measurable change Same VLAN Generate traffic
  • 13. © 2016, The Technology Firm WWW.THETECHFIRM.COM Back to Back (or as close as possible) 1 GB full duplex Average test throughput: 15 Mbps Items to document -Distance to AP -Channel, RSSI, Noise -How many other devices on AP -Etc… 2.4 Ghz 802.11n Generate traffic
  • 14. © 2016, The Technology Firm WWW.THETECHFIRM.COM Ways to Automate Traffic Generation (Windows)  To test from RAM • Iperf + batch file  To test from Disk • Iperf + batch file • Use -F, --fileinput <name> Option • To test FTP • Microsoft ftp supports the –s option that uses a text file where you can login, download, upload a file • To test http • Use a utility such as wget • To test SQL/DB2 • Microsofts sqlcmd • Many db2 and SQL vendors have utilities already available to work from the command line • Another technical option is to use Telnet and the application port number
  • 15. © 2016, The Technology Firm WWW.THETECHFIRM.COM Iperf Command line Example Generates the file test.txt with the following output 15 Using >> appends to the file test.txt
  • 16. © 2016, The Technology Firm WWW.THETECHFIRM.COM Iperf Batch File Example 16
  • 17. © 2016, The Technology Firm WWW.THETECHFIRM.COM ftp example  The –s option with microsoft’s FTP client allows you to script a test  i.e ftp -s:ftp_test.ftp  To send the output to a file use > 17
  • 18. © 2016, The Technology Firm WWW.THETECHFIRM.COM wget To Measure Throughput With HTTP D:softwarewget>wget http://churchill/300mb --2013-09-27 21:24:05-- http://churchill/300mb Resolving churchill... 10.44.10.94 Connecting to churchill|10.44.10.94|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 333202944 (318M) [application/octet-stream] Saving to: `300mb' 100%[======================================>] 333,202,944 1.47M/s in 3m 20s 2013-09-27 21:27:25 (1.59 MB/s) - `300mb' saved [333202944/333202944] D:softwarewget>wget http://churchill/8mb --2013-09-27 21:35:07-- http://churchill/8mb Resolving churchill... 10.44.10.94 Connecting to churchill|10.44.10.94|:80... connected HTTP request sent, awaiting response... 200 OK Length: 9062704 (8.6M) [application/octet-stream] Saving to: `8mb.1' 100%[======================================>] 9,062,704 1.38M/s in 6.9s 2013-09-27 21:35:14 (1.25 MB/s) - `8mb.1' saved [9062704/9062704]