SlideShare a Scribd company logo
INSTRUMENTATION
AND MEASUREMENT
M.PRASAD NAIDU
Msc Medical Biochemistry,
Ph.D Research scholar.
Abstract
 Why Instrumentation and Measurement ?
 Instrumentation Techniques
 Resources
 Data Analysis
 Case Study: Paradyn
› Guiding Principles
› System Overview
› W3
Search Model
Why Instrumentation and Measurement ?
• Gathering data to improve the next execution
of the program.
• Guiding scheduling decisions
• Adapting to computations while in execution
Instrumentation Techniques
 Program Instrumentation Techniques
› Manual : Programmer inserted directives
› Automatic : No direct user involvement
 Binary Rewriting
 Dynamic Instrumentation
 Processor Instrumentation Techniques
› Information includes timers, memory system
performance, processor usage, etc.
› Available mostly through special registers or memory
mapped location.
 Example : Pentium Pro provides performance data through
MSRs. These registers include 64 bit cycle clock and counts of
memory read /write, L1 cache misses, pipeline flushes, etc.
› Hardware assisted trace generation.
 Operating System Instrumentation Techniques
› Information includes behavior of virtual memory, file
system, file cache etc.
› Instrumentation in the form of APIs for applications to
access these variables.
 Network Instrumentation Techniques
› Ways of measuring
 Passive
 Example: RMON protocol defines SNMP MIB variables to report
traffic statistics over hubs and switches.
 Active
 Example: Ping, NWS in grid style computing.
Data Storage Representation
• Scalars
– Counters
– Times
• Traces
• Vector series
Resources
• Software Abstractions
– Program Components
– Code in Executions
– Synchronization Objects
– Other Software Abstractions
• Hardware Abstractions
• Network Abstractions
Data Analysis
• Quantitative Performance
• Automating Performance Diagnosis
• Perturbation Analysis
Harrison institute of
biotechnology
Case Study
Guiding Principles and
Characteristics
• Scalability
• Automate the search for performance problems
• Provide well-defined data abstractions
• Support heterogeneous environments
• Support high level parallel languages
• Open interfaces for visualization and new data
sources
• Streamlined use
System Overview
• Basic Abstractions
– Metric-focus grid
– Time Histograms
• Components of the System
– Main Paradyn Process
• Performance Consultant
• Visualization Manager
• Data Manager
• User Interface Manager
– Paradyn daemons
– External Visualization Processes.
Histogram VisualizationTable Visualization
Tabular Summary
CPU 3.0 4.0
Messages 117 81
Metric Manager
Instrumentation
Manager
Metric Manager
Instrumentation
Manager
Visualization
Manager
User Interface
Manager
Performance
Consultant
Data Manager
Application
Application
Processes
Processes
Visi Thread Visi Thread
HIB Daemon(s)
HIB
Dynamic Instrumentation
 Dynamic Instrumentation Interface
› Metric Manager
› Instrumentation Manager
 Points, Primitives and Predicates
addCounter(fooFlg, 1)
addCounter(fooFlg, 1)
Foo()
{
….
….
}
SendMsg( dest, ptr, cnt, size)
{
….
….
}
if (fooFlg)
startTimer(msgTme, ProcTime)
if (fooFlg)
stopTimer(msgTme)
• Instrumentation generation
– Base Trampolines
– Mini-Trampolines
• Data Collection
• Internal Uses of Dynamic Instrumentation
– Resource Discovery
– Collection of dynamic mapping information for
HLL.
The W3
Search Model and the
Performance Consultant
• Why ? Where ? When ?
– The “Why” Axis
• Why is the application performing poorly ?
– Potential performance problems are represented as hypotheses and
tests.
– Hypotheses represent activities universal to all parallel
computations.
– Hypotheses can be refined into more refined hypotheses using a
search hierarchy.
– Tests are Boolean functions that evaluate the validity of a
hypotheses.
– Tests are expressed in terms of a threshold and metrics calculated by
the Instrumentation Manager.
A sample “why” axis with several hypotheses
TopLevelHypotheses
SyncBottleNeck
HighSyncBlockingTimeFrequentSyncOperations
HighSyncContentionHighSyncHoldingTime
› The “Where” Axis
 Where is the performance problem ?
 Pinpoints the problem specific to program components.
 Each hierarchy in “where” axis has multiple levels, with the
leaf nodes being the instances of resources used by the
application.
SyncObject
Semaphores Message SpinLock Barier
– The “When” Axis
• When does the problem occur ?
– Represents periods of time during which performance
problems can occur.
• The Performance Consultant
– This module discovers performance problems
by searching the space defined by W3
Search
Model.
– Fully automated search but also allows user to
make manual refinements.
Open Visualization Interface
• Paradyn provides a simple library and RPC
interface to access performance data in real-
time.
• Visualization modules (visi’s) in Paradyn are
external processes that use this library and
interface.
• Currently provides visi’s for time-histograms,
bar charts and tables.
Examples of Use
Conclusion
Computational grids are focused on high
performance distributed computing. To
achieve high performance, such systems need
to provide tools that enable the programmer
to realize the potential performance inherent
in such a system.
THANK YOU

More Related Content

What's hot

Electronic Measurement and Instrumentation
Electronic Measurement and InstrumentationElectronic Measurement and Instrumentation
Electronic Measurement and Instrumentation
Manipal University Jaipur
 
Transducers
TransducersTransducers
Transducers
Naveen Sihag
 
sensors and transducers Module 1 n 2
sensors and transducers Module 1 n 2sensors and transducers Module 1 n 2
sensors and transducers Module 1 n 2
Anchal bassi
 
Introduction to measurements systems
Introduction to measurements systemsIntroduction to measurements systems
Introduction to measurements systems
KanyaKumariB
 
Telemetry types, frequency,position and multiplexing in telemetry
Telemetry types, frequency,position and multiplexing in telemetryTelemetry types, frequency,position and multiplexing in telemetry
Telemetry types, frequency,position and multiplexing in telemetry
sagheer ahmed
 
Data acquisition & system control basic information
Data acquisition & system control basic information Data acquisition & system control basic information
Data acquisition & system control basic information
patel andil
 
Sensors and transducers 1.ppt
Sensors and transducers 1.pptSensors and transducers 1.ppt
Sensors and transducers 1.ppt
MdJunaid20
 
Resistive Sensors
Resistive SensorsResistive Sensors
Resistive Sensors
Debasmit Das
 
Load cell-transducer
Load cell-transducerLoad cell-transducer
Load cell-transducer
usama umar
 
Static and dynamic characteristics of instruments
Static and dynamic characteristics of instrumentsStatic and dynamic characteristics of instruments
Static and dynamic characteristics of instruments
freddyuae
 
Emi unit 1 ppt
Emi unit 1 pptEmi unit 1 ppt
Emi unit 1 ppt
SIVA NAGENDRA REDDY
 
Recorder
RecorderRecorder
Different types of recorders
Different types of recordersDifferent types of recorders
Resistive transducers and Strain Gauge
Resistive transducers and Strain GaugeResistive transducers and Strain Gauge
Resistive transducers and Strain Gauge
karoline Enoch
 
Transducers ppt
Transducers pptTransducers ppt
Telemetry
TelemetryTelemetry
Telemetry
Anchal bassi
 
Data transmission and telemetry
Data transmission and telemetryData transmission and telemetry
Data transmission and telemetry
slide rock
 
Types of load cell and principle
Types of load cell and principle Types of load cell and principle
Types of load cell and principle
Mostafa Ragab
 
Displacement measurement
Displacement measurementDisplacement measurement
Displacement measurement
wasim shah
 
basic of measurement and instrumentation.
basic of measurement and instrumentation.basic of measurement and instrumentation.
basic of measurement and instrumentation.
SACHINNikam39
 

What's hot (20)

Electronic Measurement and Instrumentation
Electronic Measurement and InstrumentationElectronic Measurement and Instrumentation
Electronic Measurement and Instrumentation
 
Transducers
TransducersTransducers
Transducers
 
sensors and transducers Module 1 n 2
sensors and transducers Module 1 n 2sensors and transducers Module 1 n 2
sensors and transducers Module 1 n 2
 
Introduction to measurements systems
Introduction to measurements systemsIntroduction to measurements systems
Introduction to measurements systems
 
Telemetry types, frequency,position and multiplexing in telemetry
Telemetry types, frequency,position and multiplexing in telemetryTelemetry types, frequency,position and multiplexing in telemetry
Telemetry types, frequency,position and multiplexing in telemetry
 
Data acquisition & system control basic information
Data acquisition & system control basic information Data acquisition & system control basic information
Data acquisition & system control basic information
 
Sensors and transducers 1.ppt
Sensors and transducers 1.pptSensors and transducers 1.ppt
Sensors and transducers 1.ppt
 
Resistive Sensors
Resistive SensorsResistive Sensors
Resistive Sensors
 
Load cell-transducer
Load cell-transducerLoad cell-transducer
Load cell-transducer
 
Static and dynamic characteristics of instruments
Static and dynamic characteristics of instrumentsStatic and dynamic characteristics of instruments
Static and dynamic characteristics of instruments
 
Emi unit 1 ppt
Emi unit 1 pptEmi unit 1 ppt
Emi unit 1 ppt
 
Recorder
RecorderRecorder
Recorder
 
Different types of recorders
Different types of recordersDifferent types of recorders
Different types of recorders
 
Resistive transducers and Strain Gauge
Resistive transducers and Strain GaugeResistive transducers and Strain Gauge
Resistive transducers and Strain Gauge
 
Transducers ppt
Transducers pptTransducers ppt
Transducers ppt
 
Telemetry
TelemetryTelemetry
Telemetry
 
Data transmission and telemetry
Data transmission and telemetryData transmission and telemetry
Data transmission and telemetry
 
Types of load cell and principle
Types of load cell and principle Types of load cell and principle
Types of load cell and principle
 
Displacement measurement
Displacement measurementDisplacement measurement
Displacement measurement
 
basic of measurement and instrumentation.
basic of measurement and instrumentation.basic of measurement and instrumentation.
basic of measurement and instrumentation.
 

Viewers also liked

Characteristics of instruments
Characteristics of instrumentsCharacteristics of instruments
Characteristics of instruments
Ravi Patel
 
Measurement & Instrumentation (BE)
Measurement & Instrumentation (BE)Measurement & Instrumentation (BE)
Measurement & Instrumentation (BE)
PRABHAHARAN429
 
Static characteristics in mechanical measurements & metrology
Static characteristics in mechanical measurements & metrologyStatic characteristics in mechanical measurements & metrology
Static characteristics in mechanical measurements & metrology
Chirag Solanki
 
Static characteristics of Instruments
Static characteristics of InstrumentsStatic characteristics of Instruments
Static characteristics of Instruments
Chandan Singh
 
Introduction, advantages of electronic instrumentation, instrument classifica...
Introduction, advantages of electronic instrumentation, instrument classifica...Introduction, advantages of electronic instrumentation, instrument classifica...
Introduction, advantages of electronic instrumentation, instrument classifica...
Engr Ali Mouzam
 
Instrumentation and control systems
Instrumentation and control systemsInstrumentation and control systems
Instrumentation and control systems
Erwin Coliyat
 
Measuring instruments
Measuring instrumentsMeasuring instruments
Measuring instruments
Sayyed Raza
 
Measurement & instrumentation ppt
Measurement & instrumentation pptMeasurement & instrumentation ppt
Measurement & instrumentation ppt
Prabhu R
 
Basics Of Instrumentation
Basics Of InstrumentationBasics Of Instrumentation
Basics Of Instrumentation
Vinoth Ganesh
 
Instrumentation
InstrumentationInstrumentation
Instrumentation
AKANSHA GURELE
 
Transducers & transmitters
Transducers & transmittersTransducers & transmitters
Transducers & transmitters
MNButt
 
Measurement and Metrology
Measurement and MetrologyMeasurement and Metrology
Measurement and Metrology
Avinash Navin
 
107 basic instrumentation
107 basic instrumentation 107 basic instrumentation
107 basic instrumentation
Md. Zulfequar Ali Khan
 
Metrology and Measuremenrt
Metrology and MeasuremenrtMetrology and Measuremenrt
Metrology and Measuremenrt
surianarayan Tp.Suri
 
Electrical instruments ppt
Electrical instruments pptElectrical instruments ppt
Electrical instruments ppt
Amey Waghmare
 
Measurement memory
Measurement memoryMeasurement memory
Measurement memory
Emily Lobao
 
ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...
ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...
ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...
ijics
 
410402 Electronic Measurements And Instrumentation
410402 Electronic Measurements And Instrumentation410402 Electronic Measurements And Instrumentation
410402 Electronic Measurements And Instrumentation
guestac67362
 
Migrating from current loop to PROFIBUS PA - Dale Fittes and Dave Tomlin of ...
Migrating from current loop to PROFIBUS PA  - Dale Fittes and Dave Tomlin of ...Migrating from current loop to PROFIBUS PA  - Dale Fittes and Dave Tomlin of ...
Migrating from current loop to PROFIBUS PA - Dale Fittes and Dave Tomlin of ...
PROFIBUS and PROFINET InternationaI - PI UK
 
Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...
Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...
Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...
Thorne & Derrick International
 

Viewers also liked (20)

Characteristics of instruments
Characteristics of instrumentsCharacteristics of instruments
Characteristics of instruments
 
Measurement & Instrumentation (BE)
Measurement & Instrumentation (BE)Measurement & Instrumentation (BE)
Measurement & Instrumentation (BE)
 
Static characteristics in mechanical measurements & metrology
Static characteristics in mechanical measurements & metrologyStatic characteristics in mechanical measurements & metrology
Static characteristics in mechanical measurements & metrology
 
Static characteristics of Instruments
Static characteristics of InstrumentsStatic characteristics of Instruments
Static characteristics of Instruments
 
Introduction, advantages of electronic instrumentation, instrument classifica...
Introduction, advantages of electronic instrumentation, instrument classifica...Introduction, advantages of electronic instrumentation, instrument classifica...
Introduction, advantages of electronic instrumentation, instrument classifica...
 
Instrumentation and control systems
Instrumentation and control systemsInstrumentation and control systems
Instrumentation and control systems
 
Measuring instruments
Measuring instrumentsMeasuring instruments
Measuring instruments
 
Measurement & instrumentation ppt
Measurement & instrumentation pptMeasurement & instrumentation ppt
Measurement & instrumentation ppt
 
Basics Of Instrumentation
Basics Of InstrumentationBasics Of Instrumentation
Basics Of Instrumentation
 
Instrumentation
InstrumentationInstrumentation
Instrumentation
 
Transducers & transmitters
Transducers & transmittersTransducers & transmitters
Transducers & transmitters
 
Measurement and Metrology
Measurement and MetrologyMeasurement and Metrology
Measurement and Metrology
 
107 basic instrumentation
107 basic instrumentation 107 basic instrumentation
107 basic instrumentation
 
Metrology and Measuremenrt
Metrology and MeasuremenrtMetrology and Measuremenrt
Metrology and Measuremenrt
 
Electrical instruments ppt
Electrical instruments pptElectrical instruments ppt
Electrical instruments ppt
 
Measurement memory
Measurement memoryMeasurement memory
Measurement memory
 
ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...
ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...
ZIGBEE BASED WIRELESS DATA ACQUISITION USING LABVIEW FOR IMPLEMENTING SMART D...
 
410402 Electronic Measurements And Instrumentation
410402 Electronic Measurements And Instrumentation410402 Electronic Measurements And Instrumentation
410402 Electronic Measurements And Instrumentation
 
Migrating from current loop to PROFIBUS PA - Dale Fittes and Dave Tomlin of ...
Migrating from current loop to PROFIBUS PA  - Dale Fittes and Dave Tomlin of ...Migrating from current loop to PROFIBUS PA  - Dale Fittes and Dave Tomlin of ...
Migrating from current loop to PROFIBUS PA - Dale Fittes and Dave Tomlin of ...
 
Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...
Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...
Hazardous Area Flameproof Group I Cable Gland - G1 Liquid Tight Conduit Fitti...
 

Similar to Instrumentation and measurement

How to create custom dashboards in Elastic Search / Kibana with Performance V...
How to create custom dashboards in Elastic Search / Kibana with Performance V...How to create custom dashboards in Elastic Search / Kibana with Performance V...
How to create custom dashboards in Elastic Search / Kibana with Performance V...
PerformanceVision (previously SecurActive)
 
Automated Discovery of Performance Regressions in Enterprise Applications
Automated Discovery of Performance Regressions in Enterprise ApplicationsAutomated Discovery of Performance Regressions in Enterprise Applications
Automated Discovery of Performance Regressions in Enterprise Applications
SAIL_QU
 
Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16
Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16
Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16
AppDynamics
 
ADDO Open Source Observability Tools
ADDO Open Source Observability Tools ADDO Open Source Observability Tools
ADDO Open Source Observability Tools
Mickey Boxell
 
Diksha sda presentation
Diksha sda presentationDiksha sda presentation
Diksha sda presentation
dikshagupta111
 
The differing ways to monitor and instrument
The differing ways to monitor and instrumentThe differing ways to monitor and instrument
The differing ways to monitor and instrument
Jonah Kowall
 
Service quality monitoring system architecture
Service quality monitoring system architectureService quality monitoring system architecture
Service quality monitoring system architecture
Matsuo Sawahashi
 
Visual Studio Profiler
Visual Studio ProfilerVisual Studio Profiler
Visual Studio Profiler
Betclic Everest Group Tech Team
 
DockerCon SF 2019 - Observability Workshop
DockerCon SF 2019 - Observability WorkshopDockerCon SF 2019 - Observability Workshop
DockerCon SF 2019 - Observability Workshop
Kevin Crawley
 
Big Data Berlin v8.0 Stream Processing with Apache Apex
Big Data Berlin v8.0 Stream Processing with Apache Apex Big Data Berlin v8.0 Stream Processing with Apache Apex
Big Data Berlin v8.0 Stream Processing with Apache Apex
Apache Apex
 
Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...
Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...
Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...
Dataconomy Media
 
Automating the process of continuously prioritising data, updating and deploy...
Automating the process of continuously prioritising data, updating and deploy...Automating the process of continuously prioritising data, updating and deploy...
Automating the process of continuously prioritising data, updating and deploy...
Ola Spjuth
 
Next Gen Big Data Analytics with Apache Apex
Next Gen Big Data Analytics with Apache Apex Next Gen Big Data Analytics with Apache Apex
Next Gen Big Data Analytics with Apache Apex
DataWorks Summit/Hadoop Summit
 
The Diabolical Developers Guide to Performance Tuning
The Diabolical Developers Guide to Performance TuningThe Diabolical Developers Guide to Performance Tuning
The Diabolical Developers Guide to Performance Tuning
jClarity
 
Hadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache Apex
Hadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache ApexHadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache Apex
Hadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache Apex
Apache Apex
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
Malik Ghulam Murtza
 
A machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companiesA machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companies
DataWorks Summit
 
1 Information Systems Analysis & Design,.pptx
1 Information Systems Analysis & Design,.pptx1 Information Systems Analysis & Design,.pptx
1 Information Systems Analysis & Design,.pptx
MadhusudhanaSubraman
 
QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...
QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...
QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...
QuantUniversity
 
DNA: an overview
DNA: an overviewDNA: an overview
DNA: an overview
Cisco DevNet
 

Similar to Instrumentation and measurement (20)

How to create custom dashboards in Elastic Search / Kibana with Performance V...
How to create custom dashboards in Elastic Search / Kibana with Performance V...How to create custom dashboards in Elastic Search / Kibana with Performance V...
How to create custom dashboards in Elastic Search / Kibana with Performance V...
 
Automated Discovery of Performance Regressions in Enterprise Applications
Automated Discovery of Performance Regressions in Enterprise ApplicationsAutomated Discovery of Performance Regressions in Enterprise Applications
Automated Discovery of Performance Regressions in Enterprise Applications
 
Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16
Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16
Monitoring and Instrumentation Strategies: Tips and Best Practices - AppSphere16
 
ADDO Open Source Observability Tools
ADDO Open Source Observability Tools ADDO Open Source Observability Tools
ADDO Open Source Observability Tools
 
Diksha sda presentation
Diksha sda presentationDiksha sda presentation
Diksha sda presentation
 
The differing ways to monitor and instrument
The differing ways to monitor and instrumentThe differing ways to monitor and instrument
The differing ways to monitor and instrument
 
Service quality monitoring system architecture
Service quality monitoring system architectureService quality monitoring system architecture
Service quality monitoring system architecture
 
Visual Studio Profiler
Visual Studio ProfilerVisual Studio Profiler
Visual Studio Profiler
 
DockerCon SF 2019 - Observability Workshop
DockerCon SF 2019 - Observability WorkshopDockerCon SF 2019 - Observability Workshop
DockerCon SF 2019 - Observability Workshop
 
Big Data Berlin v8.0 Stream Processing with Apache Apex
Big Data Berlin v8.0 Stream Processing with Apache Apex Big Data Berlin v8.0 Stream Processing with Apache Apex
Big Data Berlin v8.0 Stream Processing with Apache Apex
 
Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...
Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...
Thomas Weise, Apache Apex PMC Member and Architect/Co-Founder, DataTorrent - ...
 
Automating the process of continuously prioritising data, updating and deploy...
Automating the process of continuously prioritising data, updating and deploy...Automating the process of continuously prioritising data, updating and deploy...
Automating the process of continuously prioritising data, updating and deploy...
 
Next Gen Big Data Analytics with Apache Apex
Next Gen Big Data Analytics with Apache Apex Next Gen Big Data Analytics with Apache Apex
Next Gen Big Data Analytics with Apache Apex
 
The Diabolical Developers Guide to Performance Tuning
The Diabolical Developers Guide to Performance TuningThe Diabolical Developers Guide to Performance Tuning
The Diabolical Developers Guide to Performance Tuning
 
Hadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache Apex
Hadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache ApexHadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache Apex
Hadoop Summit SJ 2016: Next Gen Big Data Analytics with Apache Apex
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
 
A machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companiesA machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companies
 
1 Information Systems Analysis & Design,.pptx
1 Information Systems Analysis & Design,.pptx1 Information Systems Analysis & Design,.pptx
1 Information Systems Analysis & Design,.pptx
 
QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...
QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...
QuTrack: Model Life Cycle Management for AI and ML models using a Blockchain ...
 
DNA: an overview
DNA: an overviewDNA: an overview
DNA: an overview
 

More from Dr.M.Prasad Naidu

Free amoebae
Free amoebaeFree amoebae
Free amoebae
Dr.M.Prasad Naidu
 
Enteric fever
Enteric feverEnteric fever
Enteric fever
Dr.M.Prasad Naidu
 
Filariasis
FilariasisFilariasis
Filariasis
Dr.M.Prasad Naidu
 
Swine Flu
Swine Flu Swine Flu
Swine Flu
Dr.M.Prasad Naidu
 
Ebola virus
Ebola virus Ebola virus
Ebola virus
Dr.M.Prasad Naidu
 
Free radicles
Free radiclesFree radicles
Free radicles
Dr.M.Prasad Naidu
 
Eukar transcription
Eukar transcriptionEukar transcription
Eukar transcription
Dr.M.Prasad Naidu
 
Gene Expression in Eukaryotes
Gene Expression in EukaryotesGene Expression in Eukaryotes
Gene Expression in Eukaryotes
Dr.M.Prasad Naidu
 
ELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATION
ELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATIONELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATION
ELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATION
Dr.M.Prasad Naidu
 
ELISA
ELISAELISA
Energy Balance
Energy BalanceEnergy Balance
Energy Balance
Dr.M.Prasad Naidu
 
Ethyl Glucuronide
Ethyl GlucuronideEthyl Glucuronide
Ethyl Glucuronide
Dr.M.Prasad Naidu
 
Electrophoresis
Electrophoresis  Electrophoresis
Electrophoresis
Dr.M.Prasad Naidu
 
Ecosinoid metabolism
Ecosinoid metabolismEcosinoid metabolism
Ecosinoid metabolism
Dr.M.Prasad Naidu
 
Electophorosis
ElectophorosisElectophorosis
Electophorosis
Dr.M.Prasad Naidu
 
Cytokines in diseases
Cytokines in diseasesCytokines in diseases
Cytokines in diseases
Dr.M.Prasad Naidu
 
Cortisol assays & diagnostic laboratory procedures
Cortisol assays & diagnostic laboratory proceduresCortisol assays & diagnostic laboratory procedures
Cortisol assays & diagnostic laboratory procedures
Dr.M.Prasad Naidu
 
Colorimetry
ColorimetryColorimetry
Colorimetry
Dr.M.Prasad Naidu
 
Chromatography
ChromatographyChromatography
Chromatography
Dr.M.Prasad Naidu
 
Chromatography
Chromatography Chromatography
Chromatography
Dr.M.Prasad Naidu
 

More from Dr.M.Prasad Naidu (20)

Free amoebae
Free amoebaeFree amoebae
Free amoebae
 
Enteric fever
Enteric feverEnteric fever
Enteric fever
 
Filariasis
FilariasisFilariasis
Filariasis
 
Swine Flu
Swine Flu Swine Flu
Swine Flu
 
Ebola virus
Ebola virus Ebola virus
Ebola virus
 
Free radicles
Free radiclesFree radicles
Free radicles
 
Eukar transcription
Eukar transcriptionEukar transcription
Eukar transcription
 
Gene Expression in Eukaryotes
Gene Expression in EukaryotesGene Expression in Eukaryotes
Gene Expression in Eukaryotes
 
ELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATION
ELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATIONELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATION
ELECTRON TRANSPORT AND OXIDATIVE PHOSPHORYLATION
 
ELISA
ELISAELISA
ELISA
 
Energy Balance
Energy BalanceEnergy Balance
Energy Balance
 
Ethyl Glucuronide
Ethyl GlucuronideEthyl Glucuronide
Ethyl Glucuronide
 
Electrophoresis
Electrophoresis  Electrophoresis
Electrophoresis
 
Ecosinoid metabolism
Ecosinoid metabolismEcosinoid metabolism
Ecosinoid metabolism
 
Electophorosis
ElectophorosisElectophorosis
Electophorosis
 
Cytokines in diseases
Cytokines in diseasesCytokines in diseases
Cytokines in diseases
 
Cortisol assays & diagnostic laboratory procedures
Cortisol assays & diagnostic laboratory proceduresCortisol assays & diagnostic laboratory procedures
Cortisol assays & diagnostic laboratory procedures
 
Colorimetry
ColorimetryColorimetry
Colorimetry
 
Chromatography
ChromatographyChromatography
Chromatography
 
Chromatography
Chromatography Chromatography
Chromatography
 

Recently uploaded

Cardiac Assessment for B.sc Nursing Student.pdf
Cardiac Assessment for B.sc Nursing Student.pdfCardiac Assessment for B.sc Nursing Student.pdf
Cardiac Assessment for B.sc Nursing Student.pdf
shivalingatalekar1
 
Ketone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistryKetone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistry
Dhayanithi C
 
Diabetic nephropathy diagnosis treatment
Diabetic nephropathy diagnosis treatmentDiabetic nephropathy diagnosis treatment
Diabetic nephropathy diagnosis treatment
arahmanzai5
 
THERAPEUTIC ANTISENSE MOLECULES .pptx
THERAPEUTIC ANTISENSE MOLECULES    .pptxTHERAPEUTIC ANTISENSE MOLECULES    .pptx
THERAPEUTIC ANTISENSE MOLECULES .pptx
70KRISHPATEL
 
Best Ayurvedic medicine for Gas and Indigestion
Best Ayurvedic medicine for Gas and IndigestionBest Ayurvedic medicine for Gas and Indigestion
Best Ayurvedic medicine for Gas and Indigestion
Swastik Ayurveda
 
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
bkling
 
Efficacy of Avartana Sneha in Ayurveda
Efficacy of Avartana Sneha in AyurvedaEfficacy of Avartana Sneha in Ayurveda
Efficacy of Avartana Sneha in Ayurveda
Dr. Jyothirmai Paindla
 
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptxPost-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
FFragrant
 
CBL Seminar 2024_Preliminary Program.pdf
CBL Seminar 2024_Preliminary Program.pdfCBL Seminar 2024_Preliminary Program.pdf
CBL Seminar 2024_Preliminary Program.pdf
suvadeepdas911
 
The Best Ayurvedic Antacid Tablets in India
The Best Ayurvedic Antacid Tablets in IndiaThe Best Ayurvedic Antacid Tablets in India
The Best Ayurvedic Antacid Tablets in India
Swastik Ayurveda
 
K CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấu
K CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấuK CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấu
K CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấu
HongBiThi1
 
Top-Vitamin-Supplement-Brands-in-India List
Top-Vitamin-Supplement-Brands-in-India ListTop-Vitamin-Supplement-Brands-in-India List
Top-Vitamin-Supplement-Brands-in-India List
SwisschemDerma
 
Cell Therapy Expansion and Challenges in Autoimmune Disease
Cell Therapy Expansion and Challenges in Autoimmune DiseaseCell Therapy Expansion and Challenges in Autoimmune Disease
Cell Therapy Expansion and Challenges in Autoimmune Disease
Health Advances
 
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptxREGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
LaniyaNasrink
 
Osteoporosis - Definition , Evaluation and Management .pdf
Osteoporosis - Definition , Evaluation and Management .pdfOsteoporosis - Definition , Evaluation and Management .pdf
Osteoporosis - Definition , Evaluation and Management .pdf
Jim Jacob Roy
 
Hemodialysis: Chapter 4, Dialysate Circuit - Dr.Gawad
Hemodialysis: Chapter 4, Dialysate Circuit - Dr.GawadHemodialysis: Chapter 4, Dialysate Circuit - Dr.Gawad
Hemodialysis: Chapter 4, Dialysate Circuit - Dr.Gawad
NephroTube - Dr.Gawad
 
TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...
TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...
TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...
Donc Test
 
Netter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdfNetter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdf
BrissaOrtiz3
 
Journal Article Review on Rasamanikya
Journal Article Review on RasamanikyaJournal Article Review on Rasamanikya
Journal Article Review on Rasamanikya
Dr. Jyothirmai Paindla
 
Muscles of Mastication by Dr. Rabia Inam Gandapore.pptx
Muscles of Mastication by Dr. Rabia Inam Gandapore.pptxMuscles of Mastication by Dr. Rabia Inam Gandapore.pptx
Muscles of Mastication by Dr. Rabia Inam Gandapore.pptx
Dr. Rabia Inam Gandapore
 

Recently uploaded (20)

Cardiac Assessment for B.sc Nursing Student.pdf
Cardiac Assessment for B.sc Nursing Student.pdfCardiac Assessment for B.sc Nursing Student.pdf
Cardiac Assessment for B.sc Nursing Student.pdf
 
Ketone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistryKetone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistry
 
Diabetic nephropathy diagnosis treatment
Diabetic nephropathy diagnosis treatmentDiabetic nephropathy diagnosis treatment
Diabetic nephropathy diagnosis treatment
 
THERAPEUTIC ANTISENSE MOLECULES .pptx
THERAPEUTIC ANTISENSE MOLECULES    .pptxTHERAPEUTIC ANTISENSE MOLECULES    .pptx
THERAPEUTIC ANTISENSE MOLECULES .pptx
 
Best Ayurvedic medicine for Gas and Indigestion
Best Ayurvedic medicine for Gas and IndigestionBest Ayurvedic medicine for Gas and Indigestion
Best Ayurvedic medicine for Gas and Indigestion
 
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
 
Efficacy of Avartana Sneha in Ayurveda
Efficacy of Avartana Sneha in AyurvedaEfficacy of Avartana Sneha in Ayurveda
Efficacy of Avartana Sneha in Ayurveda
 
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptxPost-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
 
CBL Seminar 2024_Preliminary Program.pdf
CBL Seminar 2024_Preliminary Program.pdfCBL Seminar 2024_Preliminary Program.pdf
CBL Seminar 2024_Preliminary Program.pdf
 
The Best Ayurvedic Antacid Tablets in India
The Best Ayurvedic Antacid Tablets in IndiaThe Best Ayurvedic Antacid Tablets in India
The Best Ayurvedic Antacid Tablets in India
 
K CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấu
K CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấuK CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấu
K CỔ TỬ CUNG.pdf tự ghi chép, chữ hơi xấu
 
Top-Vitamin-Supplement-Brands-in-India List
Top-Vitamin-Supplement-Brands-in-India ListTop-Vitamin-Supplement-Brands-in-India List
Top-Vitamin-Supplement-Brands-in-India List
 
Cell Therapy Expansion and Challenges in Autoimmune Disease
Cell Therapy Expansion and Challenges in Autoimmune DiseaseCell Therapy Expansion and Challenges in Autoimmune Disease
Cell Therapy Expansion and Challenges in Autoimmune Disease
 
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptxREGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
 
Osteoporosis - Definition , Evaluation and Management .pdf
Osteoporosis - Definition , Evaluation and Management .pdfOsteoporosis - Definition , Evaluation and Management .pdf
Osteoporosis - Definition , Evaluation and Management .pdf
 
Hemodialysis: Chapter 4, Dialysate Circuit - Dr.Gawad
Hemodialysis: Chapter 4, Dialysate Circuit - Dr.GawadHemodialysis: Chapter 4, Dialysate Circuit - Dr.Gawad
Hemodialysis: Chapter 4, Dialysate Circuit - Dr.Gawad
 
TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...
TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...
TEST BANK For Community Health Nursing A Canadian Perspective, 5th Edition by...
 
Netter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdfNetter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdf
 
Journal Article Review on Rasamanikya
Journal Article Review on RasamanikyaJournal Article Review on Rasamanikya
Journal Article Review on Rasamanikya
 
Muscles of Mastication by Dr. Rabia Inam Gandapore.pptx
Muscles of Mastication by Dr. Rabia Inam Gandapore.pptxMuscles of Mastication by Dr. Rabia Inam Gandapore.pptx
Muscles of Mastication by Dr. Rabia Inam Gandapore.pptx
 

Instrumentation and measurement

  • 1. INSTRUMENTATION AND MEASUREMENT M.PRASAD NAIDU Msc Medical Biochemistry, Ph.D Research scholar.
  • 2. Abstract  Why Instrumentation and Measurement ?  Instrumentation Techniques  Resources  Data Analysis  Case Study: Paradyn › Guiding Principles › System Overview › W3 Search Model
  • 3. Why Instrumentation and Measurement ? • Gathering data to improve the next execution of the program. • Guiding scheduling decisions • Adapting to computations while in execution
  • 4. Instrumentation Techniques  Program Instrumentation Techniques › Manual : Programmer inserted directives › Automatic : No direct user involvement  Binary Rewriting  Dynamic Instrumentation  Processor Instrumentation Techniques › Information includes timers, memory system performance, processor usage, etc. › Available mostly through special registers or memory mapped location.  Example : Pentium Pro provides performance data through MSRs. These registers include 64 bit cycle clock and counts of memory read /write, L1 cache misses, pipeline flushes, etc. › Hardware assisted trace generation.
  • 5.  Operating System Instrumentation Techniques › Information includes behavior of virtual memory, file system, file cache etc. › Instrumentation in the form of APIs for applications to access these variables.  Network Instrumentation Techniques › Ways of measuring  Passive  Example: RMON protocol defines SNMP MIB variables to report traffic statistics over hubs and switches.  Active  Example: Ping, NWS in grid style computing.
  • 6. Data Storage Representation • Scalars – Counters – Times • Traces • Vector series
  • 7. Resources • Software Abstractions – Program Components – Code in Executions – Synchronization Objects – Other Software Abstractions • Hardware Abstractions • Network Abstractions
  • 8. Data Analysis • Quantitative Performance • Automating Performance Diagnosis • Perturbation Analysis
  • 10. Guiding Principles and Characteristics • Scalability • Automate the search for performance problems • Provide well-defined data abstractions • Support heterogeneous environments • Support high level parallel languages • Open interfaces for visualization and new data sources • Streamlined use
  • 11. System Overview • Basic Abstractions – Metric-focus grid – Time Histograms • Components of the System – Main Paradyn Process • Performance Consultant • Visualization Manager • Data Manager • User Interface Manager – Paradyn daemons – External Visualization Processes.
  • 12. Histogram VisualizationTable Visualization Tabular Summary CPU 3.0 4.0 Messages 117 81 Metric Manager Instrumentation Manager Metric Manager Instrumentation Manager Visualization Manager User Interface Manager Performance Consultant Data Manager Application Application Processes Processes Visi Thread Visi Thread HIB Daemon(s) HIB
  • 13. Dynamic Instrumentation  Dynamic Instrumentation Interface › Metric Manager › Instrumentation Manager  Points, Primitives and Predicates addCounter(fooFlg, 1) addCounter(fooFlg, 1) Foo() { …. …. } SendMsg( dest, ptr, cnt, size) { …. …. } if (fooFlg) startTimer(msgTme, ProcTime) if (fooFlg) stopTimer(msgTme)
  • 14. • Instrumentation generation – Base Trampolines – Mini-Trampolines • Data Collection • Internal Uses of Dynamic Instrumentation – Resource Discovery – Collection of dynamic mapping information for HLL.
  • 15. The W3 Search Model and the Performance Consultant • Why ? Where ? When ? – The “Why” Axis • Why is the application performing poorly ? – Potential performance problems are represented as hypotheses and tests. – Hypotheses represent activities universal to all parallel computations. – Hypotheses can be refined into more refined hypotheses using a search hierarchy. – Tests are Boolean functions that evaluate the validity of a hypotheses. – Tests are expressed in terms of a threshold and metrics calculated by the Instrumentation Manager.
  • 16. A sample “why” axis with several hypotheses TopLevelHypotheses SyncBottleNeck HighSyncBlockingTimeFrequentSyncOperations HighSyncContentionHighSyncHoldingTime
  • 17. › The “Where” Axis  Where is the performance problem ?  Pinpoints the problem specific to program components.  Each hierarchy in “where” axis has multiple levels, with the leaf nodes being the instances of resources used by the application. SyncObject Semaphores Message SpinLock Barier
  • 18. – The “When” Axis • When does the problem occur ? – Represents periods of time during which performance problems can occur. • The Performance Consultant – This module discovers performance problems by searching the space defined by W3 Search Model. – Fully automated search but also allows user to make manual refinements.
  • 19. Open Visualization Interface • Paradyn provides a simple library and RPC interface to access performance data in real- time. • Visualization modules (visi’s) in Paradyn are external processes that use this library and interface. • Currently provides visi’s for time-histograms, bar charts and tables.
  • 21. Conclusion Computational grids are focused on high performance distributed computing. To achieve high performance, such systems need to provide tools that enable the programmer to realize the potential performance inherent in such a system.

Editor's Notes

  1. Check for the second abstarction