Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Measurement of pulse rate of a     person using his videoBy Sahil ShahDate: 30-11-2012
•Literature Review: From literature we know that approaches havebeen found to extract human pulse information from the vid...
Mean Pixel ValueRegions of Interest                      Time
Power                             FrequencyThe Power spectrum of the mean values signals for the RGB streams.Peak for the ...
ROI         Interpolatio   Normalize Video       Face                         selection      n of RGB       Intensity     ...
Fast        IdealProcessed             Fourier     Bandpass Signals            Transform     Filtering             Parabol...
•Two approaches:         1. Object tracking: We use the standard object trackingimplementation in MIRA to detect the face....
2. Active Appearance Model (AAM): We use the activeappearance model algorithm to recognize faces based on multiplefeatures...
•Average R,G and B pixel values of the regions of interest from the facefor each timestamp•Interpolation to get RGB values...
•Intensity Normalization:    rn = r/(r+g+b)    gn = g/(r+g+b)    bn = b/(r+g+b)•Independent Component Analysis•Hann Window...
•Fast Fourier Transform: Discrete Fourier transforms of the processedsignals to get their power spectrum•Band-pass filter:...
•The Pulse Detector can be configured with the help of variousparameters like:    Number of frames    Virtual Sampling Fre...
•We evaluated the Pulse Detector Unit on the following factors    Motion vs Stationary    AAM vs Object Tracking    Near v...
Screenshots
•The analysis and testing was done in Matlab while the entireimplementation is in C++ using the Middleware for Robotic App...
Which algorithm is the most promising for usage?•  The Object Tracking algorithm is giving better results currently.•  The...
What is the maximum distance of people in the image from whererobust pulse extraction is possible?•   For stationary image...
To what degree the people can move in the image without losingpulse observation?•   A well trained AAM would almost nullif...
What is the minimum duration of a video sequence to allow pulserate extraction?•    20 second blocks of video are sufficie...
[1] Remote plethysmographic imaging using ambient light. Verkruysse,W. and Svaasand, L.O. and Nelson, J.S., Optics express...
Pulse Estimation
Pulse Estimation
Pulse Estimation
Upcoming SlideShare
Loading in …5
×

Pulse Estimation

1,284 views

Published on

Measurement of the pulse rate of a person using the video of his face.

Published in: Technology
  • Be the first to comment

Pulse Estimation

  1. 1. Measurement of pulse rate of a person using his videoBy Sahil ShahDate: 30-11-2012
  2. 2. •Literature Review: From literature we know that approaches havebeen found to extract human pulse information from the video of astationary person.•One of the methods is using the mean values of the R,G,B streamsfrom a specific region of interest of the face and plotting them over timefrom the video.•Analysis using Matlab.
  3. 3. Mean Pixel ValueRegions of Interest Time
  4. 4. Power FrequencyThe Power spectrum of the mean values signals for the RGB streams.Peak for the green signal can be seen at 1.2 Hz.
  5. 5. ROI Interpolatio Normalize Video Face selection n of RGB Intensity Detection values IndependenProcessed Hann t Raw RGB Windowing Bayes Filter Component signal Signals Analysis
  6. 6. Fast IdealProcessed Fourier Bandpass Signals Transform Filtering Parabola Peak Pulse Estimation Detection
  7. 7. •Two approaches: 1. Object tracking: We use the standard object trackingimplementation in MIRA to detect the face. The ROIs are stated in theconfiguration file of the Pulse Detector unit as sub regions of the face.We select the largest detected object as the face and subsequentlyselect the closest object to the last detection as the face.ADV:• Faster• GeneralizedDIS:• Breaks when first detection is wrong (generally when face takessmaller area in the image)• ‘jumping’ detections.
  8. 8. 2. Active Appearance Model (AAM): We use the activeappearance model algorithm to recognize faces based on multiplefeatures. It returns triangles that define different features on the face.We configure the AAM face detector to return some pre selectedtriangles as ROIsADV:• More robust to small movements• Exact ROIsDIS:• No generalized model for all kinds of faces
  9. 9. •Average R,G and B pixel values of the regions of interest from the facefor each timestamp•Interpolation to get RGB values for the timestamps for which we getimages (since detections come little later)•Sampling rate can be changed and is not required to be same as thatof images because interpolation can also be used to get intensityvalues for any timestamp•Interpolation also helps to maintain equal intervals between framesand increase accuracy
  10. 10. •Intensity Normalization: rn = r/(r+g+b) gn = g/(r+g+b) bn = b/(r+g+b)•Independent Component Analysis•Hann Window: Reduces resolution but works better when S/R is low.•Bayes Filtering: Kernel with +/-1 bin change (+/- 3 bpm for a windowof 200 frames at 10Hz).
  11. 11. •Fast Fourier Transform: Discrete Fourier transforms of the processedsignals to get their power spectrum•Band-pass filter: Band-pass filter (0.75 to 1.5) to get the frequencyspectrum for the range in which the human pulse can lie.•Peak Detection: Detects maximum power frequency•Parabola estimation•Calculate Pulse
  12. 12. •The Pulse Detector can be configured with the help of variousparameters like: Number of frames Virtual Sampling Frequency Regions of Interest Use AAM Use ICA Bayes Filter Windowing (Hann) Filter Bands Parabola Estimation
  13. 13. •We evaluated the Pulse Detector Unit on the following factors Motion vs Stationary AAM vs Object Tracking Near vs Far (Resolution) Jumping detections vs. Non jumping detection Different ROIs ICA vs No ICA
  14. 14. Screenshots
  15. 15. •The analysis and testing was done in Matlab while the entireimplementation is in C++ using the Middleware for Robotic Applications(MIRA) framework.
  16. 16. Which algorithm is the most promising for usage?• The Object Tracking algorithm is giving better results currently.• The AAM tends to lose the detections on increasing movement.• But a better trained AAM will be more robust because it is more accurate and gives the exact ROI thus effect of small noise becomes negligible.
  17. 17. What is the maximum distance of people in the image from whererobust pulse extraction is possible?• For stationary images taken using the Kinect sensor we got good results even for face size 107x107 pixels from a 640x480 image.• This was around 80 cm from the camera.
  18. 18. To what degree the people can move in the image without losingpulse observation?• A well trained AAM would almost nullify the noise effects, currently face tracking however is not so robust to higher noise (>10 pixels) specially when the person is farther from the camera.
  19. 19. What is the minimum duration of a video sequence to allow pulserate extraction?• 20 second blocks of video are sufficient for pulse rate extraction. We take 20 second sliding window continuously for as long as the video is captured.
  20. 20. [1] Remote plethysmographic imaging using ambient light. Verkruysse,W. and Svaasand, L.O. and Nelson, J.S., Optics express, nr. 26, vol.16, pp. 21434-21445, Optical Society of America, 2008[2] Eulerian video magnification for revealing subtle changes in theworld. Wu, H.Y. and Rubinstein, M. and Shih, E. and Guttag, J. andDurand, F. and Freeman, W., ACM Transactions on Graphics (TOG), nr.4, vol. 31, pp. 65, ACM, 2012[3] Non-contact, automated cardiac pulse measurements using videoimaging and blind source separation. Poh, M.Z. and McDuff, D.J. andPicard, R.W., Optics Express, nr. 10, vol. 18, pp. 10762-10774, OpticalSociety of America, 2010

×