SlideShare a Scribd company logo
1 of 8
Download to read offline
Bulletin of Electrical Engineering and Informatics
Vol. 9, No. 1, February 2020,pp. 403~410
ISSN: 2302-9285,DOI: 10.11591/eei.v9i1.1855  403
Journal homepage: http://beei.org
Analysis of minimum face video duration and the effect of video
compression to image-based non-contact heart rate
monitoring system
Norwahidah Ibrahim1, Mohd Razali Md Tomari2,Wan Nurshazwani Wan Zakaria3
1,2
EMCenter, Universiti Tun Hussein Onn Malaysia, Malaysia
2
Department of Electronic Engineering, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn
Malaysia, Malaysia
Article Info ABSTRACT
Article history:
Received Aug 27, 2019
Revised Nov 1, 2019
Accepted Dec 23, 2019
Heart rate (HR) is one of important indicator for human physiological
diagnosis, and camera can be used to detect it via photoplethysmograph
(PPG) signal extraction. In doing so, number of sample images required
to measure the HR signal, and quality of the images itself are important
to yield an accurate reading. This paper tackles such an issue by analyzing
the effect of sampling interval to HR reading in compressed and original
video format, obtained in various ranging locations. Technically, important
facial points from video stream were estimated by using cascade regression
facial tracker. Based on the facial points, region of interest (ROI) was
constructed where non-rigid movement is minimal. Next, PPG signal was
extracted by calculating the average value of green pixel intensity
from the ROI. Following that, illumination variation was separated
from the signal via independent component analysis (ICA). The PPG signal
was further processed using series of signal filtering techniques to exclude
frequencies beyond range of interest prior estimate the HR.
From the experiment it can be observed that sampling time of 2 seconds in
uncompressed video shows promising HR within the range of 1 to 5 meters.
Keywords:
Heart rate
Image processing
Photoplethysmograph
Signal analysis
Video compression
This is an open access article under the CC BY-SA license.
Corresponding Author:
Mohd Razali Md Tomari,
EMCenter, Universiti Tun Hussein Onn Malaysia,
86400,Parit Raja,Batu Pahat,Johor,Malaysia .
Email: mdrazali@uthm.edu.my
1. INTRODUCTION
Over the past years,many methods introduced to monitorhuman HR reading since it closely related
to human physiological aspects. Recently, the interest is more concentrate on non-contact HR monitoringthat
especially useful to the patients with burn skin, elderly people that have fragile skin and premature infants
that have extremely sensitive skin. One of the most cost effective non-contact devices is based on camera that
measure the HR via PPG signal extraction. PPG is a simple non-contact optical measurement technique that
can measure pulse activities that connected to human cardiac system from blood flow due to muscle
contraction [1]. It was introduced back in 1973 by Hertzman et. all [2] that showed the light transmission
variation of a finger could be detected by photoelectric cell. Based on his initial work, further research was
conducted and found that, human face video that is recorded by normalcamera underambient light, conta ins
useful signal that rich enough to measure the HR [3]. Some of the trend of works that utilize PPG signal to
measure HR from colour-based method via web camera can be found in [4-8]. In the camera based HR
domains, there are also reported that instead of using three colours channel (RGB), single green channel
 ISSN: 2302-9285
Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410
404
provide more accurate outcome for PPG signal extraction because haemoglobin light absorption is most
sensitive to oxy-generation changes for green light compared to blue and red lights [5, 9]. Another interesting
works that had been introduced is pulse detection via head motion [10] that showed promising outcome
for translating subtle head motion into HR estimator.
Almost all of the mentioned works proven to yield promising results, but their main concerns only
revolve around motion artifact [11-14] and illumination variation [2-5]. They did not consider sampling time
requirements and video compression that will affect the HR reading accuracy. Recently, there is one
interesting report made by Yu et. all regarding minimum recording time requirement of input video
for image-based monitoring system [15]. Based on their experiments, they stated that if longer video duration
is used as an input for image-based monitoring system, the pulse reading accuracy would deteriorate.
However, they still not consider the case where the video was compressed especially will be useful
in the surveillance camera application. When the video was compressed, image quality of the face will be
degraded and consequently will affect the PPG signal especially to the signal shape [16]. Meanwhile Mcduff
et. all, stated that video compression degrade the signal to noise (SNR) ratio of PPG signal, thus affecting
the accuracy of HR reading [17]. Work by Zhao et all also suggest that there are deterioration in PPG signal
amplitude, SNR and signal trace due to video compression [18]. Their findings about video duration is very
interesting, thus motivated us to analyse more by integrating the minimum time sampling requirements
to the compressed video for measureingthe non-contact HR reading.
2. SYSTEM OVERVIEW
The framework of this project consists of five main steps which are facial detection and facial
tracker algorithm, raw PPG signal extraction from green channel, illumination variation elimination using
ICA, signal filtering and histogram analysis. Figure 1 depicted overall block diagram of the system. Initially,
facial detection was applied to the recorded videos for localizing human’s face in the videos. Next, facial
tracker was applied to the detected face region to extract important facial points that later on will be used
during PPG signal extraction. The facial tracker produced 49 points based on prominent human facial
features, and based on these points reagion for raw PPG signal extraction will be labelled. PPG signal was
then extracted from the labelled region using temporal random trace information of the green channel since
green channel has a good SNR reading [19]. The extracted of raw PPG signal contains unwanted noise due
to environment’s illumination and motion artifact. To cater this, combination of Independent Component
Analysis (ICA) [20] and series of signal filtering were applied to the raw signal and hence making the signal
to be smoother and easier to work with. The refined PPG was then converted to frequency domain
for determining the Power Spectrum Density (PSD) that will be utilize for the HR calculation.
Figure 1. Overall system plan
However, relying on single sequence of HR reading is still subject to the measurement variation.
To overcome this, a histogram analysisof repetitive HR reading was constructed based on the same ROI with
different random traces. Eventually, the HR is estimated from the average of histogram with lowest
variation reading.
Bulletin of Electr Eng & Inf ISSN: 2302-9285 
Analysis of minimum face video duration and the effect of video compression to… (Norwahidah Ibrahim)
405
2.1. Facial detection
Facial detection and facial landmark were used to detect the location and prominent facial features
of targeted subject. In this project Viola-Jones (VJ) based facial detection using AdaBoost-based cascade
with Haar like features [21] is employed. This classifier works by constructing a strong classifier
(positive images) as linear combination weak classifiers (negative images). During detection, a series
of classifiers are applied to every image sub-window with different scaling factor. Regions are considered
valid if they pass through all the classifier stages. As for facial tracker, combination of Discriminative
Response Map Fitting (DRMF) and Monte Carlo parallel linear regression [22] was used. The method works
by performing a raw initial guess of facial landmark positions and uses a cascade of regressors to infer
the shape as whole and explicitly minimizes the alignment error over the training data. The mathem atical
modeling for the facial tracker can be represented as shown in (1), where S=(x1, x2…xp) denotes
the coordinate of all p faciallandmarksin a bounding box I and rt(...) be the regressor cascade.
S(t+1)=S(t) + rt(I, S(t)) (1)
This facialtrackerwould produce 49 facialpoints based on important human features which include
the rigid and non-rigid points. Sample of the detected 49 points facial landmarks are as shown in Figure 2
where the left side shown the labelled number of facial points and the right side shows its real
implementation on actualimage. From the detected 49 points, fourROIs were selected to determine the most
suitable face area that would results in most accurate HR for near and long distance application. The chosen
face areas were as shown in Figure 3. Right cheek was chosen as the first ROI since less non-rigid motion is
generated in this area compared to otherregions. Another area selected was the center of face because a study
claimed that this area considered to be the most suitable area for PPG signal extraction for video based HR
system. Next, whole face area was selected since hypothetically, larger ROI means that the possibility
to extract the PPG information from a far distance is high. However, 10% horizontal dimension reduction
and 20% vertical dimension reduction were applied to this area in order to exclude unwanted background that
might affect the PPG signal extraction process. Lastly, the final area selected for this project was lower
region of face that includes nose and mouth but excluding eyes and chin area.This area was selected because
the non-rigid motion is less and the area dimension is wider compared to the right cheek region. From
the selected ROI, random pairtemporalgreen color channelvalues that indicate the PPG signal is extracted.
Figure 2. 49 Facial landmark produced
Figure 3. Region of interest
 ISSN: 2302-9285
Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410
406
2.2. PPG signal extraction
PPG signal was extracted from the green channel of the constructed ROI because of green channel
contains strongest information for signal extraction due to the light sensitivity of hemoglobin.
Since the extracted signal contained unwanted interference, ma inly illumination variation, BSS technique
known as ICA was used to separate the illumination variation from the true PPG signal. The visual
representation of signal extraction is shown in Figure 4 where the top part is the original raw signal,
and the bottom part is two signal produced by the ICA which the refined signal and its illumination variation.
It can be observed that the polished signal pattern is more or less identical with the raw one as opposed to
the predicted noise.
PPG signal using can be modelled using (2) where PPGraw is the true PPG signal and s is the green
channel signal and y is the variation of illumination. If the parameter y can be estimated directly, then pure
cardiac signal can be obtained easily, however in practice such signal cannot be measured straight away
and hence ICA is used. ICA uncover the independent source of the signal by maximizing or minimizing
a cost function of the mixing that measure non-Gausianity to uncoverthe mixture coefficients.
PPGraw=s+y (2)
Figure 4. Visualization pf signal separation process using ICA
PPG signal obtained after the ICA process is a raw signal and still contains a fragment of unwanted
noise. Thus some signal filtering processes were applied to obtain refined PPG signal. In this paper,
detrending and moving average filters were applied to the signal for reducing slow, non-stationary trend
of signal and polishing the random noise, making the signal smooth prior to frequency domain conversion
[23, 24]. The filtered PPG signal was converted to frequency domain to determine the power spectrum
density (PSD) using Welch method [25] with the constrained frequency spectrum within the range of 0.7Hz
to 4 Hz that represent the HR value range from 42bpm to 240bpm. Lastly, the HR is calculated
by multiplying the maximal PSD response with 60. The filtering processes for PPG signal were as
shown in Figure 5.
Figure 5. Detrending and moving average process
Bulletin of Electr Eng & Inf ISSN: 2302-9285 
Analysis of minimum face video duration and the effect of video compression to… (Norwahidah Ibrahim)
407
2.3. Histrogram analysis
The HR value obtained from a single sequence calculation is still subject to the variation and hence
a histogram based analysis is performed to determine the consistent reading against repetition. In this paper
10 repetition of HR reading from the same ima ge sequence is performed. Any HR reading that is significant
with the majority in the bin will be labelled as an outlier and eliminated while the remaining will be used
to determine an average of HR which shows consistency over the sampled time period.
3. RESULTS AND ANALYSIS
In the experiment, video recording was conducted in an indoor laboratory and normal ambient light
was used as lighting source. The videos were recorded with 1440×1080 pixels resolution at 60 FPS.
The camera-subject distancesvary between 1 meter, 3 meters and 5 meters respectively as shown in Figure 6.
Pulse oximeter was attached to the participants’ finger and reading from this device was made into ground
truth for this project. There were two experiments conducted for this paper. The first experiment was
to determine the minimum time requires for face video recording used in this project. For this analysis,
2 seconds, 5 seconds and 10 seconds videos were used. Another experiment was conducted to determine
the effect of using compress video on the HR accuracy.Original video format is mov whereas the compressed
video format is wmv, a fair comparison was made between HR results that were obtained from original
and compressed videos. For this project, the accuracy and the error percentage were calculated using
the shown equations.
Percentage of Error = (
|measured value−actual value|
actual value
) ∗ 100% (3)
Accuracy (%) = 100% − Percent of Error (4)
Figure 6. General experiment set up for this project
Based on both tables reading, the errors calculated for each recording time with respect to distances
did not exceed 50% which means that the system is capable of working properly even with short video
sampling time. It can also be seen clearly that the three distances, 2 seconds sampling time provide the most
accurate reading with 75% for 1 meter, 94% for 3 meters and 79.9% for 5 meters. As the sampling time
increased (5 seconds and 10 seconds), the accuracy significantly reduced with an average of below 80%
for various ranging of distances. Thus, based on this result, it was proven that the system able to work
properly with acceptable accuracy with two seconds of sampling time. It is also worth to mention that, most
of commercial pulse oximeter device required more than 5 seconds to obtain the HR reading.
However for the non-contact camera based system,ourresults showed that readingwith 2 seconds is enough.
Even though the accuracy from Table 1 and Table 2 is relatively high (above 80%), it was executed
using compressed video format (wmv) to speed up the processing time. In the next experiment, we showed
the effect of uncompressed video to the HR reading. In principle, with the uncompressed video image
the processing time will be increased since density of the pixels in the picture fragment is slightly higher.
 ISSN: 2302-9285
Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410
408
For this analysis, original images from the video frames (mov format) were used and compared
with the uncompressed one (wmv). The time assigned was two seconds for both videos format since
previously we have shown that this is optimal time sampling for calculating the HR. Technically 120 image
frames from the video was used as input stream to the system. The result for this analysis was as shown
in Table 3.
Based on the result obtained from Table 3, the reading of HR reading from original video showed
great consistency and did not varies much from the ground truth. The experiment was repeated five times
to determine the reading variation for the estimated HR. For experiment that used the compress video,
there are fluctuations in the HR reading. For example, the HR reading of compressed video for 3 meter
distance, the differences between the first reading and the second reading was inconsistence. However, there
was no fluctuation in results obtained from original video. This clearly showed that using compressed video
asinput for this system affected the HR reading accuracy.This happened because when the video format was
changed,compression occurred to the videos and perhaps there were information loss during the compression
process which caused the HR to be inconsistence and inaccurate.
Table 1. HR Reading (Bpm) for assigned time
Subjects Distance (m) Ground Truth (bpm)
HR readingfor respective duration(bpm)
2 seconds 5 seconds 10 seconds
1
1 91 86 70 79
3 94 70 94 65
5 94 85 111 116
2
1 65 91 115 88
3 75 61 92 56
5 75 89 76 82
3
1 70 88 92 109
3 65 71 71 72
5 69 104 77 64
4
1 69 76 85 64
3 68 76 85 71
5 70 68 100 107
5
1 61 97 82 82
3 56 67 68 67
5 67 107 86 58
6
1 67 76 88 76
3 68 62 92 77
5 66 73 82 85
7
1 80 97 67 61
3 68 83 80 61
5 75 67 67 97
8
1 56 70 74 88
3 59 64 73 62
5 59 62 92 86
Table 2. Accuracy Summary from Table 1
Time (seconds)
Range (m)
2 5 10
Accuracy (%) Accuracy (%) Accuracy (%)
(HR accuracy results for near distance)
1 75.00 66.40 70.00
3 94.00 80.60 84.40
(HR accuracy results for farther distance)
5 79.90 75.50 73.30
Average 82.97 74.17 75.90
Table 3. Bpm readings for compressed and original video with 2 seconds sampling time
Video Type Distance (m) Ground Truth(bpm)
1st
2nd
3rd
4th
5th
Repetition of EstimatedReading(bpm)
Compressed Video (wmv)
1 65 92 94 94 101 91
3 75 82 118 74 77 124
5 75 68 79 69 74 98
Original Video (mov)
1 65 67 67 67 67 67
3 75 74 74 74 74 74
5 75 60 60 60 60 60
Bulletin of Electr Eng & Inf ISSN: 2302-9285 
Analysis of minimum face video duration and the effect of video compression to… (Norwahidah Ibrahim)
409
4. CONCLUSION AND FUTURE WORK
This paper investigates time sampling requirements for calculating HR from compressed
and uncompressed video samples. The PPG signals were extracted from eight different subjects that was
recorded at 60 FPS from three different distances of 1 meter, 3 meters and 5 meters and hence producing 24
video samples. In the first experiment, three sampling time were analyze which are 2 seconds, 5 seconds
and 10 seconds. Averagely from all various distances sampling time of 2 seconds yield 83% accuracy
and beyond this point the accuracy level deteriorate significantly with below than 80%, and hence we
conclude that 2 secondssampling time is optimalto measure the HR that obtain from camera.In the second
experiment we conclude that original uncompressed video or high quality videos will yields accurate
and stable HR reading, but at a cost of longer processing time. In future, the system can be improved by
optimizing the processing time for real implementation. It can be done by utilizing faster facial po int’s
extractor module. Apart from that, accuracy of the system can also be improved by tuning the signal
processing part for adaptingmore robust motion and illumination artifact.
ACKNOWLEDGEMENTS
The authors would like to thank to Ministry of Education (MOE) and Universiti Tun Hussein Onn
Malaysia(UTHM) for supporting this research under Fundamental Research Grant Scheme (FRGS)
(Vot. No 1582).
REFERENCES
[1] J. Kranjec, S. Beguš, G. Geršak and J. Drnovšek, "Non-contact heart rate and heart rate variability measurements:
A review," Biomedical Signal Processing and Control, vol. 13, pp. 102-112, September 2014.
[2] A. B Hertzman and CR Spealman, "Comparative Estimation of Blood Supply of Skin Areas from Photoelectrically
Recorded Volume Pulse," Experimental Biology and Medicine, vol. 38, no. 4, pp. 562-564, 1938.
[3] W. Verkruysse, L. Svaasand and J. Nelson, "Remote plethysmographic imaging using ambient light," Optics
Express, vol. 16, no. 26, pp. 21434-21445, Dec. 2008.
[4] C. Li, C. Xu, C. Gui and M. D. Fox, "Distance Regularized Level Set Evolution and Its Application to Image
Segmentation," in IEEE Transactions on Image Processing, vol. 19, no. 12, pp. 3243-3254, Dec. 2010.
[5] M. Poh, D. J. McDuff and R. W. Picard, "Advancements in Noncontact, Multiparameter Physiological
Measurements Using a Webcam," in IEEE Transactions on Biomedical Engineering, vol. 58, no. 1, pp. 7-11,
Jan. 2011.
[6] A. Qayyum, A. S. Malik, A. N. Shuaibu and N. Nasir, "Estimation of non-contact smartphone video-based vital
sign monitoring using filtering and standard color conversion techniques," 2017 IEEE Life Sciences Conference
(LSC), Sydney, NSW, pp. 202-205, 2017.
[7] Q. Fan and K. Li, "Non-contact remote estimation of cardiovascular parameters," Biomedical Signal Processing
and Control, vol. 40, pp. 192-203, Febuary 2018.
[8] Q. Zhang, Q. Wu, Y. Zhou, X. Wu, Y. Ou and H. Zhou, "Webcam-based, non-contact, real-time measurement
for the physiological parameters of drivers," in Measurement, vol. 100, pp. 311-321, 2017.
[9] K. Matsumura, P. Rolfe, J. Lee and T. Yamakoshi, "iPhone 4s Photoplethysmography: Which Light Color Yields
the Most Accurate Heart Rate and Normalized Pulse Volume Using the iPhysioMeter Application in the Presence
of Motion Artifact?," in PLoS ONE, vol. 9, no. 3, pp. e91205, March 2014.
[10] G. Balakrishnan, F. Durand, and J. Guttag, “Detecting pulse from head motions in video,” 2013 IEEE Conference
on Computer Vision and Pattern Recognition, Portland, OR, pp. 3430-3437, 2013.
[11] X. Li, J. Chen, G. Zhao, and M. Pietikainen. “Remote Heart Rate Measurement from Face Video under Realistic
Situations,” 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, pp. 4264-4271,
2014.
[12] M. Kumar, A. Veeraraghavan and A. Sabharwal, “Distance cePPG: Robust non-contact Vital Sign Monitoring
using a Camera,” Biomedical Optic Express, vol. 6, no. 5, pp. 1565-1588, Apr. 2015.
[13] A. Lam and Y. Kuno, "Robust Heart Rate Measurement from Video Using Select Random Patches," 2015 IEEE
International Conference on Computer Vision (ICCV), Santiago, pp. 3640-3648, 2015.
[14] R. Y. Huang and L. R Dung, “Measurement of Heart Rate Variability using off the shelf smart phones,”
in Biomedical Engineering online, vol. 15, no. 11, pp. 1-16, January 2016.
[15] Yu, Y., Raveendran, P. and Lim, C., “Dynamic heart rate measurements from video sequences,” in Biomedical
Optics Express, vol. 6, no. 7, pp. 2466-2480, July 2015.
[16] S. Hanfland and M. Paul, "Video Format Dependency of PPGI Signals,” 20th Internatinoal Student Conference
on Electrical Engineering, May 2016.
[17] D. J. McDuff, E. B. Blackford and J. R. Estepp, "The Impact of Video Compression on Remote Cardiac Pulse
Measurement Using Imaging Photoplethysmography," 2017 12th IEEE International Conference on Automatic
Face & Gesture Recognition (FG 2017), Washington, DC, pp. 63-70, 2017.
[18] C. Zhao, C. Lin, W. Chen and Z. Li, "A Novel Framework for Remote Photoplethysmography Pulse Extraction
on Compressed Videos," in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
(CVPRW), Salt Lake City, UT, pp. 1380-1309, 2018.
 ISSN: 2302-9285
Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410
410
[19] T. Tamura, "Current progress of photoplethysmography and SPO2 for health monitoring," in Biomedical
Engineering Letters, vol. 9, no. 4, pp. 21-36, Febuary 2019.
[20] B. Holton, K. Mannapperuma, P. Lesniewski and J. Thomas, "Signal recovery in imaging photoplethysmography,"
in Physiological Measurement, vol. 34, no. 11, pp. 1499-1511, October 2013.
[21] P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” Proceedings
of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai,
HI, USA, 2001, pp. I 511-I 518, Febuary 2001 .
[22] P. Dollar, P. Welinder, P. Perona, “Cascaded Pose Regression,” 2010 IEEE Computer Society Conference
on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 1078-1085, 2010.
[23] M. P. Tarvainen, P. O. Ranta-aho and P. A. Karjalainen, "An advanced detrending method with application to HRV
analysis," in IEEE Transactions on Biomedical Engineering, vol. 49, no. 2, pp. 172-175, Feb. 2002.
[24] H. Lee, J. Lee, W. Jung and G. Lee, "The Periodic Moving Average Filter for Removing Motion Artifacts from
PPG Signals," in International Journal of Control, Automation, and System, vol. 5, no. 6, pp. 701-706,
December 2007.
[25] [P. Welch, "The use of fast Fourier transform for the estimation of power spectra: A method based on time
averaging over short, modified periodograms," in IEEE Transactions on Audio and Electroacoustics, vol. 15, no. 2,
pp. 70-73, June 1967.
BIOGRAPHIES OF AUTHORS
Norwahidah Ibrahim was born in Johor, Malaysia in 1993. She received the B.Eng degree in
Electronics (Mechatronics) from University Tun Hussein Onn Malaysia in 2016. Currently,
she is doing her M.Eng degree in Electrical at the same university. Her current research interest is
computer vision, image processing and signal processing.
Razali Tomari was born in Johor, Malaysia, in 1980. He received the B.Eng degree in Mechatronics
from the Universiti Teknologi Malaysia, in 2003, M.Sc in intelligent system from the Universiti
Putra Malaysia, in 2006. And PhD degree in computer vision and robotic from the Saitama
University, Japan in 2013. In 2003, he joined Faculty of Electrical Engineering, University Tun
Hussein Onn as a tutor and later on become a Senior Lecturer in 2013.
His current research interest includes computer vision, pattern recognition, smart wheelchair and
sensing technology.
WN Wan Zakaria received B.Eng (2007) in Electronics and Mechanical Engineering from Chiba
University and MSc (2008) and PhD (2012) from Newcastle University. She is currently
a lecturer in Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia.
Her current interests include Medical Robotics System specifically on development of robot force
control, Image Processing and Computer Aided Diagnosis, and development of Wearable Device.
She is author and co-author of several journal papers and conference proceedings.

More Related Content

What's hot

Preserving Global and Local Features for Robust FaceRecognition under Various...
Preserving Global and Local Features for Robust FaceRecognition under Various...Preserving Global and Local Features for Robust FaceRecognition under Various...
Preserving Global and Local Features for Robust FaceRecognition under Various...CSCJournals
 
IRJET- A New Strategy to Detect Lung Cancer on CT Images
IRJET- A New Strategy to Detect Lung Cancer on CT ImagesIRJET- A New Strategy to Detect Lung Cancer on CT Images
IRJET- A New Strategy to Detect Lung Cancer on CT ImagesIRJET Journal
 
Real Time Face Recognition Based on Face Descriptor and Its Application
Real Time Face Recognition Based on Face Descriptor and Its ApplicationReal Time Face Recognition Based on Face Descriptor and Its Application
Real Time Face Recognition Based on Face Descriptor and Its ApplicationTELKOMNIKA JOURNAL
 
Biometric Ear Recognition System
Biometric Ear Recognition SystemBiometric Ear Recognition System
Biometric Ear Recognition SystemIRJET Journal
 
Program for 2015 ieee international conference on consumer electronics taiw...
Program for 2015 ieee international conference on consumer electronics   taiw...Program for 2015 ieee international conference on consumer electronics   taiw...
Program for 2015 ieee international conference on consumer electronics taiw...supra_uny
 
Vol 5 No 1 - September 2013
Vol 5 No 1 - September 2013Vol 5 No 1 - September 2013
Vol 5 No 1 - September 2013ijcsbi
 
Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...
Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...
Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...Dr. Amarjeet Singh
 
Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...sipij
 
IRJET- Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET-  	  Retinal Fundus Image Segmentation using Watershed AlgorithmIRJET-  	  Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET- Retinal Fundus Image Segmentation using Watershed AlgorithmIRJET Journal
 
Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Jaey Jeong
 
A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...
A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...
A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...Hadi Santoso
 
Automated PCB identification and defect-detection system (APIDS)
Automated PCB identification and defect-detection system (APIDS)Automated PCB identification and defect-detection system (APIDS)
Automated PCB identification and defect-detection system (APIDS)IJECEIAES
 
IRJET- An Effective System to Detect Face Drowsiness Status using Local F...
IRJET-  	  An Effective System to Detect Face Drowsiness Status using Local F...IRJET-  	  An Effective System to Detect Face Drowsiness Status using Local F...
IRJET- An Effective System to Detect Face Drowsiness Status using Local F...IRJET Journal
 
IRJET- Customized Campus Surveillance System
IRJET- Customized Campus Surveillance SystemIRJET- Customized Campus Surveillance System
IRJET- Customized Campus Surveillance SystemIRJET Journal
 
Efficacy of Use of A-Si EPID as Imaging Device in IMRT QA
Efficacy of Use of A-Si EPID as Imaging Device in IMRT QAEfficacy of Use of A-Si EPID as Imaging Device in IMRT QA
Efficacy of Use of A-Si EPID as Imaging Device in IMRT QAIOSR Journals
 
NEURAL NETWORK APPROACH FOR EYE DETECTION
NEURAL NETWORK APPROACH FOR EYE DETECTIONNEURAL NETWORK APPROACH FOR EYE DETECTION
NEURAL NETWORK APPROACH FOR EYE DETECTIONcscpconf
 
IRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: ReviewIRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: ReviewIRJET Journal
 
Facial Expression Recognition Using Local Binary Pattern and Support Vector M...
Facial Expression Recognition Using Local Binary Pattern and Support Vector M...Facial Expression Recognition Using Local Binary Pattern and Support Vector M...
Facial Expression Recognition Using Local Binary Pattern and Support Vector M...AM Publications
 
Investigation of deformation of the cornea during tonometry using FEM
Investigation of deformation of the cornea during  tonometry using FEM Investigation of deformation of the cornea during  tonometry using FEM
Investigation of deformation of the cornea during tonometry using FEM IJECEIAES
 

What's hot (20)

Preserving Global and Local Features for Robust FaceRecognition under Various...
Preserving Global and Local Features for Robust FaceRecognition under Various...Preserving Global and Local Features for Robust FaceRecognition under Various...
Preserving Global and Local Features for Robust FaceRecognition under Various...
 
IRJET- A New Strategy to Detect Lung Cancer on CT Images
IRJET- A New Strategy to Detect Lung Cancer on CT ImagesIRJET- A New Strategy to Detect Lung Cancer on CT Images
IRJET- A New Strategy to Detect Lung Cancer on CT Images
 
N010226872
N010226872N010226872
N010226872
 
Real Time Face Recognition Based on Face Descriptor and Its Application
Real Time Face Recognition Based on Face Descriptor and Its ApplicationReal Time Face Recognition Based on Face Descriptor and Its Application
Real Time Face Recognition Based on Face Descriptor and Its Application
 
Biometric Ear Recognition System
Biometric Ear Recognition SystemBiometric Ear Recognition System
Biometric Ear Recognition System
 
Program for 2015 ieee international conference on consumer electronics taiw...
Program for 2015 ieee international conference on consumer electronics   taiw...Program for 2015 ieee international conference on consumer electronics   taiw...
Program for 2015 ieee international conference on consumer electronics taiw...
 
Vol 5 No 1 - September 2013
Vol 5 No 1 - September 2013Vol 5 No 1 - September 2013
Vol 5 No 1 - September 2013
 
Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...
Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...
Development and Implementation of VLSI Reconfigurable Architecture for Gabor ...
 
Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...
 
IRJET- Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET-  	  Retinal Fundus Image Segmentation using Watershed AlgorithmIRJET-  	  Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET- Retinal Fundus Image Segmentation using Watershed Algorithm
 
Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...
 
A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...
A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...
A Parallel Architecture for Multiple-Face Detection Technique Using AdaBoost ...
 
Automated PCB identification and defect-detection system (APIDS)
Automated PCB identification and defect-detection system (APIDS)Automated PCB identification and defect-detection system (APIDS)
Automated PCB identification and defect-detection system (APIDS)
 
IRJET- An Effective System to Detect Face Drowsiness Status using Local F...
IRJET-  	  An Effective System to Detect Face Drowsiness Status using Local F...IRJET-  	  An Effective System to Detect Face Drowsiness Status using Local F...
IRJET- An Effective System to Detect Face Drowsiness Status using Local F...
 
IRJET- Customized Campus Surveillance System
IRJET- Customized Campus Surveillance SystemIRJET- Customized Campus Surveillance System
IRJET- Customized Campus Surveillance System
 
Efficacy of Use of A-Si EPID as Imaging Device in IMRT QA
Efficacy of Use of A-Si EPID as Imaging Device in IMRT QAEfficacy of Use of A-Si EPID as Imaging Device in IMRT QA
Efficacy of Use of A-Si EPID as Imaging Device in IMRT QA
 
NEURAL NETWORK APPROACH FOR EYE DETECTION
NEURAL NETWORK APPROACH FOR EYE DETECTIONNEURAL NETWORK APPROACH FOR EYE DETECTION
NEURAL NETWORK APPROACH FOR EYE DETECTION
 
IRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: ReviewIRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: Review
 
Facial Expression Recognition Using Local Binary Pattern and Support Vector M...
Facial Expression Recognition Using Local Binary Pattern and Support Vector M...Facial Expression Recognition Using Local Binary Pattern and Support Vector M...
Facial Expression Recognition Using Local Binary Pattern and Support Vector M...
 
Investigation of deformation of the cornea during tonometry using FEM
Investigation of deformation of the cornea during  tonometry using FEM Investigation of deformation of the cornea during  tonometry using FEM
Investigation of deformation of the cornea during tonometry using FEM
 

Similar to Analysis of minimum face video duration and the effect of video compression to image-based non-contact heart rate monitoring system

Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...
Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...
Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...IJECEIAES
 
A Survey on Non-Contact Heart Rate Estimation from Facial Video
A Survey on Non-Contact Heart Rate Estimation from Facial VideoA Survey on Non-Contact Heart Rate Estimation from Facial Video
A Survey on Non-Contact Heart Rate Estimation from Facial VideoBRNSSPublicationHubI
 
Touchless HeartRate Prediction System.pdf
Touchless HeartRate Prediction System.pdfTouchless HeartRate Prediction System.pdf
Touchless HeartRate Prediction System.pdfKomal526846
 
Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...
Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...
Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...IRJET Journal
 
Pulse Rate Monitoring Using Image Processing
Pulse Rate Monitoring Using Image ProcessingPulse Rate Monitoring Using Image Processing
Pulse Rate Monitoring Using Image ProcessingIRJET Journal
 
Motion artifacts reduction in cardiac pulse signal acquired from video imaging
Motion artifacts reduction in cardiac pulse signal  acquired from video imaging Motion artifacts reduction in cardiac pulse signal  acquired from video imaging
Motion artifacts reduction in cardiac pulse signal acquired from video imaging IJECEIAES
 
Extraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emdExtraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emdeSAT Publishing House
 
Extraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emdExtraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emdeSAT Journals
 
IRJET - Touch-Less Heartbeat Detection and Cardiopulmonary Modeling
IRJET -  	  Touch-Less Heartbeat Detection and Cardiopulmonary ModelingIRJET -  	  Touch-Less Heartbeat Detection and Cardiopulmonary Modeling
IRJET - Touch-Less Heartbeat Detection and Cardiopulmonary ModelingIRJET Journal
 
Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...
Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...
Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...IRJET Journal
 
IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...
IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...
IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...IRJET Journal
 
IRJET- Smartphone based Blood Pressure Estimation using CART and PPG
IRJET- Smartphone based Blood Pressure Estimation using CART and PPGIRJET- Smartphone based Blood Pressure Estimation using CART and PPG
IRJET- Smartphone based Blood Pressure Estimation using CART and PPGIRJET Journal
 
REAL TIME VIGILANCE DETECTION USING FRONTAL EEG
REAL TIME VIGILANCE DETECTION USING FRONTAL EEGREAL TIME VIGILANCE DETECTION USING FRONTAL EEG
REAL TIME VIGILANCE DETECTION USING FRONTAL EEGijcsit
 
IRJET- Analysis of Yawning Behavior in IoT based of Drowsy Drivers
IRJET- Analysis of Yawning Behavior in IoT based of Drowsy DriversIRJET- Analysis of Yawning Behavior in IoT based of Drowsy Drivers
IRJET- Analysis of Yawning Behavior in IoT based of Drowsy DriversIRJET Journal
 
Photoplethysmogram signal reconstruction through integrated compression sensi...
Photoplethysmogram signal reconstruction through integrated compression sensi...Photoplethysmogram signal reconstruction through integrated compression sensi...
Photoplethysmogram signal reconstruction through integrated compression sensi...IAESIJAI
 
Top Cited Articles in Signal & Image Processing 2021-2022
Top Cited Articles in Signal & Image Processing 2021-2022Top Cited Articles in Signal & Image Processing 2021-2022
Top Cited Articles in Signal & Image Processing 2021-2022sipij
 
A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...
A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...
A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...IRJET Journal
 
New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...
New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...
New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...CSCJournals
 
An Automatic ROI of The Fundus Photography
An Automatic ROI of The Fundus Photography An Automatic ROI of The Fundus Photography
An Automatic ROI of The Fundus Photography IJECEIAES
 

Similar to Analysis of minimum face video duration and the effect of video compression to image-based non-contact heart rate monitoring system (20)

Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...
Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...
Non-contact Heart Rate Monitoring Analysis from Various Distances with differ...
 
A Survey on Non-Contact Heart Rate Estimation from Facial Video
A Survey on Non-Contact Heart Rate Estimation from Facial VideoA Survey on Non-Contact Heart Rate Estimation from Facial Video
A Survey on Non-Contact Heart Rate Estimation from Facial Video
 
Touchless HeartRate Prediction System.pdf
Touchless HeartRate Prediction System.pdfTouchless HeartRate Prediction System.pdf
Touchless HeartRate Prediction System.pdf
 
Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...
Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...
Cross-platform Remote Photoplethysmography (rPPG) based Heart's Vital Signs M...
 
Pulse Rate Monitoring Using Image Processing
Pulse Rate Monitoring Using Image ProcessingPulse Rate Monitoring Using Image Processing
Pulse Rate Monitoring Using Image Processing
 
Motion artifacts reduction in cardiac pulse signal acquired from video imaging
Motion artifacts reduction in cardiac pulse signal  acquired from video imaging Motion artifacts reduction in cardiac pulse signal  acquired from video imaging
Motion artifacts reduction in cardiac pulse signal acquired from video imaging
 
Extraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emdExtraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emd
 
Extraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emdExtraction of respiratory rate from ppg signals using pca and emd
Extraction of respiratory rate from ppg signals using pca and emd
 
IRJET - Touch-Less Heartbeat Detection and Cardiopulmonary Modeling
IRJET -  	  Touch-Less Heartbeat Detection and Cardiopulmonary ModelingIRJET -  	  Touch-Less Heartbeat Detection and Cardiopulmonary Modeling
IRJET - Touch-Less Heartbeat Detection and Cardiopulmonary Modeling
 
Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...
Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...
Remote Photoplethysmography (rPPG) using RGB Camera using Peak Detection Algo...
 
IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...
IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...
IRJET- Face Spoofing Detection Based on Texture Analysis and Color Space Conv...
 
IRJET- Smartphone based Blood Pressure Estimation using CART and PPG
IRJET- Smartphone based Blood Pressure Estimation using CART and PPGIRJET- Smartphone based Blood Pressure Estimation using CART and PPG
IRJET- Smartphone based Blood Pressure Estimation using CART and PPG
 
REAL TIME VIGILANCE DETECTION USING FRONTAL EEG
REAL TIME VIGILANCE DETECTION USING FRONTAL EEGREAL TIME VIGILANCE DETECTION USING FRONTAL EEG
REAL TIME VIGILANCE DETECTION USING FRONTAL EEG
 
Real Time Vigilance Detection using Frontal EEG
Real Time Vigilance Detection using Frontal EEGReal Time Vigilance Detection using Frontal EEG
Real Time Vigilance Detection using Frontal EEG
 
IRJET- Analysis of Yawning Behavior in IoT based of Drowsy Drivers
IRJET- Analysis of Yawning Behavior in IoT based of Drowsy DriversIRJET- Analysis of Yawning Behavior in IoT based of Drowsy Drivers
IRJET- Analysis of Yawning Behavior in IoT based of Drowsy Drivers
 
Photoplethysmogram signal reconstruction through integrated compression sensi...
Photoplethysmogram signal reconstruction through integrated compression sensi...Photoplethysmogram signal reconstruction through integrated compression sensi...
Photoplethysmogram signal reconstruction through integrated compression sensi...
 
Top Cited Articles in Signal & Image Processing 2021-2022
Top Cited Articles in Signal & Image Processing 2021-2022Top Cited Articles in Signal & Image Processing 2021-2022
Top Cited Articles in Signal & Image Processing 2021-2022
 
A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...
A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...
A Novel Framework For Preprocessing Of Breast Ultra Sound Images By Combining...
 
New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...
New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...
New Noise Reduction Technique for Medical Ultrasound Imaging using Gabor Filt...
 
An Automatic ROI of The Fundus Photography
An Automatic ROI of The Fundus Photography An Automatic ROI of The Fundus Photography
An Automatic ROI of The Fundus Photography
 

More from journalBEEI

Square transposition: an approach to the transposition process in block cipher
Square transposition: an approach to the transposition process in block cipherSquare transposition: an approach to the transposition process in block cipher
Square transposition: an approach to the transposition process in block cipherjournalBEEI
 
Hyper-parameter optimization of convolutional neural network based on particl...
Hyper-parameter optimization of convolutional neural network based on particl...Hyper-parameter optimization of convolutional neural network based on particl...
Hyper-parameter optimization of convolutional neural network based on particl...journalBEEI
 
Supervised machine learning based liver disease prediction approach with LASS...
Supervised machine learning based liver disease prediction approach with LASS...Supervised machine learning based liver disease prediction approach with LASS...
Supervised machine learning based liver disease prediction approach with LASS...journalBEEI
 
A secure and energy saving protocol for wireless sensor networks
A secure and energy saving protocol for wireless sensor networksA secure and energy saving protocol for wireless sensor networks
A secure and energy saving protocol for wireless sensor networksjournalBEEI
 
Plant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural networkPlant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural networkjournalBEEI
 
Customized moodle-based learning management system for socially disadvantaged...
Customized moodle-based learning management system for socially disadvantaged...Customized moodle-based learning management system for socially disadvantaged...
Customized moodle-based learning management system for socially disadvantaged...journalBEEI
 
Understanding the role of individual learner in adaptive and personalized e-l...
Understanding the role of individual learner in adaptive and personalized e-l...Understanding the role of individual learner in adaptive and personalized e-l...
Understanding the role of individual learner in adaptive and personalized e-l...journalBEEI
 
Prototype mobile contactless transaction system in traditional markets to sup...
Prototype mobile contactless transaction system in traditional markets to sup...Prototype mobile contactless transaction system in traditional markets to sup...
Prototype mobile contactless transaction system in traditional markets to sup...journalBEEI
 
Wireless HART stack using multiprocessor technique with laxity algorithm
Wireless HART stack using multiprocessor technique with laxity algorithmWireless HART stack using multiprocessor technique with laxity algorithm
Wireless HART stack using multiprocessor technique with laxity algorithmjournalBEEI
 
Implementation of double-layer loaded on octagon microstrip yagi antenna
Implementation of double-layer loaded on octagon microstrip yagi antennaImplementation of double-layer loaded on octagon microstrip yagi antenna
Implementation of double-layer loaded on octagon microstrip yagi antennajournalBEEI
 
The calculation of the field of an antenna located near the human head
The calculation of the field of an antenna located near the human headThe calculation of the field of an antenna located near the human head
The calculation of the field of an antenna located near the human headjournalBEEI
 
Exact secure outage probability performance of uplinkdownlink multiple access...
Exact secure outage probability performance of uplinkdownlink multiple access...Exact secure outage probability performance of uplinkdownlink multiple access...
Exact secure outage probability performance of uplinkdownlink multiple access...journalBEEI
 
Design of a dual-band antenna for energy harvesting application
Design of a dual-band antenna for energy harvesting applicationDesign of a dual-band antenna for energy harvesting application
Design of a dual-band antenna for energy harvesting applicationjournalBEEI
 
Transforming data-centric eXtensible markup language into relational database...
Transforming data-centric eXtensible markup language into relational database...Transforming data-centric eXtensible markup language into relational database...
Transforming data-centric eXtensible markup language into relational database...journalBEEI
 
Key performance requirement of future next wireless networks (6G)
Key performance requirement of future next wireless networks (6G)Key performance requirement of future next wireless networks (6G)
Key performance requirement of future next wireless networks (6G)journalBEEI
 
Noise resistance territorial intensity-based optical flow using inverse confi...
Noise resistance territorial intensity-based optical flow using inverse confi...Noise resistance territorial intensity-based optical flow using inverse confi...
Noise resistance territorial intensity-based optical flow using inverse confi...journalBEEI
 
Modeling climate phenomenon with software grids analysis and display system i...
Modeling climate phenomenon with software grids analysis and display system i...Modeling climate phenomenon with software grids analysis and display system i...
Modeling climate phenomenon with software grids analysis and display system i...journalBEEI
 
An approach of re-organizing input dataset to enhance the quality of emotion ...
An approach of re-organizing input dataset to enhance the quality of emotion ...An approach of re-organizing input dataset to enhance the quality of emotion ...
An approach of re-organizing input dataset to enhance the quality of emotion ...journalBEEI
 
Parking detection system using background subtraction and HSV color segmentation
Parking detection system using background subtraction and HSV color segmentationParking detection system using background subtraction and HSV color segmentation
Parking detection system using background subtraction and HSV color segmentationjournalBEEI
 
Quality of service performances of video and voice transmission in universal ...
Quality of service performances of video and voice transmission in universal ...Quality of service performances of video and voice transmission in universal ...
Quality of service performances of video and voice transmission in universal ...journalBEEI
 

More from journalBEEI (20)

Square transposition: an approach to the transposition process in block cipher
Square transposition: an approach to the transposition process in block cipherSquare transposition: an approach to the transposition process in block cipher
Square transposition: an approach to the transposition process in block cipher
 
Hyper-parameter optimization of convolutional neural network based on particl...
Hyper-parameter optimization of convolutional neural network based on particl...Hyper-parameter optimization of convolutional neural network based on particl...
Hyper-parameter optimization of convolutional neural network based on particl...
 
Supervised machine learning based liver disease prediction approach with LASS...
Supervised machine learning based liver disease prediction approach with LASS...Supervised machine learning based liver disease prediction approach with LASS...
Supervised machine learning based liver disease prediction approach with LASS...
 
A secure and energy saving protocol for wireless sensor networks
A secure and energy saving protocol for wireless sensor networksA secure and energy saving protocol for wireless sensor networks
A secure and energy saving protocol for wireless sensor networks
 
Plant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural networkPlant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural network
 
Customized moodle-based learning management system for socially disadvantaged...
Customized moodle-based learning management system for socially disadvantaged...Customized moodle-based learning management system for socially disadvantaged...
Customized moodle-based learning management system for socially disadvantaged...
 
Understanding the role of individual learner in adaptive and personalized e-l...
Understanding the role of individual learner in adaptive and personalized e-l...Understanding the role of individual learner in adaptive and personalized e-l...
Understanding the role of individual learner in adaptive and personalized e-l...
 
Prototype mobile contactless transaction system in traditional markets to sup...
Prototype mobile contactless transaction system in traditional markets to sup...Prototype mobile contactless transaction system in traditional markets to sup...
Prototype mobile contactless transaction system in traditional markets to sup...
 
Wireless HART stack using multiprocessor technique with laxity algorithm
Wireless HART stack using multiprocessor technique with laxity algorithmWireless HART stack using multiprocessor technique with laxity algorithm
Wireless HART stack using multiprocessor technique with laxity algorithm
 
Implementation of double-layer loaded on octagon microstrip yagi antenna
Implementation of double-layer loaded on octagon microstrip yagi antennaImplementation of double-layer loaded on octagon microstrip yagi antenna
Implementation of double-layer loaded on octagon microstrip yagi antenna
 
The calculation of the field of an antenna located near the human head
The calculation of the field of an antenna located near the human headThe calculation of the field of an antenna located near the human head
The calculation of the field of an antenna located near the human head
 
Exact secure outage probability performance of uplinkdownlink multiple access...
Exact secure outage probability performance of uplinkdownlink multiple access...Exact secure outage probability performance of uplinkdownlink multiple access...
Exact secure outage probability performance of uplinkdownlink multiple access...
 
Design of a dual-band antenna for energy harvesting application
Design of a dual-band antenna for energy harvesting applicationDesign of a dual-band antenna for energy harvesting application
Design of a dual-band antenna for energy harvesting application
 
Transforming data-centric eXtensible markup language into relational database...
Transforming data-centric eXtensible markup language into relational database...Transforming data-centric eXtensible markup language into relational database...
Transforming data-centric eXtensible markup language into relational database...
 
Key performance requirement of future next wireless networks (6G)
Key performance requirement of future next wireless networks (6G)Key performance requirement of future next wireless networks (6G)
Key performance requirement of future next wireless networks (6G)
 
Noise resistance territorial intensity-based optical flow using inverse confi...
Noise resistance territorial intensity-based optical flow using inverse confi...Noise resistance territorial intensity-based optical flow using inverse confi...
Noise resistance territorial intensity-based optical flow using inverse confi...
 
Modeling climate phenomenon with software grids analysis and display system i...
Modeling climate phenomenon with software grids analysis and display system i...Modeling climate phenomenon with software grids analysis and display system i...
Modeling climate phenomenon with software grids analysis and display system i...
 
An approach of re-organizing input dataset to enhance the quality of emotion ...
An approach of re-organizing input dataset to enhance the quality of emotion ...An approach of re-organizing input dataset to enhance the quality of emotion ...
An approach of re-organizing input dataset to enhance the quality of emotion ...
 
Parking detection system using background subtraction and HSV color segmentation
Parking detection system using background subtraction and HSV color segmentationParking detection system using background subtraction and HSV color segmentation
Parking detection system using background subtraction and HSV color segmentation
 
Quality of service performances of video and voice transmission in universal ...
Quality of service performances of video and voice transmission in universal ...Quality of service performances of video and voice transmission in universal ...
Quality of service performances of video and voice transmission in universal ...
 

Recently uploaded

Augmented Reality (AR) with Augin Software.pptx
Augmented Reality (AR) with Augin Software.pptxAugmented Reality (AR) with Augin Software.pptx
Augmented Reality (AR) with Augin Software.pptxMustafa Ahmed
 
Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..MaherOthman7
 
Insurance management system project report.pdf
Insurance management system project report.pdfInsurance management system project report.pdf
Insurance management system project report.pdfKamal Acharya
 
Adsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) pptAdsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) pptjigup7320
 
The Entity-Relationship Model(ER Diagram).pptx
The Entity-Relationship Model(ER Diagram).pptxThe Entity-Relationship Model(ER Diagram).pptx
The Entity-Relationship Model(ER Diagram).pptxMANASINANDKISHORDEOR
 
Seizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networksSeizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networksIJECEIAES
 
Independent Solar-Powered Electric Vehicle Charging Station
Independent Solar-Powered Electric Vehicle Charging StationIndependent Solar-Powered Electric Vehicle Charging Station
Independent Solar-Powered Electric Vehicle Charging Stationsiddharthteach18
 
Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...IJECEIAES
 
5G and 6G refer to generations of mobile network technology, each representin...
5G and 6G refer to generations of mobile network technology, each representin...5G and 6G refer to generations of mobile network technology, each representin...
5G and 6G refer to generations of mobile network technology, each representin...archanaece3
 
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdflitvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdfAlexander Litvinenko
 
Working Principle of Echo Sounder and Doppler Effect.pdf
Working Principle of Echo Sounder and Doppler Effect.pdfWorking Principle of Echo Sounder and Doppler Effect.pdf
Working Principle of Echo Sounder and Doppler Effect.pdfSkNahidulIslamShrabo
 
handbook on reinforce concrete and detailing
handbook on reinforce concrete and detailinghandbook on reinforce concrete and detailing
handbook on reinforce concrete and detailingAshishSingh1301
 
What is Coordinate Measuring Machine? CMM Types, Features, Functions
What is Coordinate Measuring Machine? CMM Types, Features, FunctionsWhat is Coordinate Measuring Machine? CMM Types, Features, Functions
What is Coordinate Measuring Machine? CMM Types, Features, FunctionsVIEW
 
engineering chemistry power point presentation
engineering chemistry  power point presentationengineering chemistry  power point presentation
engineering chemistry power point presentationsj9399037128
 
Filters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility ApplicationsFilters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility ApplicationsMathias Magdowski
 
15-Minute City: A Completely New Horizon
15-Minute City: A Completely New Horizon15-Minute City: A Completely New Horizon
15-Minute City: A Completely New HorizonMorshed Ahmed Rahath
 
Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)Ramkumar k
 
Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...IJECEIAES
 
Artificial Intelligence in due diligence
Artificial Intelligence in due diligenceArtificial Intelligence in due diligence
Artificial Intelligence in due diligencemahaffeycheryld
 
Final DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manualFinal DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manualBalamuruganV28
 

Recently uploaded (20)

Augmented Reality (AR) with Augin Software.pptx
Augmented Reality (AR) with Augin Software.pptxAugmented Reality (AR) with Augin Software.pptx
Augmented Reality (AR) with Augin Software.pptx
 
Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..
 
Insurance management system project report.pdf
Insurance management system project report.pdfInsurance management system project report.pdf
Insurance management system project report.pdf
 
Adsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) pptAdsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) ppt
 
The Entity-Relationship Model(ER Diagram).pptx
The Entity-Relationship Model(ER Diagram).pptxThe Entity-Relationship Model(ER Diagram).pptx
The Entity-Relationship Model(ER Diagram).pptx
 
Seizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networksSeizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networks
 
Independent Solar-Powered Electric Vehicle Charging Station
Independent Solar-Powered Electric Vehicle Charging StationIndependent Solar-Powered Electric Vehicle Charging Station
Independent Solar-Powered Electric Vehicle Charging Station
 
Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...
 
5G and 6G refer to generations of mobile network technology, each representin...
5G and 6G refer to generations of mobile network technology, each representin...5G and 6G refer to generations of mobile network technology, each representin...
5G and 6G refer to generations of mobile network technology, each representin...
 
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdflitvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
 
Working Principle of Echo Sounder and Doppler Effect.pdf
Working Principle of Echo Sounder and Doppler Effect.pdfWorking Principle of Echo Sounder and Doppler Effect.pdf
Working Principle of Echo Sounder and Doppler Effect.pdf
 
handbook on reinforce concrete and detailing
handbook on reinforce concrete and detailinghandbook on reinforce concrete and detailing
handbook on reinforce concrete and detailing
 
What is Coordinate Measuring Machine? CMM Types, Features, Functions
What is Coordinate Measuring Machine? CMM Types, Features, FunctionsWhat is Coordinate Measuring Machine? CMM Types, Features, Functions
What is Coordinate Measuring Machine? CMM Types, Features, Functions
 
engineering chemistry power point presentation
engineering chemistry  power point presentationengineering chemistry  power point presentation
engineering chemistry power point presentation
 
Filters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility ApplicationsFilters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility Applications
 
15-Minute City: A Completely New Horizon
15-Minute City: A Completely New Horizon15-Minute City: A Completely New Horizon
15-Minute City: A Completely New Horizon
 
Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)
 
Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...
 
Artificial Intelligence in due diligence
Artificial Intelligence in due diligenceArtificial Intelligence in due diligence
Artificial Intelligence in due diligence
 
Final DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manualFinal DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manual
 

Analysis of minimum face video duration and the effect of video compression to image-based non-contact heart rate monitoring system

  • 1. Bulletin of Electrical Engineering and Informatics Vol. 9, No. 1, February 2020,pp. 403~410 ISSN: 2302-9285,DOI: 10.11591/eei.v9i1.1855  403 Journal homepage: http://beei.org Analysis of minimum face video duration and the effect of video compression to image-based non-contact heart rate monitoring system Norwahidah Ibrahim1, Mohd Razali Md Tomari2,Wan Nurshazwani Wan Zakaria3 1,2 EMCenter, Universiti Tun Hussein Onn Malaysia, Malaysia 2 Department of Electronic Engineering, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Malaysia Article Info ABSTRACT Article history: Received Aug 27, 2019 Revised Nov 1, 2019 Accepted Dec 23, 2019 Heart rate (HR) is one of important indicator for human physiological diagnosis, and camera can be used to detect it via photoplethysmograph (PPG) signal extraction. In doing so, number of sample images required to measure the HR signal, and quality of the images itself are important to yield an accurate reading. This paper tackles such an issue by analyzing the effect of sampling interval to HR reading in compressed and original video format, obtained in various ranging locations. Technically, important facial points from video stream were estimated by using cascade regression facial tracker. Based on the facial points, region of interest (ROI) was constructed where non-rigid movement is minimal. Next, PPG signal was extracted by calculating the average value of green pixel intensity from the ROI. Following that, illumination variation was separated from the signal via independent component analysis (ICA). The PPG signal was further processed using series of signal filtering techniques to exclude frequencies beyond range of interest prior estimate the HR. From the experiment it can be observed that sampling time of 2 seconds in uncompressed video shows promising HR within the range of 1 to 5 meters. Keywords: Heart rate Image processing Photoplethysmograph Signal analysis Video compression This is an open access article under the CC BY-SA license. Corresponding Author: Mohd Razali Md Tomari, EMCenter, Universiti Tun Hussein Onn Malaysia, 86400,Parit Raja,Batu Pahat,Johor,Malaysia . Email: mdrazali@uthm.edu.my 1. INTRODUCTION Over the past years,many methods introduced to monitorhuman HR reading since it closely related to human physiological aspects. Recently, the interest is more concentrate on non-contact HR monitoringthat especially useful to the patients with burn skin, elderly people that have fragile skin and premature infants that have extremely sensitive skin. One of the most cost effective non-contact devices is based on camera that measure the HR via PPG signal extraction. PPG is a simple non-contact optical measurement technique that can measure pulse activities that connected to human cardiac system from blood flow due to muscle contraction [1]. It was introduced back in 1973 by Hertzman et. all [2] that showed the light transmission variation of a finger could be detected by photoelectric cell. Based on his initial work, further research was conducted and found that, human face video that is recorded by normalcamera underambient light, conta ins useful signal that rich enough to measure the HR [3]. Some of the trend of works that utilize PPG signal to measure HR from colour-based method via web camera can be found in [4-8]. In the camera based HR domains, there are also reported that instead of using three colours channel (RGB), single green channel
  • 2.  ISSN: 2302-9285 Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410 404 provide more accurate outcome for PPG signal extraction because haemoglobin light absorption is most sensitive to oxy-generation changes for green light compared to blue and red lights [5, 9]. Another interesting works that had been introduced is pulse detection via head motion [10] that showed promising outcome for translating subtle head motion into HR estimator. Almost all of the mentioned works proven to yield promising results, but their main concerns only revolve around motion artifact [11-14] and illumination variation [2-5]. They did not consider sampling time requirements and video compression that will affect the HR reading accuracy. Recently, there is one interesting report made by Yu et. all regarding minimum recording time requirement of input video for image-based monitoring system [15]. Based on their experiments, they stated that if longer video duration is used as an input for image-based monitoring system, the pulse reading accuracy would deteriorate. However, they still not consider the case where the video was compressed especially will be useful in the surveillance camera application. When the video was compressed, image quality of the face will be degraded and consequently will affect the PPG signal especially to the signal shape [16]. Meanwhile Mcduff et. all, stated that video compression degrade the signal to noise (SNR) ratio of PPG signal, thus affecting the accuracy of HR reading [17]. Work by Zhao et all also suggest that there are deterioration in PPG signal amplitude, SNR and signal trace due to video compression [18]. Their findings about video duration is very interesting, thus motivated us to analyse more by integrating the minimum time sampling requirements to the compressed video for measureingthe non-contact HR reading. 2. SYSTEM OVERVIEW The framework of this project consists of five main steps which are facial detection and facial tracker algorithm, raw PPG signal extraction from green channel, illumination variation elimination using ICA, signal filtering and histogram analysis. Figure 1 depicted overall block diagram of the system. Initially, facial detection was applied to the recorded videos for localizing human’s face in the videos. Next, facial tracker was applied to the detected face region to extract important facial points that later on will be used during PPG signal extraction. The facial tracker produced 49 points based on prominent human facial features, and based on these points reagion for raw PPG signal extraction will be labelled. PPG signal was then extracted from the labelled region using temporal random trace information of the green channel since green channel has a good SNR reading [19]. The extracted of raw PPG signal contains unwanted noise due to environment’s illumination and motion artifact. To cater this, combination of Independent Component Analysis (ICA) [20] and series of signal filtering were applied to the raw signal and hence making the signal to be smoother and easier to work with. The refined PPG was then converted to frequency domain for determining the Power Spectrum Density (PSD) that will be utilize for the HR calculation. Figure 1. Overall system plan However, relying on single sequence of HR reading is still subject to the measurement variation. To overcome this, a histogram analysisof repetitive HR reading was constructed based on the same ROI with different random traces. Eventually, the HR is estimated from the average of histogram with lowest variation reading.
  • 3. Bulletin of Electr Eng & Inf ISSN: 2302-9285  Analysis of minimum face video duration and the effect of video compression to… (Norwahidah Ibrahim) 405 2.1. Facial detection Facial detection and facial landmark were used to detect the location and prominent facial features of targeted subject. In this project Viola-Jones (VJ) based facial detection using AdaBoost-based cascade with Haar like features [21] is employed. This classifier works by constructing a strong classifier (positive images) as linear combination weak classifiers (negative images). During detection, a series of classifiers are applied to every image sub-window with different scaling factor. Regions are considered valid if they pass through all the classifier stages. As for facial tracker, combination of Discriminative Response Map Fitting (DRMF) and Monte Carlo parallel linear regression [22] was used. The method works by performing a raw initial guess of facial landmark positions and uses a cascade of regressors to infer the shape as whole and explicitly minimizes the alignment error over the training data. The mathem atical modeling for the facial tracker can be represented as shown in (1), where S=(x1, x2…xp) denotes the coordinate of all p faciallandmarksin a bounding box I and rt(...) be the regressor cascade. S(t+1)=S(t) + rt(I, S(t)) (1) This facialtrackerwould produce 49 facialpoints based on important human features which include the rigid and non-rigid points. Sample of the detected 49 points facial landmarks are as shown in Figure 2 where the left side shown the labelled number of facial points and the right side shows its real implementation on actualimage. From the detected 49 points, fourROIs were selected to determine the most suitable face area that would results in most accurate HR for near and long distance application. The chosen face areas were as shown in Figure 3. Right cheek was chosen as the first ROI since less non-rigid motion is generated in this area compared to otherregions. Another area selected was the center of face because a study claimed that this area considered to be the most suitable area for PPG signal extraction for video based HR system. Next, whole face area was selected since hypothetically, larger ROI means that the possibility to extract the PPG information from a far distance is high. However, 10% horizontal dimension reduction and 20% vertical dimension reduction were applied to this area in order to exclude unwanted background that might affect the PPG signal extraction process. Lastly, the final area selected for this project was lower region of face that includes nose and mouth but excluding eyes and chin area.This area was selected because the non-rigid motion is less and the area dimension is wider compared to the right cheek region. From the selected ROI, random pairtemporalgreen color channelvalues that indicate the PPG signal is extracted. Figure 2. 49 Facial landmark produced Figure 3. Region of interest
  • 4.  ISSN: 2302-9285 Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410 406 2.2. PPG signal extraction PPG signal was extracted from the green channel of the constructed ROI because of green channel contains strongest information for signal extraction due to the light sensitivity of hemoglobin. Since the extracted signal contained unwanted interference, ma inly illumination variation, BSS technique known as ICA was used to separate the illumination variation from the true PPG signal. The visual representation of signal extraction is shown in Figure 4 where the top part is the original raw signal, and the bottom part is two signal produced by the ICA which the refined signal and its illumination variation. It can be observed that the polished signal pattern is more or less identical with the raw one as opposed to the predicted noise. PPG signal using can be modelled using (2) where PPGraw is the true PPG signal and s is the green channel signal and y is the variation of illumination. If the parameter y can be estimated directly, then pure cardiac signal can be obtained easily, however in practice such signal cannot be measured straight away and hence ICA is used. ICA uncover the independent source of the signal by maximizing or minimizing a cost function of the mixing that measure non-Gausianity to uncoverthe mixture coefficients. PPGraw=s+y (2) Figure 4. Visualization pf signal separation process using ICA PPG signal obtained after the ICA process is a raw signal and still contains a fragment of unwanted noise. Thus some signal filtering processes were applied to obtain refined PPG signal. In this paper, detrending and moving average filters were applied to the signal for reducing slow, non-stationary trend of signal and polishing the random noise, making the signal smooth prior to frequency domain conversion [23, 24]. The filtered PPG signal was converted to frequency domain to determine the power spectrum density (PSD) using Welch method [25] with the constrained frequency spectrum within the range of 0.7Hz to 4 Hz that represent the HR value range from 42bpm to 240bpm. Lastly, the HR is calculated by multiplying the maximal PSD response with 60. The filtering processes for PPG signal were as shown in Figure 5. Figure 5. Detrending and moving average process
  • 5. Bulletin of Electr Eng & Inf ISSN: 2302-9285  Analysis of minimum face video duration and the effect of video compression to… (Norwahidah Ibrahim) 407 2.3. Histrogram analysis The HR value obtained from a single sequence calculation is still subject to the variation and hence a histogram based analysis is performed to determine the consistent reading against repetition. In this paper 10 repetition of HR reading from the same ima ge sequence is performed. Any HR reading that is significant with the majority in the bin will be labelled as an outlier and eliminated while the remaining will be used to determine an average of HR which shows consistency over the sampled time period. 3. RESULTS AND ANALYSIS In the experiment, video recording was conducted in an indoor laboratory and normal ambient light was used as lighting source. The videos were recorded with 1440×1080 pixels resolution at 60 FPS. The camera-subject distancesvary between 1 meter, 3 meters and 5 meters respectively as shown in Figure 6. Pulse oximeter was attached to the participants’ finger and reading from this device was made into ground truth for this project. There were two experiments conducted for this paper. The first experiment was to determine the minimum time requires for face video recording used in this project. For this analysis, 2 seconds, 5 seconds and 10 seconds videos were used. Another experiment was conducted to determine the effect of using compress video on the HR accuracy.Original video format is mov whereas the compressed video format is wmv, a fair comparison was made between HR results that were obtained from original and compressed videos. For this project, the accuracy and the error percentage were calculated using the shown equations. Percentage of Error = ( |measured value−actual value| actual value ) ∗ 100% (3) Accuracy (%) = 100% − Percent of Error (4) Figure 6. General experiment set up for this project Based on both tables reading, the errors calculated for each recording time with respect to distances did not exceed 50% which means that the system is capable of working properly even with short video sampling time. It can also be seen clearly that the three distances, 2 seconds sampling time provide the most accurate reading with 75% for 1 meter, 94% for 3 meters and 79.9% for 5 meters. As the sampling time increased (5 seconds and 10 seconds), the accuracy significantly reduced with an average of below 80% for various ranging of distances. Thus, based on this result, it was proven that the system able to work properly with acceptable accuracy with two seconds of sampling time. It is also worth to mention that, most of commercial pulse oximeter device required more than 5 seconds to obtain the HR reading. However for the non-contact camera based system,ourresults showed that readingwith 2 seconds is enough. Even though the accuracy from Table 1 and Table 2 is relatively high (above 80%), it was executed using compressed video format (wmv) to speed up the processing time. In the next experiment, we showed the effect of uncompressed video to the HR reading. In principle, with the uncompressed video image the processing time will be increased since density of the pixels in the picture fragment is slightly higher.
  • 6.  ISSN: 2302-9285 Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410 408 For this analysis, original images from the video frames (mov format) were used and compared with the uncompressed one (wmv). The time assigned was two seconds for both videos format since previously we have shown that this is optimal time sampling for calculating the HR. Technically 120 image frames from the video was used as input stream to the system. The result for this analysis was as shown in Table 3. Based on the result obtained from Table 3, the reading of HR reading from original video showed great consistency and did not varies much from the ground truth. The experiment was repeated five times to determine the reading variation for the estimated HR. For experiment that used the compress video, there are fluctuations in the HR reading. For example, the HR reading of compressed video for 3 meter distance, the differences between the first reading and the second reading was inconsistence. However, there was no fluctuation in results obtained from original video. This clearly showed that using compressed video asinput for this system affected the HR reading accuracy.This happened because when the video format was changed,compression occurred to the videos and perhaps there were information loss during the compression process which caused the HR to be inconsistence and inaccurate. Table 1. HR Reading (Bpm) for assigned time Subjects Distance (m) Ground Truth (bpm) HR readingfor respective duration(bpm) 2 seconds 5 seconds 10 seconds 1 1 91 86 70 79 3 94 70 94 65 5 94 85 111 116 2 1 65 91 115 88 3 75 61 92 56 5 75 89 76 82 3 1 70 88 92 109 3 65 71 71 72 5 69 104 77 64 4 1 69 76 85 64 3 68 76 85 71 5 70 68 100 107 5 1 61 97 82 82 3 56 67 68 67 5 67 107 86 58 6 1 67 76 88 76 3 68 62 92 77 5 66 73 82 85 7 1 80 97 67 61 3 68 83 80 61 5 75 67 67 97 8 1 56 70 74 88 3 59 64 73 62 5 59 62 92 86 Table 2. Accuracy Summary from Table 1 Time (seconds) Range (m) 2 5 10 Accuracy (%) Accuracy (%) Accuracy (%) (HR accuracy results for near distance) 1 75.00 66.40 70.00 3 94.00 80.60 84.40 (HR accuracy results for farther distance) 5 79.90 75.50 73.30 Average 82.97 74.17 75.90 Table 3. Bpm readings for compressed and original video with 2 seconds sampling time Video Type Distance (m) Ground Truth(bpm) 1st 2nd 3rd 4th 5th Repetition of EstimatedReading(bpm) Compressed Video (wmv) 1 65 92 94 94 101 91 3 75 82 118 74 77 124 5 75 68 79 69 74 98 Original Video (mov) 1 65 67 67 67 67 67 3 75 74 74 74 74 74 5 75 60 60 60 60 60
  • 7. Bulletin of Electr Eng & Inf ISSN: 2302-9285  Analysis of minimum face video duration and the effect of video compression to… (Norwahidah Ibrahim) 409 4. CONCLUSION AND FUTURE WORK This paper investigates time sampling requirements for calculating HR from compressed and uncompressed video samples. The PPG signals were extracted from eight different subjects that was recorded at 60 FPS from three different distances of 1 meter, 3 meters and 5 meters and hence producing 24 video samples. In the first experiment, three sampling time were analyze which are 2 seconds, 5 seconds and 10 seconds. Averagely from all various distances sampling time of 2 seconds yield 83% accuracy and beyond this point the accuracy level deteriorate significantly with below than 80%, and hence we conclude that 2 secondssampling time is optimalto measure the HR that obtain from camera.In the second experiment we conclude that original uncompressed video or high quality videos will yields accurate and stable HR reading, but at a cost of longer processing time. In future, the system can be improved by optimizing the processing time for real implementation. It can be done by utilizing faster facial po int’s extractor module. Apart from that, accuracy of the system can also be improved by tuning the signal processing part for adaptingmore robust motion and illumination artifact. ACKNOWLEDGEMENTS The authors would like to thank to Ministry of Education (MOE) and Universiti Tun Hussein Onn Malaysia(UTHM) for supporting this research under Fundamental Research Grant Scheme (FRGS) (Vot. No 1582). REFERENCES [1] J. Kranjec, S. Beguš, G. Geršak and J. Drnovšek, "Non-contact heart rate and heart rate variability measurements: A review," Biomedical Signal Processing and Control, vol. 13, pp. 102-112, September 2014. [2] A. B Hertzman and CR Spealman, "Comparative Estimation of Blood Supply of Skin Areas from Photoelectrically Recorded Volume Pulse," Experimental Biology and Medicine, vol. 38, no. 4, pp. 562-564, 1938. [3] W. Verkruysse, L. Svaasand and J. Nelson, "Remote plethysmographic imaging using ambient light," Optics Express, vol. 16, no. 26, pp. 21434-21445, Dec. 2008. [4] C. Li, C. Xu, C. Gui and M. D. Fox, "Distance Regularized Level Set Evolution and Its Application to Image Segmentation," in IEEE Transactions on Image Processing, vol. 19, no. 12, pp. 3243-3254, Dec. 2010. [5] M. Poh, D. J. McDuff and R. W. Picard, "Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam," in IEEE Transactions on Biomedical Engineering, vol. 58, no. 1, pp. 7-11, Jan. 2011. [6] A. Qayyum, A. S. Malik, A. N. Shuaibu and N. Nasir, "Estimation of non-contact smartphone video-based vital sign monitoring using filtering and standard color conversion techniques," 2017 IEEE Life Sciences Conference (LSC), Sydney, NSW, pp. 202-205, 2017. [7] Q. Fan and K. Li, "Non-contact remote estimation of cardiovascular parameters," Biomedical Signal Processing and Control, vol. 40, pp. 192-203, Febuary 2018. [8] Q. Zhang, Q. Wu, Y. Zhou, X. Wu, Y. Ou and H. Zhou, "Webcam-based, non-contact, real-time measurement for the physiological parameters of drivers," in Measurement, vol. 100, pp. 311-321, 2017. [9] K. Matsumura, P. Rolfe, J. Lee and T. Yamakoshi, "iPhone 4s Photoplethysmography: Which Light Color Yields the Most Accurate Heart Rate and Normalized Pulse Volume Using the iPhysioMeter Application in the Presence of Motion Artifact?," in PLoS ONE, vol. 9, no. 3, pp. e91205, March 2014. [10] G. Balakrishnan, F. Durand, and J. Guttag, “Detecting pulse from head motions in video,” 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, pp. 3430-3437, 2013. [11] X. Li, J. Chen, G. Zhao, and M. Pietikainen. “Remote Heart Rate Measurement from Face Video under Realistic Situations,” 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, pp. 4264-4271, 2014. [12] M. Kumar, A. Veeraraghavan and A. Sabharwal, “Distance cePPG: Robust non-contact Vital Sign Monitoring using a Camera,” Biomedical Optic Express, vol. 6, no. 5, pp. 1565-1588, Apr. 2015. [13] A. Lam and Y. Kuno, "Robust Heart Rate Measurement from Video Using Select Random Patches," 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, pp. 3640-3648, 2015. [14] R. Y. Huang and L. R Dung, “Measurement of Heart Rate Variability using off the shelf smart phones,” in Biomedical Engineering online, vol. 15, no. 11, pp. 1-16, January 2016. [15] Yu, Y., Raveendran, P. and Lim, C., “Dynamic heart rate measurements from video sequences,” in Biomedical Optics Express, vol. 6, no. 7, pp. 2466-2480, July 2015. [16] S. Hanfland and M. Paul, "Video Format Dependency of PPGI Signals,” 20th Internatinoal Student Conference on Electrical Engineering, May 2016. [17] D. J. McDuff, E. B. Blackford and J. R. Estepp, "The Impact of Video Compression on Remote Cardiac Pulse Measurement Using Imaging Photoplethysmography," 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), Washington, DC, pp. 63-70, 2017. [18] C. Zhao, C. Lin, W. Chen and Z. Li, "A Novel Framework for Remote Photoplethysmography Pulse Extraction on Compressed Videos," in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, pp. 1380-1309, 2018.
  • 8.  ISSN: 2302-9285 Bulletin of Electr Eng & Inf, Vol. 9, No. 1, February 2020 : 403 – 410 410 [19] T. Tamura, "Current progress of photoplethysmography and SPO2 for health monitoring," in Biomedical Engineering Letters, vol. 9, no. 4, pp. 21-36, Febuary 2019. [20] B. Holton, K. Mannapperuma, P. Lesniewski and J. Thomas, "Signal recovery in imaging photoplethysmography," in Physiological Measurement, vol. 34, no. 11, pp. 1499-1511, October 2013. [21] P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai, HI, USA, 2001, pp. I 511-I 518, Febuary 2001 . [22] P. Dollar, P. Welinder, P. Perona, “Cascaded Pose Regression,” 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 1078-1085, 2010. [23] M. P. Tarvainen, P. O. Ranta-aho and P. A. Karjalainen, "An advanced detrending method with application to HRV analysis," in IEEE Transactions on Biomedical Engineering, vol. 49, no. 2, pp. 172-175, Feb. 2002. [24] H. Lee, J. Lee, W. Jung and G. Lee, "The Periodic Moving Average Filter for Removing Motion Artifacts from PPG Signals," in International Journal of Control, Automation, and System, vol. 5, no. 6, pp. 701-706, December 2007. [25] [P. Welch, "The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms," in IEEE Transactions on Audio and Electroacoustics, vol. 15, no. 2, pp. 70-73, June 1967. BIOGRAPHIES OF AUTHORS Norwahidah Ibrahim was born in Johor, Malaysia in 1993. She received the B.Eng degree in Electronics (Mechatronics) from University Tun Hussein Onn Malaysia in 2016. Currently, she is doing her M.Eng degree in Electrical at the same university. Her current research interest is computer vision, image processing and signal processing. Razali Tomari was born in Johor, Malaysia, in 1980. He received the B.Eng degree in Mechatronics from the Universiti Teknologi Malaysia, in 2003, M.Sc in intelligent system from the Universiti Putra Malaysia, in 2006. And PhD degree in computer vision and robotic from the Saitama University, Japan in 2013. In 2003, he joined Faculty of Electrical Engineering, University Tun Hussein Onn as a tutor and later on become a Senior Lecturer in 2013. His current research interest includes computer vision, pattern recognition, smart wheelchair and sensing technology. WN Wan Zakaria received B.Eng (2007) in Electronics and Mechanical Engineering from Chiba University and MSc (2008) and PhD (2012) from Newcastle University. She is currently a lecturer in Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia. Her current interests include Medical Robotics System specifically on development of robot force control, Image Processing and Computer Aided Diagnosis, and development of Wearable Device. She is author and co-author of several journal papers and conference proceedings.