Toward Real Time Eyes-Free Barcode Scanning on Smartphones in Video Mode

TOWARD REAL TIME EYES-FREE BARCODE SCANNING ON SMARTPHONES IN VIDEO MODE Vladimir Kulyukin Aliasgar Kutiyanawala John Nicholson Department of Computer Science Computer Science and Informational Technology Department Utah State University Austin Peay State University Abstract Interactive Camera Alignment Barcode LocalizationIn our previous research, we have shown that visually impaired (VI)individuals can shop independently by scanning MSI barcodes on shelves andUPC barcodes on products. This system was called ShopTalk and used a hand-held barcode scanner, a shoulder-mounted keypad and headphones connected Downscale Apply line detection image filterto an ultra-portable OQO computer. ShopMobile2 is the next version of this Haptic interfaces ensure thatsystem that reduces the systems hardware complexity by allowing VI users to the camera is aligned with theshop independently using only a smartphone. barcode in the pitch and yaw planes and help keep visionShopMobile2 has three software modules – an eyes-free barcode scanner, an algorithms simple. a b cOCR engine and remote guidance. This paper describes our barcode scanning Rasterized search for areas withalgorithm that operates in video mode on the Google Nexus One Android 2.2 high alternating frequency andsmartphone. Two pilot experiments are presented: the first one, conducted in vertical continuitya grocery store evaluated the contributions of the algorithm’s modules; thesecond one, performed in a laboratory with two VI users, evaluated theeffectiveness of the algorithm in finding UPC barcodes on various grocery Barcode Detectionproducts. Extract barcode from original image ShopMobile – II System Components e d Compute x-gradient Compute y-gradient Product Retrieval image image Barcode Decoding 300 250 Extract intensities along a 200 scanline Product 150 Verification 100 Find the product by scanning MSI 50 barcodes on the shelves and 0 0 50 100 150 200 250 300 350 400 450 500 reading product name using OCR. Identify image regions with high start pattern Convert intensities to response in x-gradient and low digit 0 line widths (L) response in y-gradient or vice Extract patterns & versa using a SVM digits from line widths 111321114111114 ... 2122111 1321114111114 ... OCR 2122111 Verify the product by scanning the Match extracted patterns & UPC barcode on it and reading digits with templates text using OCR. Digit Line width pattern Detect Barcode 0 3211 1 2211 TeleShop 3211 ... ... The store is right 9 3122 Read nutrition facts and in front of you ingredients list on products using OCR. Alternating Frequency & Vertical Continuity Acknowledgements The first author would like to acknowledge that this research has been supported, in part, through NSF grant IIS-0346880, and several Community University Research Get help from family, friends and Initiative (CURI) grants from the State of Utah. caregivers at remote locations by transmitting real-time video.

http://vkedco.blogspot.com	174
http://www.vkedco.blogspot.com	63
http://vkedco.blogspot.in	5
http://vkedco.blogspot.com.au	1
http://www.vkedco.blogspot.in	1
http://vkedco.blogspot.mx	1

Toward Real Time Eyes-Free Barcode Scanning on Smartphones in Video Mode

by Vladimir Kulyukin on Jan 17, 2012

Accessibility

Categories

Tags

Upload Details

Usage Rights

6 Embeds 245

Statistics

Toward Real Time Eyes-Free Barcode Scanning on Smartphones in Video Mode — Presentation Transcript