If Paper Could Talk, What Would It Say?

Labels That Talk Ken Berkun berkun@LTTaloha.com 808 254 1609 Fonly Institute Lee Felsenstein lee@fonlyinstitute.com 1-650-322-8680

If paper could talk, what would it say? 2 Labels That Talk, Confidential

3 Labels That Talk, Confidential

Soundpaper 6 Labels That Talk, Confidential

Company Info LTT, LTD is a QHTB Based in Kailua (Oahu) Hawaii Self-funded to date Who are we? Lee – Fonly LLC Ken 7 Labels That Talk, Confidential

Low Cost And Easy To Use 8 Labels That Talk, Confidential

Killer Apps 9 Labels That Talk, Confidential

Business Model Embedded software in OEM products 10 Labels That Talk, Confidential

Building Alliances Across the Photo Food Chain Not just taking pictures: telling stories. Spoken Word (audio Message) Soundpaper Cell Phone Home Photo Photo Kiosks Camera PC Device Printer Photo with Soundpaper 11 Labels That Talk, Confidential

Technology – starting points 900 860 800 Audio Compression 700 688 600 Quality 500 400 Availability 300 200 Must get greatest 120 160 100 8 20 28 40 45 96 128 8 16 22 32 0 36 compression R eq Hi Ty kbit/sec pi Com C g ui re h ly om Ty ca C d pr fo Com l C pic om PC pr e Yet maintain speech p r o m sse ess al c rS M p om ress 16 ou pr d, es ed e d -bi es nd lo se ,f pr quality se w t/4 ai pa d es , r se typ q d pe sp 4. ee sp u ali qua 1k i r l ity d . a cal ch ee ty m ch st m on sf us mu er eo o sic fil e ic kbit/sec KB/10 Sec. M P- 3 12 Labels That Talk, Confidential

Technology – starting points Cell Phone Cameras Field of View Density 13 Labels That Talk, Confidential

Technology – Starting points 360 DPI Printers Ink Jet Photo Paper Print Durability Dot purity 360 DPI Paper Quality Thermal Xfer Glossy Label 300 DPI Thermal Label 14 Labels That Talk, Confidential

Technology - Constraints Processing intensive Audio CODEC – compress/decompress Bar coding - encode /decode w/error correction Image Processing • Not an out-of-the-box proposition • Optimization is key: Performance went from ~ 10 seconds per frame to 10 frames per second 15 Labels That Talk, Confidential

Technology - Constraints Manual positioning Depth of field Hand motion Off-normal and rotated (360 deg) Off-Normal, rotated Blurred due to hand motion Readable Not Readable 16 Labels That Talk, Confidential

Technology – Constraints - UI Audio “Warm/Cold/OK” Use by elderly Tone frequency, spectrum Intuitive user interface Playback of audio as Row of ten LEDs recovered (green, end one amber) Linear countdown during recording Keep-alive indicator Use for framing indication 17 Labels That Talk, Confidential

Technology - Opportunities DSP chips w/ software C cross-compilers Cell phone camera sensors Development environments Audio CODECs for cell phones Audio is fault tolerant 18 Labels That Talk, Confidential

Technology - Opportunities Bitrate Codec Company Notes License (kb/sec) Not the best quality, but Speex Open Source 1 -- 16 Open Source source is available Very good low bit rate quality, ComPacketer Compandent 1 -- 64 Proprietary Very slow Performance Proprietary or 4.75 -- Many codecs AMR VoiceAge build from 12.2 available scratch Proprietary Digital Voice AMBE 2.4 -- 9.6 Software or Systems hardware 19 Labels That Talk, Confidential

Technology - Opportunities Cartridge label printers Thermal Transfer print technology 360/180 dpi Simple, reliable Used in desktop label printers 20 Labels That Talk, Confidential

Technology – First cuts 2-D Bar codes New generation designed for camera capture Bypass original image processing UPS Maxicode UPC Code 93 Bytes 12 Digits Soundpaper Barcode: 8000 bytes 21 Labels That Talk, Confidential

Technology – First cuts Infrared LED flash illumination Silicon peak sensitivity All colors on Bayer matrix 22 Labels That Talk, Confidential

Technology - Problems Open Source Codec Labor intensive to port Minimal support Can be totally customized Commercial Codec Extra bits we don’t need Expensive 23 Labels That Talk, Confidential

Technology - Problems Image processing is hand-crafted Pattern recognition takes many forms No magic mathematical solution 24 Labels That Talk, Confidential

Technology - Problems Sensor chip manufacturers don’t always help One major company never responded Demo systems not complete 25 Labels That Talk, Confidential

Technology - Solutions Build PC test bed for CODECs Bar codes Image degradation simulation 26 Labels That Talk, Confidential

Technology - Problems Desktop Inkjet Printers Great variability in quality Will need to be certified “SoundPaper Enabled” Clogging – one missing dot matters Photo Kiosks Low resolution, may not be good enough May require a separate printer to print Soundpaper on back of photo 27 Labels That Talk, Confidential

Technology - Solutions Use machine-vision camera & SW for test Chip vendor support inadequate Buyout solution for demo schedule 28 Labels That Talk, Confidential

Technology - Solutions Multi-stage SW development Write to run on PC • Algorithms must be final due to effort required to port to DSP Rewrite for DSP constraints • fixed point • chip architecture Port to DSP • segmented memory • data pages through on-chip memory ASIC remains a possibility 29 Labels That Talk, Confidential

Image Processing Short Course Edges Found Original Image 30 Labels That Talk, Confidential

Found it! Finding Segments Search area for Rotated Segment separator 31 Labels That Talk, Confidential

All (most!) Segments Found 32 Labels That Talk, Confidential

Identify Top and Bottom Edges 33 Labels That Talk, Confidential

Rectify Segment Actual Size 34 Labels That Talk, Confidential

Technology - Road Map Webcam version Single-use handheld PDA phone SW Cell phone SW Special application versions Web Integration PC Application Integration 35 Labels That Talk, Confidential

Status Working Prototype on PC Not final barcode Not final voice codec Not final camera DSP Platform TBD Performance: direct port from PC version won’t work Will require more image processing crafting 36 Labels That Talk, Confidential

Next Steps Raise funds! Complete Reference Designs for: Scanner/Printer Smartphone/PDA Webcam 3rd Party Software Plug-in 3rd Party Web site Close first OEM deal 37 Labels That Talk, Confidential

Soundpaper 38 Labels That Talk, Confidential

If Paper Could Talk, What Would It Say?

0 comments

Notes on slide 1

Favorites, Groups & Events