142 - Enabling an Immersive Mobile Internet Experience with the ARM Cortex-A8...
Image Sensors 2009 - Shri Sundaram
1. Moving Towards the Next Generation of Imaging Applications A Perspective Shri Sundaram, Toshiba America Electronic Components, Inc.
2.
3.
4. How Does a Player Defend the Position in a Mature Market? Toshiba’s strategies to grow its core business in this rapidly maturing industry Sensitivity, SNR, Crosstalk, Smaller Pixels DSC Quality, Wide Dynamic Range Smallest form factor z, x & y Easy Manufacturing High Reliability Pixel Technology Image Pipeline Module Packaging Advanced Fabrication Technologies & Highly Integrated Manufacturing Facilities
11. Future Applications May Not Need High-Res Images for Image Identification Source: http://www.youtube.com/watch?v=6VTrb2gl-14 Google Tech Talks by Bob Fischer of Optics1 Inc. “ Motion is the cue that’s extremely important… probably would be able to tell what it is if you saw the car (PT Cruiser) driving across the 8x16…” - Bob Fischer Video is Important, Resolution Not so …
12. It Will Come Down to Architecture Definition Source: http://electronicdesign.com/files/29/21483/fig_03.gif Cover Feature on Video Analysis by Richard Quinnell in Electronic Design (7/23/09) Traditional architectures place video analysis in a central location such as on a server or a digital video recorder, but analysis is now moving toward the edge with IP cameras offering built-in processing … Image is no longer the end product. ..
13. Another View of the System Partition Image sensor from a leading supplier or from a specialty supplier Traditionally a remote location, these functional blocks are moving closer to camera. Functions include Hough Space Transformation and instant pattern matching… Remote Image is the raw material for further analysis.
14. An Example of a Processor Residing Close to the Camera - TX4961 System from Toshiba MOST M-LB TX49 RISC CPU Core Graphic Display Ctrl. & Accelerators ADC Mem Ctr DMA Ctrl DDR- S D RAM Flash FG SEI, UART AC Link I2C CAN 3ch Timer PWM GPIO With CAN interface, GPIO, ADC, Timers, and PWMs , the TX4961 can do the job of an MCU Auxiliary audio output for sound effects and reinforcement In-Vehicle Communications CAN /MOST/Serial Live video input from rearview / sideview cameras or DVD/Navi system Full-size TFT Software-Reconfigurable Instrument Cluster NAND Ctr
17. Scaling and Transformations in Action! Once a frame is captured, it becomes graphics data that can be processed further by the graphics engines for real-time processing of video input CROP SCALE TRANSFORM
18. Here’s Another Toshiba Processor (ARM® Core) That Can Reside Next to a Camera – TMPA900CM TX09 Series - ARM926EJ-S TM Core - Embedded USB Device and USB Host function ARM is a registered trademark and ARM926EJ-S is a trademark of ARM Limited in the EU and other countries. SSP/UART (2/3ch) I/O Port (91pins) I2C/I2S (1/1ch) 10bitA/D (8ch) NANDF (2ch) / CLCDC 16bit WATCH DOG TIMER RTC 16bit Timer (6ch) USB (Device) Memory Controller SRAM SDR SDRAM DDR SDRAM USB (Host) CLCDC 24bit / CMOS IF LCDDA Scale Rotation Blend OFD ARM926EJ-S TM CORE Boot ROM RAM CG DMAC Touch Screen SD Host Controller (1ch)