Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

CS-ISP Overview

376 views

Published on

Chips&Media ISP Solution Overview

Published in: Technology
  • Be the first to comment

CS-ISP Overview

  1. 1. 1 ISP(Image Signal Processing) IP Product Introduction CONTENTS Introducing ISP p2 ISP in real world applications p3 Market Trend P4 ISP flow and key functions P5 ISP key functions p6 Functional block diagram p11 ISP product specification p12 Value proposition p13 ISP roadmap p14 Version Date: May 2016
  2. 2. 2 Image Signal Processing IP Introducing ISP IP  Complete and configurable full ISP pipeline  High performance and small size IPs applicable to different processor types ISP Processor type Image Processor (Vision) Image processor (Companion processor) CIS Sensor Size 2M ~ 8MPixel (4K) ~ 2MPixel ~ 2MPixel Application IP surveillance cameras, Automotive Surveillance cameras Surveillance camera Market size High or Mass Mass Mass or Entry Memory (Buffer type) External memory (e.g. Frame buffer) No external memory, Internal SRAM (Line buffer) and/or SDRAM (SiP) No external memory Chips&Media IPs
  3. 3. 3 ISP is being widely used in different applications requiring image signal processing High-end Applications (5MP~13MP) Low-end Applications (VGA~HD) Ultra High-end Applications (16MP and higher) Mid-end Applications (HD~5MP) Security Camera Tablet Camera Camcorder Smartphone/Tablet Camera Notebook/PC Camera Smartphone Camera Automotive Camera (incl. Dashboard Camera) Console Game Camera Smartphone Camera DSLR Camera Digital Still Camera Smartphone/Tablet Camera Toy Camera Medical Camera (Endoscopy) Drone Camera ISP in Real World Applications
  4. 4. 4 Camera Modules market is on sustainable growth with 2MP/8MP being the largest in volume Market Trend Global Camera Modules Market Volume by Pixel Count Global Camera Modules Market by Volume ○ Camera Modules market for Non-Mobile and Mobile Market is expected to grow continuously - Non-Mobile Market : 7.9% CAGR; Mobile Market : 21.2% - Non-Mobile Market including Automotive, Surveillance, and Drones use multiple number of camera modules - Mobile Market has trend to integrate dual camera (2 cameras) ○ Demand for high resolution camera is on rapid rise - The market is expected to divide at 8MP marks as 8MP+ makes up 50% of the market, and 5MP- fills up the rest 50% - In detailed breakdown, demand for 8MP camera modules and 2MP camera modules are forecasted to be the largest
  5. 5. 5 ISP flow and Key Functions Key Functions Functions Summary Lens Shading Correction  16x16 2D Mesh Based Shading Correction  RGB Color Shading Correction support  Shading Parameter Correction for light source change Gamma Correction  Bayer/RGB/Y Gamma correction Color Enhancement  Basic 3x3 Color Matrix & Adaptive Correction  Individual 12-Region Saturation/Hue/ Delta-L Control support Gb/Gr Correction  Max. 12.5% of single deviation corrections (None Uniform) Auto White Balance  16x12 RGB, Cb/Cr Base Feed Forward Algorithm support Auto Exposure  16x12 Weighting Window support Auto Focus  3-Type Filter & 9-AF Window support Noise Reduction  Bayer/RGB/Y Noise Reduction  Texture Preserved Noise Reduction Edge Enhancement  Bayer/RGB/Y Sharpness support RGB Interpolation  Hybrid Type High-Resolution Color Interpolation ISP flow Bayer In YUV Out Object Lens Image Sensor Bayer Image Photo(YUV)ISP ISP Flow and Key functions <Functional block diagram>
  6. 6. 6 ISP Key functions Key Functions Functions Summary Lens Shading Correction  16x16 2D Mesh Based Shading Correction  RGB Color Shading Correction support  Shading Parameter Correction for light source change Gamma Correction  Bayer/RGB/Y Gamma correction Color Enhancement  Basic 3x3 Color Matrix & Adaptive Correction  Individual 12-Region Saturation/Hue/ Delta-L Control support Gb/Gr Correction  Max. 12.5% of single deviation corrections (None Uniform) Auto White Balance  16x12 RGB, Cb/Cr Base Feed Forward Algorithm support Auto Exposure  16x12 Weighting Window support Auto Focus  3-Type Filter & 9-AF Window support Noise Reduction  Bayer/RGB/Y Noise Reduction  Texture Preserved Noise Reduction Edge Enhancement  Bayer/RGB/Y Sharpness support RGB Interpolation  Hybrid Type High-Resolution Color Interpolation Lens Shading Correction  Function: Adjust the effect of lower surrounding RGB value (vs. the value of the center) due to characteristic relationship between Lens and Sensor ISP Key functions Before After Before After Gamma Correction  Function: Adjust gamma value to reproduce more natural image
  7. 7. 7 ISP Key functions Key Functions Functions Summary Lens Shading Correction  16x16 2D Mesh Based Shading Correction  RGB Color Shading Correction support  Shading Parameter Correction for light source change Gamma Correction  Bayer/RGB/Y Gamma correction Color Enhancement  Basic 3x3 Color Matrix & Adaptive Correction  Individual 12-Region Saturation/Hue/ Delta-L Control support Gb/Gr Correction  Max. 12.5% of single deviation corrections (None Uniform) Auto White Balance  16x12 RGB, Cb/Cr Base Feed Forward Algorithm support Auto Exposure  16x12 Weighting Window support Auto Focus  3-Type Filter & 9-AF Window support Noise Reduction  Bayer/RGB/Y Noise Reduction  Texture Preserved Noise Reduction Edge Enhancement  Bayer/RGB/Y Sharpness support RGB Interpolation  Hybrid Type High-Resolution Color Interpolation Color Enhancement  Function: Enhance the color input to the sensor to reproduce the actual c olor of input image ISP Key functions Before After Before After Gb/Gr Correction  Function: Correct the disparate values of the even line G and odd line G ca used by the sensor properties
  8. 8. 8 ISP Key functions Key Functions Functions Summary Lens Shading Correction  16x16 2D Mesh Based Shading Correction  RGB Color Shading Correction support  Shading Parameter Correction for light source change Gamma Correction  Bayer/RGB/Y Gamma correction Color Enhancement  Basic 3x3 Color Matrix & Adaptive Correction  Individual 12-Region Saturation/Hue/ Delta-L Control support Gb/Gr Correction  Max. 12.5% of single deviation corrections (None Uniform) Auto White Balance  16x12 RGB, Cb/Cr Base Feed Forward Algorithm support Auto Exposure  16x12 Weighting Window support Auto Focus  3-Type Filter & 9-AF Window support Noise Reduction  Bayer/RGB/Y Noise Reduction  Texture Preserved Noise Reduction Edge Enhancement  Bayer/RGB/Y Sharpness support RGB Interpolation  Hybrid Type High-Resolution Color Interpolation Auto White Balance  Function: Correct RGB values to assign White Color to the input image ISP Key functions Before After Before After Auto Exposure  Function: Adjust Exposure and Gain values to optimize the image’s brightness
  9. 9. 9 ISP Key functions Key Functions Functions Summary Lens Shading Correction  16x16 2D Mesh Based Shading Correction  RGB Color Shading Correction support  Shading Parameter Correction for light source change Gamma Correction  Bayer/RGB/Y Gamma correction Color Enhancement  Basic 3x3 Color Matrix & Adaptive Correction  Individual 12-Region Saturation/Hue/ Delta-L Control support Gb/Gr Correction  Max. 12.5% of single deviation corrections (None Uniform) Auto White Balance  16x12 RGB, Cb/Cr Base Feed Forward Algorithm support Auto Exposure  16x12 Weighting Window support Auto Focus  3-Type Filter & 9-AF Window support Noise Reduction  Bayer/RGB/Y Noise Reduction  Texture Preserved Noise Reduction Edge Enhancement  Bayer/RGB/Y Sharpness support RGB Interpolation  Hybrid Type High-Resolution Color Interpolation Auto Focus  Function: Correct RGB values to assign actual White Color to the input image ISP Key functions Before After Before After Noise Reduction  Function: Reduce or remove the noise of input image
  10. 10. 10 ISP Key functions Key Functions Functions Summary Lens Shading Correction  16x16 2D Mesh Based Shading Correction  RGB Color Shading Correction support  Shading Parameter Correction for light source change Gamma Correction  Bayer/RGB/Y Gamma correction Color Enhancement  Basic 3x3 Color Matrix & Adaptive Correction  Individual 12-Region Saturation/Hue/ Delta-L Control support Gb/Gr Correction  Max. 12.5% of single deviation corrections (None Uniform) Auto White Balance  16x12 RGB, Cb/Cr Base Feed Forward Algorithm support Auto Exposure  16x12 Weighting Window support Auto Focus  3-Type Filter & 9-AF Window support Noise Reduction  Bayer/RGB/Y Noise Reduction  Texture Preserved Noise Reduction Edge Enhancement  Bayer/RGB/Y Sharpness support RGB Interpolation  Hybrid Type High-Resolution Color Interpolation Edge Enhancement  Function: Bayer/RGB/Y Sharpness Support ISP Key functions Before After Before After RGB Interpolation  Function: Interpolate RGB values in a pixel which only holds a value of R, G, or B
  11. 11. 11 Functional block diagram Functional Block Diagram Bayer / YUV(16bit) YUV Out Input Control Bayer Pre-Processing Bayer Processing RGB Interpolation RGB Processing Contrast Correction YUV Processing Formatting • Color Correction Matrix • Gamma Correction • Color Enhancement • Noise Reduction • Sharpness • Noise Reduction • Color NR • Sharpness • and more • Noise Reduction • Defective Pixel Correction • GbGr Correction • and more • Shading • Gain Correction 3A Statistics AWB/AE Gain
  12. 12. 12 Product Specification ISP Product Specification CS-U02Z-G/0 Size Logic 390Kgate Memory 150Kgate Maximum resolution Image Up to 2MPixel Video 1920x1080 at 60fps1) Synthesizable clock 350MHz (w/ 55nm Lib.) Input formats Bayer(8bit, 10bit, 12bit), YUV(16bit) Output formats YUV 1) Requires 160MHz operating clock. CS-O20Z-G/0 Size Logic 2.1Mgate Memory 1.4Mgate Maximum resolution Image Up to 20MPixel Video UHD at 60fps Synthesizable clock 1.1GHz (w/ 28nm Lib.) Input formats Bayer(8bit, 10bit, 12bit), YUV(16bit) Output formats YUV CS-O08Z-G/0 Size Logic 620Kgate Memory 460Kgate Maximum resolution Image Up to 8MPixel Video UHD at 30fps1) Synthesizable clock 350MHz (w/ 55nm Lib.) Input formats Bayer(8bit, 10bit, 12bit), YUV(16bit) Output formats YUV 1) Requires 320MHz operating clock.
  13. 13. 13 Customer benefits Each IPs within Full IP Engine can be selectively and independently used, based on target quality, Chip Size and Cost requirement. IPs available are as follows: Cost Reduction while maintaining Quality and Flexibility Cost Effectiveness Smaller Chip Size  Gate Count : 50% or lower vs competitors (in same resolution) 1.6 1.1 0.49 S Co. SS Co. C&M 13 12 3.5 S Co. Q Co. C&M 3MP(CIS) 16MP(AP) Complete and Configurable IP Pipeline Unit: Million Unit: Million Value Proposition  3 Auto  Lens Shading Correction  Gamma Correction  CIS Timing Controller  Gb/Gr Correction  Dead Pixel Correction  Black Level Compensation  Dark Correction  RGB Interpolation Competitively affordable licensing cost with guaranteed on-time delivery Competitive License Cost and Delivery Time C&M Full ISP Engine Q Company ISP in AP S Company ISP in AP Cost(Production/License) Image Quality e.g.: 1) Full ISP Pipeline with medium quality 2) Selected ISP Pipeline with high quality (configured)
  14. 14. 14 ISP IP and Image Processing Single IP development plan Item 2015 2016 2017 2018 Current 2Q 3Q 4Q 1Q 2Q 3Q 4Q 1Q ISP IP Full IP (up to 20MP) Single IP CS-O20Z-G/0 CS-O08Z-G/0 CS-L20Z-G/0 CS-U02Z-G/0 0.28nm Tech. 1.1GHz Operation 3.5M G/C w/Memory (20MP) 0.55nm Tech. 200MHz Operation 0.49M G/C w/Memory(FHD) 0.28nm Tech. 600MHz Operation 1.18M G/C w/Memory(8MP) 0.28nm Tech. 1.1GHz Operation 3.1M G/C w/Memory(20MP) ISP Product Roadmap
  15. 15. 15 End of Document Contact: isp@chipsnmedia.com

×