Image Signal Processing (ISP) 

& Computational Photography (CP)

Chips&Media is partnering with BTREE to provide packaged multimedia IPs, including ISP IPs, to offer the best solution possible to the clients with a complete pipeline with optimized gate size and memory usage.

METIS

Quality optimized, multi-instance
(ISP)

LEDA (5MP)

Size optimized, competitive quality 
(ISP)

CARPO (2MP)

Size optimized, competitive quality
(ISP)

KERBEROS

Lens Distortion Correction
(CP)

NIX

Multi-exposure, HDR
(CP)

HYDRA

3D Noise Reduction (3DNR)
(CP)

METIS

Quality optimized, multi-instance ISP

The Camera ISP IP – METIS is the Image Signal Processing (ISP) IP developed to be used in automotive and surveillance applications such as Around View Monitor / Surround View Monitor, Dash Cams, and Autonomous Driving Assistants. METIS offers a complete and configurable ISP pipeline with multi-instances to process up to 4 inputs from CMOS sensors simultaneously. 

View Detailed Specs


Product Specification Features

  • Maximum resolution: 8MP (3840h x 2160v)
  • Maximum input frame rate: 60fps (@ 8MP, Output : 30 fps)
  • Low power consumption and small gate count
  • 20bit Sensor Data Interface
  • Anti-Ghosting
  • Adaptive Tone Mapping per input images
  • Real-time HDR Output





 
 

LEDA (5MP)

Size optimized, competitive quality ISP

The Camera ISP IP – LEDA is the Imaging Signal Processing (ISP) targeted to be used in low-light environments for surveillance cameras, automotive applications such as car DVRs and Infotainment systems, and has a maximum processing resolution of 5 Mega Pixels (MP) at 30 frames per second (FPS). This ISP offers a complete and configurable ISP pipeline with features including 8x6 2D Color-Shading Correction, 19-Point Bayer Gamma Correction, 6-Region Color Saturation, Hue, and Delta-L Control functions, and generates the best possible picture quality by implementing optimum low light Noise/Sharp filters on the inputted image after analyzing each scene, which is one of the key advantages of LEDA ISPs. Furthermore, the other competitive advantage over other IPs is the significantly low gate size and memory usage which are achieved by optimizing the algorithm through information sharing of each process. 

View Detailed Specs


Product Specification Features

  • Maximum resolution: 2592x1944 5M
  • Maximum frame rate: 30fps (2592x1944)
  • Programmable window size and position
  • Supports up to 100% barrel distortion correction





CARPO (2MP)

Size optimized, competitive quality ISP

The Camera ISP IP – CARPO is the Imaging Signal Processing (ISP) targeted to be used in low light environments for surveillance cameras, automotive applications such as car DVRs and Infotainment systems with a maximum processing resolution of 2 Mega Pixels (MP) at 30 frames per second (FPS). The ISP offers a complete and configurable ISP pipeline with features including 8x6 2D Color-Shading Correction, 19-Point Bayer Gamma Correction, 6-Region Color Saturation, Hue, and Delta-L Control functions, and generates the best possible picture quality by implementing optimum low light Noise/Sharp filters on the inputted image after analyzing each scene, which is one of the key advantages of CARPO ISPs. Furthermore, the other competitive advantages over other IPs are the significantly low gate size and memory usage which are achieved by optimizing the algorithm through information sharing of each process. 

View Detailed Specs


Product Specification

  • Max Resolution: Full-HD (16:9) 1920(H) x 1080(V)
  • Max Frame Rate : 30 FPS @ 2MP
Defective Pixel Correction
  • On-The-Fly Defective Pixel Correction
Gb/Gr Unbalance Correction
  • Max Correction Tolerance Gb/Gr Rate : 12.5%
2D Lens-Shading Correction (8x6)
  • Normal R/Gb/Gr/B Channel Shading Correction
Supports Color Stain Correction
High-Resolution RGB Interpolation
  • ES/Hue-Med/Average/Non-Directional based hybrid type algorithm
Color Correction Matrix (3x3) Bayer Gamma Correction (19 points) Color Enhancement (Hue /Sat /∆-L)
  • Each 6-Region Hue/Sat/∆-L Control (R/G/B/C/M/Y)
High-Performance Noise Reduction for low light environment
  • Bayer/RGB/YC Domain Noise Reduction
High-Resolution Sharpness Control
  • Uses Multi-Sharp Filter and Individual Sharp Gain Control
Auto Exposure
  • 16x16 luminance weight window & pixel weighting
Auto White Balance
  • R/G/B based feed-forward method
Tone Mapping
  • Multi-band scheme using linear transformation as multi-slope
Auto Focus
  • 2-type 6-region AF value return
Interface – with a host system
  • ARM® AMBA 4 APB bus interface for CARPO ISP system control
  • 128 bit ARM® AMBA 4 AXI Interface for data
  • Direct connection to sensor stream data





 
 

KERBEROS

Lens Distortion Correction CP

Most cameras or sensors, which use the lens to collect light, face input image distortion or warping of straight lines (bending). This phenomenon is intensified in wide lenses, fisheye lenses and poor quality sensors. Among this type of distortion, the most prominent one is radial distortion, in which the image expands or shrinks radially from a point on the image. There are numerous methods which can be applied to correct these distortions, with advantages and disadvantages for each.

KERBEROS uses a method which estimates the parameter which determines the distortion rate through a mathematically model of the distortion, then performs a correction by inversely transforming the estimated parameter value. 
The KERBEROS IP is composed of 3 hardware blocks, a block generating coordinates for distortion correction, a block to store external memory to cache data using the generated coordinates, and a block that produces the final data by interpolating data stored in the data cache.

View Detailed Specs


Product Specification Features

  • Maximum resolution: 2592x1944 5M
  • Maximum frame rate: 30fps (2592x1944)
  • Programmable window size and position
  • Supports up to 100% barrel distortion correction





 

NIX

Multi-exposure High Dynamic Range (HDR) CP

As human eyes have a wider dynamic range than CMOS image sensors (CIS), a wider range of brightness can be recognized. A scene or an object which is visible to human eyes is not expressed clearly (either having oversaturation or under-saturation). To compensate for this factor, a CIS and IP algorithm to observe a higher range of brightness was developed.

The result of High Dynamic Range (HDR) based on single exposure (1 image) has a limitation of not being able to regenerate the saturated region from the CIS. To resolve this limitation, an algorithm which can synthesize multiple exposures (by combining more than 1 image) are being utilized. This new algorithm is called Wide Dynamic Range (WDR), which is also referred to as multi-exposure HDR.

The NIX IP analyzes long exposed images and short exposure images from the CIS, and performs fusion, local and global tone mapping, anti-ghosting, and contrast correction, then outputs the image with a wide dynamic range of 108 dB or higher.

For real-time processing, NIX provides a Video Stream Interface, which is similar to the output format from the CIS, and an AXI interface can also be provided per customer’s requirements.

View Detailed Specs


Product Specification Features

  • Maximum resolution: 8MP (3840h x 2160v)
  • Maximum input frame rate: 60fps (@ 8MP, Output : 30 fps)
  • Low power consumption and small gate count
  • 20bit Sensor Data Interface
  • Anti-Ghosting
  • Adaptive Tone Mapping per input images
  • Real-time HDR Output





 

HYDRA

3D Noise Reduction (3DNR) CP

In the signals outputted from the CMOS Image Sensor (CIS), base noise such as Additive White Gaussian Noise (AWGN) exists. This base noise does not affect the digital image during the day time when daylight inputted to the CIS is strong enough to prevent image deterioration. However, during night time when the available light signal is weak, the base noise level becomes equal or similar to the light signal and acts as the main cause of digital image deterioration.

In still images, a mask filter-based convolution calculation is used to remove base noise. The downside of this method is that as noise increases, the mask filter size and calculations increase significantly.  In continuous stream images (i.e. video), besides using the mask filter-based method, noise is also removed by accumulating temporal noise data, which possesses Gaussian distribution that when the average input signal of unit time (temporal) is used, temporal noise can be effectively removed. However, noise reduction using sequential images (referred to as 3-dimensional noise reduction – 3DNR) generates ghosting when movement or motion appears during the image sequences due to inconsistent images of the previous and current signal. The generation of ghosting in 3DNR is inevitable and will only be decreased, therefore, in HYDRA, the anti-ghost block is included to minimize ghosting.

HYDRA includes Digital Video Port (DVP), which is similar to the general output format from the CIS, as a baseline interface for real-time processing. An AXI interface can also be provided per customer’s requirements.

View Detailed Specs


Product Specification Features

  • Maximum resolution: 2592x1944 5M
  • Maximum frame rate: 30fps (2592x1944)
  • Programmable window size and position
  • Supports up to 100% barrel distortion correction





 Quick Navigation 

Documentation

Products

Support

  • LinkedIn
  • Facebook
  • YouTube

All contents © Copyright Chips&Media Inc. 2020. All Rights Reserved.