SYSTEM AND METHOD FOR EFFICIENT ENHANCEMENT TO ENABLE COMPUTER VISION ON MOBILE DEVICES

• US 20070257934A1
• Filed: 05/08/2007
• Published: 11/08/2007
• Est. Priority Date: 05/08/2006
• Status: Abandoned Application

• Current Assignee: David Doermann, Huiping Li
• Original Assignee: David Doermann, Huiping Li
• Inventors: Li, Huiping, Doermann, David
• Application Number:
  US11/746,044
• Publication Number:
  US 20070257934A1
• Time in Patent Office: Days
• US Class Current: 345/606
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06V 10/20 Image preprocessing

Abstract

A system and method for using camera enabled personal digital assistant (PDA) or cell phone hardware to provide enhanced imaging capabilities. The system and method enhances images taken on a mobile camera device to enable the mobile device, for example, a personal digital assistant (PDA) or cell phone, to provide enhanced imaging capabilities. A method comprising the steps of pre-calculating a pixel value at each point on a grid and storing said pre-calculated pixel values in a lookup table, using one bit to represent each pixel in said image, quantizing said image at a small step interval such that each pixel in the image corresponds to one point on said grid, and interpolating said image through a memory-indexing process. The method may further comprise the step of performing clustering based contrast enhancement on said image prior to said step of using one bit to represent each pixel in said image.

Claims

1. A method for enhancing an image on a mobile device comprising the steps of:

pre-calculating a pixel value at each point on a grid and storing said pre-calculated pixel values in a lookup table;

using one bit to represent each pixel in said image;

quantizing said image at a small step interval such that each pixel in the image corresponds to one point on said grid; and

interpolating said image through a memory-indexing process.

2. A method for enhancing an image on a mobile device according to claim 1 further comprising the step of performing clustering based contrast enhancement on said image prior to said step of using one bit to represent each pixel in said image.

3. A method for enhancing an image on a mobile device, wherein coordinates of four corners (P₁, P₂, P₃ and P₄) of a bounding box in said image are known, top and bottom boundaries of said bounding box intersect at a vanishing point A and right and left boundaries of said bounding box intersect at a vanishing point B, comprising the steps of:

calculating a mapping between an ideal, non-perspective image and said image, wherein said calculated mapping comprises a plane-to-plane homograph matrix H=(H₁, H₂, H₃), wherein said calculating a mapping comprises the steps of;

reshaping matrix H as a vector h=(h₁₁, h₁₂, h₁₃, h₂₂, h₂₃, h₂₄, h₃₁, h₃₂, h₃₃)^T;

calculating H₃ according to the equation

$\begin{array}{c}\{\frac{H_3·<br><br>A=0}{H_3·<br><br>B=0}\Rightarrow <br><br>H_3\sim <br><br>A\times <br><br>B,\mathrm{and}\\ H_3\sim <br><br>\left(\left(P_1\times <br><br>P_2\right)\times <br><br>\left(P_2\times <br><br>P_3\right)\right)\times <br><br>\left(\left(P_1\times <br><br>P_2\right)\times <br><br>\left(P_3\times <br><br>P_4\right)\right),\end{array}$

calculating H according to the equation

$H=\left(\begin{array}{ccc}{h}_{33}& 0& 0\\ 0& h_{33}& 0\\ h_{31}& h_{32}& h_{33}\end{array}\right),$

calculating H<sup>−

1</sup> according to the equation

$H^{-1}\sim <br><br>\left(\begin{array}{ccc}{h}_{33}& 0& 0\\ 0& h_{33}& 0\\ -h_{31}& -h_{32}& h_{33}\end{array}\right),$

mapping P₁, P₂, P₃ and P₄ to affine points P′

₁, P′

₂, P′

₃, P′

₄ using homography H; and

for any matrix entry (i, j) in a w×

h matrix compute its affine coordinate

$\frac{i}{w}<br><br>P_1^{\mathrm{\prime <br><br>}}<br><br>P_4^{\mathrm{\prime <br><br>}}+\frac{j}{h}<br><br>P_1^{\mathrm{\prime <br><br>}}<br><br>P_2^{\mathrm{\prime <br><br>}}$

and use H<sup>−

1</sup> to map this affine coordinate to the image coordinate.

4. A method for enhancing an image on a mobile device comprising the steps of:

for each pixel in said image, determining if binarization is required based upon an N×

N neighborhood using a block-based approach;

if binarization is not necessary, for a particular neighborhood, set all pixels in said particular neighborhood to background;

for each pixel requiring binarization, calculating a binarization threshold using Nibliack'"'"'s approach and conducting binarization; and

post-processing said binary image to remove ghost objects.

5. A method for enhancing an image on a mobile device comprising the steps of:

representing each foreground pixel in said image with a pattern vector generated from pixel values in an N×

N neighborhood of said foreground pixel; and

converting each foreground pixel to f² pixels in a higher resolution image where f is a magnification factor.

6. A method for enhancing an image on a mobile device according to claim 5, wherein how to convert a foreground pixel depends upon said pattern vector, k−

1 other pattern vectors in said image that are similar to said pattern vector where similarity is measured by a Hamming distance of two pattern vectors, and pixels in said higher resolution image corresponding to said k pattern vectors.