Method and apparatus for preserving background continuity in images

• US 6,175,663 B1
• Filed: 02/24/1998
• Issued: 01/16/2001
• Est. Priority Date: 02/24/1998
• Status: Expired due to Term

• Current Assignee: Resource Consortium Limited, LLC
• Original Assignee: Paravision Imaging, Inc.
• Inventors: Huang, Shih-Chi
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): PATEL, KANJIBHAI B
• Application Number:
  US09/028,973
• Time in Patent Office: 1,057 Days
• Field of Search: 382/284, 382/280, 382/298, 382/296, 382/187, 382/162-165, 358/515, 358/527, 358/450, 345/113, 345/126, 345/419, 345/433, 345/501, 345/418, 345/422, 345/114, 345/334, 345/326, 345/435, 348/239, 348/584, 348/586
• US Class Current: 382/284
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/20056 Discrete and fast Fourier transform, [DFT, FFT]
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation

Abstract

The disclosed system has particular applications to image archives and reediting. Given an image of an article having graphic objects including texts and pictures, the disclosed system first distinguishes graphic objects from the background by segmenting the image so as to produce an object image comprising a foreground, wherein the foreground corresponds to the graphic objects in the image. With respect to the foreground, the disclosed system “repaints” those spaces previously occupied by the graphic objects, referred to as object spaces, with the background color in the image as such the background continuity is preserved when the graphic objects are rendered and subsequently superimposed onto the repainted background. To account for various backgrounds, the disclosed system uses a point-wise patching approach followed by a one-dimensional patching approach if the object spaces contain two different colors. In addition, a two-dimensional patching approach is implemented to account for printing effects such as half-toning and mosaic patterns.

Claims

1. A method for preserving background continuity in an image comprising vector pixels, said method comprising:

acquiring said image into a working memory so that said vector pixels can be randomly accessed for manipulation, wherein said image comprises a number of graphic objects, at least one of said graphic objects includes texts;

converting said vector pixels, accordingly and respectively, to scalar pixels;

binarizing scalar pixels to produce a binarized image;

producing an object image from said acquired image with respect to said binarized image, said object image comprising a foreground and a background, wherein said foreground corresponds to object spaces occupied by said graphic objects in said image;

generating a patched image from said object image by filling in said object spaces with colors of said background;

receiving rendered objects generated respectively from said graphic objects in said acquired image with respect to said object image, wherein one of said rendered objects is from an optical character recognition (OCR) engine and in accordance with said at least one of said graphic objects including texts; and

superimposing said rendered objects onto the patched image near respective positions of each of said graphic objects to produce a composed output image.

2. The method as recited in claim 1 further comprising reformatting said rendered object so that said composed output image containing said rendered objects resembles said acquired image.

3. The method as recited in claim 2, wherein said generating said patched image from said object image comprises:

searching for a reference color in an area, cross-referenced by said background in said object image, in said image; and

patching said object spaces in said image with said reference color.

4. The method as recited in claim 3, wherein said generating said patched image from said object image further comprises researching for a new reference color if a color difference between said patched object spaces and said area is greater than a threshold.

5. The method as recited in claim 4, wherein said generating said patched image from said object image further comprises patching said object spaces in said image with said new reference color.

6. An apparatus for preserving background continuity in an image comprising vector pixels, said apparatus comprising:

means for acquiring said image into a working memory so that said vector pixels can be randomly accessed for manipulation, wherein said image comprises a number of graphic objects, at least one of said graphic objects includes texts;

means for converting said vector pixels, accordingly and respectively, to scalar pixels;

means for binarizing scalar pixels to produce a binarized image;

means for producing an object image from said acquired image with respect to said binarized image, said object image comprising a foreground and a background, wherein said foreground corresponds to object spaces occupied by said graphic objects in said image and said background correspond to areas unoccupied by said graphic objects;

means for generating a patched image from said object image by filling in said object spaces with colors of said background;

means for receiving rendered objects generated respectively from said graphic objects in said acquired image with respect to said object image, wherein one of said rendered objects is from an optical character recognition (OCR) engine and in accordance with said at least one of said graphic objects including texts; and

means for superimposing said rendered objects onto the patched image near respective positions of each of said graphic objects to produce a composed output image.

7. The apparatus as recited in claim 6 further comprising means for reformatting said rendered object so that said composed output image containing said rendered objects resembles said acquired image.

8. The apparatus as recited in claim 7, wherein said means for generating said patched image from said object image comprises:

means for searching for a reference color in an area, cross-referenced by said background in said object image, in said image; and

means for patching said object spaces in said image with said reference color.

9. The apparatus as recited in claim 8, wherein said means for generating said patched image from said object image further comprises means for researching for a new reference color if a color difference between said patched object spaces and said area is greater than a threshold.

10. The apparatus as recited in claim 9, wherein said means for generating said patched image from said object image further comprises patching said object spaces in said image with said new reference color.