Semantic classification and enhancement processing of images for printing applications

• US 8,373,905 B2
• Filed: 12/12/2008
• Issued: 02/12/2013
• Est. Priority Date: 09/25/2003
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Erol, Berna, Hull, Jonathan J., Lee, Dar-Shyang, Wolff, Gregory J.
• Primary Examiner(s): Lee, Thomas D
• Application Number:
  US12/334,303
• Publication Number:
  US 20090092322A1
• Time in Patent Office: 1,523 Days
• Field of Search: 358/1.1, 358/1.9, 358/2.1, 358/3.24, 358/3.27, 358/1.13, 358/1.15, 358/1.18, 358/448, 358/462, 382/224, 382/228, 382/229, 382/254
• US Class Current: 358/3.27
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/162 Quantising the image signal
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

A printing system enables the printing of enhanced documents using a semantic classification scheme. A printing system receives an image to be printed. The system classifies the image according to the semantic classification scheme and, based on this classification, performs enhancement processing on the image. Depending on the desired application, the printing system may recognize and classify any number of image types and may then perform various enhancement processing functions on the image, where the type of enhancement processing performed is based on the classification of the image.

Claims

1. A system for organizing images captured in an environment, the system comprising:

an interface for receiving an image from an image capture device;

a semantic classifier module coupled to the interface, the semantic classifier module configured to determine a semantic category for the image, at least in part, by comparing heights of a plurality of markings on the image to determine whether the image belongs to a semantic category typically comprising machine-generated text or a semantic category typically comprising handwriting; and

an enhancement processing module coupled to the semantic classifier module, the enhancement processing module configured to enhance the image based on the semantic category into which the image was classified.

2. The system of claim 1, further comprising:

an output system coupled to receive the enhanced image from the enhancement processing module and prepare the enhanced image for printing.

3. The system of claim 1, wherein the semantic categories include at least whiteboard images, business card images, document images, slide images, and regular images.

4. The system of claim 1, wherein the semantic classifier module determines the semantic category for the image, at least in part, by:

extracting a plurality of features from the image;

combining the extracted features into a feature vector; and

comparing the feature vector with information in a trained database to determine the semantic category for the image.

5. The system of claim 1, wherein the enhancement processing module enhances the image, at least in part, by performing at least one of:

scaling, cropping, foreground subtraction, background subtraction, contrast adjustment, and text rotation.

6. The system of claim 1, wherein the enhancement processing module enhances the image, at least in part, by appending information to the image to enhance the image.

7. The system of claim 1, wherein the image is a whiteboard image, and the enhancement processing module computes a background of the image and subtracts the background from the image to enhance textual content in the image.

8. The system of claim 1, further comprising:

an output system configured to select a layout orientation for a printed output of the image based on the semantic category into which the image was classified.

9. The system of claim 1, further comprising:

an output system configured to select a paper source and/or ink selection for a printed output of the image based on the semantic category into which the image was classified.

10. The system of claim 1, further comprising:

an output system coupled to receive the enhanced image from the enhancement processing module and prepare the enhanced image for printing, at least in part, by;

retrieving a set of default printing preferences associated with the semantic category into which the image was classified; and

applying the set of default printing preferences to generate a printed output of the image.

11. The system of claim 1, wherein the captured image is received from a digital camera.

12. The system of claim 1, further comprising:

an output system configured to generate a printed output of the enhanced image.

13. The system of claim 1, further comprising:

an output system configured to deliver the enhanced image to one or more users, the delivered enhanced image capable of being printed.

14. A computer-implemented method for organizing images captured in an environment, the method comprising:

receiving, with a processor, a captured image;

classifying, with the processor, the image into a semantic category, at least in part, by comparing heights of a plurality of markings on the image to determine whether the image belongs to a semantic category typically comprising machine-generated text or a semantic category typically comprising handwriting; and

enhancing, with the processor, the image based on the semantic category into which the image was classified.

15. The method of claim 14, further comprising:

preparing the enhanced image for printing.

16. The method of claim 14, wherein the semantic categories include at least whiteboard images, business card images, document images, slide images, and regular images.

17. The method of claim 14, wherein the classifying comprises:

extracting a plurality of features from the image;

combining the extracted features into a feature vector; and

comparing the feature vector with information in a trained database to determine the semantic category for the image.

18. A computer-implemented method for printing an image captured from an image capture device, the method comprising:

classifying, with a processor, the image into a semantic category, at least in part, by comparing heights of a plurality of markings on the image to determine whether the image belongs to a semantic category typically comprising machine-generated text or a semantic category typically comprising handwriting;

enhancing, with the processor, the image based on the semantic category of the image; and

printing, with the processor, the enhanced image.