Server based image processing for client display of documents

• US 7,620,892 B2
• Filed: 07/29/2004
• Issued: 11/17/2009
• Est. Priority Date: 07/29/2004
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Eschbach, Reiner, Rainero, Emil V.
• Primary Examiner(s): Basehoar, Adam L
• Application Number:
  US10/901,241
• Publication Number:
  US 20060026511A1
• Time in Patent Office: 1,937 Days
• Field of Search: 715/523, 715/501.1, 715/530, 715/526, 715/528, 715/234, 715/236, 715/242, 715/255, 715/273, 715/275, 358/1.15, 358/1.1, 358/1.9, 709/246, 709/247, 709/202, 709/203, 382167-169, 382/232, 382/233, 382/244, 382254-262, 382/276
• US Class Current: 715/273
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355

Abstract

Methods and systems that allow the viewing of arbitrary documents on a client display by up-loading all necessary image processing steps to the server, thereby eliminating any software downloads to, or installation on, the client device.

Claims

1. A method for processing image information associated with a document requested by a client device from a server, the image information having one or more data values and color levels, the method comprising:

receiving a request to provide the document image information to the client device;

determining, by the server, from a plurality of possible image formats, an image format of the requested document image information that is compatible with a client device display format;

predefining a set of relationships between zoom levels and enhancement tonal reproduction curves in one or more client dependent image processing tables; and

performing one or more server based image processing operations of the requested document image information based on the determined image format, wherein the performing one or more server based image processing operations comprises;

converting the requested document to a raster image using raster image processing techniques;

scaling the raster image to a zoom level desired or requested by the client device;

enhancing a contrast of the data values using an enhancement tonal reproduction curve, the enhancement tonal reproduction curve being selected, based on the zoom level, from the predefined set of relationships stored in the one or more client dependent image processing tables; and

compressing data of the raster image, wherein the compression is performed after the contrast enhancement, and uses tonal reproduction curves to suppress backgrounds and further enhance perception of detail.

2. The method of claim 1, wherein providing a request comprises:

selecting the document to be viewed by a user; and

requesting the server to provide a rendition of at least a part of the document image information in a browser application of the client device.

3. The method of claim 1, wherein performing one or more server based image processing operations comprises determining one or more parameters associated with at least one of the client device, a data network to transmit the at least a part of the document image information to the browser of the client device, a requested document file format and user-provided hints.

4. The method of claim 3, wherein performing one or more server based image processing operations comprises processing image information by reducing a number of the color levels based on the one or more parameters determined.

5. The method of claim 3, wherein determining one or more parameters comprises determining the one or more parameters dynamically, without operator intervention.

6. The method of claim 1, wherein performing one or more server based image processing operations comprises processing image information based on one or more of at least a client device make or model, client device input capabilities, client device display capabilities, type of image formats supported by the client device browser application, client device browser capabilities, an image data display zoom level requested by the client device, a bandwidth of the data transmission network, a transmission speed of the network and a type and/or content of document requested by the client device and user-provided hints for displaying the image data.

7. The method of claim 1, wherein performing one or more server based image processing operations comprises processing image information based on knowledge obtained from a current user'"'"'s session.

8. The method of claim 2, further comprising transmitting the at least a part of the document image information processed by the server to a browser of the client device for display.

9. The method of claim 1, said compressing step including processing the image data to reduce a number of the color levels.

10. The method of claim 8, further comprising performing additional server based image processing operations of the requested document image information in response to at least one of user-initiated document image information quality requests and document navigation requests performed on the document image information displayed in the browser.

11. The method of claim 10, wherein the user-initiated document image information quality requests comprise at least a contrast sharpening request, a color type selection request, an image invert request and a color correct request.

12. The method of claim 10, wherein the document navigation requests comprise a document image page selection request, a document image panning request, a document image zoom request and/or a document image rotate request.

13. A system to process image information associated with a document requested by a client device from a server, the image information having one or more data values and color levels, the system comprising a controller that:

receives a request to provide the document image information to the client device;

determines, using the server, from a plurality of possible image formats, an image format of the requested document image information that is compatible with a client device display format;

accesses a set of relationships between zoom levels and enhancement tonal reproduction curves that is predefined in one or more client dependent image processing tables; and

performs one or more server based image processing operations of the requested document image information based on the determined image format, wherein the performing one or more server based image processing operations comprises;

converting the requested document to a raster image using raster image processing techniques;

scaling the raster image to a zoom level desired or requested by the client device;

enhancing a contrast of the data values using an enhancement tonal reproduction curve, the enhancement tonal reproduction curve being selected, based on the zoom level, from the predefined set of relationships stored in the one or more client dependent image processing tables; and

compressing data of the raster image, wherein the compression is performed after the contrast enhancement, and uses tonal reproduction curves to suppress backgrounds and further enhance perception of detail.

14. The system of claim 13, wherein providing a request comprises:

selecting the document to be viewed by a user; and

requesting the server to provide a rendition of at least a part of the document image information in a browser application of the client device.

15. The system of claim 13, wherein performing one or more server based image processing operations comprises determining one or more parameters associated with at least one of the client device, a data network to transmit the at least a part of the document image information to the browser of the client device, a requested document file format and user-provided hints.

16. The system of claim 15, wherein performing one or more server based image processing operations comprises processing image information by reducing a number of the color levels based on the one or more parameters determined.

17. A machine-readable medium that provides instructions for processing image information associated with a document requested by a client device from a server, the image information having one or more data values and color levels, the instructions, when executed by a processor, cause the processor to perform operations comprising:

receiving a request to provide the document image information to the client device;

determining, by the server, from a plurality of possible image formats, an image format of the requested document image information that is compatible with a client device display format;

accessing a set of relationships between zoom levels and enhancement tonal reproduction curves that is predefined in one or more client dependent image processing tables; and

performing one or more server based image processing operations of the requested document image information based on the determined image format, wherein the performing one or more server based image processing operations comprises;

converting the requested document to a raster image using raster image processing techniques;

scaling the raster image to a zoom level desired or requested by the client device;

enhancing a contrast of the data values using an enhancement tonal reproduction curve, the enhancement tonal reproduction curve being selected, based on the zoom level, from the predefined set of relationships stored in the one or more client dependent image processing tables; and

compressing data of the raster image, wherein the compression is performed after the contrast enhancement, and uses tonal reproduction curves to suppress backgrounds and further enhance perception of detail.

18. The machine-readable medium of claim 17, wherein performing the one or more server based image processing operations comprises processing image information based on one or more of at least a client device make or model, client device input capabilities, client device display capabilities, type of image formats supported by the client device browser application, client device browser capabilities, an image data display zoom level requested by the client device, a bandwidth of the data transmission network, a transmission speed of the network and a type and/or content of document requested by the client device and user-provided hints for displaying the image data.