Process and system for increasing the display resolution of a point-to-point video transmission relative to the actual amount of video data sent

• US 6,078,349 A
• Filed: 06/27/1997
• Issued: 06/20/2000
• Est. Priority Date: 06/07/1995
• Status: Expired due to Term

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Compaq Computer Corporation (HP Inc.)
• Inventors: Molloy, Mark Edward
• Primary Examiner(s): Olms, Douglas W.
• Assistant Examiner(s): VINCENT, DAVID ROBERT
• Application Number:
  US08/883,936
• Time in Patent Office: 1,089 Days
• Field of Search: 348/15, 348/17, 348/581, 348/384, 348/408, 364/514, 358/426, 382/56, 386/1, 386/46, 386/117
• US Class Current: 348/14.07
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server

Abstract

A process and system for improving the display resolution of a video image that is transmitted point-to-point. The process and system function by determining regions on a screen that are of high interest to a viewer and regions on the screen which are of lower interest to the viewer. Regions of high interest to the viewer are transmitted from a video source and displayed on the screen at a higher resolution than those regions of lower interest to the viewer.

Claims

1. A process for selectively manipulating the display resolution of a sensory image displayed with a sensory image display device having display elements, the process comprising the steps of:

a. selecting, in accordance with a viewer'"'"'s control, a subset of the display elements of the sensory image,

b. transmitting to the sensory image display device a first level of detail for the selected subset of display elements, and

c. transmitting to the sensory image display device a second level of detail for the remainder of the display elements which were not selected;

wherein steps b and c are performed at the same time.

2. A process as recited in claim 1,

a. wherein the sensory image display device comprises a screen;

and

b. wherein the display elements are pixels of the screen.

3. A process for selectively manipulating the display resolution of a sensory image transmitted to a display device at a given transmission bandwidth, the process comprising the steps of:

a. determining, in accordance with a viewer'"'"'s control, coordinates of a focus region on the display device on which the viewer is focusing and coordinates of a non-focus region on the display device on which the user is not focusing;

but which is within the viewer'"'"'s field of vision;

b. receiving a digitized sensory image;

c. region-differentially processing the digitized sensory image in accordance with the viewer determined coordinates of the focus and non-focus regions such that at the given transmission bandwidth, image data transmitted to the focus region is at a different resolution than that transmitted to the non-focus region; and

d. displaying the sensory image on the display device;

wherein the image data is transmitted to both the focus region and the non-focus regions at the same time.

4. A process as recited in claim 3 wherein the step of region-differentially processing comprises the steps of:

a. region-differentially compressing the digitized image in accordance with the coordinates of the focus and non-focus regions so as to allow more image data to be transmitted to the focus region than to the non-focus region at the given transmission bandwidth;

b. transmitting the region-differentially compressed image to the display device;

c. region-differentially decompressing the compressed image; and

d. assembling the decompressed image.

5. A process as recited in claim 4, further comprising the steps of:

recording the sensory image; and

digitizing the sensory image.

6. A system for manipulating display resolution of a sensory image transmitted at a given transmission bandwidth, the system comprising:

a. a sensory display device having a screen;

b. means, in accordance with a viewer'"'"'s control, for determining region coordinates of a focus region on the screen on which the viewer is focusing and a non-focus region on the screen on which the viewer is not focusing, but is within the viewer'"'"'s field of vision;

c. means for receiving digitized sensory image; and

d means for region-differentially processing the digitized sensory source image in accordance with the region coordinates such that at the given transmission bandwidth, the display resolution of the sensory image at the focus region is different than that at the non-focus region;

wherein the image data is transmitted to both the focus region and the non-focus region at the same-time.

7. A system as recited in claim 6, further comprising

a sensory image recorder including a video camera for recording a video image;

and

an image digitizer, responsive to the image recorder, for digitizing the video image;

wherein the sensory display device includes a video display device.

8. A system as recited in claim 6,

a. wherein the sensory display device comprises a speaker for providing sound in accompaniment of an image displayed on the screen of the video display device;

b. wherein the sensory image recorder comprises a microphone for recording sound accompanying the video image; and

c. further comprising means for coupling sound from the speaker to the microphone.

9. A system as recited in claim 6, wherein the means for region-differentially processing comprises:

a. means for region-differentially compressing the digitized sensory image in accordance with the region coordinates of the focus and non-focus regions so as to allow more image data to be transmitted to the focus region than to the non-focus region at the given transmission bandwidth;

b. means for transmitting the region-differentially compressed sensory image to the display device;

c. means for region-differentially decompressing the compressed sensory image; and

d. means for assembling the decompressed image for displaying on the display device.

10. A system for manipulating display resolution of a video image transmitted at a given transmission bandwidth, the system comprising:

a. a monitor having a screen and an input;

b. a viewer controllable pointing device having an output representative of location information of a focus region on the screen on which the viewer is focusing and a non-focus region on the screen on which the viewer is not focusing, but is within the viewer'"'"'s field of vision;

c. a first memory;

d. a first processor coupled to the first memory, having an output and having an input coupled to the output of the pointing device and for receiving a region-differentially compressed source image, the first processor being capable of executing instructions stored in the first memory for converting the location information of the focus and non-focus regions into region coordinates, for making available for transmission at its output the region coordinates, for region-differentially decompressing and assembling the compressed image, and for making available at its output the assembled image for coupling to the input of the monitor for display on the screen;

e. video camera, having an output, for recording a source image and making it available at the output;

f. an image digitizer, coupled to the video camera, for digitizing the source image and having an output representative of the digitized source image;

g. a second memory; and

h. a second processor, coupled to the second memory and having an output and an input coupled to the output of the image digitizer, the second processor being capable of executing instructions stored in the second memory for receiving the region coordinates at its input, for region-differentially compressing the digitized source image in accordance with the region coordinates, and for making available at its output for transmission the region-differentially compressed source image to the input of the first processor, wherein image data of the compressed source image is transmitted to the focus region and the non-focus region on the screen at the given transmission bandwidth at the same time.

11. A process for manipulating display resolution of an image transmitted to a display device at a given transmission bandwidth, the process comprising the steps of:

defining, in accordance with a viewer'"'"'s control, a focus region at a first location on the display device on which the viewer is focusing;

defining, in accordance with the viewer'"'"'s control, a non-focus region at a second location on the display device on which the viewer is not focusing, but is within the viewer'"'"'s field of vision;

transmitting image data to the focus region of the display device for displaying at a first resolution; and

transmitting image data to the non-focus region of the display device for displaying at a second resolution;

wherein the image data is transmitted to the focus region and the non-focus region of the display device at the given transmission bandwidth at the same time.

12. The process of claim 11, further comprising the steps of:

changing, in accordance with the viewer'"'"'s control, the location of the focus region to a third location on the display device;

changing, in accordance with the viewer'"'"'s control, the location of the non-focus region to a fourth location on the display device;

transmitting image data to the focus region at the third location of the focus region on the display device for displaying at a third resolution;

transmitting image data to the non-focus region at the fourth location of the non-focus region on the display device;

wherein the image data is transmitted to the focus region at the third location and the non-focus region at the fourth location at the given transmission bandwidth at substantially the same time;

wherein the image data transmitted to the focus region at the third location is more than that transmitted to the non-focus region at the fourth location;

wherein the third resolution is higher than the fourth resolution.

13. The process of claim 11,

wherein the display device includes a screen;

wherein the viewer'"'"'s field of vision comprises the entire screen,

wherein the non-focus region is the entire screen other than the focus region.