Method and apparatus for generating video images

• US 7,027,659 B1
• Filed: 05/20/1999
• Issued: 04/11/2006
• Est. Priority Date: 05/20/1998
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Thomas, David R.
• Primary Examiner(s): Lee, Thomas D
• Assistant Examiner(s): BRINICH, STEPHEN M
• Application Number:
  US09/315,247
• Time in Patent Office: 2,518 Days
• Field of Search: 382254-255, 382260-269, 358/1.9
• US Class Current: 382/254
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/15 for colour aspects of image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/236 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0085 Motion estimation from stereoscopic image signals

Abstract

A method and system for generating a video image is disclosed in which an object is monitored with a video camera to produce a sequence of video frames. Each of the video frames is divided into a plurality of regions, each region being representative of a portion of said object. For example, the frame of the video image may include the head and shoulder region of a user. Regions corresponding to predetermined facial features may be selected, such as the chin, opposing edges of the mouth, the nose, and the outer edge of each eye. At least one of the plurality of regions is selected. In the illustrative example, the selected region may comprise the mouth of the monitored user. The selected region is then recombined with each of the remaining regions of the video frame to form a display video image. The sequence of video frames is then displayed such that the selected region is perceived by an observer to form a sharp image, and remaining regions of said display video image are less sharp in accordance with the distance between said respective portion of said object and said video camera.

Claims

1. A method for generating a video image of an object comprising the steps of:

generating video data representing video frames for forming the video image of said object;

processing said video data by;

dividing each video frame into a plurality of regions, each region being representative of a portion of said object, at least one of said plurality of regions being predetermined at least one of said plurality of regions and the other of said plurality of regions being remaining ones of said plurality of regions;

selecting said predetermined at least one of said plurality of regions of the video frame;

de-emphasising said remaining ones of the plurality of regions of the video frame;

transmitting video data indicative of said selected at least predetermined one and said remaining ones of the plurality of regions of said video frames to a receiver having a display for displaying said display video image; and

recombining said regions of each of said video frames to form a display video, said recombining step comprising forming a display video image in which the selected region of the video frame is sharp or well-defined, and remaining ones of the plurality of regions of the video frame are de-emphasised or blurred in accordance with the relative distance between the portion of said object in a remaining one of the plurality of regions respective region of said object and a reference point.

2. The method as claimed in claim 1 wherein said step of selecting said region comprises selecting a region defining a foreground object.

3. The method as claimed in claim 1 wherein said step of selecting said region comprises an observer selecting a region of the object.

4. The method as claimed in claim 1 wherein said step of selecting said region comprises selecting a region of said video frame according to the position of an object relative to at least one other object.

5. The method as claimed in claim 1 wherein said step of selecting said region comprises selecting a region of said video frame defining an active entity.

6. The method as claimed in claim 1 wherein said step of dividing said video image into a plurality of regions comprises dividing said video image into a plurality of regions each defining a focal plane.

7. The method as claimed in claim 6, wherein the step of dividing said video image into a plurality of regions each defining a focal plane comprises dividing said video image into regions wherein each focal plane is representative of a different distance between a respective portion of said object and said reference point.

8. The method as claimed in claim 1, wherein said step of selecting at least a predetermined one of said plurality of regions comprises de-emphasising remaining portions of said video image according to the distance between a respective portion of said object and said reference point.

9. The method as claimed in claim 8, wherein said step of de-emphasising remaining portions of said video image comprises applying greater de-emphasisation to regions of the video image that are representative of portions of the object having a greater distance between the respective portion of said object and said reference point than regions of the video image that are representative of portions of the object having a smaller distance between the respective portion of the object and the reference point.

10. The method as claimed in claim 1 further comprising;

artificially generating each remaining region of the video image.

11. The method as claimed in claim 1, wherein said step of generating video data comprises monitoring an object with a video camera to produce one or more video frames.

12. The method as claimed in claim 11, wherein the step of displaying said video image comprises displaying said video frame such that remaining regions of the display video image are less sharp in accordance with the relative distance between said respective portion of said object and said video camera.

13. The method as claimed in claim 1 wherein said step of generating video data comprises generating a sequence of video frames, and said step of displaying said display video image comprises displaying a sequence of video frames.

14. A system for generating a video image of an object comprising;

circuitry for generating video data representing video frames for forming the video image of said object;

circuitry for dividing each video frame into a plurality of regions such that each region is representative of a portion of said object, at least one of said plurality of regions being predetermined at least one of said plurality of regions and the other of said plurality of regions being remaining ones of said plurality of regions; and

means for selecting said at least one of said plurality of predetermined regions from said received video data;

circuitry for recombining said regions of each of said video frames to form a display video image; and

a display for displaying said video frames of said display video image such that said selected region is formed as a sharp image, and remaining regions of said display video image are less sharp in accordance with the relative distance between said respective portion of said object and a reference point.

15. The system as claimed in claim 14 wherein said means for selecting are arranged to select a region defining a foreground object.

16. The system as claimed in claim 14 wherein said means for selecting are arranged such that an observer can select a region of the monitored object.

17. The system as claimed in claim 14 wherein said means for selecting are arranged to select a region of said video frame according to the position of an object relative to at least one other object.

18. The system as claimed in claim 14 wherein said means for selecting are arranged to select a region of said video frame defining an active entity.

19. The system as claimed in claim 14 wherein said circuitry for dividing said video image into a plurality of regions is arranged for dividing said video image into a plurality of regions each defining a focal plane.

20. The system as claimed in claim 19, wherein said circuitry for dividing said video image into a plurality of regions each defining a focal plane is arranged for dividing said video image into regions wherein each focal plane is representative of a different distance between a respective portion of said object and said reference point.

21. The system as claimed in claim 20 further comprising;

circuitry for de-emphasizing remaining regions of said display video image.

22. The system as claimed in claim 21, wherein said de-emphasising circuitry is arranged for de-emphasising remaining portions of said video image according to the distance between a respective portion of said object and said reference point.

23. The system as claimed in claim 22, wherein de-emphasising circuitry is arranged for applying greater de-emphasisation to regions of the video image that are representative of portions of the object having a greater distance between the respective portion of said object and said reference point than regions of the video image that are representative of portions of the object having a smaller distance between the respective portion of the object and the reference point.

24. The system as claimed in claim 21 further comprising;

means for artificially generating each remaining region of the video image.

25. The method as claimed in claim 21 wherein the circuitry for generating video data comprises a video camera for monitoring an object to produce one or more video frames and the display is capable of displaying said video frame such that remaining regions of the display video image are less sharp in accordance with the relative distance between said respective portion of said object and said video camera.