Immersive surround visual fields

• US 8,130,330 B2
• Filed: 12/05/2005
• Issued: 03/06/2012
• Est. Priority Date: 12/05/2005
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Tan, Kar-Han, Bhattacharjya, Anoop K.
• Primary Examiner(s): Chan, Jason
• Assistant Examiner(s): Calderon, Cynthia
• Application Number:
  US11/294,023
• Publication Number:
  US 20070126938A1
• Time in Patent Office: 2,283 Days
• Field of Search: 348/840, 348/794, 345/629
• US Class Current: 348/840
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 9/3179 Video signal processing therefor
• CPC Class Codes: H04N 9/74 for obtaining special effects H04N9/65 - H04N9/73 take precedence

Abstract

A surround visual field that has a characteristic or characteristics that relate to an audio/visual presentation is described. In one embodiment, the surround visual field is projected on an area partially surrounding or surrounding video content being displayed on a device. This surround visual field may be comprised of a plurality of elements that further enhance the visual effect of the content being displayed. For example, one embodiment of the invention provides for elements within the surround visual field to move in relation to motion within the video content being displayed. Other characteristics of the video content may also be supplemented by the surround visual field or the surround visual field may simply be authored to correspond to the content itself.

Claims

1. A system for displaying primary video content within a primary display area, and for generating secondary video content from said primary video content, said system comprising:

an input for receiving a video signal conveying said primary video content;

a first computing processing block for extracting motion vectors from said video signal, said motion vectors identifying motion between successive video frames of said primary video content, said motion vectors including rotation angle information describing rotation motion of at least a first portion of a current frame of said primary video content;

a second computing processing block for generating secondary video content not found within said video signal, said secondary video content including an extrapolation of said rotation motion of said first portion of a current frame and; and

a display means for displaying said primary video content within said primary display area and displaying said generated secondary video content;

wherein said display means is a single display device simultaneously displaying said primary video content and said generated secondary video content;

said secondary video content includes generation of a highlighting image that highlights video content within said primary display area; and

said display device displays said highlighting image within said primary display area.

2. The system of claim 1, wherein said secondary video content includes generation of a highlighting image tracking the motion of an object within said primary display area;

and

said display device displays said highlighting image on said object within said primary display area.

3. The system of claim 1, wherein said motion vectors are extracted from a displacement model describing rotation, translation, dilation, and shear motion between said successive video frames of said primary video content.

4. The system of claim 3, wherein said displacement model includes a displacement vector, a rotation angle, two scaling factors along two axes, and the scaling factor'"'"'s orientation angles.

5. The system of claim 1, wherein said video signal is part of a video/audio signal including a multi-channel audio signal, and wherein at least a portion of the generating of said secondary video content is responsive to a specific one channel of said multi-channel audio signal.

6. The system of claim 1, wherein:

said display means displays said primary video content within said primary display area, and displays said secondary video content within said secondary display area; and

said extrapolation of said rotation motion extrapolates rotation motion for said secondary video content.

7. A system for displaying primary video content within a primary display area, and for generating secondary video content from said primary video content, said system comprising:

an input for receiving a video signal conveying said primary video content;

a first computing processing block for extracting motion vectors from said video signal, said motion vectors identifying motion between successive video frames of said primary video content, said motion vectors including rotation angle information describing rotation motion of at least a first portion of a current frame of said primary video content;

a second computing processing block for generating secondary video content not found within said video signal, said secondary video content including an extrapolation of said rotation motion of said first portion of a current frame and; and

a display means for displaying said primary video content within said primary display area and displaying said generated secondary video content;

wherein said extrapolation of said rotation motion extends beyond said current frame and is not representative of video content within the received video signal; and

said extrapolation of said rotation motion is displayed in a secondary display area that at least partially surrounds said primary display area.

8. The system of claim 7, wherein said extrapolation of said rotation motion is represented by a new set of motion vectors outside said primary display area.

9. The system of claim 8, wherein said rotational motion of said at least first portion of said current frame of said primary video content is indicative of a clockwise rotational motion, and said new set of motion vectors indicate a clockwise rotational motion outside said primary display area.

10. The system of claim 8, wherein the shape of objects within said secondary display area are distorted and elongated in the rotational direction indicated by said new set of motion vectors.

11. The system of claim 7, wherein:

the received video signal is a compressed digital video signal, and said first processing block decompresses said compressed digital video signal;

the extracted motion vectors identify a global motion between successive video frames of said primary video content;

said display means displays said primary video content within said primary display area, and displays said secondary video content within said secondary display area.

12. The system of claim 11, further including an environmental sensor for detecting a location of a human viewer of said primary display area;

wherein

said secondary video content creates a center of vision within said secondary display area, and said center of vision is adjusted to coincide with a currently detected location of said human viewer; and

said display means displays said primary video content within said primary display area and displays the generated secondary video content having the adjusted center of vision to coincide with the currently detected location of said human viewer in said within said secondary display area.

13. The system of claim 7, wherein said second processing block tracks the motion of a scene within said primary display area, and as part of said scene passes out of view of said primary display area, the part that passes out of view is regenerated and continued within said secondary display area.

14. A system for displaying primary video content within a primary display area, and for generating secondary video content from said primary video content, said system comprising:

an input for receiving a video signal conveying said primary video content;

a first computing processing block for extracting motion vectors from said video signal, said motion vectors identifying motion between successive video frames of said primary video content, said motion vectors including rotation angle information describing rotation motion of at least a first portion of a current frame of said primary video content;

a second computing processing block for generating secondary video content not found within said video signal, said secondary video content including an extrapolation of said rotation motion of said first portion of a current frame and; and

a display means for displaying said primary video content within said primary display area and displaying said generated secondary video content;

wherein the received video signal is a compressed video signal, and said first computing processing block extracts motion vectors from the compression information of said compressed video signal.

15. A system for displaying primary video content within a primary display area, and for generating secondary video content from said primary video content, said system comprising:

an input for receiving a video signal conveying said primary video content;

a first computing processing block for extracting motion vectors from said video signal, said motion vectors identifying motion between successive video frames of said primary video content, said motion vectors including rotation angle information describing rotation motion of at least a first portion of a current frame of said primary video content;

a second computing processing block for generating secondary video content not found within said video signal, said secondary video content including an extrapolation of said rotation motion of said first portion of a current frame and; and

a display means for displaying said primary video content within said primary display area and displaying said generated secondary video content;

wherein the received video signal is an encoded digital video signal, and said first computing processing block extracts motion vectors the encoded information of said encoded digital video signal.

16. A system for displaying primary video content within a primary display area, and for generating secondary video content from said primary video content, said system comprising:

an input for receiving a video signal conveying said primary video content;

a first computing processing block for extracting motion vectors from said video signal, said motion vectors identifying motion between successive video frames of said primary video content, said motion vectors including rotation angle information describing rotation motion of at least a first portion of a current frame of said primary video content;

a second computing processing block for generating secondary video content not found within said video signal, said secondary video content including an extrapolation of said rotation motion of said first portion of a current frame and; and

a display means for displaying said primary video content within said primary display area and displaying said generated secondary video content;

wherein the extracted motion vectors identify a global frame motion between successive video frames of said primary video content.

17. The system of claim 16, wherein said global frame motion is a vector field across a frame.

18. The system of claim 16, wherein said display means is a single display device.

19. The system of claim 18, wherein said single display device is a single projector.