VTV System
First Claim
Patent Images
1. ) An interactive image capture and display system comprisinga) an image input means including an array of electronic image capture devices distributed in a horizontal plane such that their fields of view partially overlap and collectively cover a full 360 degrees;
- andb) an image storage and playback means compatible with existing television standards;
c) a signal processing means including1) a means of producing graphical imagery depicting a panoramic image such that said panoramic image is composed of a plurality of smaller image sections;
2) a means for cropping, distorting and aligning individual images produced by the said image capture devices to produce an overall 360 degree panoramic image with negligible distortion and overlap between the individual image sections and wherein each pixel in the resulting 360 degree panoramic image has the same effective width, where each pixel subtends an equal horizontal angle to the center of said panoramic image;
3) a means for generating an image representing a subset of the said 360 degree panoramic image, whereby the azimuth and elevation of the center of said subset is adjustable by user control;
4) a means for selectively combining and geometrically altering real time imagery from said capture devices and prerecorded imagery to create a composite augmented reality experience;
5) a means for determining the correct location of said image sections within said 360 degree panoramic image utilizing additional information present in the source media;
6) a means for inserting tracking information to describe at least the current orientation of said array of electronic image capture devices into an outgoing video stream;
7) a means for encoding multi-track audio such that it maintains compatibility with standard video storage, playback and transmission systems; and
8) a means for producing orientation-sensitive audio in real-time, utilizing multi-track audio information and controlled by coordinates of a viewport within said panoramic image;
d) an image output means capable of outputting an image in a format compatible with existing television standards;
e) an audio output means capable of outputting at least 2 channels of audio;
f) a display means including at least one display device;
g) a user control means including an input device allowing the user to control said signal processing means; and
h) A tracking means capable of measuring at least azimuth and elevation of said array of electronic image capture devices.
0 Assignments
0 Petitions
Accused Products
Abstract
The following patent relates to an overall hardware configuration that produces an enhanced spatial television-like viewing experience. Unlike normal television, with this system the viewer is able to control both the viewing direction and relative position of the viewer with respect to the movie action. In addition to a specific hardware configuration, this patent also relates to a new video format which makes possible this virtual reality like experience.
-
Citations
32 Claims
-
1. ) An interactive image capture and display system comprising
a) an image input means including an array of electronic image capture devices distributed in a horizontal plane such that their fields of view partially overlap and collectively cover a full 360 degrees; - and
b) an image storage and playback means compatible with existing television standards; c) a signal processing means including 1) a means of producing graphical imagery depicting a panoramic image such that said panoramic image is composed of a plurality of smaller image sections; 2) a means for cropping, distorting and aligning individual images produced by the said image capture devices to produce an overall 360 degree panoramic image with negligible distortion and overlap between the individual image sections and wherein each pixel in the resulting 360 degree panoramic image has the same effective width, where each pixel subtends an equal horizontal angle to the center of said panoramic image; 3) a means for generating an image representing a subset of the said 360 degree panoramic image, whereby the azimuth and elevation of the center of said subset is adjustable by user control; 4) a means for selectively combining and geometrically altering real time imagery from said capture devices and prerecorded imagery to create a composite augmented reality experience; 5) a means for determining the correct location of said image sections within said 360 degree panoramic image utilizing additional information present in the source media; 6) a means for inserting tracking information to describe at least the current orientation of said array of electronic image capture devices into an outgoing video stream; 7) a means for encoding multi-track audio such that it maintains compatibility with standard video storage, playback and transmission systems; and 8) a means for producing orientation-sensitive audio in real-time, utilizing multi-track audio information and controlled by coordinates of a viewport within said panoramic image; d) an image output means capable of outputting an image in a format compatible with existing television standards; e) an audio output means capable of outputting at least 2 channels of audio; f) a display means including at least one display device; g) a user control means including an input device allowing the user to control said signal processing means; and h) A tracking means capable of measuring at least azimuth and elevation of said array of electronic image capture devices. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32)
- and
-
10. ) A system according to 5 further comprising within one or more scan lines of a standard video image, additional coded data providing
a) audio information for generation of four or more real-time audio tracks; - and
b) data descriptive of a number of employed audio tracks, an employed audio data format, an employed audio sampling rate, and track synchronization, whereby said signal processing means can decode the audio information into position and orientation sensitive sound.
- and
Specification