Immersive dodecaherdral video viewing system

• US 5,703,604 A
• Filed: 05/22/1995
• Issued: 12/30/1997
• Est. Priority Date: 05/22/1995
• Status: Expired due to Term

• Current Assignee: Immersive Licensing, Inc.
• Original Assignee: Dodeca LLC
• Inventors: McCutchen, David
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): LOUI, MARTIN S
• Application Number:
  US08/445,658
• Time in Patent Office: 953 Days
• Field of Search: 345/121, 345/8, 345/5, 345/31, 348/36, 348/38-39, 348/42, 348/51, 348/383, 348/744, 463/32-34, 353/94
• US Class Current: 345/8
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 5/395 Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen G09G5/399 takes precedence
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/207 using a single 2D image sensor
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/9205 the additional signal being at least another television signal
• CPC Class Codes: H04N 5/9261 involving data reduction
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Video image information representing an immersive image up to a complete spherical field of view is utilized by a special image processor to extract a region of interest as a moveable window. The immersive image is divided into standardized pentagonal segments according to the geometry of the dodecahedron, and these segments are carried as a plurality of video channels. The image processor extracts and assembles the moveable region of interest from among the various segments of the image as they are recorded in a segmented memory, according to pointing device information from the user, such as a joystick or the tracker of a head-mounted-display. The video image information used can come from sources including a photographic camera system recording scenes from the real world, and can be either live or prerecorded. Existing methods for transmission of video channels can be used to broadcast such immersive images. A special encoding of pentagon information can be used to conserve bandwidth and reduce the number of channels required, or to add information for a stereoscopic effect. independently movable windows within a single overall spherical video image input can be produced when more than one viewing processor is used.

Claims

1. An apparatus for reproduring a portion of a spherical view up to a complete sphere, comprising:

(a) input means for a plurality of video images representing a plurality of pentagonal sections derived from dodecahedral divisions of a spherical field of view,

(b) digital memory means comprising a matrix wherein is stored information representing the pixels of said plurality of video images,

(c) at least one viewing device with a movable viewing aperture window capable of reporting the location of said movable viewing aperture window on a sphere as a location signal, and capable of displaying at least a portion of said video images,

(d) addressing means for said matrix whereby said information representing said pixels is presented to said aperture window of said viewing device according to said location signal so that the edges of pentagonal sections originally adjacent to each other in the spherical field of view are made adjacent also within said aperture window, thereby creating an apparent substantially continuous image within said aperture window.

2. The apparatus of claim 1, wherein each of said video images includes a representation of only one of said pentagonal sections.

3. The apparatus of claim 2, wherein the addressing means for said matrix include programmable logic devices for identifying the borders of said pentagonal sections within said video images.

4. The apparatus of claim 1, wherein said plurality of pentagonal sections derived from dodecahedral divisions of a spherical field of view includes at least one stereoscopically offset pair, and said viewing device is also stereoscopic.

5. The apparatus of claim 1, wherein at least one of said video images includes both a representation of a first pentagonal section and a second pentagonal section, and said representation of said second pentagonal section is encoded in the image area of said video image surrounding said representation of a first pentagonal section, with means for addressing the constituent parts of said second pentagonal section.

6. The apparatus of claim 5, wherein said means for addressing the constituent parts of said second pentagonal section comprise a programmable logic device.

7. The apparatus of claim 4, wherein at least one of said video images includes both a representation of a first pentagonal section and a second pentagonal section, and said representation of said second pentagonal section is encoded in the image area in said video image surrounding said representation of a first pentagonal section, with means for addressing the constituent parts of said second pentagonal section, and said second pentagonal section represents a stereoscopically offset view of one of said plurality of pentagonal sections derived from dodecahedral divisions of a spherical field of view.

8. The apparatus of claim 7, wherein said means for addressing the constituent parts of said second pentagonal section comprise a programmable logic device.

9. The apparatus of claim 7, wherein said second pentagonal section represents a stereoscopically offset view of said first pentagonal section.

10. The apparatus of claim 1, wherein said matrix of said digital memory means include a dual memory arrangement means for allowing storage of incoming video frames to be done at the same time as previously-stored video frame information is being addressed by said addressing means for said matrix whereby said information representing said pixels is presented to said aperture window.

11. The apparatus of claim 10, wherein said dual memory arrangment allows stereoscopic readout by means of field-sequential presentation of right and left-eye views.

12. The apparatus of claim 1, wherein said addressing means for said matrix whereby said information representing said pixels is presented to said aperture window use prestored address tables based on the location of a region of interest reported from said viewing device.

13. The apparatus of claim 1, wherein said input means for a plurality of video images includes multichannel tuner means.

14. The apparatus of claim 1, wherein said input means for a plurality of video images includes conversion of an analog signal representing at least one of said video images into a digital form suitable for storage in said digital memory means.

15. The apparatus of claim 1, wherein said information representing said pixels is presented to said aperture window of said viewing device by means of a secondary memory buffer which is scanned after it is filled to produce an output signal suitable for display by said viewing device.

16. The apparatus of claim 12, wherein said output signal is in the form of National Television Standards Committee (NTSC) video.

17. The apparatus of claim 15, wherein said secondary memory buffer also includes means for fractal decompression of the image pixels to interpolate between them.

18. The apparatus of claim 1, wherein a plurality of viewing devices with movable viewing aperture windows are coupled to a plurality of addressing means for said matrix whereby said information representing said pixels is independently presented to said aperture windows of said viewing devices according to said location signals generated by each.