System for digitally capturing and recording panoramic movies

• US 20020046218A1
• Filed: 10/05/2001
• Published: 04/18/2002
• Est. Priority Date: 06/23/1999
• Status: Abandoned Application

• Current Assignee: David J. Kaiman, Michael C. Park, Ripley G. David, Scott Gilbert
• Original Assignee: David J. Kaiman, Michael C. Park, Ripley G. David, Scott Gilbert
• Inventors: Kaiman, David J., Park, Michael C., Gilbert, Scott, Ripley, G. David
• Application Number:
  US09/971,950
• Publication Number:
  US 20020046218A1
• Time in Patent Office: Days
• US Class Current: 715/500.1
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 9/8047 using transform coding
• CPC Class Codes: H04N 9/806 with processing of the sound signal
• CPC Class Codes: H04N 9/8211 the additional signal being a sound signal H04N9/835 takes precedence
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

The present invention provides a very flexible, digital system for capturing and storing panoramic images using progressive scan (that is, non interlaced) technology. The system includes a digital image input device and an associated control computer. Since the image capture device is digital it can be easily and flexibly controlled by software in the control computer. The image input device has six lenses positioned on the six faces of a cube. While the image input system can have other lens configurations, the use of six lenses in a cubic configuration is optimal for a system that is used to capture a spherical panorama. The six lenses simultaneously focuses different images on six CCDs (Charge Coupled Devices). The image input device also includes an embedded controller, and data compression circuitry. The embedded controller controls the exposure time of the CCDs (i.e. the effective aperture and effective shutter speed) and reads image data from the CCDs. The image data read from the CCDs is compressed, multiplexed, and sent to the control computer. The control computer stores the images in frames, each of which have one image from each of the six lenses. Each frame includes six images that were simultaneously recorded and any associated information, such as audio tracks, textual information, or environmental information such as GPS (Global Position System) data or artificial horizon data. The control computer includes a user interface which allows a user to specify control information such as frame rate, compression ratio, gain, etc. The control computer sends control information to the embedded controller which in turn controls the CCDs and the compression circuitry. The images can be sent from the control computer to a real time viewer so that a user can determine if the correct images are being captured. The images stored at the control computer are later seamed into panoramas and made into panoramic movies.

Claims

1. ) A system for capturing a series of sets of images, each set of images having overlapping edges which can be seamed to form a panoramas, a series of digital panoramas forming a panoramic movie,

a digital image capture unit which simultaneously captures a plurality of digital images utilizing a non-interleaved progressive scan,

a control computer,

a control link and a data capture link between said control computer and said digital image capture unit whereby said digital images from said image capture unit can be transferred to said control computer and said control computer can send signals to said digital image capture unit to control said digital image capture unit,

a plurality of digital sound tracks, each having a segment of sound associated with each set of images, each segment forming a separate sound data set, and providing sound appropriate for displaying said images at a particular rate in a particular direction,

a computer program which seams each of said sets of images into a panorama and which associates with each panorama a plurality of sound data sets, one from each of said sound tracks.

2. ) The system recited in claim 1 wherein said panoramas are transformed into the equirectangular format prior to the addition of said sound tracks.

3. ) The system recited in claim 1 wherein said control computer includes digital storage to store said images.

7. ) The system recited in claim 1 wherein one of said sound tracks can be used when said images are shown in a forward direction and one of said soundtracks can be used when said images are shown in a reverse direction.

4. ) A system for capturing a series of sets of images, each set of images having overlapping edges which can be seamed to form a panoramas, a series of digital panoramas forming a panoramic movie,

a digital image capture unit including,

a plurality of lenses pointed in different directions,

a plurality of image sensors, one associated with each of said lenses,

a plurality of image compression circuits for compressing the output of said image sensors,

one associated with each of said lenses,

an embedded controller for controlling said image sensors to capture sets of progressive scan images,

said control computer including user input means and image storage means,

a connection between said control computer and said embedded controller for transferring said user input to said embedded controller and said images to said control computer,

a plurality of digital sound tracks, each having a segment of sound associated with each set of images, each segment forming a separate computer sound data set, and providing sound appropriate for displaying said images at a particular rate in a particular direction,

a computer program for seaming each set of images into a panorama and for associating with each panorama a plurality of computer sound data sets, one from each of said sound tracks.

5. ) The system recited in claim 4 wherein one of said sound tracks can be used when said images are shown in a forward direction and one of said soundtracks can be used when said images are shown in a reverse direction.

6. ) The system recited in claim 4 where different sound tracks are appropriate for different speeds at which said images are displayed.

8. ) The system recited in claim 4 wherein said image compression chips are JPEG compression chips.

9. ) The system recited in claim 8 wherein the amount of compression applied by said JPEG compression can be controlled.

10. ) The system recited in claim 4 including a FIFO (first in first out) memory between each image sensor and the associated compression chip.

11. ) The system recited in claim 4 wherein a high speed serial bus connects said image capture unit and said control computer.

12. ) The system recited in claim 4 wherein said computer program which seams said images is in a different computer.