System for omnidirectional image viewing at a remote location without the transmission of control signals to select viewing parameters

• US 5,877,801 A
• Filed: 06/05/1997
• Issued: 03/02/1999
• Est. Priority Date: 05/13/1991
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Interactive Pictures Corp. (IPIX Corporation)
• Inventors: Zimmerman, Steven D., Busko, Nicholas, Kuban, Daniel P., Martin, H. Lee
• Primary Examiner(s): Lee, Michael
• Application Number:
  US08/870,410
• Time in Patent Office: 635 Days
• Field of Search: 348/15, 348/17, 348/36, 348/207, 348/143, 348/147, 359/718, 359/728, 359/364, 359/363, 382/44, 395/137-139
• US Class Current: 348/36
• CPC Class Codes: A61B 2090/0813 Accessories designed for easy sterilising, i.e. re-usable
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/1963 Arrangements allowing camera rotation to change view, e.g. pivoting camera, pan-tilt and zoom [PTZ]
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19658 Telephone systems used to communicate with a camera, e.g. PSTN, GSM, POTS
• CPC Class Codes: G08B 13/19676 Temporary storage, e.g. cyclic memory, buffer storage on pre-alarm
• CPC Class Codes: G08B 13/19689 Remote control of cameras, e.g. remote orientation or image zooming control for a PTZ camera
• CPC Class Codes: H04N 1/2158 using a detachable storage unit
• CPC Class Codes: H04N 1/217 Interfaces allowing access to a single user
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/002 Special television systems not provided for by H04N7/007 - H04N7/18 still pictures via a television channel H04N1/00098
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A system for achieving perspective-corrected views at a location removed from the site of the creation of a distorted wide angle image without the transmission of control signals to the site of image creation. Angles of tilt, pan and rotation, as well as degrees of magnification, are achieved without the use of mechanical devices by using transform algorithms. The system provides for the transmission of signals related to an uncorrected image from a site where this distorted image is created, with the transmitted signals being received at one or more processing sites for creating the perspectively-corrected views. Transmission can be via telephone lines, with the system including signal compression and decompression units. Wireless transmission is also utilized where desired.

Claims

1. A display control system comprising:

a camera imaging system having a wide-angle lens at a first site for receiving a partial spherical image and for producing output signals corresponding to the partial spherical images;

a transmitter, responsive to the camera-imaging system, at the first site for transmitting the output signals from the first site to at least a second site and a third site;

a first receiver at the second site for receiving the transmitted output signals;

a second receiver at the third site for receiving the transmitted output signals;

an image memory at the second site for digitally storing data representing the partial spherical image obtained at the first site;

a control input at the second site for receiving a signal representing a selection of a portion of the partial spherical image; and

a converter at the second site, responsive to said control input, for converting stored digital data representing the selected portion to digital data representing a planar image for display without the transmission of said signal representing the selection of the portion of the partial spherical image to the first site.

2. A display control system as recited in claim 1, said control input for receiving signals representing zenith and azimuth angles of the selected image portion.

3. A display control system as recited in claim 2, said control input further receiving signals representing an angle of rotation for the selected image portion.

4. A display control system as recited in claim 2, said control input further receiving signals representing a degree of magnification.

5. A display control system as recited in claim 1 further comprising

an image compression circuit at the first site for compressing the output signals of the camera imaging system prior to transmission and an image decompression circuit at the second site for decompressing the compressed signals.

6. A display control system as recited in claim 1 further comprising a second converter responsive to a respective control input for converting stored digital data representing a respective selected image portion to digital data representing a planar image for display.

7. A display control system as recited in claim 6 further comprising a third converter, a fourth converter, a third control input, a fourth control input and a display at the first site, said display responsive to said first, second, third, and fourth converters, for displaying four views as selected by said first, third, fourth and fifth control inputs, respectively.

8. A display control system as recited in claim 1 wherein said output signals corresponding to said partial spherical image comprise a video signal.

9. A display control system as recited in claim 1 further comprising an image capture circuit, responsive to said output signals, for generating digital data signals for storage in said image memory.

22. A display control system as recited in claim 1, wherein the signal received by said control input designates the selected portion over a selected pan through 180 degrees and tilt through 180 degrees across said partial spherical image.

25. A display control system as recited in claim 1, wherein said display control system is one of a plurality of display control systems, each receiving the signals representing the partial spherical image, wherein each of said control inputs are adapted to receive different signals representing selections of the portion of the partial spherical image, and wherein each of said converters convert the selected portions of said partial spherical image using said signals input through said control inputs.

10. A method of controlling an image display comprising the steps of:

generating output signals corresponding to a partial spherical image;

transmitting from a first site the output signals to at least a second site and a third site;

receiving the transmitted signals at the second site and the third site;

storing in a first image memory at the second site digital data representing the partial spherical image generated at the first site;

storing in a second image memory at the third site digital data representing the partial spherical image generated at the first site;

inputting a first signal representing a first selected portion of the partial spherical image at the second site;

inputting a second signal representing a second selected portion of the partial spherical image at the third site;

converting the stored digital data at the second site representing the first selected portion of the partial spherical image to digital data representing a first planar image for display without transmitting said first input signal representing the first selected portion of the partial spherical image to said first site; and

converting the stored digital data at said third site representing said second selected portion of the partial spherical image to digital data representing a second planar image for display without transmitting the second input signal representing the second selected portion of the partial spherical image to said first site;

whereby the first selected portion for display at the second site is different from the second selected portion for display at the third site.

11. A display control method as recited in claim 10 wherein said data conversion steps are performed simultaneously at the second and third sites for the different selected portions.

12. A display control method as recited in claim 11 wherein the number of different portions comprises at least two.

13. A display control method as recited in claim 10 wherein said first and second input signals are indicative of an azimuth and zenith angle for each of the first and second selected portions of the partial spherical image, respectively.

14. A display control method as recited in claim 13 wherein said first and second input signals are further indicative of a degree of magnification.

15. A display control method as recited in claim 13 wherein said first and second input signals are further indicative of an angle of rotation.

16. A display control method as recited in claim 10 further comprising the steps of:

compressing the output signals at the first site prior to transmission; and

decompressing the output signals after receipt at the second and third sites.

17. A display control method as recited in claim 10 wherein said generated output signals comprise video signals.

18. A display control method as recited in claim 10 further comprising the step of analog to digital conversion of said output signals at the second and third sites prior to storage.

23. A display control method as recited in claim 10, wherein the first and second input signals received at the second and third sites, respectively, designate the first and second selected portions of the partial spherical image, respectively, over a selected pan through 180 degrees and tilt through 180 degrees across said partial spherical image.

26. A display control method as recited in claim 10, wherein said display control method one of a plurality of display control methods, each of said receiving steps receiving the transmitted signals at a plurality of second sites, each of said inputting steps inputting signals representing selected portions of the partial spherical image at said plurality of second sites, and wherein said converting step converts the stored digital data representing the partial spherical image at the plurality of second sites.

19. A computer-readable storage medium for selectively displaying a selected portion of a spherical image comprising:

a first module for receiving from a remote source a digital signal representing a partial spherical image;

a second module for receiving an input signal which designates a selected portion of said partial spherical image;

a third module for converting the selected portion of said partial spherical image from the digital signal representing said partial spherical image to digital data representing a planar image for display without transmitting said input signal representing the selected portion of the partial spherical image to said remote site,

whereby the designation of the selected portion is unique among receiving sites.

20. A computer-readable storage medium according to claim 19, wherein the input signal received by said second module designates the selected portion through a 180 degree arc across said partial spherical image.

21. A computer-readable storage medium according to claim 19, wherein the input signal received by said second module designates the selected portion over a pan through 180 degrees and tilt through 180 degrees across said partial spherical image.

24. A computer-readable storage medium according to claim 19, wherein said computer-readable storage medium is one of a plurality of computer-readable storage mediums, each receiving the digital signal representing the partial spherical image, wherein each of said second modules are adapted to receive different input signals which designate different selected portions of said partial spherical image, and wherein each of said third modules convert the selected portions of said partial spherical image from the digital signal representing said partial spherical image to digital data representing planar images for display using said different input signals.