PANORAMIC CAMERA

• US 20010010555A1
• Filed: 06/11/1997
• Published: 08/02/2001
• Est. Priority Date: 06/24/1996
• Status: Active Grant

• Current Assignee: Cedar Lane Technologies Inc.
• Original Assignee: Be Here Corporation
• Inventors: DRISCOLL, EDWARD Jr.
• Granted Patent: US 6,459,451 B2
• Time in Patent Office: Days
• US Class Current: 348/335
• CPC Class Codes: G02B 13/06 Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: G03B 37/00 Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G08B 13/19626 optical details, e.g. lenses, mirrors or multiple lenses
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Most camera systems only record an image from a limited viewing angle. A new panoramic camera apparatus is disclosed that instantaneously captures a 360 degree panoramic image. In the camera device, virtually all of the light that converges on a point in space is captured. Specifically, in the camera of the present invention, light striking this point in space is captured if it comes from any direction, 360 degrees around the point and from angles 50 degrees or more above and below the horizon. The panoramic image is recorded as a two dimensional annular image. Furthermore, various different systems for displaying the panoramic images and distributing the panoramic images. Specifically, methods and apparatus for digitally performing a geometric transformation of the two dimensional annular image into rectangular projections such that the panoramic image can be displayed using conventional methods such as printed images and televised images.

Claims

1. An apparatus for capturing panoramic images, said apparatus comprising:

a convex mirror, said convex mirror reflecting light from 360 degrees around said convex mirror;

an astigmatism correction lens, said astigmatism correction lens correcting astigmatism in said light reflected from said convex mirror;

an objective lens for focusing said light reflected from said convex mirror; and

an image capture mechanism, said image capture mechanism capturing said light reflected from said convex mirror.

2. The apparatus as claimed in

claim 1

further comprising:

a field flattening lens, said field flattening lens flattening a field of optimal focus.

3. The apparatus as claimed in

claim 1

wherein image capture mechanism comprises photographic film.

4. The apparatus as claimed in

claim 1

wherein image capture mechanism comprises an electronic image capture mechanism.

5. The apparatus as claimed in

claim 4

wherein said electronic image capture mechanism comprises a charged coupled device array.

6. An apparatus for capturing panoramic images, said apparatus comprising:

a convex mirror, said convex mirror reflecting light from 360 degrees around said convex mirror;

an objective lens for focusing said light reflected from said convex mirror;

a field flattening lens, said field flattening lens flattening a field of optimal focus; and

an image capture mechanism, said image capture mechanism capturing said light reflected from said convex mirror.

7. The apparatus as claimed in

claim 6

wherein image capture mechanism comprises photographic film.

8. The apparatus as claimed in

claim 6

wherein image capture mechanism is housed within.

9. The apparatus as claimed in

claim 8

wherein said image capture mechanism comprises an electronic image capture device.

10. The apparatus as claimed in

claim 8

wherein said electronic image capture device comprises at least one charged coupled device.

11. An apparatus for capturing panoramic images, said apparatus comprising:

a convex mirror, said convex mirror reflecting light from a 360 degree band around said convex mirror, said 360 degree band having a horizon line; and

an image capture mechanism, said image capture mechanism capturing an annular shaped image created by said light reflected from said convex mirror;

wherein said convex mirror is shaped such that an angle of elevation from said horizon line is linearly proportional to a radial distance of the center of said annular shaped image.

12. The apparatus as claimed in

claim 11

further comprising:

a field flattening lens, said field flattening lens flattening a field of optimal focus.

13. The apparatus as claimed in

claim 11

further comprising:

an astigmatism correction lens, said astigmatism correction lens correcting astigmatism in said light reflected from said convex mirror.

14. An apparatus for capturing panoramic images, said apparatus comprising:

a convex mirror, said convex mirror reflecting light from a 360 degree band around said convex mirror, said 360 degree band having a horizon line;

a beam splitter, said beam splitter dividing said reflected light into a first annular image and a second annular image;

a first electronic image capture mechanism, said first electronic image capture mechanism capturing at least half of said first annular image created by said light reflected from said convex mirror; and

a second electronic image capture mechanism, said second electronic image capture mechanism capturing at least half of said second annular image created by said light reflected from said convex mirror.

15. The apparatus as claimed in

claim 14

wherein said first electronic image capture mechanism and said second electronic image capture mechanism comprise charged coupled devices.

16. An apparatus for capturing panoramic images, said apparatus comprising:

a convex mirror, said convex mirror reflecting light from a 360 degree band around said convex mirror;

a second mirror, said second mirror reflecting said light from said convex mirror into an aperture in said convex mirror; and

an image capture mechanism, said image capture mechanism capturing said light reflected from said convex mirror and said second mirror.

17. The apparatus as claimed in

claim 16

wherein said image capture mechanism is housed within said convex mirror.

18. A panoramic camera apparatus, said panoramic camera apparatus comprising:

an image capture mechanism;

a main reflector, said main reflector reflecting light from a 360 degree panorama onto said image capture mechanism; and

a protective transparent block;

said protective transparent block covering said main reflector.

19. The apparatus as claimed in

claim 18

wherein said protective transparent block is shaped such that light rays that will be reflected onto said image capture mechanism enter said protective transparent case at a normal to the surface of said protective transparent block.

20. The apparatus as claimed in

claim 18

further comprising:

a second reflector, said second reflector reflecting light from said main reflector down through an opening in said main reflector.

21. The apparatus as claimed in

claim 20

wherein said protective transparent block ends at said opening in said main reflector.

22. The apparatus as claimed in

claim 20

wherein an lens system is housed within an indentation of said protective transparent block.

23. A method of recording a panorama, said method comprising the steps of:

reflecting light from a 360 degree band around a convex mirror to an image plane;

correcting astigmatism in said light reflected from said convex mirror; and

capturing an annular representation of said panorama on said image plane with an image capture mechanism.

24. A method of recording a panorama, said method comprising the steps of:

reflecting light from a 360 degree band around a convex mirror to an image plane;

flattening a field of optimal focus for said reflected light; and

capturing an annular representation of said panorama on said image plane with an image capture mechanism.

25. The method as claimed in

claim 24

further comprising:

correcting astigmatism in said light reflected from said convex mirror.

26. The method as claimed in

claim 24

wherein said step of capturing an annular representation comprises capturing an annular image on photographic film.

27. The method as claimed in

claim 24

wherein said step of capturing an annular representation comprises capturing an annular image on a charged coupled device array.

28. The method as claimed in

claim 24

further comprising:

focusing said light reflected from said convex mirror with an objective lens.

29. A method of presenting panoramic images, said method comprising the steps of:

recording an annular representation of a panorama;

storing said annular representation of said panorama as a digitized annular representation;

geometrically transforming said digitized annular representation of said panorama into a rectangular projection of said panorama; and

displaying said rectangular projection of said panorama.

30. The method as claimed in

claim 29

wherein said step of mathematical transforming further comprises sampling said digitized annular representation with a dynamically changing sampling shape wherein said sampling shape is dependent upon a viewing angle.

31. The method as claimed in

claim 29

wherein said step of geometrically transforming further comprises sampling said digitized annular representation with a dynamically changing sampling shape orientation wherein said sampling shape orientation is dependent upon a horizontal viewing angle.

32. A method of presenting panoramic images, said method comprising the steps of:

recording an annular representation of a panorama;

storing said annular representation of said panorama as a digitized annular representation;

geometrically transforming said digitized annular representation of said panorama into a cylindrical representation of said panorama; and

displaying said cylindrical representation of said panorama using a computer program.

33. The method as claimed in

claim 32

wherein said step of displaying said cylindrical representation of said panorama using a computer program comprises running a QuickTime VR program.

34. A method of presenting panoramic images of a remote location, said method comprising the steps of:

capturing a digitized annular representation of a panorama at said remote location;

transmitting said digitized annular representation to a local computer;

geometrically transforming said digitized annular representation into a rectangular projection of said panorama using said local computer; and

displaying said rectangular projection of said panorama.

35. A method of presenting panoramic images of a remote location, said method comprising the steps of:

capturing a digitized annular representation of a panorama at said remote location;

geometrically transforming said digitized annular representation into a rectangular representation of said panorama;

transmitting said rectangular representation of said panorama to a local receiver; and

displaying said rectangular representation of said panorama on said local receiver.

36. The method of presenting panoramic images of a remote location as claimed in

claim 35

wherein said step of geometrically transforming said digitized annular representation into a rectangular representation of said panorama comprises geometrically transforming a portion of said digitized annular representation into rectangular projection.

37. The method of presenting panoramic images of a remote location as claimed in

claim 36

further comprising the steps of:

transmitting a request from said local receiver to said remote location; and

selecting said portion of said digitized annular representation dependent upon said request.

38. A method of presenting panoramic images of a remote location, said method comprising the steps of:

capturing a digitized annular frame of a panorama at said remote location;

geometrically transforming said digitized annular frame into a rectangular projection frame of said panorama;

transmitting said rectangular projection frame of said panorama to a local receiver;

displaying said rectangular representation of said panorama on said local receiver;

capturing a stream of digitized annular frames of a panorama at said remote location;

geometrically transforming a particular portion of said stream of digitized annular frames into a stream of rectangular projection frames; and

displaying said stream of rectangular projection frames on said local receiver.

39. The method of presenting panoramic images of a remote location as claimed in

claim 38

further comprising the steps of:

transmitting a request from said local receiver to said remote location; and

selecting said particular portion of said digitized annular representation dependent upon said request.

40. The method of presenting panoramic images of a remote location as claimed in

claim 38

further comprising the steps of:

capturing audio at said remote location; and

transmitting said audio to said local receiver.

41. A method of presenting images from a remote location, said method comprising the steps of:

capturing a digitized annular representation of a panorama at said remote location;

geometrically transforming said digitized annular representation into a rectangular representation of said panorama;

selecting a viewport from said rectangular representation of said panorama;

transmitting said viewport from said rectangular representation of said panorama to a local receiver; and

displaying said viewport on said local receiver.

42. The method of presenting images from a remote location as claimed in

claim 41

, said method further comprising the steps of:

capturing at least one audio stream at said remote location;

transmitting said audio stream to said local receiver; and

generating audio at said local receiver using said audio stream.

43. The method of presenting images from a remote location as claimed in

claim 41

wherein said steps are repeated such that said viewport on said local receiver comprises a motion image.

44. The method of presenting images from a remote location as claimed in

claim 41

wherein said step of capturing at least one audio stream at said remote location comprises, said method further comprising the steps of:

capturing multiple directional audio sources;

mixing said multiple directional audio sources based upon said selected viewport to create a mixed audio stream;

transmitting said audio stream to said local receiver; and

generating audio at said local receiver using said audio stream.

45. The method of presenting images from a remote location as claimed in

claim 41

, said method further comprising the steps of:

transmitting at least one command from said local receiver to said remote location; and

selecting said viewport dependent upon said command.

46. A method of presenting panoramic images of a remote location, said method comprising the steps of:

capturing a digitized annular representation of a panorama at said remote location;

selecting a viewport from said digitized annular representation of said panorama;

geometrically transforming said selected viewport from said digitized annular representation into a rectangular representation of said viewport;

transmitting said rectangular representation of said viewport to a local computer; and

displaying said rectangular representation of said viewport on said local computer.

47. The method of presenting images from a remote location as claimed in

claim 46

wherein said steps are repeated such that said viewport on said local receiver comprises a motion image.

48. The method of presenting images from a remote location as claimed in

claim 46

, said method further comprising the steps of:

capturing at least one audio stream at said remote location;

transmitting said audio stream to said local receiver; and

generating audio at said local receiver using said audio stream.

49. The method of presenting images from a remote location as claimed in

claim 46

wherein said step of capturing at least one audio stream at said remote location comprises, said method further comprising the steps of:

capturing multiple directional audio sources;

mixing said multiple directional audio sources based upon said selected viewport to create a mixed audio stream;

transmitting said audio stream to said local receiver; and

generating audio at said local receiver using said audio stream.

50. The method of presenting images from a remote location as claimed in

claim 46

, said method further comprising the steps of:

transmitting at least one command from said local receiver to said remote location; and

selecting said viewport dependent upon said command.

51. A camera apparatus, said camera apparatus comprising:

a panoramic camera for capturing a digitized annular representation of a panorama at said remote location;

a computer for geometrically transforming said digitized annular representation into a rectangular representation of said panorama, said computer selecting a viewport from said rectangular representation of said panorama;

a communication device for transmitting said viewport from said rectangular representation of said panorama to a local receiver; and

a local receiver for receiving said viewport and displaying said viewport.

52. The camera apparatus as claimed in

claim 51

, said camera apparatus further comprising:

at least one microphone for capturing at least one audio stream at said remote location, said audio stream transmitted to said local receiver; and

audio generator for generating audio at said local receiver using said audio stream.

53. The camera apparatus as claimed in

claim 51

, said camera apparatus further comprising:

at least two microphones at said remote location for capturing multiple audio sources;

a mixer at said remote location, said mixer combining said multiple audio sources into a mixed audio stream, said mixed audio stream transmitted to said local receiver; and

audio generator for generating audio at said local receiver based upon said mixed audio stream.

54. The camera apparatus as claimed in

claim 53

wherein said mixer mixes said multiple audio sources based upon said selected viewport.

55. The camera apparatus as claimed in

claim 51

wherein said local receiver transmits at least one command to said computer to indicate a desired viewport.

56. The camera apparatus as claimed in

claim 51

wherein said communication device continuously transmits viewports such that a motion image is displayed at said local receiver.

57. A camera apparatus, said camera apparatus comprising:

a panoramic camera for capturing a digitized annular representation of a panorama at said remote location;

a computer for selecting a viewport from said digitized annular representation of said panorama, said computer geometrically transforming said digitized viewport into a rectangular representation of said panorama;

a communication device for transmitting said viewport from said rectangular representation of said panorama to a local receiver; and

a local receiver for receiving said viewport and displaying said viewport.

58. The camera apparatus as claimed in

claim 57

, said camera apparatus further comprising:

at least one microphone for capturing at least one audio stream at said remote location, said audio stream transmitted to said local receiver; and

audio generator for generating audio at said local receiver using said audio stream.

59. The camera apparatus as claimed in

claim 57

, said camera apparatus further comprising:

at least two microphones at said remote location for capturing multiple audio sources;

a mixer at said remote location, said mixer combining said multiple audio sources into a mixed audio stream, said mixed audio stream transmitted to said local receiver; and

audio generator for generating audio at said local receiver based upon said mixed audio stream.

60. The camera apparatus as claimed in

claim 59

wherein said mixer mixes said multiple audio sources based upon said selected viewport.

61. The camera apparatus as claimed in

claim 57

wherein said local receiver transmits at least one command to said computer to indicate a desired viewport.

62. The camera apparatus as claimed in

claim 57

wherein said communication device continuously transmits viewports such that a motion image is displayed at said local receiver.