System With Selective Narrow FOV and 360 Degree FOV, And Associated Methods

• US 20110164108A1
• Filed: 12/30/2010
• Published: 07/07/2011
• Est. Priority Date: 12/30/2009
• Status: Abandoned Application

• Current Assignee: Fivefocal, LLC
• Original Assignee: Fivefocal, LLC
• Inventors: Bates, Robert Matthew, Baron, Alan E., Kubala, Kenneth Scott, Wach, Hans B.
• Application Number:
  US12/982,692
• Publication Number:
  US 20110164108A1
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: G02B 13/06 Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

Systems and methods image with selective narrow FOV and 360 degree FOV onto a single sensor array. The 360 degree FOV is imaged with null zone onto the sensor array and the narrow FOV is imaged onto the null zone. The narrow FOV is selectively within the 360 degree FOV and has increased magnification as compared to the 360 degree FOV.

Claims

1. A system with selective narrow field of view (FOV) and 360 degree FOV, comprising:

a single sensor array;

a first optical channel for capturing a first FOV and producing a first image incident upon a first area of the single sensor array; and

a second optical channel for capturing a second FOV and producing a second image incident upon a second area of the single sensor array, the first image having higher magnification than the second image.

2. The system of claim 1, wherein the second area has an annular shape and the first area has a circular shape contained within a null zone of the second image.

3. The system of claim 1, wherein the first FOV and focal length of the first optical channel is each at least four times less than the second FOV and focal length of the second optical channel, respectively.

4. The system of claim 1, wherein the first area and the second area are substantially non-overlapping in image space.

5. The system of claim 1, further comprising a panoramic catadioptric positioned only within the second optical channel and at least one refractive lens positioned within both the first optical channel and the second optical channel.

6. The system of claim 5, further comprising at least two additional reflective surfaces in a folded configuration and positioned within the second optical channel.

7. The system of claim 1, wherein the second optical channel comprises two or more apertures imaging different parts of the second FOV.

8. The system of claim 7, further comprising, for each aperture of the second optical channel, off axis refractive optics.

9. The system of claim 7, further comprising, for each aperture of the second optical channel, a fold mirror for correcting distortion.

10. The system of claim 1, further comprising a common objective group shared by the first and second optical channels in forming the first and second images.

11. The system of claim 10, where the objective group includes a dual zone lens.

12. The system of claim 11, wherein the dual zone lens includes a zone of light blocking material.

13. The system of claim 1, wherein the first and second optical channels have f-numbers that are within half a stop of each other to equalize exposure of the optical channels onto the image sensor.

14. The system of claim 1, wherein the first FOV is in the range from 1 degree×

1 degree to 20 degrees×

20 degrees.

15. The system of claim 1, wherein the first FOV is in the range from 1 degree×

1 degree to 50 degrees×

50 degrees.

16. The system of claim 1, wherein the second FOV is in the range from 360 degrees×

1 degree to 360 degrees×

90 degrees.

17. The system of claim 1, wherein the single sensor array has hexagonal pixels for improving resolution for azimuth angles of the first and second FOV that are not vertically or horizontally aligned with the sensor.

18. The system of claim 17, wherein the pixels are non-uniform in area.

19. The system of claim 1, wherein the single sensor array has non-uniformly shaped pixels.

20. The system of claim 1, wherein bore sight of the second optical channel is oriented parallel to horizon.

21. The system of claim 1, wherein bore sight of the second optical channel is oriented within +/−

90 degrees of a plane parallel to the horizon.

22. The system of claim 1, wherein primary mirror shape of the second optical channel is based upon orientation of the second FOV such that a tilted plane is imaged at second image with substantially constant ground sample distance (GSD) in an elevation direction.

23. The system of claim 1, wherein slant angle of the second optical channel changes as a function of azimuth angle.

24. The system of claim 5, wherein the panoramic catadioptric is actuated, segmented and/or flexed, to change slant angle.

25. The system of claim 5, wherein the panoramic catadioptric is locally actuated to create local zoom through distortion.

26. The system of claim 1, further comprising a mirror positioned within the first optical channel to select the first FOV for the first image.

27. The system of claim 26, the mirror having one or both of azimuth and elevation maneuverability.

28. The system of claim 27, wherein the maneuverability is provided by one or more actuators selected from the group of actuators including Piezo, geared, brushless, and voice coil.

29. The system of claim 27, wherein the mirror has positional encoding.

30. The system of claim 26, further comprising one or more actuators for varying power of the mirror.

31. The system of claim 30, wherein the mirror has a first side for a first set of wavelengths and a second side for a second set of wavelengths.

32. The system of claim 1, further comprising a second imaging system positioned with horizontal separation to the imaging system to provide stereo images.

33. The system of claim 32, wherein the stereo images are used to determine range by one or both of triangulation and stereo correspondence.

34. The system of claim 1, further comprising a second imaging system positioned with a vertical separation to the imaging system to provide stereo images.

35. The system of claim 34, wherein the stereo images are used to determine range by one or both of triangulation and stereo correspondence.

36. The system of claim 1, wherein the first optical channel is stabilized and uses a longer exposure time to improve low light performance.

37. The system of claim 1, further comprising an image processor for synthesizing zoom based upon one or more of variable magnification in the first optical channel, variable magnification in the second optical channel, super resolution, and interpolation between the first image and the second image.

38. The system of claim 37, wherein the image processor is remotely located from the single sensor array, the first optical channel and the second optical channel.

39. The system of claim 37, where an angle with respect to the ground horizon to an object in the first field of view is determined from the position of the object in the first image, the azimuth and elevation of the first optical channel, and an attitude of a platform supporting the imaging system.

40. The system of claim 39, wherein the attitude is determined from a navigation system of the platform.

41. The system of claim 39, further comprising a housing for mounting the imaging system within aircraft or a ground robot or an unmanned airborne vehicle or a waterborne vehicle or an underwater vehicle.

42. A system with selective narrow field of view (FOV) and 360 degree FOV, comprising:

a single sensor array;

a first optical channel including a refractive fish-eye lens for capturing a first field of view (FOV) and producing a first image incident upon a first area of the single sensor array; and

a second optical channel including catadioptrics for capturing a second FOV and producing a second image incident upon a second area of the single sensor array;

wherein the first area has an annular shape and the second area is contained within a null zone of the first area.

43. A method for imaging with selective narrow FOV and 360 degree FOV, comprising:

imaging 360 degree FOV with null zone onto a sensor array; and

imaging narrow FOV onto the null zone, the narrow FOV being selectively within the 360 degree FOV and having increased magnification as compared to the 360 degree FOV.

44. The method of claim 43, further comprising selectively steering the narrow FOV within the 360 FOV.

45. The method of claim 43, wherein each step of imaging utilizes a shared lens group having a plastic dual power optical component.

46. The method of claim 45, wherein the step of imaging 360 degree FOV comprises utilizing a panoramic catadioptric.

47. The method of claim 43, wherein the step of imaging 360 degree FOV comprises forming an annular image with the null zone it its center.

48. The method of claim 47, wherein the step of imaging narrow FOV comprises forming a circular image at the null zone, the circular image being substantially non-overlapping with the annular image.

49. The method of claim 43, further comprising actuating a mirror to steer the narrow FOV within the 360 FOV.

50. The method of claim 43, further comprising de-warping images created from the steps of imaging to provide a linear image.

51. The method of claim 43, wherein the step of imaging narrow FOV comprises selectively zooming to the increased magnification.

52. The method of claim 43, wherein the steps of imaging comprises imaging a first wavelength band onto the sensor array sensitive to the first wavelength band, and further comprising:

imaging the 360 degree FOV with LWIR null zone onto a second sensor array sensitive to LWIR; and

imaging the narrow FOV onto the LWIR null zone of the second sensor array.

53. The method of claim 52, further comprising utilizing a mirror coated on one side to reflect visible light as the first wavelength band and coated on a second side to reflect LWIR for steps of imaging in the LWIR.

54. The method of claim 43, wherein imaging 360 degree FOV comprises utilizing four 90 degree FOV optical channels each with its own aperture.

55. The method of claim 54, wherein imaging comprises contiguously imaging each 90 degree FOV into rectangles of the sensor array.

56. The method of claim 43, wherein the steps of imaging are performed within one of an unmanned airborne vehicle (UAV), an unmanned ground vehicle (UGV), an unmanned underwater vehicle, and an unmanned space vehicle.