Methods, systems, and computer program products for acquiring three-dimensional range information
First Claim
1. A method for acquiring three-dimensional range information of a scene, the method comprising:
- (a) obtaining a plurality of pixel-shifted images of a scene, at least one of the images being shifted by a non-integer pixel value with respect to another of the images, wherein obtaining each of the pixel-shifted images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, images of the reflected electromagnetic radiation, wherein each image includes an array of simultaneously-captured pixels; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a super-resolution image of the scene by combining the data values from the plurality of pixel-shifted images; and
(c) determining a three-dimensional location for each pixel of the super-resolution image based on analysis of the data values of the super-resolution image.
4 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and computer program products for acquiring three-dimensional range information are disclosed. According to one aspect, acquiring three-dimensional range information of a scene includes obtaining multiple pixel-shifted images of a scene, where at least one of the images being shifted by a non-integer pixel value with respect to another of the images, Obtaining each of the pixel-shifted images includes generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired. The reflected electromagnetic radiation is collected using a sensor array of at least two dimensions, where an array of pixels is captured simultaneously. A data value is determined for each captured pixel based on analysis of the collected electromagnetic radiation, by combining the data values from the pixel-shifted images to create a super-resolution image of the scene, and by analyzing the data values of the super-resolution image to determine a three-dimensional location for each pixel of the super-resolution image.
-
Citations
109 Claims
-
1. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
(a) obtaining a plurality of pixel-shifted images of a scene, at least one of the images being shifted by a non-integer pixel value with respect to another of the images, wherein obtaining each of the pixel-shifted images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, images of the reflected electromagnetic radiation, wherein each image includes an array of simultaneously-captured pixels; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a super-resolution image of the scene by combining the data values from the plurality of pixel-shifted images; and
(c) determining a three-dimensional location for each pixel of the super-resolution image based on analysis of the data values of the super-resolution image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)
-
-
43. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
in a range camera;
(a) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(b) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously;
(c) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(d) determining a three-dimensional location for each captured pixel based on analysis of the data value of each captured pixel; and
(e) storing at least one of the data value for each captured pixel and the location for each captured pixel in a storage medium local to the range camera.
-
-
44. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
in a range camera;
(a) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(b) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously;
(c) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(d) performing at least one of geometric and radiometric corrections to the range value for each captured pixel; and
(e) determining a three-dimensional location for each captured pixel based on analysis of the data value of each captured pixel.
-
-
45. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
in a range camera;
(a) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(b) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously;
(c) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(d) applying a noise reduction algorithm to the data values for each captured pixel for reducing error introduced by noise; and
(e) determining a three-dimensional location for each captured pixel based on analysis of the data value of each captured pixel.
-
-
46. A method for acquiring color and three-dimensional range information of a scene, the method comprising:
-
in a range camera;
(a) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(b) collecting, using a range sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of range pixels is captured simultaneously;
(c) collecting, using a color sensor array of at least two dimensions, electromagnetic radiation from the scene, wherein an array of color pixels is captured simultaneously;
(d) determining a three-dimensional location for each captured range pixel based on analysis of the captured range pixels; and
(e) determining a color value for each captured color pixel based on analysis of the captured color pixels.
-
-
47. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
(a) obtaining a plurality of images of a scene, wherein obtaining each of the images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously and wherein at least one of azimuth and elevation is changed at least once during the collecting; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a composite image of the scene by combining the data values from the plurality of images; and
(c) determining a three-dimensional location for each pixel of the composite image based on analysis of the data values of each pixel of the composite image.
-
-
48. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
(a) obtaining a plurality of images of a scene, wherein obtaining each of the images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously and wherein focus of at least one of the generated and collected electromagnetic radiation is changed at least once during the collecting; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a composite image of the scene by combining the data values from the plurality of images; and
(c) determining a three-dimensional location for each pixel of the composite image based on analysis of the data values of each pixel of the composite image.
-
-
49. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
(a) obtaining a plurality of images of a scene, wherein obtaining each of the images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously and wherein focal length of at least one of the generated and collected electromagnetic radiation is changed at least once during the collecting; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a composite image of the scene by combining the data values from the plurality of images; and
(c) determining a three-dimensional location for each pixel of the composite image based on analysis of the data values of each pixel of the composite image.
-
-
50. A method for acquiring three-dimensional range information of a scene, the method comprising:
-
(a) obtaining a plurality of images of a scene, wherein obtaining each of the images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, the reflected electromagnetic radiation, wherein an array of pixels is captured simultaneously and wherein at least one of intensity of the generated electromagnetic radiation and exposure of the collected electromagnetic radiation is changed at least once during the collecting; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a composite image of the scene by combining the data values from the plurality of images; and
(c) determining a three-dimensional location for each pixel of the composite image based on analysis of the data values of each pixel of the composite image.
-
-
51. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting images of electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein each image includes an array of simultaneously captured pixels;
(c) a pixel image shifter for shifting the image of the scene on the sensor array to obtain a plurality of pixel-shifted images of the scene, wherein at least one of the pixel-shifted images is shifted by a non-integer pixel distance with respect to another of the pixel-shifted images; and
(d) a processor for determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation, for creating a super-resolution image by combining the data values from the plurality of pixel-shifted images, and for determining a three-dimensional location for each pixel of the super-resolution image based on analysis of the data values for each pixel of the super-resolution image. - View Dependent Claims (52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94)
-
-
95. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) a processor for determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation, and for determining the three-dimensional location for each captured pixel based on analysis of the data values of each captured pixel; and
(d) a storage device for storing at least one of the data value for each captured pixel and the range value for each captured pixel.
-
-
96. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously; and
(c) a processor for determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation, for determining the three-dimensional location for each captured pixel based on analysis of the data values of each captured pixel, and for performing at least one of geometric and radiometric corrections to the range value for each captured pixel.
-
-
97. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously; and
(c) a processor for determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation, for applying noise reduction algorithms to the data values for each captured pixel for reducing error introduced by noise, and for determining the three-dimensional location for each captured pixel based on analysis of the data values of each captured pixel.
-
-
98. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) a processor for determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation, and for determining the three-dimensional location for each captured pixel based on analysis of the data values of each captured pixel; and
(d) a display device for displaying at least one of the data value for each captured pixel, the range value for each captured pixel, the color value for each captured pixel, and the temperature value of each captured pixel.
-
-
99. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation; and
(d) a user interface for controlling at least one of generation, collection, and analysis of the electromagnetic radiation.
-
-
100. A system for acquiring color and three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a range sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of range pixels is captured simultaneously;
(c) a color sensor array of at least two dimensions for collecting electromagnetic radiation from the scene, wherein an array of color pixels is captured simultaneously; and
(d) a processor for determining a three-dimensional location for each captured range pixel based on analysis of the captured range pixels and for determining a color value for each captured color pixel based on analysis of the captured color pixels.
-
-
101. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
(a) a range camera having a housing, the housing including;
(i) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(ii) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously; and
(iii) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation; and
(b) a mount for supporting the housing, the mount including at least one actuator controllable by the processor to control movement of the housing, thereby controlling at least one of azimuth and elevation of the range camera.
-
-
102. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) means for controlling exposure of the sensor array to the reflected electromagnetic radiation; and
(d) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation.
-
-
103. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) means for controlling the focus of the collected electromagnetic radiation onto the sensor array; and
(d) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation.
-
-
104. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) means for controlling focal length of the collected electromagnetic radiation; and
(d) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation.
-
-
105. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) means for controlling intensity of the illumination generated by the electromagnetic radiation source; and
(d) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation.
-
-
106. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) means for controlling the focus of the illumination generated by the electromagnetic radiation source; and
(d) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation.
-
-
107. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
a range camera having a housing, the housing including;
(a) an electromagnetic radiation source for illuminating a scene about which range information is desired;
(b) a sensor array of at least two dimensions for collecting electromagnetic radiation generated by the electromagnetic radiation source and reflected from the scene, wherein an array of pixels is captured simultaneously;
(c) means for controlling focal length of the illumination generated by the electromagnetic radiation source; and
(d) a processor for determining a range value for each captured pixel based on analysis of the collected electromagnetic radiation.
-
-
108. A system for acquiring three-dimensional range information of a scene, the system comprising:
-
(a) a range camera for capturing three-dimensional range information of a scene;
(b) an arm for supporting the range camera, the arm including a first end pivotally coupled to the range camera and a second end spaced from the first end; and
(c) a stand for supporting the arm, the stand being pivotally coupled to the second end of the arm in a manner that allows the range camera to obtain an unobstructed range image of a scene underneath the stand.
-
-
109. A computer program product comprising computer executable instructions embodied in a computer readable medium for performing steps comprising:
-
(a) obtaining a plurality of pixel-shifted images of a scene, at least one of the images being shifted by a non-integer pixel value with respect to another of the images, wherein obtaining each of the pixel-shifted images includes;
(i) generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired;
(ii) collecting, using a sensor array of at least two dimensions, images of the reflected electromagnetic radiation, wherein each image includes an array of simultaneously-captured pixels; and
(iii) determining a data value for each captured pixel based on analysis of the collected electromagnetic radiation;
(b) creating a super-resolution image of the scene by combining the data values from the plurality of pixel-shifted images; and
(c) determining a three-dimensional location for each pixel of the super-resolution image based on analysis of the data values of the super-resolution image.
-
Specification