HAND HELD DIMENSION CAPTURE APPARATUS, SYSTEM AND METHOD

• US 20130329013A1
• Filed: 08/13/2013
• Published: 12/12/2013
• Est. Priority Date: 05/11/2012
• Status: Abandoned Application

• Current Assignee: Proiam LLC
• Original Assignee: Proiam LLC
• Inventors: Metois, Eric, Murphy, Mike, Durbin, Mark
• Application Number:
  US13/965,947
• Publication Number:
  US 20130329013A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00

Abstract

A method of determining dimension information indicative of the dimensions of an object is disclosed, the method including: receiving a depth image of the object; and processing the depth information. The processing may include: determining a region of interest (ROI) in the image corresponding to a corner of the object; generating local normal information indicative of local normals corresponding to points in the image; generating, based at least in part on the ROI and the local normal information, object face information indicative of an association of points in the image with sides of the object; and determining the dimension information based at least in part on the object face information.

Claims

1. A method of determining dimension information indicative of the dimensions of an object, the method comprising:

receiving a depth image of the object; and

processing the depth information, the processing comprising;

determining a region of interest (ROI) in the image corresponding to a corner of the object;

generating local normal information indicative of local normals corresponding to points in the image;

generating, based at least in part on the ROI and the local normal information, object face information indicative of an association of points in the image with faces of the object; and

determining the dimension information based at least in part on the object face information.

2. The method of claim 1, wherein the object is substantially cuboid in shape, and wherein the dimension information comprises information indicative of the length, width, and height of the cuboid.

3. The method of claim 2, wherein generating object face information comprises:

estimating the location of the corner of the object based on the ROI; and

identifying, based on the local normal information, object points in the image corresponding to points located in planes passing through the ROI based on the local normal information.

4. The method of claim 3, wherein the identifying object points comprises identifying points in the image corresponding to points located in planes passing within a threshold distance from the location of the corner.

5. The method of claim 3, wherein generating object face information further comprises:

generating segmentation information indicative of a distribution of the object points; and

estimating the location of the faces of the object based on the segmentation information.

6. The method of claim 5, wherein estimating the location of the faces of the object based on the segmentation information comprises:

determining an orthogonal triplet of axes based on the segmentation information.

7. The method of claim 6, wherein determining the dimension information based at least in part on the object face information comprises:

projecting each of the object points onto one of the three axes; and

determining the dimension information based on the projection.

8. The method of claim 1, further comprising obtaining the depth image.

9. The method of claim 1, further comprising obtaining the depth image using a device that is not fixed in location relative to the object.

10. The method of claim 9, wherein the device is a hand held device.

11. The method of claim 10 wherein the device comprises an infrared 3D camera.

13. The method of claim 1, wherein processing the depth information is carried out on a computer processor.

14. The method of any claim 1, further comprising:

prior to generating the local normal information, applying a low pass spatial filter to the depth image.

12. (canceled)

15. An apparatus for determining dimension information indicative of the dimensions of an object, the apparatus comprising:

a processor configured to

receive a depth image of the object; and

process the depth information;

wherein the processor is configured to;

determine a region of interest (ROI) in the image corresponding to a corner of the object; and

generate local normal information indicative of local normals corresponding to points in the image;

generate, based at least in part on the ROI and the local normal information, object face information indicative of an association of points in the image with faces of the object; and

determine the dimension information based at least in part on the object face information.

16. The apparatus of claim 15, wherein the object is substantially cuboid in shape, and wherein the dimension information comprises information indicative of the length, width, and height of the cuboid.

17. The apparatus of claim 16, wherein the processor comprises a segmentation module configured to generate object face information, the segmentation module configured to:

estimate the location of the corner of the object based on the ROI; and

identify, based on the local normal information, object points in the image corresponding to points located in planes passing through the ROI based on the local normal information.

18. The apparatus of claim 15, wherein the segmentation module is configured to:

identify object points by identifying points in the image corresponding to points located in planes passing within a threshold distance from the location of the corner.

19. The apparatus of claim 18, wherein the segmentation module is configured to:

generate segmentation information indicative of a distribution of the object points; and

estimate the location of the faces of the object based on the segmentation information.

20. The apparatus of claim 19, wherein the processor comprises an orthogonal triplet selection module configured to estimate the location of the faces of the object based on the segmentation information by determining an orthogonal triplet of axes based on the segmentation information.

21. The apparatus of claim 20, wherein the processor comprises a dimensioning module configure to determine the dimension information based at least in part on the object face information by:

projecting each of the object points onto one of the three axes; and

determining the dimension information based on the projection.

22. The apparatus of claim 15, further comprising a sensor configured to generate the depth image of the object and transmit the image to the processor.

23. The apparatus of claim 22, wherein the sensor is not fixed in location relative to the object.

24. The apparatus of claim 23, comprising a hand held device comprising the sensor.

25. The apparatus of claim 24, wherein the hand held device comprises the processor.

26. The apparatus of claim 24, wherein the processor is located remotely from the hand held device.

27. The apparatus of claim 22, wherein the sensor comprises an infrared 3D camera.

28. The apparatus of claim 15, further comprising an output module for outputting the dimension information.

29. The apparatus of claim 15, further comprising a filter module configured to apply a low pass spatial filter to the image.

30. The apparatus of claim 15, comprising a handle unit comprising a sensor configured to generate the depth image of the object and transmit the image to the processor;

and wherein the processor is incorporated in a computing device mounted on the handle unit.

32. The apparatus of claim 30, wherein the computing device is detachably mounted on the handle unit.

31. (canceled)

33-35. -35. (canceled)