Mobile three dimensional imaging system

• US 8,837,813 B2
• Filed: 07/01/2011
• Issued: 09/16/2014
• Est. Priority Date: 07/01/2011
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Pan, Hao, Yuan, Chang
• Primary Examiner(s): Desire, Gregory M
• Application Number:
  US13/175,166
• Publication Number:
  US 20130004058A1
• Time in Patent Office: 1,173 Days
• Field of Search: 348/42, 348/46, 348/47, 348/51, 382/103, 382/154
• US Class Current: 382/154
• CPC Class Codes: G01B 11/026 by measuring distance between sensor and object G01B11/0608 takes precedence
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces

Abstract

A mobile device including an imaging device with a display and capable of obtaining a pair of images of a scene having a disparity between the pair of images. The imaging device estimating the distance between the imaging device and a point in the scene indicated by a user on the display. The imaging device displaying the scene on the display together with an indication of a geometric measure.

Claims

1. A mobile device comprising:

(a) an imaging device with a display and at least one sensor capable of obtaining a pair of images of a scene having a disparity between said pair of images, and rendering said scene on said display;

(b) a processor of said imaging device capable of receiving a user'"'"'s selection of an object in the rendered said scene;

(c) a positioning device operatively connected to said processor and capable of determining a location of said mobile device, where said processor is capable of using the determined location and the rendered said scene to associate the rendered said scene with information in a database remote from said mobile device;

d) where said processor is capable of jointly processing said image and processing said information to determine a feature related to the selected said object.

2. The mobile device of claim 1 wherein said feature is an approximate distance to the selected said object from said mobile device.

3. The mobile device of claim 1 wherein said feature relates to the geometry of the selected said object.

4. The mobile device of claim 1 wherein said point in said scene is selected in a first image of said pair of images, and its corresponding point is determined in a second image of said pair of images.

5. The mobile device of claim 1 wherein said imaging device wherein said indicated by said user on said display is further modified based upon a set of points of interest computed based on the image content.

6. The mobile device of claim 1 further determines a relative three dimensional measurement error indicating the reliability of 3D coordinate values.

7. The mobile device of claim 1 wherein said imaging device includes a pair of cameras.

8. The mobile device of claim 7 wherein said pair of cameras have parallel axes.

9. The mobile device of claim 7 wherein said pair of cameras have converging axes.

10. The mobile device of claim 7 wherein said pair of cameras have diverging axes.

11. The mobile device of claim 1 further determines a relative three dimensional measurement error that is visualized in both a two-dimensional left view image and a two-dimensional right view image.

12. The mobile device of claim 1 further determines a relative three dimensional measurement error that is visualized in a three dimensional manner, appearing virtually in front of object in said scene.

13. The mobile device of claim 1 wherein said feature is a length of at least a portion of said object.

14. The mobile device of claim 13 wherein said estimation is further based upon location data.

15. The mobile device of claim 13 wherein said estimation is further based upon gyroscopic data.

16. The mobile device of claim 1 wherein said feature is a distance.

17. The mobile device of claim 16 wherein said estimation is further based upon location data.

18. The mobile device of claim 16 wherein said estimation is further based upon gyroscopic data.

19. The mobile device of claim 1 wherein said imaging device estimating an area of a portion of an object in said scene and said feature is an area.

20. The mobile device of claim 19 wherein said estimation is further based upon location data.

21. The mobile device of claim 19 wherein said estimation is further based upon gyroscopic data.

22. The mobile device of claim 1 wherein said imaging device estimating a volume of a portion of an object in said scene and said feature is a volume.

23. The mobile device of claim 22 wherein said estimation is further based upon location data.

24. The mobile device of claim 22 wherein said estimation is further based upon gyroscopic data.

25. The mobile device of claim 1 wherein said imaging device estimating an elevation of a portion of an object in said scene and said feature is an elevation.

26. The mobile device of claim 25 wherein said estimation is further based upon location data.

27. The mobile device of claim 25 wherein said estimation is further based upon gyroscopic data.