Three-dimensional object model determination using a beacon

• US 9,292,963 B2
• Filed: 09/28/2011
• Issued: 03/22/2016
• Est. Priority Date: 09/28/2011
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Liu, Eric, Marti, Stefan J., Kim, Seung Wook
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): Suh, Joseph
• Application Number:
  US13/247,277
• Publication Number:
  US 20130076860A1
• Time in Patent Office: 1,637 Days
• Field of Search: 348/46
• US Class Current: 1/1
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation

Abstract

Example embodiments disclosed herein relate to determining relationships between locations based on beacon information. At least three sensors of a device can be used to determine locations of a beacon. The device can determine a three-dimensional relationship between the locations.

Claims

1. A method comprising:

obtaining a two-dimensional (2D) image of a physical scene using a camera, wherein the camera is coupled to a device, and the 2D image of the physical scene includes a 2D image of a physical object;

selecting a portion of the 2D image of the physical object;

detecting a three-dimensional (3D) position of a beacon at the device, wherein after selecting the portion of the 2D image, the beacon is placed in the physical scene at a corresponding location to the selected portion of the physical object;

associating the position of the beacon with the portion of the 2D image of the physical object; and

determining, at the device, a three-dimensional (3D) model of the physical object based on the association of the position of the beacon with the portion of the 2D image of the physical object.

2. The method of claim 1, wherein the beacon is an input device to the device, the method further comprising:

selecting the portion of the 2D image of the physical object from the 2D image of the physical scene using the beacon;

triggering the detection of the position of the beacon,

wherein the position of the beacon corresponds to the portion of the 2D image of the physical object.

3. The method of claim 2, wherein the input device is a pen device that selects the portion of the 2D image of the physical object from the 2D image of the physical scene as a touch screen input to the device.

4. The method of claim 1, further comprising:

processing the image to determine the portion of the 2D image of the physical object from the 2D image of the physical scene based on a visual analysis.

5. The method of claim 1, wherein the beacon includes an output signal and wherein the device includes at least three sensors to triangulate the position of the beacon.

6. The method of claim 5, wherein the output signal includes at least one of:

an ultrasound signal,

a radio frequency signal, a visible light signal, magnetic field signal,

and an infrared signal.

7. The method of claim 5, wherein the position of the beacon include three-dimensional coordinates and wherein the three-dimensional model includes texture mapped from the image.

8. The method of claim 5, further comprising:

monitoring a location of the device;

determining that the location of the device has changed;

determining another 2D image of the physical object; and

detecting another position of the beacon that is associated with a portion of the other 2D representation of the physical object from the 2D image,

wherein the 3D model is further based on the other position.

9. The method of claim 5, wherein the device further includes an accelerometer to determine the position of the beacon.

10. The method of claim 5, wherein the sensors in the device do not form a straight line.

11. The method of claim 1, wherein selecting the portion of the 2D image of the physical object from the 2D image of the physical scene comprises processing the image to automatically detect features associated with the portion of the 2D image of the physical object from the 2D image of the physical scene.

12. A computing system comprising:

a device including;

an image capture device;

at least three position sensors;

a processor coupled to memory; and

a mobile beacon that can provide input to the device, the mobile beacon including a signal transmitter,

wherein the processor is configured to;

determine a plurality of two-dimensional (2D) images of a physical scene via the image capture device;

determine a physical object in the 2D images of the physical scene using visual characteristics of the physical object;

recognize the mobile beacon in the images;

determine a portion of a 2D image of the physical object from at least one of the 2D images of the physical scene based on the recognition;

receive signal information about at least one signal received at the at least three position sensors from the mobile beacon;

determine three-dimensional (3D) spatial location information about the mobile beacon, after determining the portion of the 2D image of the physic object, wherein the 3D spatial location information corresponds to the portion of the 2D image of the physical object; and

determine a three-dimensional (3D) model of the object based, at least in part, on the 3D spatial location information.

13. The computing system of claim 12, wherein the processor is further configured to:

determine another portion of at least another one of the 2D images;

receive another signal information about at least another signal received at the at least three position sensors from the mobile beacon;

determine another 3D spatial location information about the mobile beacon wherein

the other 3D spatial location information corresponds to the other portion of 2D image of the physical object,

wherein the three-dimensional model is further based on the other 3D spatial location information.

14. The computing system of claim 12, wherein the at least one signal is used to trigger the determination of the portion.

15. A device comprising:

an image capture module to capture a two-dimensional (2D) image of a physical scene using a camera, the 2D image of the physical scene including a 2D image of a physical object;

a location module to determine a three-dimensional (3D) position of a beacon at the device, wherein after using the device to select a portion of the 2D image of the physical object, the beacon is placed in the physical scene at a corresponding location to the selected portion of the 2D image of the physical object;

a relationship module to associate the position of the beacon with the portion of the 2D image of the physical object; and

an object module to determine, at the device, a three-dimensional (3D) model of the physical object based on the association of the position of the beacon with the portion of the 2D image of the physical object.

16. The device of claim 15,

wherein the beacon is an input device to the device;

wherein the portion of the 2D image of the physical object is selected from the 2D image of the physical scene using the beacon; and

wherein the position of the beacon corresponds to the portion of the 2D image of the physical object.

17. A non-transitory machine-readable storage medium encoded with instructions executable by a processor of a computer, the machine-readable medium comprising:

instruction to obtain a two-dimensional (2D) image of a physical scene using a camera, wherein the camera is coupled to a device, and the 2D image of the physical scene includes a 2D image of a physical object;

instruction to select a portion of the 2D image of the physical object;

instruction to detect a three-dimensional (3D) position of a beacon at the device, wherein after selecting the portion of the 2D image, the beacon is placed in the physical scene at a corresponding location to the selected portion of the physical object;

instruction to associate the position of the beacon with the portion of the 2D image of the physical object; and

instruction to determine, at the device, a three-dimensional (3D) model of the physical object based on the association of the position of the beacon with the portion of the 2D image of the physical object.

18. A system comprising:

means for obtaining a two-dimensional (2D) image of a physical scene using a camera, wherein the camera is coupled to a device, and the 2D image of the physical scene includes a 2D image of a physical object;

means for selecting a portion of the 2D image of the physical object;

means for detecting a three-dimensional (3D) position of a beacon at the device, wherein after selecting the portion of the 2D image, the beacon is placed in the physical scene at a corresponding location to the selected portion of the physical object;

means for associating the position of the beacon with the portion of the 2D image of the physical object; and

means for determining, at the device, a three-dimensional (3D) model of the physical object based on the association of the position of the beacon with the portion of the 2D image of the physical object.