DETERMINING MOTION OF PROJECTION DEVICE

• US 20130077059A1
• Filed: 09/27/2011
• Published: 03/28/2013
• Est. Priority Date: 09/27/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Marti, Stefan J., Liu, Eric, Kim, Seung Wook
• Granted Patent: US 9,033,516 B2
• Time in Patent Office: Days
• US Class Current: 353/69
• CPC Class Codes: G03B 21/147 Optical correction of image distortions, e.g. keystone
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Example embodiments disclosed herein relate to determining a motion based on projected image information. Image information is projected onto an external surface from a device. Sensor information about the external surface and/or projection is received. Motion of the device is determined based on the sensor information.

Claims

1. A method comprising:

projecting image information onto an external surface from a mobile device;

detecting information about the external surface using a sensor on the mobile device;

determining distortion information based on the detected information; and

determining an intentional movement pattern is associated with the distortion information.

2. The method of claim 1, further comprising:

determining that the intentional movement pattern is associated with a command; and

performing the command.

3. The method of claim 1, further comprising:

correcting a distortion of the projection on the external surface based on the distortion information.

4. The method of claim 3, wherein the distortion is corrected based on keystone correction technology.

5. The method of claim 1, further comprising:

receiving, via the sensor, image information about the external surface; and

comparing the image information to a set of reference patterns,

wherein the intentional movement pattern is determined to be intentional if the image information matches at least one of the reference patterns of the set.

6. The method of claim 1,

wherein the sensor includes an image sensor,

wherein the detected information includes image information about the projected image information, and

wherein the method further comprises:

comparing the image information to a set of reference patterns; and

determining whether the image information is associated with intentional movement based on the comparison.

7. The method of claim 6, wherein the image information is used to determine egomotion of the mobile device.

8. The method of claim 1, wherein the sensor includes at least one of:

a camera sensor facing the external surface and a depth sensor.

9. A device comprising:

a projection module to project image information onto an external surface;

a sensor module to receive sensor information based on at least one of;

the projected image information and the external surface;

a projection correction module to stabilize the projected image information on the external surface based on the sensor information;

an egomotion detection module to detect egomotion data from the sensor information; and

an motion determination module to determine whether the egomotion data is associated with a motion pattern.

10. The device of claim 9, wherein the motion determination module compares the egomotion data to the motion pattern to determine whether the egomotion data is associated with the pattern.

11. The device of claim 9, further comprising:

a control module to perform a command if the egomotion data is determined to be associated with the motion pattern.

12. The device of claim 9,

wherein the projection module includes a structured light emitter on a first face of the device,

wherein the sensor module includes a camera sensor on the first face of the device, and

wherein the egomotion data is determined, at least in part, by a correlation of information projected by the structured light emitter and the sensor information.

13. A non-transitory machine-readable storage medium storing instructions that, if executed by a processor of a mobile device, cause the processor to:

cause a projector to project image information onto an external surface;

receive sensor information describing at least one of;

the projected image information and the external surface;

determine spatial data from the sensor information;

correct the projection based on the spatial data; and

determine an intentional motion from the spatial data.

14. The non-transitory machine-readable storage medium of claim 13, wherein the correction of the projection includes at least one of drift correction and jitter correction.

15. The non-transitory machine-readable storage medium of claim 13, wherein the spatial data includes six degrees of freedom information.