Enhanced Multi-Touch Detection

• US 20100039379A1
• Filed: 08/13/2009
• Published: 02/18/2010
• Est. Priority Date: 08/15/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: GestureTek Incorporated (Winning Brands Corp.)
• Inventors: Hildreth, Evan
• Granted Patent: US 8,373,657 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: B29C 70/46 using matched moulds, e.g. for deforming sheet moulding compounds [SMC] or prepregs
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Enhanced multi-touch detection, in which a graphical user interface for an application is projected onto a surface, and electromagnetic radiation is emitted. The electromagnetic radiation is collectively emitted by an array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected. Electromagnetic radiation is detected that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected, and indicating a position of the object is output.

Claims

1. A device comprising:

a projector configured to project a graphical user interface for an application onto a surface;

an array of emitters each configured to emit electromagnetic radiation, the electromagnetic radiation collectively emitted by the array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected;

a sensor configured to detect the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

an interface configured to output data indicating a position of the object.

2. The method of claim 1, wherein the projector comprises a short throw projector or an ultra short throw projector.

3. The method of claim 1, wherein the array comprises a semicircular array configured to emit the electromagnetic radiation toward a central point of the array.

4. The device of claim 1, further comprising a housing, wherein the projector, the array, and the sensor are disposed within the housing.

5. The device of claim 1, wherein the projector is configured to project the graphical user interface onto the surface through the defined layer of electromagnetic radiation.

6. The device of claim 1, wherein the layer of electromagnetic radiation collectively emitted by the array fans out from a central point and has a thickness of less than 0.5 inches in a center of the region of the surface onto which the graphical user interface is projected, and has a thickness of less than 1 inch in any part of the region of the surface onto which the graphical user interface is projected.

7. The device of claim 1, wherein a difference in angle between adjacent emitters of the array is less than or equal to a minimum angle of half intensity of each of the adjacent emitters.

8. The device of claim 1, further comprising:

a processor configured to perform a calibration process to identify one or more objects obstructing the defined layer at a position where the defined layer overlaps the region of the surface onto which the graphical user interface is projected and, subsequent to the calibration process, ignore the identified one or more objects in detection processing.

9. The device of claim 1, wherein the array of emitters further comprises a plate defining a slot, the slot limiting a vertical spread of the electromagnetic radiation collectively emitted by the array.

10. The device of claim 1, further comprising:

a processor configured to determine the position of the object with respect to the region of the surface onto which the graphical user interface is projected, based on the detected electromagnetic radiation, and to control the application based on the determined position.

11. The device of claim 10, wherein the position of the object is determined with respect to the region of the surface onto which the graphical user interface is projected based on applying a coordinate transform to the detected electromagnetic radiation.

12. The device of claim 10, wherein the processor is further configured to automatically calibrate the projector and the sensor.

13. The device of claim 10, wherein:

the sensor further comprises a wide-angle lens, and

the processor is further configured to correct a distortion associated with the wide-angle lens.

14. The device of claim 10 wherein the controlling the application based on the determined position further comprises mapping the determined position to a mouse event.

15. The device of claim 1, wherein the array is disposed between the projector and the surface.

16. The device of claim 1, wherein:

the region comprises a rectangular region measuring at least 60 inches diagonal, and

the array emits the electromagnetic radiation at a horizontal angle of 170°

or greater, and a vertical angle of 1°

or less.

17. The device of claim 1, further comprising:

a processor configured to determine the position of the object based on the detected electromagnetic radiation, compare the determined position of the object with the region of the surface onto which the graphical user interface is projected, determine whether the determined position of the object is within the region of the surface onto which the graphical user interface is projected based on the comparison, and, in response to a determination that the determined position of the object is outside of the region of the surface onto which the graphical user interface is projected, ignore the object in controlling the application.

18. The device of claim 1, wherein in the application is at least one of a medical therapy application and an application to entertain pets.

19. A computer-implemented method comprising:

projecting a graphical user interface for an application onto a surface;

emitting electromagnetic radiation, the electromagnetic radiation collectively emitted by an array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected;

detecting the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

outputting, using at least one processor, data indicating a position of the object.

20. The computer-implemented method of claim 19, further comprising:

determining the position of the object with respect to the region of the surface onto which the graphical user interface is projected, based on the detected electromagnetic radiation; and

controlling the application based on the determined position.

21. The computer-implemented method of claim 20, further comprising:

applying a coordinate transform to the detected electromagnetic radiation.

22. A computer-readable medium encoded with a computer program comprising instructions that, when executed, operate to cause one or more computers to perform operations comprising:

projecting a graphical user interface for an application onto a surface;

emitting electromagnetic radiation, the electromagnetic radiation collectively emitted by an array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected;

detecting the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

outputting data indicating a position of the object.