Enhanced multi-touch detection

• US 8,373,657 B2
• Filed: 08/13/2009
• Issued: 02/12/2013
• Est. Priority Date: 08/15/2008
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hildreth, Evan
• Primary Examiner(s): PHAM, VIET DAVID
• Application Number:
  US12/540,992
• Publication Number:
  US 20100039379A1
• Time in Patent Office: 1,279 Days
• Field of Search: 345156-173
• US Class Current: 345/158
• CPC Class Codes: B29C 70/46 using matched moulds, e.g. for deforming sheet moulding compounds [SMC] or prepregs
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Enhanced multi-touch detection, in which a graphical user interface for an application is projected onto a surface, and electromagnetic radiation is emitted. The electromagnetic radiation is collectively emitted by an array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected. Electromagnetic radiation is detected that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected, and indicating a position of the object is output.

Claims

1. A device comprising:

a projector configured to project a graphical user interface for an application onto a surface;

a semicircular array of emitters configured to emit electromagnetic radiation toward a central point of the array, the electromagnetic radiation collectively emitted by the array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected, wherein

a difference in angle between adjacent emitters of the array is less than or equal to a minimum angle of half intensity of each of the adjacent emitters;

a sensor configured to detect the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

an interface configured to output data indicating a position of the object.

2. The device of claim 1, wherein the projector comprises a short throw projector or an ultra short throw projector.

3. The device of claim 1, further comprising a housing, wherein the projector, the array, and the sensor are disposed within the housing.

4. The device of claim 1, wherein the projector is configured to project the graphical user interface onto the surface through the defined layer of electromagnetic radiation.

5. The device of claim 1, wherein the layer of electromagnetic radiation collectively emitted by the array fans out from a central point and has a thickness of less than 0.5 inches in a center of the region of the surface onto which the graphical user interface is projected, and has a thickness of less than 1 inch in any part of the region of the surface onto which the graphical user interface is projected.

6. The device of claim 1, further comprising:

a processor configured to perform a calibration process to identify one or more objects obstructing the defined layer at a position where the defined layer overlaps the region of the surface onto which the graphical user interface is projected and, subsequent to the calibration process, ignore the identified one or more objects in detection processing.

7. The device of claim 1, wherein the array of emitters further comprises a plate defining a slot, the slot limiting a vertical spread of the electromagnetic radiation collectively emitted by the array.

8. The device of claim 1, further comprising:

a processor configured to determine the position of the object with respect to the region of the surface onto which the graphical user interface is projected, based on the detected electromagnetic radiation, and to control the application based on the determined position.

9. The device of claim 8, wherein the position of the object is determined with respect to the region of the surface onto which the graphical user interface is projected based on applying a coordinate transform to the detected electromagnetic radiation.

10. The device of claim 8, wherein the processor is further configured to automatically calibrate the projector and the sensor.

11. The device of claim 8, wherein:

the sensor further comprises a wide-angle lens, and

the processor is further configured to correct a distortion associated with the wide-angle lens.

12. The device of claim 8 wherein the controlling the application based on the determined position further comprises mapping the determined position to a mouse event.

13. The device of claim 1, wherein the array is disposed between the projector and the surface.

14. The device of claim 1, wherein:

the region comprises a rectangular region measuring at least 60 inches diagonal, and

the array emits the electromagnetic radiation at a horizontal angle of 170°

or greater, and a vertical angle of 1°

or less.

15. The device of claim 1, further comprising:

a processor configured to determine the position of the object based on the detected electromagnetic radiation, compare the determined position of the object with the region of the surface onto which the graphical user interface is projected, determine whether the determined position of the object is within the region of the surface onto which the graphical user interface is projected based on the comparison, and, in response to a determination that the determined position of the object is outside of the region of the surface onto which the graphical user interface is projected, ignore the object in controlling the application.

16. The device of claim 1, wherein in the application is at least one of a medical therapy application and an application to entertain pets.

22. The device of claim 1, wherein the array comprises more than three emitters.

23. The device of claim 1, wherein each of the emitters is configured to emit electromagnetic radiation toward the central point.

24. The device of claim 1, wherein the array comprises a plurality of facets, each facet comprising a group of emitters.

25. The device of claim 24, wherein each of the facets is configured such that combined electromagnetic radiation of the facet'"'"'s emitters is directed toward the central point.

26. The device of claim 1, wherein the central point is ahead, behind, above, below, left, or right of an actual or exact center of the array.

17. A computer-implemented method comprising:

projecting a graphical user interface for an application onto a surface;

emitting electromagnetic radiation, the electromagnetic radiation collectively emitted by a semicircular array of emitters defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected, wherein;

the semicircular array of emitters is configured to emit electromagnetic radiation toward a central point of the semicircular array; and

a difference in angle between adjacent emitters of the array is less than or equal to a minimum angle of half intensity of each of the adjacent emitters;

detecting the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

outputting, using at least one processor, data indicating a position of the object.

18. The computer-implemented method of claim 17, further comprising:

determining the position of the object with respect to the region of the surface onto which the graphical user interface is projected, based on the detected electromagnetic radiation; and

controlling the application based on the determined position.

19. The computer-implemented method of claim 18, further comprising:

applying a coordinate transform to the detected electromagnetic radiation.

20. A computer-readable storage medium encoded with a computer program comprising instructions that, when executed, operate to cause one or more computers to perform operations comprising:

projecting a graphical user interface for an application onto a surface;

emitting electromagnetic radiation, the electromagnetic radiation collectively emitted by a semicircular array of emitters defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected, wherein;

the semicircular array is configured to emit electromagnetic radiation toward a central point of the array; and

a difference in angle between adjacent emitters of the array is less than or equal to a minimum angle of half intensity of each of the adjacent emitters;

detecting the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

outputting data indicating a position of the object.

21. A device comprising:

means for projecting a graphical user interface for an application onto a surface;

a semicircular array of means for emitting electromagnetic radiation toward a central point of the array, the electromagnetic radiation collectively emitted by the array defining a layer aligned parallel with the surface and overlapping at least a region of the surface onto which the graphical user interface is projected, wherein

a difference in angle between adjacent emitters of the array is less than or equal to a minimum angle of half intensity of each of the adjacent emitters;

means for detecting the electromagnetic radiation that reflects off of an object interrupting the defined layer where the defined layer overlaps the region of the surface onto which the graphical user interface is projected; and

means for outputting data indicating a position of the object.