SYSTEM AND METHOD FOR PROVIDING INFRARED GESTURE INTERACTION ON A DISPLAY

• US 20140118270A1
• Filed: 02/27/2013
• Published: 05/01/2014
• Est. Priority Date: 10/26/2012
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Moses, Daniel, Kleiman, Robert Mitchell, Aleksic, Milivoje
• Application Number:
  US13/779,201
• Publication Number:
  US 20140118270A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1607 Arrangements to support accessories mechanically attached to the display housing G06F1/1603, G06F1/1605 take precedence
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and apparatus for a touch sensitive display device providing infrared gesture capture and recognition are described. A display device with a detachable front panel is capable of interactive touch sensing and infrared gesture capture and processing. An infrared light source and infrared camera can be configured to capture images of complex multi-touch gestures made on the detachable front panel of the device. The detachable front panel may be removed from the display device for cleaning and ease of use.

Claims

1. A touch-sensitive display device, comprising:

a touchscreen having a front and a back and capable of detecting a user'"'"'s touch;

one or more infrared lights configured to illuminate a user'"'"'s finger placed in front of the touchscreen;

an infrared camera positioned behind the touchscreen and configured to capture infrared images of a user'"'"'s finger through the touchscreen; and

a gesture processing module configured to determine a user'"'"'s touch on the touchscreen and track the position of the user'"'"'s finger, wherein the gesture processing module determines a user'"'"'s gesture from the determined touch and position tracking.

2. The display of claim 1, wherein the touchscreen is mounted on a frame structure.

3. The display of claim 2, wherein the touchscreen comprises a first panel mounted on the frame structure and configured to display information and a second panel detachably secured to the first panel and configured to cover the first panel.

4. The display of claim 3 further comprising at least one pressure sensor coupled to the frame structure and configured to determine a location of a user'"'"'s touch on the second panel.

5. The display of claim 3, wherein the second panel is detachably secured to the first panel by a plurality of magnets.

6. The display of claim 3, wherein the infrared lights are coupled to the frame structure behind the first and second panels and configured to direct light through the first and second panels towards a user of the display.

7. The display of claim 3, wherein the infrared camera is coupled to the frame structure behind the first and second panels.

8. The display of claim 4, wherein the infrared lights are configured to be turned on in response to a touch event on the second panel.

9. A system to capture user gestures on a touch-sensitive display device, comprising:

a touchscreen having a front and back and capable of detecting a user'"'"'s touch, one or more infrared lights configured to illuminate a user'"'"'s finger placed in front of the touchscreen, and an infrared camera positioned behind the touchscreen and configured to capture infrared images of a user'"'"'s finger through the touchscreen;

a control module configured to;

activate a gesture recognition module when a user touches the touchscreen;

capture one or more images of user gestures made on the touchscreen of the touch-sensitive display device;

deactivate the gesture recognition module when a user releases the touchscreen; and

analyze the images of user gestures to perform a corresponding action on the display.

10. The system of claim 9, wherein the touchscreen is mounted on a frame structure.

11. The system of claim 10, wherein the touchscreen comprises a first panel mounted on the frame structure and configured to display information and a second panel detachably secured to the first panel and configured to cover the first panel.

12. The system of claim 9, wherein the control module is further configured to query a memory for a user command associated with the images of the user gestures.

13. The system of claim 12, wherein the control module is further configured to execute the user command via a processor.

14. The system of claim 12, wherein the query for the user command associated with the images of the user gestures is based on an identified gesture pattern.

15. A touch-sensitive display device, comprising:

a touchscreen having a front and a back and capable of detecting a user'"'"'s touch;

means for providing an infrared light when a user touches the touchscreen;

means for capturing one or more images of a user'"'"'s gestures made on the touchscreen of the touch-sensitive display device;

means for deactivating the infrared light and discontinuing capture of images of user gestures when a user releases the touchscreen; and

means for analyzing the images of user gestures to perform a corresponding action on the display.

16. The device of claim 15, wherein the means for capturing one or more images comprises an infrared camera.

17. The device of claim 15, wherein the means for providing infrared light comprises one or more infrared light sources configured to shine light through the touchscreen.

18. A method for inputting data into a touch-sensitive electronic device, the method comprising:

detecting pressure from a user touch on the touch-sensitive device;

activating an infrared light unit when a user touch is detected;

capturing one or more images of a user gestures made on the touch-sensitive display device; and

analyzing the images of user gestures to perform a corresponding action on a display of the touch-sensitive electronic device.

19. The method of claim 18, wherein analyzing the images of user gestures comprises comparing the images to each of a plurality of gesture recognition templates to identify at least one candidate gesture.

20. The method of claim 19 further comprising assigning a confidence factor to each candidate gesture.

21. The method of claim 20, wherein analyzing the gesture comprises selecting a gesture from the at least one candidate gesture having the greatest confidence factor.

22. A non-transitory computer-readable storage medium comprising instructions that when executed by a processor perform a method of inputting data into a touch-sensitive electronic device, the method comprising:

detecting pressure from a user touch on the touch-sensitive device;

activating an infrared light unit when a user touch is detected;

capturing one or more images of a user gestures made on the touch-sensitive display device; and

analyzing the images of user gestures to perform a corresponding action on a display of the touch-sensitive electronic device.

23. The computer-readable storage medium of claim 22, wherein analyzing the images of user gestures comprises comparing the images to each of a plurality of gesture recognition templates to identify at least one candidate gesture.