Methods And Systems For Optical Detection Of Gestures

• US 20100225588A1
• Filed: 01/21/2010
• Published: 09/09/2010
• Est. Priority Date: 01/21/2009
• Status: Abandoned Application

• Current Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Devine, Nigel, Newton, John David
• Application Number:
  US12/691,088
• Publication Number:
  US 20100225588A1
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A position detection system can comprise a display device, an input device, and an optical assembly positioned adjacent to the display device. The optical assembly can comprise an image sensor configured to detect light in a space between the display device and the input device. One or both of the imaging assembly and the input device can be configured to direct energy into the space between the display device and the input device, with directing energy comprising reflecting energy and/or emitting energy. A processing device can be configured to use the imaging sensor to determine when an object is in the space and/or to determine motion of the object.

Claims

1. A position detection system, comprising:

a display device;

an input device; and

an optical assembly positioned adjacent to the display device, the optical assembly comprising an image sensor configured to detect light in a space between the display device and the input device,

wherein at least one of the imaging assembly and the input device is configured to direct energy into the space between the display device and the input device.

2. The system set forth in claim 1, further comprising:

a processing device, the processing device configured to use the imaging sensor to determine when an object is in the field of view based on detecting interference with light in the space between the display device and the input device.

3. The system set forth in claim 2, wherein the processing device is configured to identify a position of the object based on a reduction of energy reflected from the input device.

4. The system set forth in claim 3, wherein the processing device is interfaced to a computing system, the computing system configured to identify an input gesture based on tracking the position of the object over a time interval.

5. The system set forth in claim 1, wherein a retro-reflective member is included in an input device positioned in the field of view and the optical assembly comprises an energy emitter.

6. The system set forth in claim 5, wherein the input device comprises a keyboard.

7. The system set forth in claim 6, wherein the retro-reflective member comprises a retro-reflective material embedded in a surface of a plurality of keys of the keyboard.

8. The system set forth in claim 6, wherein the retro-reflective member comprises a retro-reflective material positioned below keys of the keyboard and visible at least through gaps between the keys.

9. The system set forth in claim 6, wherein the retro-reflective member comprises a retro-reflective material positioned below keys of the keyboard, the keys of the keyboard comprising a material that is at least partially transparent at a wavelength of energy emitted from the imaging assembly.

10. The system set forth in claim 6, wherein the keyboard comprises an energy emitter configured to emit energy into the space between the keyboard and the display device.

11. The system set forth in claim 1, wherein the display and retro-reflective member are comprised in a notebook computer, the imaging assembly mounted to the display and the retro-reflective member comprised in a keyboard of the notebook computer.

12. A position tracking method, comprising:

using an emitter positioned adjacent an imaging sensor, emitting light across a space and toward a retro-reflective member, the retro-reflective member comprised in or near an input device of a computing system;

detecting, using the imaging sensor, light reflected back toward the sensor by the retro-reflective member; and

determining at least one of a position of an object in the space or movement of the object in the space based on interference by the object with at least one of light emitted toward the retro-reflective member or reflected back toward the sensor.

13. The method set forth in claim 12, wherein determining a position of the object is based on a reduction in light detected using the imaging sensor due to interruption of light reflected back toward the sensor by the object.

14. The method set forth in claim 12, further comprising:

identifying a gesture based on determining the position of the object over a time interval.

15. The method set forth in claim 12, wherein the emitter and imaging sensor are positioned on a display device of a computing system configured to determine the position of the object.

16. The method set forth in claim 15, wherein the retro-reflective member comprises retro-reflective material included in a keyboard of the computing system.

17. The method set forth in claim 12, wherein the light comprises infrared light.

18. A storage medium embodying program code executable by a computing device, the program code comprising:

program code that configures the computing device to read data from an imaging sensor;

program code that configures the computing device to determine, based on the data, a level of reflected light detected from a retro-reflective member; and

program code that configures the computing device to identify, based on the level of reflected light, if an object has interfered with the light and, if, so, a position of the object.

19. The storage medium set forth in claim 18, further comprising:

program code that configures the computing device to drive a light source to emit light across a space towards the retro-reflective member.

20. The storage medium set forth in claim 18, wherein the program code that configures the computing device to identify the position of the object configures the computing device to determine a position of at least two objects.