Tracking approaching or hovering objects for user-interfaces

• US 9,310,935 B2
• Filed: 02/13/2015
• Issued: 04/12/2016
• Est. Priority Date: 10/23/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Soo, Armstrong, Ku, Bernard, Brandt, Jeffrey
• Primary Examiner(s): Nguyen, Kimnhung
• Application Number:
  US14/621,740
• Publication Number:
  US 20150160753A1
• Time in Patent Office: 424 Days
• Field of Search: 345173-179, 345/165, 345/166, 178 1801- 1804
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/046 by electromagnetic means

Abstract

An architecture is described that can utilize photo-sensors embedded in a substantially transparent layer of a UI display for tracking objects that approach or hover over the UI display. The photo-sensors can be configured to detect light of certain wavelengths (e.g., visible light, infrared light) that are propagated toward the UI display, while ignoring light emanating from the UI display when displaying content. Accordingly, by examining various characteristics of the incoming light such as intensity, the architecture can identify a location of a shadow incident upon the display caused by an approaching or hovering selector object blocking portions of incoming light. Additionally or alternatively, the architecture can identify a location of higher intensity for light emanating from the selector object.

Claims

1. A device, comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising;

determining angle data representative of an angle by which electromagnetic radiation intersects the device, wherein the electromagnetic radiation originates from a source that is remote from the device;

determining, based on the angle data, location data representative of a location of an object proximal to the device; and

translating the location data to coordinate data representing a first coordinate on a device user interface that corresponds to the location of the object.

2. The device of claim 1, wherein the operations further comprise determining intensity data representing an intensity of the electromagnetic radiation.

3. The device of claim 2, wherein the operations further comprise determining, based on the intensity data, shadow data representing a set of characteristics of a shadow, caused by the object, on the device user interface.

4. The device of claim 3, wherein the determining the shadow data comprises determining shadow size data representing a size of the shadow.

5. The device of claim 3, wherein the determining the shadow data comprises determining shadow coordinate data representing a second coordinate on the device user interface that corresponds to a determined central location of the shadow.

6. The device of claim 5, wherein the determining the location data is based on the angle data and the shadow data.

7. The device of claim 6, wherein the translating the location data to coordinate data comprises determining the first coordinate based on an offset of the second coordinate associated with the shadow, and wherein the offset is determined based on the angle data.

8. The device of claim 1, wherein the device further comprises a display device that presents information and a photosensing device comprising a set of photosensors that sense the electromagnetic radiation.

9. The device of claim 1, wherein the device user interface receives input to control the device.

10. The device of claim 1, wherein the device user interface presents output determined by the device.

11. A computer readable storage device comprising executable instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

determining angle data representative of an angle by which electromagnetic radiation intersects a user interface, wherein the electromagnetic radiation originates from a source that is remote from the user interface;

determining location data representing a location of an object in proximity to the user interface based on the angle data; and

mapping the location data to coordinate data representing a first coordinate on the user interface that corresponds to the location of the object.

12. The computer readable storage device of claim 11, wherein the operations further comprise determining intensity data representative of an intensity of the electromagnetic radiation at the user interface.

13. The computer readable storage device of claim 12, wherein the operations further comprise determining shadow coordinate data representing a second coordinate on the user interface that corresponds to a determined location representative of a shadow of the object one the user interface.

14. The computer readable storage device of claim 13, wherein the determining the location data is based on the angle data and the shadow coordinate data.

15. The computer readable storage device of claim 14, wherein the mapping the location data to coordinate data comprises determining the first coordinate based on an offset of the second coordinate, and wherein the offset is determined based on the angle data.

16. A method, comprising:

determining, by a system comprising a processor, angle data representing an angle by which electromagnetic radiation originating from a source remote from a user interface device intersects the user interface device;

determining, by the system, location data representing a location of an object relative to the user interface device based on the angle data; and

translating, by the system, the location data to coordinate data representing a first coordinate on the user interface device that maps to the location of the object.

17. The method of claim 16, further comprising determining, by the system, intensity data representing an intensity of the electromagnetic radiation at the user interface device.

18. The method of claim 17, further comprising determining, by the system, shadow coordinate data representing a second coordinate on the user interface device that corresponds to a determined location representative of a salient portion of a shadow of the object on the user interface device.

19. The method of claim 18, wherein the determining the location data is based on the angle data and the shadow coordinate data.

20. The method of claim 19, wherein the translating the location data to coordinate data comprises determining the first coordinate based on an offset of the second coordinate, and wherein the offset is determined based on the angle data.