Tracking approaching or hovering objects for user-interfaces

• US 9,690,429 B2
• Filed: 03/08/2016
• Issued: 06/27/2017
• Est. Priority Date: 10/23/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Brandt, Jeffrey, Soo, Armstrong, Ku, Bernard
• Primary Examiner(s): Nguyen, Jennifer
• Application Number:
  US15/063,745
• Publication Number:
  US 20160188120A1
• Time in Patent Office: 476 Days
• Field of Search: 345156, 345165, 345166, 345173-179
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/046 by electromagnetic means

Abstract

An architecture is described that can utilize photo-sensors embedded in a substantially transparent layer of a UI display for tracking objects that approach or hover over the UI display. The photo-sensors can be configured to detect light of certain wavelengths (e.g., visible light, infrared light) that are propagated toward the UI display, while ignoring light emanating from the UI display when displaying content. Accordingly, by examining various characteristics of the incoming light such as intensity, the architecture can identify a location of a shadow incident upon the display caused by an approaching or hovering selector object blocking portions of incoming light. Additionally or alternatively, the architecture can identify a location of higher intensity for light emanating from the selector object.

Claims

1. A device, comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising;

determining intensity data indicative of an intensity of electromagnetic radiation that intersects the device, wherein the electromagnetic radiation originates from a source that differs from the device;

determining, as a function of the intensity data, shadow data indicative of a shadow cast by an object on the device; and

determining coordinate data indicative of a coordinate on the device that corresponds to the shadow.

2. The device of claim 1, wherein the determining the shadow data comprises determining shadow size data indicative of a size of the shadow.

3. The device of claim 1, wherein the determining the shadow data comprises determining shadow shape data indicative of a shape of the shadow.

4. The device of claim 1, wherein the operations further comprise determining, as a function of the shadow data, size data indicative of a size of the object or shape data indicative of a shape of the object.

5. The device of claim 1, wherein the operations further comprise determining, as a function of the shadow data, distance data indicative of a distance between the coordinate and the object.

6. The device of claim 1, wherein the electromagnetic radiation is visible light with a wavelength between approximately 300 nanometers and approximately 800 nanometers and the intensity of the visible light is determined to have a lower value at the shadow than at other portions of the device.

7. The device of claim 1, wherein the electromagnetic radiation is infrared light with a wavelength between approximately 800 nanometers and approximately one millimeters and the intensity of the infrared light is determined to have a higher value at the shadow than at other portions of the device.

8. The device of claim 1, wherein the operations further comprise determining angle data indicative of an angle of incident of the electromagnetic radiation with the device.

9. The device of claim 8, wherein the determining the coordinate data further comprises determining the coordinate data indicative of a different coordinate on the device that corresponds to the shadow offset as a function of the angle data.

10. The device of claim 1, wherein the intensity of the electromagnetic radiation represents a measure of time-averaged energy flux of the electromagnetic radiation.

11. The device of claim 1, wherein the intensity of the electromagnetic radiation represents a measure of energy density of the electromagnetic radiation.

12. A non-transitory machine-readable storage medium comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

determining intensity data indicative of an intensity of electromagnetic radiation that is irradiating a user interface portion of a device, wherein the electromagnetic radiation originates from a source that is remote from the user interface portion;

as a function of the intensity data, determining shadow data indicative of a shadow cast by an object on the user interface portion; and

determining coordinate data indicative of a coordinate on the user interface portion that corresponds to the shadow.

13. The non-transitory machine-readable storage medium of claim 12, wherein the operations further comprise:

as a function of the shadow data, determining size data indicative of a size of the object.

14. The non-transitory machine-readable storage medium of claim 12, wherein the operations further comprise:

as a function of the shadow data, determining shape data indicative of a shape of the object.

15. The non-transitory machine-readable storage medium of claim 12, wherein the operations further comprise:

as a function of the shadow data, determining distance data indicative of a distance between the coordinate and the object.

16. The non-transitory machine-readable storage medium of claim 12, wherein the operations further comprise determining angle data indicative of an angle of incident of the electromagnetic radiation with the user interface portion.

17. The non-transitory machine-readable storage medium of claim 16, wherein the coordinate is a first coordinate, and wherein the determining the coordinate data further comprises determining the coordinate data indicative of a second coordinate on the user interface portion that corresponds to the shadow offset as a function of the angle data.

18. A method, comprising:

determining, by a system comprising a processor, intensity data indicative of an intensity of electromagnetic radiation that intersects with a user interface portion of a device, wherein the electromagnetic radiation originates from a source different than the user interface portion;

determining, by the system, shadow data indicative of a shadow cast by an object on the user interface portion based on the intensity data; and

determining, by the system, coordinate data indicative of a coordinate on the user interface portion that corresponds to the shadow.

19. The method of claim 18, further comprising determining, by the system, angle data indicative of an angle of incident of the electromagnetic radiation with the user interface portion.

20. The method of claim 18, wherein the coordinate is a first coordinate, and wherein the determining the coordinate data further comprises determining the coordinate data indicative of a second coordinate on the user interface portion that corresponds to the shadow offset as a function of the angle data.