Signal processing for touch and hover sensing display device

• US 9,851,829 B2
• Filed: 09/30/2010
• Issued: 12/26/2017
• Est. Priority Date: 08/27/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: King, Brian Michael, Leung, Omar, Puskarich, Paul G., Bernstein, Jeffrey Traer, Mucignat, Andrea, Cieplinski, Avi E., Choudry, Muhammad U., Subramani, Praveen R., Piche, Marc J., Amm, David T., Kerr, Duncan Robert
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): Lu, William
• Application Number:
  US12/895,671
• Publication Number:
  US 20120050181A1
• Time in Patent Office: 2,644 Days
• Field of Search: 345156, 345173-179
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04111 Cross over in capacitive digitiser, i.e. details of structures for connecting electrodes of the sensing pattern where the connections cross each other, e.g. bridge structures comprising an insulating layer, or vias through substrate
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/041662 using alternate mutual and self-capacitive scanning
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes

Abstract

Signal processing for a touch and hover sensing display device is disclosed. A touch and hover sensing display device can include a sensing panel for sensing a touch or hover event, a display for displaying graphical information to select based on the touch or hover event, and a control system for processing a signal indicative of the touch or hover event. The control system can process the signal to determine to which display location a hovering object is pointing according to a profile of the object'"'"'s shape. In addition or alternatively, the control system can process the signal to differentiate between a close small object and a distant large object so as to subsequently perform intended actions of the device based, at least in part, on the object distance and/or area (or size). The display can be positioned at a desirable distance from the panel so as to reduce interference from the display to the panel and avoid adverse effects on the signal.

Claims

1. A touch and hover sensing display device comprising:

a touch and hover sensing panel having multiple sensors configured to detect one or more objects proximate to the panel, wherein the sensing panel is capable of detecting one or more objects touching the panel for a touch event, one or more objects hovering over the panel for a hover event, and objects concurrently touching and hovering over the panel for touch and hover events; and

a touch and hover control system configured to;

process signals indicative of the touch and hover events so as to determine a pointer location on the panel to which one of the proximate objects that is hovering over the panel is pointing, wherein the determined pointer location on the panel changes as a function of a distance at which the one proximate object is hovering over the panel,

in accordance with a determination that the one proximate object points in a first direction, the pointer location shifts in the first direction in response to an increase in the distance at which the one proximate object is hovering over the panel, and

in accordance with a determination that the one proximate object points in a second direction, the pointer location shifts in the second direction in response to an increase in the distance at which the one proximate object is hovering over the panel, the second direction different from the first direction.

2. The device of claim 1, further comprising a display configured to display graphical information to select in response to the touch and hover events, the display being positioned at a distance from the panel so as to reduce interference from the display to the panel and to eliminate a grounding shield between the display and the panel.

3. The device of claim 2, wherein determining an input location of the one proximate object comprises determining that the pointer location of the one proximate object is at the graphical information on the display.

4. The device of claim 2, wherein at least one of an object area or an object distance from the panel is usable for selecting the graphical information on the display.

5. The device of claim 1 incorporated into at least one of a mobile phone, a digital media player, or a computer.

6. The device of claim 1, wherein determining the pointer location comprises:

determining at least one characteristic of the one proximate object hovering over the device;

calculating a centroid of the hovering object based on the determined characteristic;

setting a pointer at the calculated centroid as an initial estimate of the pointer location of the hovering object;

shifting the pointer from the calculated centroid to another portion of the hovering object based on the determined characteristic; and

estimating the pointer location of the hovering object based on the shifted pointer.

7. The device of claim 6, wherein determining the characteristic comprises determining an orientation of the hovering object.

8. The device of claim 7, wherein determining the orientation comprises receiving a user input indicating the orientation.

9. The device of claim 6, wherein determining the characteristic comprises determining a shape of the hovering object.

10. The device of claim 9, wherein determining the shape comprises determining an extended portion of the shape and shifting the pointer from the calculated centroid to another portion of the hovering object based on the determined characteristic comprises shifting the pointer in a direction of the extended portion of the shape.

11. The device of claim 6, wherein determining the characteristic comprises determining a direction of motion of the hovering object.

12. The device of claim 11, wherein determining the direction of motion comprises:

detecting a first location of the hovering object relative to the sensing device at a first time;

detecting a second location of the hovering object relative to the sensing device at a second time; and

comparing the first and second locations to determine the direction of motion.

13. The device of claim 1, further comprising a capture device configured to capture a representation of an object proximate to the panel.

14. The device of claim 13, wherein the control system is further configured to receive captured representations of the proximate objects and to determine the distances of the proximate objects based on the received captured representations.

15. The device of claim 1, further comprising a detector configured to detect an object proximate to the panel.

16. The device of claim 15, wherein the control system is further configured to receive detection signals from the detector for the proximate objects and to determine the distance of the one proximate object based on the received detection signals.

17. The device of claim 2, wherein the distance is about 1 mm.

18. The device of claim 2, wherein the distance exceeds an effective reach of display signals causing the interference.

19. The device of claim 1, wherein the one proximate object is associated with signals detected at a first set of sensors in a first area of the panel, and the determined pointer location is outside of the first area of the panel.