System and method for determining user input from occluded objects

• US 10,168,843 B2
• Filed: 05/12/2016
• Issued: 01/01/2019
• Est. Priority Date: 12/09/2010
• Status: Active Grant

• Current Assignee: Synaptics Incorporated
• Original Assignee: Synaptics Incorporated
• Inventors: Worfolk, Patrick, Jordan, Joel
• Primary Examiner(s): Lin, Chun-Nan
• Application Number:
  US15/152,814
• Publication Number:
  US 20160253008A1
• Time in Patent Office: 964 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes

Abstract

Devices and method are provided that facilitate improved input device performance. Specifically, the systems and methods are configured to identify a portion of an image of sensor values as corresponding to at least one sensed object in the sensing region, determine a polygon corresponding to the identified portion of the image, and determine a contact characterization of the at least one sensed object based on the polygon. The determination of a polygon corresponding to a sensed object facilitates improved contact characterization of the sensed object. For example, the determined polygon may be used to determine if the sensed object is actually more than one object. As a second example, the determined polygon may be used to determine the orientation of the sensed object. In addition, determined polygons may be used to more accurately track changes in the position of the sensed object.

Claims

1. A processing system for use with a capacitive input device that senses objects in a sensing region, comprising:

a sensor circuitry configured to operate a plurality of sensor electrodes to acquire resulting signals; and

a determination circuitry configured to;

determine an image of sensor values based on the resulting signals;

identify a portion of the image corresponding to a sensed object in the sensing region;

determine a polygon corresponding to the sensed object by;

identifying a first pixel within the identified portion of the image;

identifying a plurality of pixels that are adjacent to the first pixel but external to the identified portion of the image; and

determine a vertex of the polygon by interpolating based on a sensor value for the first pixel in the image and a plurality of sensor values for the plurality of pixels in the image;

track the sensed object based on the polygon; and

perform a graphical user interface action based on a characteristic of the polygon.

2. The processing system of claim 1, wherein the determination circuitry tracks the sensed object based on the polygon by determining at least one parameter selected from a group consisting of a centroid of the polygon, an area of the polygon, an orientation of the polygon, an eccentricity of the polygon, a width of the polygon, and an edge of the polygon.

3. The processing system of claim 1, wherein the graphical user interface action comprises at least one action selected from a group consisting of cursor movement and menu navigation.

4. The processing system of claim1, wherein the determination circuitry is further configured to track the sensed object after the sensed object has moved partially out of the sensing region.

5. The processing system of claim 4, wherein the determination circuitry tracks the sensed object after the sensed object has moved partially out of the sensing region by calculating a centroid of the polygon or an edge of the polygon before the sensed object has moved partially outside of the sensing region.

6. The processing system of claim 1, further comprising a display circuitry that operates a display of the capacitive input device.

7. The processing system of claim 6, wherein the sensor circuitry and the display circuitry share an electrical component, and the electrical component is utilized for display and sensing with the input device.

8. The processing system of claim 1, wherein:

the plurality of pixels comprises;

a second pixel that shares an edge with the first pixel; and

a third pixel that is diagonal to the first pixel; and

the vertex is not on the edge shared by the first pixel and the second pixel.

9. The processing system of claim 8, wherein the determination circuitry is further configured to:

determine a normalized moment of the polygon based on the vertex; and

determine the characteristic of the polygon based on the normalized moment.

10. The processing system of claim 9, wherein the vertex is outside the identified portion of the image.

11. The processing system of claim 8, wherein the determination circuitry is further configured to:

determine a convexity of the polygon based on the vertex; and

determine the identified portion of the image corresponds to only one sensed object based on the convexity.

12. The processing system of claim 11, wherein determining the convexity of the polygon comprises:

determining a plurality of vectors based on adjacent vertices of the polygon;

calculating a plurality of cross-products based on the plurality of vectors; and

determining there is no change in sign among the plurality of cross-products.

13. The processing system of claim 11, wherein determining the convexity of the polygon comprises:

determining a first area of the polygon;

determining a second area of the convex hull of the polygon; and

determining a ratio of between the first area and the second area.

14. An input device comprising:

a plurality of capacitive sensor electrodes configured to sense in a sensing region;

a sensor circuitry configured to operate the plurality of sensor electrodes;

a display; and

a processing system coupled to the plurality of capacitive sensor electrodes, the processing system configured to;

determine an image of sensor values based on resulting signals acquired by the plurality of capacitive sensor electrodes;

identify a portion of the image corresponding to a sensed object in the sensing region;

determine a polygon corresponding to the sensed object by;

identifying a first pixel within the identified portion of the image;

identifying a plurality of pixels that are adjacent to the first pixel but external to the identified portion of the image; and

determine a vertex of the polygon by interpolating based on a sensor value for the first pixel in the image and a plurality of sensor values for the plurality of pixels in the image;

track the sensed object based on the polygon; and

perform a graphical user interface action based on a characteristic of the polygon.

15. The input device of claim 14, wherein the processing system tracks the sensed object based on the polygon by determining an edge of the polygon.

16. The input device of claim 14, wherein the processing system is further configured to track the sensed object after the sensed object has moved partially out of the sensing region.

17. The input device of claim 16, wherein the processing system is further configured to track the sensed object after the sensed object has moved partially out of the sensing region by calculating a centroid or edge of the polygon before the sensed object has moved partially outside of the sensing region.

18. A non-transitory computer readable medium (CRM) storing instructions for performing graphical user interface actions in response to sensing objects in a sensing region, the instructions comprising functionality to:

determine an image of sensor values based on resulting signals acquired by a plurality of capacitive sensor electrodes;

identify a portion of the image corresponding to a sensed object in the sensing region;

determine a polygon corresponding to the sensed object by;

identifying a first pixel within the identified portion of the image;

identifying a plurality of pixels that are adjacent to the first pixel but external to the identified portion of the image; and

determine a vertex of the polygon by interpolating based on a sensor value for the first pixel in the image and a plurality of senor values for the plurality of pixels in the image;

track the sensed object based on the polygon; and

perform a graphical user interface action based on a characteristic of the polygon.

19. The non-transitory CRM of claim 18, wherein the instructions further comprise functionality to track the sensed object based on the polygon by determining at least one parameter selected from a group consisting of an edge of the polygon and a centroid of the polygon.

20. The non-transitory CRM of claim 18, wherein the instructions further comprise functionality to:

track the sensed object after the sensed object has moved partially out of the sensing region by calculating a centroid or edge of the polygon before the sensed object has moved partially outside of the sensing region.