Data processing in relation to a multi-touch sensing apparatus

• US 9,710,101 B2
• Filed: 10/13/2015
• Issued: 07/18/2017
• Est. Priority Date: 07/01/2010
• Status: Active Grant

• Current Assignee: FlatFrog Laboratories AB
• Original Assignee: FlatFrog Laboratories AB
• Inventors: Wassvik, Ola, Fhraeus, Christer, Christiansson, Tomas
• Primary Examiner(s): Pervan, Michael
• Application Number:
  US14/881,739
• Publication Number:
  US 20160034099A1
• Time in Patent Office: 644 Days
• Field of Search: 178 1801- 1907, 345173-178
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A device obtains a signal representative of objects on a touch surface of a multi-touch sensing apparatus and executes a method for extracting touch data from the signal. The method operates in a sequence of detection frames. Each detection frame comprises the steps of: obtaining (300) the signal; processing (301) the signal for identifying touches; determining (302) a set of identified touches and touch data for the set of identified touches; and outputting (303) the touch data. At least one of the steps of processing (301) and determining (302) includes a prioritization that actively favors certain touches to be identified and included in the set of identified touches, respectively. Temporal prioritization favors a touch that corresponds to a previous touch, which is identified in one or more preceding detection frames. Spatial prioritization favors a touch that is located within at least one predefined subarea on the touch surface. The prioritization enables the touch data to be generated in way that is predictable, consistent and in accordance with user expectations within a general or specific context.

Claims

1. A method for extracting data from a multi-touch sensing apparatus, said method operating in a sequence of detection frames, at least one detection frame among the sequence of detection frames comprising:

obtaining at least one signal representative of objects on a touch surface of the multi-touch sensing apparatus;

processing said at least one signal to identify touches;

determining a set of identified touches and touch data for the set of identified touches; and

outputting the touch data;

wherein each of the detection frames includes a spatial prioritization, the spatial prioritization based on a previous touch, which is identified by the processing performed in one or more preceding detection frames; and

wherein the processing said at least one signal to identify touches includes

comparing a spatial distribution of signal values of the at least one signal with corresponding threshold signal values, using the spatial prioritization to estimate a location of a touch corresponding to the previous touch, and

locally changing the corresponding threshold signal values based on the estimated location.

2. The method of claim 1, wherein the processing operates to promote identification of the touch in said at least one signal.

3. The method of claim 1, wherein the processing further comprises:

identifying a signal feature in said at least one signal based on the estimated location of the touch.

4. The method of claim 3, wherein

the signal feature is a local change in signal values of a projection signal;

and

the signal values correspond to transmitted energy on a plurality of detection lines across the touch surface.

5. The method of claim 3, wherein the signal feature corresponds to a local change in signal values in a distribution of an energy-related parameter within at least part of the touch surface.

6. The method of claim 1, wherein the signal values are included in said at least one signal.

7. The method of claim 1, wherein the signal values are included in a distribution of an energy-related parameter within at least part of the touch surface, said distribution being obtained based on said at least one signal.

8. The method of claim 1, wherein the processing further comprises:

obtaining, based on said at least one signal, a distribution of an energy-related parameter within at least part of the touch surface;

identifying a set of local extrema in the distribution;

sequentially processing the set of local extrema for determining the touch data; and

favoring one or more local extrema in the set of local extrema.

9. The method of claim 1, wherein

the processing further includes identifying a number of touches based on said at least one signal;

and

the determining includes selecting the set of identified touches as a subset of said identified number of touches.

10. The method of claim 9, wherein the set of identified touches is limited to a predefined maximum number of touches.

11. The method claim 9, wherein the processing further comprises:

determining age data for each of the identified touches, the age data representing a number of preceding detection frames in which a touch is deemed to be identified; and

wherein said set of identified touches is selected among the identified number of touches based on the age data.

12. The method of claim 1, further comprising:

sequentially applying different prioritization criteria to determine the set of identified touches.

13. The method of claim 1, further comprising:

accessing a history list including location data and age data of touch traces, wherein

each of the touch traces represents a corresponding previous touch,

the location data for a touch trace among the touch traces represents a most recent location of the corresponding previous touch on the touch surface, and

the age data for the touch trace among the touch traces represents the number of detection frames in which the corresponding previous touch has been identified; and

wherein

the determining determines the set of identified touches based on at least the location data in the history list.

14. The method of claim 13, further comprising:

matching said set of identified touches for a current detection frame to the touch traces in the history list; and

updating the history list based on the matching.

15. A non-transitory computer-readable storage medium comprising computer code which, when executed on a data-processing system, causes the data-processing system to carry out the method of claim 1.

16. The method of claim 1, wherein the spatial prioritization for a detection frame, in the sequence of detection frames, provides spatial information regarding peaks having been identified as touches in one or more previous detection frames in the sequence of detection frames.

17. A device for generating touch data, said device configured to operate in a sequence of detection frames, and said device comprising:

an input; and

one or more processors connected to said input, the one or more processors configured to execute computer-readable instructions such that the one or more processors are configured to in at least one detection frame

obtain, via said input, at least one signal representative of objects on a touch surface of a multi-touch sensing apparatus;

process said at least one signal to identify touches;

determine a set of identified touches and touch data for the set of identified touches; and

output said touch data;

wherein each of the detection frames includes a spatial prioritization, the spatial prioritization based on a previous touch, which is identified by the processing performed in one or more preceding detection frames; and

wherein the one or more processors are configured to execute the computer-readable instructions such that the one or more processors are further configured to process said at least one signal to identify the touches by

comparing a spatial distribution of signal values of the at least one signal with corresponding threshold signal values,

using the spatial prioritization to estimate a location of a touch corresponding to the previous touch, and

locally changing the corresponding threshold signal values based on the estimated location.

18. A multi-touch sensing apparatus, comprising:

a touch surface, a plurality of sensors arranged within and/or around the touch surface and adapted to generate at least one signal representative of objects on the touch surface, and the device of claim 17.

19. The device of claim 17, wherein the spatial prioritization for a detection frame, in the sequence of detection frames, provides spatial information regarding peaks having been identified as touches in one or more previous detection frames in the sequence of detection frames.