Method for locating an impact on a surface and device therefor

• US 20050212777A1
• Filed: 12/28/2004
• Published: 09/29/2005
• Est. Priority Date: 06/12/2002
• Status: Active Grant

• Current Assignee: Elo Touch Solutions, Inc., Universite Paris - Sud
• Original Assignee: Sensitive Object
• Inventors: Fink, Mathias, Ing, Ros Kiri, Quieffin, Nicolas, Catheline, Stefan
• Granted Patent: US 7,511,711 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0433 in which the acoustic waves are either generated by a movable member and propagated within a surface layer or propagated within a surface layer and captured by a movable member

Abstract

Apparatus and methods for locating an impact point on a surface of an object. The object is provided with an acoustic sensor that senses the impact from the acoustic waves that are generated when the object is subjected to the impact. The location of the impact on the surface of the object is determined by a recognition step that includes a comparison of the sensed signal to one or more predetermined signals. Each predetermined signal represents an active zone on the surface of the object. A predetermined signal corresponds to the sensed signal when the impact causing the sensed signal is generated in the active zone represented by the predetermined signal. The impact is associated with the active zone represented by a predetermined signal when the sensed signal and the predetermined signal sufficiently correspond to each other.

Claims

1. A computer program product for use in conjunction with a computer system, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising:

instructions for measuring at least one sensed signal from one or more acoustic waves generated by an impact on a surface of an object forming an acoustic interface, the surface provide with at least one acoustic sensor;

instructions for localizing a position of said impact on said surface by processing of said at least one sensed signal, the processing characterized by a comparison of a sensed signal in the at least one sensed signal with at least one predetermined signal in a plurality of predetermined signals, wherein

each respective predetermined signal in said plurality of predetermined signals corresponds to an active zone in a plurality of active zones on said surface, and

each respective predetermined signal in said plurality of predetermined signals represents a signal that is sensed when a reference impact is generated on the active zone in said plurality of active zones that corresponds to the respective predetermined signal, and wherein,

the position of the impact is associated with an active zone in said plurality of active zones by said localizing when the sensed signal is sufficiently similar to said predetermined signal corresponding to the active zone.

2. The computer program product of claim 1 wherein said instructions for localizing comprise instructions for comparing the sensed signal with said plurality of predetermined signals, each respective predetermined signal in said plurality of predetermined signals corresponding to a signal sensed when an impact is generated on a corresponding one of said active zones in said plurality of active zones.

3. The computer program product of claim 1, wherein

said at least one acoustic sensor comprises a plurality of acoustic sensors;

said at least one sensed signal comprises a plurality of sensed signals, wherein each sensed signal in said plurality of sensed signals is detected by a different acoustic sensor in said plurality of acoustic sensors; and

said instructions for localizing comprise comparing, using a first comparison technique, a first sensed signal in the plurality of sensed signals with one or more predetermined signals in said plurality of predetermined signals that were measured using the same acoustic sensor that sensed said first sensed signal, wherein said comparing of said first sensed signal is performed independent of all other comparisons of sensed signals.

4. The computer program product of claim 3, wherein said instructions for localizing further comprise comparing, using a second comparison technique, a second sensed signal in the at least one sensed signals with one or more predetermined signals in said plurality of predetermined signals that were measured using the same acoustic sensor that sensed said second sensed signal, wherein said first comparison technique and said second comparison technique are different from one another.

5. The computer program product of claim 1, wherein said at least one acoustic sensor comprises a plurality of acoustic sensors that sense said at least one sensed signal at several different magnitudes.

6. The computer program product of claim 1 wherein said at least one acoustic sensor consists of one acoustic sensor or two acoustic sensors.

7. The computer program product of claim 1 wherein said at least one acoustic sensor consists of a single acoustic sensor.

8. The computer program product of claim 1, the computer program mechanism further comprising instructions for experimentally determining a predetermined signal in said plurality of predetermined signals by receiving a measurement of an acoustic wave caused by at least one impact in an active zone on the surface of said object, wherein said active zone corresponds to the predetermined signal.

9. The computer program product of claim 1, the computer program mechanism further comprising instructions for experimentally determining a predetermined signal in said plurality of predetermined signals by receiving a measurement of an acoustic wave caused by at least one impact in an active zone on a surface of a reference object that is identical to or very similar to said object, wherein said active zone corresponds to the predetermined signal.

10. The computer program product of claim 1, wherein said comparison of said at least one sensed signal with said at least one predetermined signal comprises comparison by intercorrelation.

11. The computer program product of claim 1 wherein said comparison of said sensed signal with said at least one predetermined signal comprises comparison by voice recognition, signal recognition, shape recognition or recognition by a neural network.

12. The computer program product of claim 1, wherein said position of said impact is associated with either (i) a unique active zone in said plurality of active zones or (ii) no active zone in said plurality of active zones.

13. The computer program product of claim 1, wherein each active zone in said plurality of active zones corresponds to a predetermined information element and, when the position of the impact is associated with an active zone, an electronic device is made to use the predetermined information element corresponding to the active zone.

14. The computer program product of claim 1, wherein the surface of the object forming an acoustic interface comprises a plurality of active zones and the instructions for localizing comprise:

instructions for performing a respective intercorrelation between the sensed signal S(t) and each said predetermined signal R_i(t) in said at least one predetermined signals, wherein i is a natural integer between 1 and n and wherein i designates an active zone in said plurality of active zones, thereby obtaining one or more respective intercorrelation functions Ci(t);

instructions for determining a potentially activated active zone j corresponding to an intercorrelation function Cj (t), in the one or more respective intercorrelation functions Ci(t), wherein the intercorrelation function Cj(t) has a maximum amplitude greater than those of the other intercorrelation functions Ci(t);

instructions for determining the distribution D(i) of the amplitude maxima of the intercorrelation functions wherein;

D(i)=Max(Ci(t));

instructions for determining the distribution D′

(i) of the amplitude maxima of the intercorrelation function C′

i(t) between (i) the predetermined signal corresponding to the potentially activated zone, Rj(t), and (ii) each respective predetermined signal Ri(t) wherein;

D′

(i)=Max(C′

i(t));

instructions for computing an intercorrelation between D′

(i) and D(i); and

instructions for determining whether the impact was generated on the active zone j as a function of a level of correlation between the distributions D(i) and D′

(i) computed by said intercorrelation between D′

(i) and D(i).

15. The computer program product of claim 1, the computer program mechanism further comprising:

instructions for extracting data from a sensed signal in said at least one sensed signal representative of a sensed characteristic of the sensed signal; and

instructions for extracting data from a predetermined signal in said plurality of predetermined signals representative of a reference characteristic of the predetermined signal;

wherein

said comparison of the sensed signal with the least at one predetermined signals comprises comparing the sensed characteristic to the reference characteristic.

16. The computer program product of claim 15 wherein said sensed characteristic is formulated as a first code and wherein said comparison of the sensed signal with the at least one predetermined signals comprises comparing the first code with a table of codes, wherein each code in said table of codes represents data from a predetermined signal corresponding to an active zone in said plurality of active zones.

17. The computer program product of claim 1, wherein the object forming an acoustic interface comprises a plurality of active zones and wherein said instructions for localizing comprise:

instructions for determining a plurality of resemblance values, each resemblance value representative of a resemblance between the sensed signal and a predetermined signal in said plurality of predetermined signals;

instructions for associating the position of the impact (I) with a plurality of adjacent active zones as a function of said plurality of resemblance values; and

instructions for identifying the position of the impact (I) on the surface based on a function of the resemblance values attributed to the plurality of adjacent active zones associated with said impact.

18. The computer program product of claim 17, wherein said instructions for identifying the position of the impact (I) on the surface based on said function comprises correlating the resemblance values corresponding to the plurality of adjacent active zones to one or more theoretical resemblance values computed for said plurality of adjacent active zones for an impact generated in said position on the surface.

20. The computer program product of claim 1 wherein said comparison of the sensed signal with at least one predetermined signal in the plurality of predetermined signals comprises comparing a phase of a predetermined signal in the plurality of predetermined signals with a phase of the sensed signal.

21. The computer program product of claim 20, the computer program mechanism further comprising:

instructions for computing a Fourier transform R_i(ω

)=|R_i(ω

)|•

e<sup>j φ

i(ω

)</sup> of a predetermined signal in the plurality of predetermined signals that corresponds to an active zone i in said plurality of active zones;

instructions for computing a Fourier transform S(ω

)=|S(ω

)|•

e<sup>j φ

(ω

)</sup> of a sensed signal in the at least one sensed signals;

wherein

said comparison of the sensed signal in the at least one sensed signal with said at least one predetermined signal in the plurality of predetermined signals comprises comparing;

S′

(ω

) to R′

₁(ω

)

wherein,

S′

(ω

) is a phase component of the Fourier transform of the sensed signal for those frequency bands ω

in which the amplitude |S(ω

)| is greater than a predetermined threshold; and

R′

₁(ω

) is a phase component of the Fourier transform of the predetermined signal for those frequency bands ω

in which the amplitude |R_i(ω

)| is greater than a predetermined threshold.

22. The computer program product of claim 21, wherein the predetermined threshold is equal to the maximum of MAX/D and |B(ω

)|, where;

MAX is a maximal value of the amplitude |R_i(ω

)|, a maximal value of amplitude |R_i(ω

)| normalized in energy, or a maximal value of an envelope of an average of amplitude |R_i(ω

)| normalized in energy,

D is a constant, and

|B(ω

)| is an average of a plurality of noise spectra in the object forming an acoustic interface, acquired at different times.

23. The computer program product of claim 21, the computer program mechanism further comprising:

instructions for computing, for each active zone i in the plurality of active zones,

Pi(ω

)=S′

(ω

) multiplied by the conjugate of R′

(ω

);

instructions for normalizing, for each active zone i in the plurality of active zones, Pi(ω

);

instructions for obtaining a plurality of temporal functions, each temporal function X_i(t) in said plurality of temporal functions corresponding to an active zone i in the plurality of active zones, wherein Xi(t) for a respective active zone i is an inverse Fourier transform of the product Pi(ω

) for the respective active zone; and

instructions for attributing the signal S(t) to an active zone in the plurality of active zones as a function of said temporal functions.

24. The computer program product of claim 23, wherein the signal S(t) is attributed to the active zone corresponding to a temporal function having a maximum value that is greater than the maximum value of any other temporal function in said plurality of temporal functions.

25. The computer program product of claim 3, the computer program mechanism comprising instructions for repeating said localizing for each respective sensed signal in the plurality of sensed signals.

26. The computer program product of claim 13 wherein the predetermined information element is a command, a digit, a letter, or a position on said surface.

19. The computer program product of 18 wherein a theoretical resemblance value in said one or more theoretical resemblance values is a function of the position of the impact on the surface wherein said function is determined prior to said localizing for said plurality of adjacent active zones.

27. A computer program product for use in conjunction with a computer system, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising:

instructions for measuring a sensed signal caused by an impact on a surface of an object, wherein said surface is delineated into a plurality of active zones;

instructions for comparing said sensed signal with a library of predetermined signals, each predetermined signal in said library of predetermined signals corresponding to an active zone in said plurality of active zones;

wherein

when a correspondence between said sensed signal and a respective predetermined signal in said plurality of sensed signals is sufficiently similar, a location of said impact is deemed to be in an active zone corresponding to said respective predetermined signal.

28. The computer program product of claim 27 wherein said instructions for comparing comprise intercorrelating said sensed signal with a predetermined signal in said library of predetermined signals.

29. The computer program product of claim 27 wherein said sensed signal is normalized prior to execution of said instructions for comparing.

30. The computer program product of claim 27, the computer program mechanism further comprising:

instructions for converting said sensed signal to a sensed code representative of said sensed signal and wherein

said library of signals comprises a plurality of predetermined codes, each predetermined code representing a different signal in said plurality of predetermined signals; and

wherein

said instructions for comparing comprise comparing said sensed code with a predetermined code in said plurality of predetermined codes.

31. The computer program product of claim 30, wherein said sensed code is a 16-bit code wherein

(a) the first eight bits of said 16-bit code are determined by a frequency spectrum of the sensed signal that is subdivided into eight predetermined frequency tranches [f_k, f_k+1], wherein k=1 . . . 8 and wherein the bit of rank k is equal to

1 when a final energy value given by the spectrum at frequency f_k+1 is greater than an average energy value of an acoustic wave in the frequency tranches [f_k, f_k+1] and

0 when a final energy value given by the spectrum at frequency f_k+1 is not greater than the average energy value of the acoustic wave in the frequency tranches [f_k, f_k+1];

and wherein

(b) the last eight bits of the code are determined from the sensed signal when it is subdivided into nine predetermined temporal tranches [t_k, t_k+1], wherein k=1 . . . 9 and wherein the bit of rank k+8 is equal to

1 when an average value of a signal power during the period [t_k, t_k+1] is greater than an average value of the signal power during the period [t_k+1, t_k+2], k=1 . . . 8,

0 when an average value of a signal power during the period [t_k, t_k+1] is not greater than an average value of the signal power during the period [t_k+1, t_k+2], k=1 . . . 8.

32. A computer comprising:

a measurement module comprising instructions for receiving a measurement of a sensed signal, the sensed signal representative of an acoustic wave generated by an impact on a surface of an object, wherein said surface is delineated into a plurality of active zones; and

a comparison module comprising instructions for comparing said sensed signal to a predetermined signal in a library of predetermined signals;

wherein, when said sensed signal is substantially similar to said predetermined signal, a location of the impact on said surface is deemed to be in an active zone corresponding to the predetermined signal.

33. The computer of claim 32, the computer further comprising:

a training module comprising instructions for building said library of predetermined signals;

each predetermined signal in said library of predetermined signals representing an acoustic wave measured from an active zone in said plurality of active zones.

34. The computer of claim 32 wherein said an acoustic wave is in a frequency range between 0 kilohertz (kHz) and 20 kHz.

35. The computer of claim 32 wherein the measurement model and the comparison module are embodied in one or more digital signal processors and wherein the one or more digital signal processors are an integral part of said object.

36. The computer of claim 32 wherein said instructions for comparing said sensed signal with said predetermined signal comprise intercorrelating said sensed signal with said predetermined signal.

37. The computer of claim 32 wherein said measurement of said sensed signal has a duration between 5 milliseconds and 100 milliseconds.

38. The computer of claim 32 wherein said sensed signal has a signal to noise ratio of 6 decibels or greater.

39. The computer of claim 32 wherein said predetermined signal has a signal to noise ratio of 20 decibels or greater.

40. The computer of claim 32, wherein the measurement module further comprises instructions for normalizing said sensed signal for energy in a time dimension.

41. The computer of claim 32, wherein the measurement module further comprises instructions for normalizing said sensed signal for energy in a frequency dimension.

42. The computer of claim 32, wherein the measurement module further comprises instructions for correcting said sensed signal for linear temporal dilation or contraction as a function of a temperature of said object at a time when said acoustic wave was generated.

43. The computer of claim 32, wherein said plurality of active zones comprises between 5 and 100 active zones.

44. The computer of claim 32, wherein said plurality of active zones comprises more than 200 active zones.

45. The computer of claim 32, wherein said plurality of active zones comprises less than 1000 active zones.

46. A system comprising:

an object having a surface forming an acoustic interface, wherein said surface is delineated into a plurality of active zones;

at least one acoustic sensor in communication with said surface such that one or more acoustic waves generated by an impact on said surface can be detected by said at least one acoustic sensor; and

a processor comprising;

instructions for receiving one or more measurements by said at least one acoustic sensor, said one or more measurements comprising a sensed signal from said one or more acoustic waves generated by said impact on said surface; and

instructions for comparing said sensed signal to a predetermined signal in a library of predetermined signals;

wherein, when said sensed signal is substantially similar to said predetermined signal, a location of the impact on said surface is deemed to be in an active zone corresponding to the predetermined signal.

47. The system of claim 46, wherein the processor is an integral component of said object.

48. The system of claim 46, wherein said object is a pane, a door, a window, a portable tray, a computer screen, a display panel, an interactive terminal, a toy, a vehicle dashboard, a rear of a front seat back of an automobile vehicle, a rear of an airplane seat, a wall, a floor, or a vehicle fender.

49. The system of claim 46, wherein an acoustic sensor in said at least one acoustic sensor is a piezoelectric sensor, a capacitive sensor, a magnetostrictive sensor, an electromagenetic sensor, an acoustic velocimeter, a micro-electro-mechanical system (MEMS), or an optical sensor.

50. The system of claim 46, wherein said one or more acoustic waves comprise a longitudinal wave, a shear wave, a surface wave, a plate wave, or an anti-symmetric Lamb wave.