Touch sensitive system and method for cognitive and behavioral testing and evaluation

• US 9,717,459 B2
• Filed: 02/27/2014
• Issued: 08/01/2017
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Cogneuro Solutions LLC
• Original Assignee: Anne Bibiana Sereno
• Inventors: Sereno, Anne Bibiana, Patel, Saumil S., Shrestha, Yujan, Red, Stuart Douglass
• Primary Examiner(s): CERIONI, DANIEL LEE
• Application Number:
  US14/192,391
• Publication Number:
  US 20140249447A1
• Time in Patent Office: 1,251 Days
• Field of Search: 600558
• CPC Class Codes: A61B 2560/0487 Special user inputs or interfaces
• CPC Class Codes: A61B 2562/0204 Acoustic sensors
• CPC Class Codes: A61B 5/162 Testing reaction times
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick

Abstract

Portable operatively simple touch screen apparatus uses testing methods and systems that are free of age and language constraints include special signal processing techniques that provide a temporal resolution highly sensitive for probing cognitive function. The embodiments include or make use of one or more modules implemented at least partially in a set of instructions in software and configured to measure user reaction times to visual stimulus on a touch screen device having a capacitive sensor touch-sensitive surface and a detector of audio waves resulting from touch on the touch-sensitive surface. The modules employ recordation of acoustic vibrations resulting from a user'"'"'s touching a target location on the touch screen surface spaced from a touched starting location on that surface, in one embodiment, to measure temporal response to a visual stimulus placed at the target location.

Claims

1. A method of measuring user reaction times to a visual stimulus on a portable touch screen device having a capacitive touch-sensitive surface with a touch reporting mechanism, and one or more modules at least partially implemented in software, said one or more modules being responsive to a user start command to

a) open a time log file on receipt of said start command,

b) generate a visual stimulus at a first location on the touch screen surface for touch by a user,

c) generate at least one second visual stimulus at a second location on the touch screen surface spaced from said first location and write time of generation of the second visual stimulus to a log file signifying such time of generation (Tv),

d) receive notification of capacitance sensed touch and coordinates of such sensed touch and write timer time to a log file (Tc) signifying time of such sensed touch and also write the sensed touch coordinates location to a file,

e) remove the second visual stimulus from the touch screen surface, steps b)-e) comprising a single trial,

f) repeat steps b)-e) until a set of trials signified by a predetermined number of capacitance sensed touches (Tc) of said second location attains a preset number, then cease repeating steps b)-e), and close the log file onto a computer readable medium which may be in said device or in communication with said device, and

g) in a computing device which may be the same as said portable device or another computing device having one or more modules implemented at least partially in software and to which the data from said portable device is transmitted, determine a user reaction time (RT) byopening the log file from step f),

reading the data from the log file corresponding to Tc for each trial,calculating uncorrected response time:

RTuncorrected=Tc−

Tv for each trial,

4) calculating response time corrected for accuracy;

RTaccuracy corrected=RTuncorrected−

Kc, where Kc is an empirically measured constant corresponding to the average latency of the capacitive touch reporting mechanism, and

5) writing the accuracy corrected response time to an output.

3. A method of measuring user reaction times to a visual stimulus on a portable touch screen device having a capacitive touch-sensitive surface with a touch reporting mechanism, and one or more modules at least partially implemented in software, said one or more modules being responsive to a user start command, as claimed in claim 1 further comprising:

1) coincident with step a), commence recording for input signals from an acoustic sensor to an audio file and write a timer time to a log file signifying a time of a start of this monitoring (Ta),

2) in step f), close said audio and log files onto a computer readable medium which may be in said device or in communication with said device upon completion of the set of trials for steps b)-e),

3) in step g, determine a user reaction time by;

1) opening the audio file in addition to the log file from step f),

2) completion of steps

     2)-4) of step q),

3) determining an audio sample from the audio file corresponding to a touch response from a touch sensor (Nc) and convert it to time (Tc+Ka),

4) defining a time window as Tc+Ka−

t1 to Tc+Ka+t2 to search for audio signatures of touch in the audio file for each trial, where t1 and t2 are fixed durations for said device,

5) reading audio samples from the audio file corresponding to a search window defined as N_L to N_U,

6) locating audio samples corresponding to maximum amplitude (Nmax) and converting said maximum amplitude to time (Tmax),

7) calculating Wmax=Tmax−

(Tc−

Ta−

t1),

8) calculating an audio based correction of dt=Wmax−

Mean(Wmax), where Mean(Wmax) is the Wmax averaged across all the trials comprising steps a)-f),

9) calculating a precision corrected response time RTcorrected=RTaccuracycorrected+dt, and

10) writing RTcorrected to an output in addition to writing the accuracy corrected response time to an output in step

     5) of step q.

4. A method comprising one or more modules at least partially implemented in software and configured to measure user reaction times to visual stimulus on a portable touch screen device having a capacitive touch-sensitive surface with a touch reporting mechanism, an acoustic sensor proximal to said surface, said one or more modules being responsive to a user start command, as claimed in claim 1 further comprising measurement chosen from one of the following:

Kc or RTcorrected from signals derived from the acoustic sensor as below;

1) coincident with step a), commence recording for input signals from an acoustic sensor to an audio file and write a timer time to a log file signifying a time of a start of this monitoring (Ta),

2) in step c), convert the at least one second visual stimulus to a vibration using a photo detector and a sound or vibration source proximal to said surface,

3) in step f), close said audio and log files onto a computer readable medium which may be in said device or in communication with said device upon completion of the set of trials for steps b)-e),

4) for each trial, comprising of steps b)-e), calculate the accurate and precise response time RTcorrected, from the audio file, by taking a difference between the onset time of two acoustic sensor signals;

a signal indicating the onset of the at least one second visual stimulus and a signal indicating the onset of a touch response,

5) computing Kc by regressing RTuncorrected from step

     3) of step q) against RTcorrected as below;

a) RTcorrected=RTuncorrected+Kc,

6) storing Kc onto a computer readable medium which may be in said device or in communication with said device for correcting timing of touch responses when not using a light to sound/vibration converter, and

7) writing RTcorrected to an output file as a precise and accurate timing of touch responses when using a light to sound/vibration converter and storing an output file onto a computer readable medium which may be in said device or in communication with said device.

2. A system comprising one or more modules at least partially implemented in software and configured to measure user reaction times to a visual stimulus on a portable touch screen device having a capacitive touch-sensitive surface with a touch reporting mechanism, said one or more modules being responsive to a user start command to:

a) open a time log file on receipt of said start command,

b) generate a visual stimulus at a first location on the touch screen surface for touch by a user,

c) generate at least one second visual stimulus at a second location on the touch screen surface spaced from said first location and write time of generation of the second visual stimulus to a log file signifying such time of generation (Tv),

d) receive notification of capacitance sensed touch and coordinates of such sensed touch and write timer time to a log file (Tc) signifying time of such sensed touch and also write the sensed touch coordinates location to a file,

e) remove the second visual stimulus from the touch screen surface, steps b)-e) comprising a single trial,

f) repeat steps b)-e) until a set of trials signified by a predetermined number of capacitance sensed touches (Tc) of said second location attains a preset number, then cease repeating steps b)-e), and close the log file onto a computer readable medium which may be in said device or in communication with said device, and

g) in a computing device, which may be the same as said portable device or another computing device having one or more modules implemented at least partially in software and to which the data from said portable device is transmitted, determine a user reaction time (RT) by

1) opening the log file from step f),

2) reading the data from the log file corresponding to Tc for each trial,

3) calculating uncorrected response time;

RTuncorrected=Tc−

Tv for each trial,

4) calculating response time corrected for accuracy;

RTaccuracy corrected=RTuncorrected−

Kc where Kc is an empirically measured constant corresponding to the average latency of the capacitive touch reporting mechanism, and

5) writing the accuracy corrected response time to an output.

5. A system of measuring user reaction times to a visual stimulus on a portable touch screen device having a capacitive touch-sensitive surface with a touch reporting mechanism, and one or more modules at least partially implemented in software, said one or more modules being responsive to a user start command, as claimed in claim 2 further comprising:

1) coincident with step a), commence recording for input signals from an acoustic sensor to an audio file and write a timer time to a log file signifying a time of a start of this monitoring (Ta),

2) in step f), close said audio and log files onto a computer readable medium which may be in said device or in communication with said device upon completion of the set of trials for steps b)-e), and

3) in step g, determine a user reaction time by;

1) opening the audio file in addition to the log file from step f),

2) completion of steps g)

     2)-4),

3) determining an audio sample from the audio file corresponding to a touch response from a touch sensor (Nc) and convert it to time (Tc+Ka),

4) defining a time window as Tc+Ka−

t1 to Tc+Ka+t2 to search for audio signatures of touch in the audio file for each trial, where t1 and t2 are fixed durations for said device,

5) reading audio samples from the audio file corresponding to a search window defined as N_L to N_U,

6) locating audio samples corresponding to maximum amplitude (Nmax) and converting said maximum amplitude to time (Tmax),

7) calculating Wmax=Tmax−

(Tc−

Ta−

t1),

8) calculating an audio based correction of dt=Wmax−

Mean(Wmax), where Mean(Wmax) is the Wmax averaged across all the trials comprising steps a)-f),

9) calculating a precision corrected response time RTcorrected=RTaccuracycorrected+dt, and

10) writing RTcorrected to an output in addition to writing the accuracy corrected response time to an output in step g)5).

6. A system comprising one or more modules at least partially implemented in software and configured to measure user reaction times to visual stimulus on a portable touch screen device having a capacitive touch-sensitive surface with a touch reporting mechanism, an acoustic sensor proximal to said surface, said one or more modules being responsive to a user start command, as claimed in claim 2 further comprising measurement chosen from one of the following:

Kc or RTcorrected from signals derived from the acoustic sensor as below;

1) coincident with step a), commence recording for input signals from an acoustic sensor to an audio file and write a timer time to a log file signifying a time of a start of this monitoring (Ta),

2) in step c), instantly convert the at least one second visual stimulus to a vibration using a photo detector and a sound or vibration source proximal to said surface,

3) in step f), close said audio and log files onto a computer readable medium which may be in said device or in communication with said device upon completion of the set of trials for steps b)-e),

4) for each trial, comprising of steps b-e, calculate the accurate and precise response time RTcorrected, from the audio file, by taking a difference between the onset time of two acoustic sensor signals;

the signal indicating an onset of at least one second visual stimulus and second signal indicating the onset of a touch response,

5) computing Kc by regressing RTuncorrected from step

     3) of step g) against RTcorrected as below;

a. RTcorrected=RTuncorrected+Kc,

6) storing Kc onto a computer readable medium which may be in said device or in communication with said device for correcting timing of touch responses when not using the light to sound/vibration converter, and

7) writing RTcorrected to an output file as a precise and accurate timing of touch responses when using a light to sound/vibration convertor and storing an output file onto a computer readable medium which may be in said device or in communication with said device.