TOUCH INTERFACE HAVING MICROPHONE TO DETERMINE TOUCH IMPACT STRENGTH

• US 20110084914A1
• Filed: 10/14/2009
• Published: 04/14/2011
• Est. Priority Date: 10/14/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Zalewski, Gary M.
• Granted Patent: US 8,411,050 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

A computing device receives position coordinates of a touch input region upon a user touching the touch input region. The computing device also receives an audio signal from an audio sensor upon the user touching the touch input region. An impact strength of the user'"'"'s touch is determined based on the audio signal. The computing device performs an action that is associated with the determined impact strength.

Claims

1-18. -18. (canceled)

19. A computer implemented method of responding to touch based user input, comprising:

determining position coordinates of a touch input region upon a user touching the touch input region;

receiving an audio signal from a microphone upon the user touching the touch input region;

determining an impact strength of the user'"'"'s touch based on the audio signal; and

generating a command that is associated with the determined impact strength, wherein a host computing device performs an action based on the command.

20. The method of claim 19, wherein a low impact strength is associated with ambient handling of the touch input region and a high impact strength is associated with a deliberate user tap.

21. The method of claim 19, further comprising:

normalizing the audio signal based on the position coordinates.

22. The method of claim 19, further comprising:

calibrating the microphone by performing a plurality of taps on the touch input region, each of the plurality of taps occurring at different position coordinates of the touch input region and having an approximately identical impact strength;

measuring the audio signal for each of the plurality of taps; and

normalizing the measured audio signals for the plurality of taps such that they each have approximately the same reading.

23. The method of claim 19, further comprising:

receiving first position coordinates at a first time when the touch input region is initially touched, the first position coordinates satisfying a first contact threshold;

receiving second position coordinates at a second time after the touch input region is initially touched, the second position coordinates satisfying a second contact threshold;

determining an elapsed time period between the first time and the second time;

when the elapsed time period falls within a first range, performing a first action; and

when the elapsed time period falls within a second range, performing a second action.

24. The method of claim 19, further comprising:

requesting a user to perform one or more soft taps on the touch input region;

measuring audio signals for the one or more soft taps;

requesting the user to perform on or more hard taps on the touch input region;

measuring audio signals for the one or more hard taps; and

setting a threshold that is used to differentiate between the hard taps and the soft taps based on the measured audio signals for the hard taps and the measured audio signals for the soft taps.

25. The method of claim 19, further comprising:

requesting the user to perform one or more non-tap gestures on the touch input region;

measuring the audio signal received during performance of the one or more non-tap gestures; and

setting a threshold to differentiate between deliberate user taps and non-tap gestures.

26. An electronic apparatus, comprising:

a position identifier to identify position coordinates corresponding to a location of a touch input region touched by a user;

an audio analyzer to receive an audio signal generated by an audio sensor when the touch input region is touched by the user and to determine an impact strength of the user'"'"'s touch based on the audio signal; and

a controller to receive the position coordinates from the position identifier and the impact strength from the audio analyzer, and to generate a command that is associated with the determined impact strength, wherein a host computing device to perform an action based on the command.

27. The electronic apparatus of claim 26, further comprising:

at least one of a touchpad or a touchscreen that includes the touch input region, wherein the at least one of the touchpad or the touchscreen to send a position signal to the position identifier when the user touches the touch input region.

28. The electronic apparatus of claim 26, further comprising:

a camera that is configured to perform video tracking within the touch input region, wherein the camera to send a position signal to the position identifier when the user touches the touch input region.

29. The electronic apparatus of claim 26, further comprising:

the audio sensor, wherein the audio sensor is wirelessly connected with at least one of the host computing device or a wireless interface of the electronic apparatus.

30. The electronic apparatus of claim 26, wherein a low impact strength is associated with ambient handling of the touch input region and a high impact strength is associated with a deliberate user tap.

31. The electronic apparatus of claim 26, further comprising:

the position identifier to determine first position coordinates at a first time when the touch input region is initially touched, the first position coordinates satisfying a first contact threshold, to determine second position coordinates at a second time after the touch input region is initially touched, the second position coordinates satisfying a second contact threshold, to determine an elapsed time period between the first time and the second time, to perform a first action when the elapsed time period falls within a first range, and to perform a second action when the elapsed time period falls within a second range.

32. The electronic apparatus of claim 26, further comprising:

a display to display a first request for a user to perform one or more soft taps on the touch input region and to display a second request for the user to perform one or more hard taps on the touch input screen;

the audio analyzer to receive audio signals for the one or more soft taps and for the one or more hard taps, and to set a threshold that is used to differentiate between the hard taps and the soft taps based on the received audio signals for the hard taps and the received audio signals for the soft taps.

33. The electronic apparatus of claim 26, further comprising:

the audio analyzer to receive first audio signals that are known to be caused by non-tap gestures on the touch input region, to receive second audio signals that are known to be caused by deliberate user taps on the touch input region, and to set a threshold to differentiate between deliberate user taps and non-tap gestures.

34. The electronic apparatus of claim 26, wherein the audio analyzer maintains a lookup table that associates a normalization value with each set of position coordinates, the audio analyzer to receive the position coordinates from the position identifier and to modify the received audio signal based on the normalization value associated with the received position coordinates.

35. The electronic apparatus of claim 26, wherein the audio analyzer includes a normalization model that uses as an input the position coordinates and generates as an output an amplification value, the audio analyzer to receive the position coordinates from the position identifier, to determine the amplification value using the model, and to modify the received audio signal based on the amplification value.