Audio driver user interface

• US 9,632,586 B2
• Filed: 11/21/2012
• Issued: 04/25/2017
• Est. Priority Date: 11/30/2011
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Shenoy, Ravi, Reponen, Erika, Tammi, Mikko, Rm, Anssi
• Primary Examiner(s): Ton, David
• Application Number:
  US14/361,401
• Publication Number:
  US 20140258864A1
• Time in Patent Office: 1,616 Days
• Field of Search: 381 92, 704275, 715716, 715727, 715728
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

A method for an audio driver user interface comprising: capturing at least two audio signals (1 1, 14, 101); determining a trajectory of an audio source from the at least two audio signals (103); and generating a user interface input dependent on the trajectory of the audio source (105).

Claims

1. A method comprising:

determining at least two audio signals from a sound generated by a moving audio source;

determining a trajectory of the moving audio source from the at least two audio signals; and

generating a user interface input dependent on the trajectory of the moving audio source, wherein generating the user interface input dependent on the trajectory of the moving audio source comprises;

comparing the determined trajectory of the moving audio source with at least one defined gesture trajectory; and

generating the user interface input when the determined trajectory matches with the at least one defined gesture trajectory.

2. The method as claimed in claim 1, wherein the matching the trajectory of the moving audio source comprises at least one of:

detecting the speed of the trajectory of the moving audio source is within a defined gesture speed range; and

detecting the direction of the trajectory of the moving audio source is within a defined gesture direction range.

3. The method as claimed in claim 1, wherein determining the trajectory of the moving audio source from the at least two audio signals comprises:

determining an audio source position dependent on the at least two audio signals for a first time corresponding to a first position of the moving audio source and a succeeding second time corresponding to a second position of the moving audio source; and

determining the trajectory of the moving audio source from the difference in audio source position for the first time and the succeeding second time.

4. The method as claimed in claim 3, wherein determining the audio source position dependent on the at least two audio signals comprises determining a delay maximising the correlation between the at least two audio signals.

5. The method as claimed in claim 1, wherein determining the trajectory of the moving audio source from the at least two audio signals at least one of:

determining a trajectory in one dimension based on at least two audio signals; and

determining a trajectory in two or three dimensions based on at least three audio signals.

6. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus at least to:

determine at least two audio signals from a sound generated by a moving audio source;

determine a trajectory of the moving an audio source from the at least two audio signals; and

generate a user interface input dependent on the trajectory of the moving audio source;

wherein causing the apparatus to generate the user interface input dependent on the trajectory of the moving audio source causes the apparatus to;

compare the determined trajectory of the moving audio source with at least one defined gesture trajectory; and

generate the user interface input when the determined trajectory matches with the at least one defined gesture trajectory.

7. The apparatus as claimed in claim 6, wherein causing the apparatus to determine the trajectory of the moving audio source from the at least two audio signals causes the apparatus to:

determine an audio source position dependent on the at least two audio signals for a first time corresponding to a first position of the moving audio source and a succeeding second time corresponding to a second position of the moving audio source; and

determine the trajectory of the moving audio source from the difference in audio source position for the first time and the succeeding second time.

8. The apparatus as claimed in claim 6, wherein causing the apparatus to determine the trajectory of the moving audio source from the at least two audio signals causes the apparatus to at least one of:

determine a trajectory in one dimension based on at least two audio signals; and

determine a trajectory in two or three dimensions based on at least three audio signals.

9. The apparatus as claimed in claim 6, wherein causing the apparatus to generate the user input dependent on the trajectory of the moving audio source causes the apparatus to at least one of:

generate a ‘

swipe’

dependent on the trajectory of the moving audio source; and

generate a ‘

scroll’

dependent on the trajectory of the moving audio source.

10. The apparatus as claimed in claim 6, wherein the apparatus is configured to determine at least one of:

a speed of the trajectory of the moving audio source is within a defined gesture speed range; and

a direction of the trajectory of the moving audio source is within a defined gesture direction range.

11. The apparatus as claimed in claim 6, wherein the apparatus is caused to determine the at least two audio signals configured to capture at least one acoustic signal by a first microphone to determine a first of the at least two audio signals and capture at least one acoustic signal by a second microphone to determine a second of the at least two audio signals.

12. The apparatus as claimed in claim 11, wherein the apparatus is caused to analyse the audio signals from the microphones so as to determine a direction of the trajectory of the moving audio source.

13. A computer program product embodied in a non-transitory computer memory and comprising instructions the execution of which by a processor results in performing operations that comprise:

determining at least two audio signals from a sound generated by a moving audio source;

determining a trajectory of the moving an audio source from the at least two audio signals; and

generating a user interface input dependent on the trajectory of the moving audio source;

wherein generating the user interface input dependent on the trajectory of the moving audio source comprises;

comparing the determined trajectory of the moving audio source with at least one defined gesture trajectory; and

generating the user interface input when the determined trajectory matches with the at least one defined gesture trajectory.

14. The computer product as claimed in claim 13, wherein the matching the trajectory of the moving audio source comprises at least one of:

detecting the speed of the trajectory of the moving audio source is within a defined gesture speed range; and

detecting the direction of the trajectory of the moving audio source is within a defined gesture direction range.

15. The computer product as claimed in claim 13, wherein determining the trajectory of the moving audio source from the at least two audio signals comprises:

determining an audio source position dependent on the at least two audio signals for a first time and a succeeding second time; and

determining the trajectory of the moving audio source from the difference in audio source position for the first time and the succeeding second time.

16. The computer product as claimed in claim 15, wherein determining the audio source position dependent on the at least two audio signals comprises determining a delay maximising the correlation between the at least two audio signals.

17. The computer product as claimed in claim 13, wherein determining the trajectory of the moving audio source from the at least two audio signals at least one of:

determining a trajectory in one dimension based on at least two audio signals; and

determining a trajectory in two or three dimensions based on at least three audio signals.