Systems and methods for mapping a source location

• US 9,857,451 B2
• Filed: 03/15/2013
• Issued: 01/02/2018
• Est. Priority Date: 04/13/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kim, Lae-Hoon, Visser, Erik, Ton, Phuong Lam, Toman, Jeremy Patrick, Shaw, Jeffrey Clinton
• Primary Examiner(s): Toatley, Gregory J
• Assistant Examiner(s): STIFTER JR, TERENCE E
• Application Number:
  US13/833,867
• Publication Number:
  US 20130275077A1
• Time in Patent Office: 1,754 Days
• Field of Search: 702141
• CPC Class Codes: G01B 21/00 Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/876 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S15/872 takes precedence
• CPC Class Codes: G01S 3/80 using ultrasonic, sonic or infrasonic waves
• CPC Class Codes: G01S 3/8006 Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G01S 5/186 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G06F 1/1633 Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

A method for mapping a source location by an electronic device is described. The method includes obtaining sensor data. The method also includes mapping a source location to electronic device coordinates based on the sensor data. The method further includes mapping the source location from electronic device coordinates to physical coordinates. The method additionally includes performing an operation based on a mapping.

Claims

1. A method for mapping a source location by an electronic device, comprising:

obtaining sensor data that comprises an audio signal for a voice call, wherein the audio signal originates from a source location;

mapping the source location of the audio signal for the voice call to electronic device coordinates based on the sensor data;

mapping the source location from the electronic device coordinates to physical coordinates;

discriminating, within a first 180 degree span relative to a first microphone pair configuration, the source location of the audio signal; and

performing an operation based on a mapping, wherein performing the operation comprises switching to a second microphone pair configuration to discriminate within a second 180 degree span relative to a second microphone pair configuration and displaying a view of a multi-view visualization of the source location by providing at least one of multiple views based on an electronic device orientation.

2. The method of claim 1, further comprising mapping the source location from the physical coordinates into a three-dimensional display space.

3. The method of claim 1, further comprising maintaining a source orientation in a three-dimensional display space regardless of the electronic device orientation.

4. The method of claim 1, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

5. The method of claim 1, wherein the sensor data is obtained from a plurality of microphones and one or more of an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

6. The method of claim 1, further comprising determining the electronic device orientation based on the sensor data.

7. The method of claim 1, further comprising detecting any change in the electronic device orientation based on the sensor data.

8. The method of claim 1, further comprising detecting whether there is a difference between the electronic device orientation and a reference orientation.

9. The method of claim 1, wherein switching to the second microphone pair configuration increases a spatial resolution of the source location in the physical coordinates.

10. The method of claim 1, wherein performing an operation comprises tracking a source in three dimensions based on the mapping.

11. The method of claim 10, wherein the electronic device comprises three microphones and discriminates audio signals in 360 degrees in three dimensions.

12. The method of claim 10, further comprising projecting the source location into a two-dimensional space.

13. The method of claim 12, further comprising switching to tracking in two dimensions in the two-dimensional space.

14. The method of claim 1, wherein performing an operation comprises performing non-stationary noise suppression independent of the electronic device orientation.

15. The method of claim 1, wherein the electronic device comprises three microphones and is capable of discriminating audio signals in 360 degrees in a two-dimensional plane.

16. The method of claim 1, wherein the electronic device is capable of discriminating audio signals in 180 degrees for each of the first microphone pair configuration and the second microphone pair configuration.

51. The method of claim 1, wherein performing the operation comprises interpolating the multi-view visualization between holding patterns.

52. The method of claim 16, wherein the electronic device is capable of discriminating audio signals in 180 degrees in a two-dimensional plane for each of the first microphone pair configuration and the second microphone pair configuration.

17. An electronic device for mapping a source location by an electronic device, comprising:

at least one sensor configured to obtain sensor data that comprises an audio signal for a voice call, wherein the audio signal originates from a source location;

mapper circuitry coupled to the at least one sensor, wherein the mapper circuitry is configured to map the source location of the audio signal for the voice call to electronic device coordinates based on the sensor data and to map the source location from the electronic device coordinates to physical coordinates; and

operation circuitry coupled to the mapper circuitry, wherein the operation circuitry is configured to discriminate, within a first 180 degree span relative to a first microphone pair configuration, the source location of the audio signal, to switch to a second microphone pair configuration to discriminate within a second 180 degree span relative to a second microphone pair configuration, and to display a view of a multi-view visualization of the source location by providing at least one of multiple views based on an electronic device orientation.

18. The electronic device of claim 17, wherein the operation circuitry is configured to map the source location from the physical coordinates into a three-dimensional display space.

19. The electronic device of claim 17, wherein the operation circuitry is configured to maintain a source orientation in a three-dimensional display space regardless of the electronic device orientation.

20. The electronic device of claim 17, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

21. The electronic device of claim 17, wherein the sensor data is obtained from a plurality of microphones and one or more of an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

22. The electronic device of claim 17, wherein the mapper circuitry determines the electronic device orientation based on the sensor data.

23. The electronic device of claim 17, wherein the mapper circuitry detects any change in the electronic device orientation based on the sensor data.

24. The electronic device of claim 17, wherein the operation circuitry detects whether there is a difference between the electronic device orientation and a reference orientation.

25. The electronic device of claim 17, wherein switching to the second microphone pair configuration increases a spatial resolution of the source location in the physical coordinates.

26. The electronic device of claim 17, wherein the operation circuitry is configured to maintain tracking a source in three dimensions based on the mapping.

27. The electronic device of claim 26, wherein the electronic device comprises three microphones and is capable of discriminating audio signals in 360 degrees in three dimensions.

28. The electronic device of claim 26, wherein the operation circuitry projects the source location into a two-dimensional space.

29. The electronic device of claim 28, wherein the operation circuitry switches to tracking in two dimensions in the two-dimensional space.

30. The electronic device of claim 17, wherein the operation circuitry is configured to perform non-stationary noise suppression independent of the electronic device orientation.

31. The electronic device of claim 17, wherein the electronic device comprises three microphones and is capable of discriminating audio signals in 360 degrees in a two-dimensional plane.

32. The electronic device of claim 17, wherein the electronic device is capable of discriminating audio signals in 180 degrees for each of the first microphone pair configuration and the second microphone pair configuration.

53. The electronic device of claim 17, wherein the operation circuitry is configured to interpolate the multi-view visualization between holding patterns.

54. The electronic device of claim 32, wherein the electronic device is capable of discriminating audio signals in 180 degrees in a two-dimensional plane for each of the first microphone pair configuration and the second microphone pair configuration.

33. A computer-program product for mapping a source location, comprising a non-transitory tangible computer-readable medium having instructions thereon, the instructions comprising:

code for causing an electronic device to obtain sensor data that comprises an audio signal for a voice call, wherein the audio signal originates from a source location;

code for causing the electronic device to map the source location of the audio signal for the voice call to electronic device coordinates based on the sensor data;

code for causing the electronic device to map the source location from the electronic device coordinates to physical coordinates;

code for causing the electronic device to discriminate, within a first 180 degree span relative to a first microphone pair configuration, the source location of the audio signal; and

code for causing the electronic device to perform an operation based on a mapping, comprising code for causing the electronic device to switch to a second microphone pair configuration to discriminate within a second 180 degree span relative to a second microphone pair configuration and code for causing the electronic device to display a view of a multi-view visualization of the source location by providing at least one of multiple views based on an electronic device orientation.

34. The computer-program product of claim 33, further comprising code for causing the electronic device to map the source location from the physical coordinates into a three-dimensional display space.

35. The computer-program product of claim 33, further comprising code for causing the electronic device to maintain a source orientation in a three-dimensional display space regardless of the electronic device orientation.

36. The computer-program product of claim 33, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

37. The computer-program product of claim 33, wherein the sensor data is obtained from a plurality of microphones and one or more of an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

38. The computer-program product of claim 33, wherein the instructions further comprise code for causing the electronic device to determine the electronic device orientation based on the sensor data.

39. The computer-program product of claim 33, wherein the instructions further comprise code for causing the electronic device to detect any change in the electronic device orientation based on the sensor data.

40. The computer-program product of claim 33, wherein the instructions further comprise code for causing the electronic device to detect whether there is a difference between the electronic device orientation and a reference orientation.

41. The computer-program product of claim 33, wherein switching to the second microphone pair configuration increases a spatial resolution of the source location in the physical coordinates.

42. An apparatus for mapping a source location, comprising:

means for obtaining sensor data that comprises an audio signal for a voice call, wherein the audio signal originates from a source location;

means for mapping the source location of the audio signal for the voice call to electronic device coordinates based on the sensor data;

means for mapping the source location from the electronic device coordinates to physical coordinates;

means for discriminating, within a first 180 degree span relative to a first microphone pair configuration, the source location of the audio signal; and

means for performing an operation based on a mapping, comprising means for switching to a second microphone pair configuration to discriminate within a second 180 degree span relative to a second microphone pair configuration and means for displaying a view of a multi-view visualization of the source location by providing at least one of multiple views based on an electronic device orientation.

43. The apparatus of claim 42, further comprising means for mapping the source location from the physical coordinates into a three-dimensional display space.

44. The apparatus of claim 42, further comprising means for maintaining a source orientation in a three-dimensional display space regardless of the electronic device orientation.

45. The apparatus of claim 42, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

46. The apparatus of claim 42, wherein the sensor data is obtained from a plurality of microphones and one or more of an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

47. The apparatus of claim 42, further comprising means for determining the electronic device orientation based on the sensor data.

48. The apparatus of claim 42, further comprising means for detecting any change in the electronic device orientation based on the sensor data.

49. The apparatus of claim 42, further comprising means for detecting whether there is a difference between the electronic device orientation and a reference orientation.

50. The apparatus of claim 42, wherein switching to the second microphone pair configuration increases a spatial resolution of the source location in the physical coordinates.