SYSTEMS AND METHODS FOR MAPPING A SOURCE LOCATION

• US 20130275077A1
• Filed: 03/15/2013
• Published: 10/17/2013
• Est. Priority Date: 04/13/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kim, Lae-Hoon, Visser, Erik, Toman, Jeremy P., Ton, Phuong L., Shaw, Jeffrey C.
• Granted Patent: US 9,857,451 B2
• Time in Patent Office: Days
• US Class Current: 702/141
• CPC Class Codes: G01B 21/00 Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/876 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S15/872 takes precedence
• CPC Class Codes: G01S 3/80 using ultrasonic, sonic or infrasonic waves
• CPC Class Codes: G01S 3/8006 Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G01S 5/186 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G06F 1/1633 Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

A method for mapping a source location by an electronic device is described. The method includes obtaining sensor data. The method also includes mapping a source location to electronic device coordinates based on the sensor data. The method further includes mapping the source location from electronic device coordinates to physical coordinates. The method additionally includes performing an operation based on a mapping.

Claims

1. A method for mapping a source location by an electronic device, comprising:

obtaining sensor data;

mapping a source location to electronic device coordinates based on the sensor data;

mapping the source location from the electronic device coordinates to physical coordinates; and

performing an operation based on a mapping.

2. The method of claim 1, wherein performing the operation comprises mapping the source location from the physical coordinates into a three-dimensional display space.

3. The method of claim 1, wherein performing the operation comprises maintaining a source orientation in a three-dimensional display space regardless of a device orientation.

4. The method of claim 1, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

5. The method of claim 1, wherein the sensor data is obtained from at least one of a group consisting of one or more microphones, an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

6. The method of claim 1, further comprising determining an electronic device orientation based on the sensor data.

7. The method of claim 1, further comprising detecting any change in an electronic device orientation based on the sensor data.

8. The method of claim 1, further comprising detecting whether there is a difference between an electronic device orientation and a reference orientation.

9. The method of claim 1, wherein performing an operation comprises switching to an electronic device microphone configuration that maximizes a spatial resolution of a source in the physical coordinates.

10. The method of claim 1, wherein performing an operation comprises tracking a source in three dimensions based on the mapping.

11. The method of claim 10, wherein the source location corresponds to an audio source.

12. The method of claim 10, further comprising projecting the source location into a two-dimensional space.

13. The method of claim 12, further comprising switching to tracking in two dimensions in the two-dimensional space.

14. The method of claim 1, wherein performing an operation comprises performing non-stationary noise suppression independent of an electronic device orientation.

15. The method of claim 1, wherein the electronic device comprises three microphones and is capable of discriminating audio signals in 360 degrees.

16. The method of claim 1, wherein the electronic device comprises two microphones and is capable of discriminating audio signals in 180 degrees.

17. An electronic device for mapping a source location by an electronic device, comprising:

at least one sensor that obtains sensor data;

mapper circuitry coupled to the at least one sensor, wherein the mapper circuitry maps a source location to electronic device coordinates based on the sensor data and maps the source location from the electronic device coordinates to physical coordinates; and

operation circuitry coupled to the mapper circuitry, wherein the operation circuitry performs an operation based on a mapping.

18. The electronic device of claim 17, wherein performing the operation comprises mapping the source location from the physical coordinates into a three-dimensional display space.

19. The electronic device of claim 17, wherein performing the operation comprises maintaining a source orientation in a three-dimensional display space regardless of a device orientation.

20. The electronic device of claim 17, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

21. The electronic device of claim 17, wherein the sensor data is obtained from at least one of a group consisting of one or more microphones, an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

22. The electronic device of claim 17, wherein the mapper circuitry determines an electronic device orientation based on the sensor data.

23. The electronic device of claim 17, wherein the mapper circuitry detects any change in an electronic device orientation based on the sensor data.

24. The electronic device of claim 17, wherein the operation circuitry detects whether there is a difference between an electronic device orientation and a reference orientation.

25. The electronic device of claim 17, wherein performing an operation comprises switching to an electronic device microphone configuration that maximizes a spatial resolution of a source in the physical coordinates.

26. The electronic device of claim 17, wherein performing an operation comprises tracking a source in three dimensions based on the mapping.

27. The electronic device of claim 26, wherein the source location corresponds to an audio source.

28. The electronic device of claim 26, wherein the operation circuitry projects the source location into a two-dimensional space.

29. The electronic device of claim 28, wherein the operation circuitry switches to tracking in two dimensions in the two-dimensional space.

30. The electronic device of claim 17, wherein performing an operation comprises performing non-stationary noise suppression independent of an electronic device orientation.

31. The electronic device of claim 17, wherein the electronic device comprises three microphones and is capable of discriminating audio signals in 360 degrees.

32. The electronic device of claim 17, wherein the electronic device comprises two microphones and is capable of discriminating audio signals in 180 degrees.

33. A computer-program product for mapping a source location, comprising a non-transitory tangible computer-readable medium having instructions thereon, the instructions comprising:

code for causing an electronic device to obtain sensor data;

code for causing the electronic device to map a source location to electronic device coordinates based on the sensor data;

code for causing the electronic device to map the source location from the electronic device coordinates to physical coordinates; and

code for causing the electronic device to perform an operation based on a mapping.

34. The computer-program product of claim 33, wherein performing the operation comprises mapping the source location from the physical coordinates into a three-dimensional display space.

35. The computer-program product of claim 33, wherein performing the operation comprises maintaining a source orientation in a three-dimensional display space regardless of a device orientation.

36. The computer-program product of claim 33, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

37. The computer-program product of claim 33, wherein the sensor data is obtained from at least one of a group consisting of one or more microphones, an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

38. The computer-program product of claim 33, wherein the instructions further comprise code for causing the electronic device to determine an electronic device orientation based on the sensor data.

39. The computer-program product of claim 33, wherein the instructions further comprise code for causing the electronic device to detect any change in an electronic device orientation based on the sensor data.

40. The computer-program product of claim 33, wherein the instructions further comprise code for causing the electronic device to detect whether there is a difference between an electronic device orientation and a reference orientation.

41. The computer-program product of claim 33, wherein performing an operation comprises switching to an electronic device microphone configuration that maximizes a spatial resolution of a source in the physical coordinates.

42. An apparatus for mapping a source location, comprising:

means for obtaining sensor data;

means for mapping a source location to electronic device coordinates based on the sensor data;

means for mapping the source location from the electronic device coordinates to physical coordinates; and

means for performing an operation based on a mapping.

43. The apparatus of claim 42, wherein performing the operation comprises mapping the source location from the physical coordinates into a three-dimensional display space.

44. The apparatus of claim 42, wherein performing the operation comprises maintaining a source orientation in a three-dimensional display space regardless of a device orientation.

45. The apparatus of claim 42, wherein the physical coordinates comprise a two-dimensional plane corresponding to earth coordinates.

46. The apparatus of claim 42, wherein the sensor data is obtained from at least one of a group consisting of one or more microphones, an accelerometer, a gyroscope, a compass, an infrared sensor, a proximity sensor, a camera, a global positioning system receiver and an ultrasound sensor.

47. The apparatus of claim 42, further comprising means for determining an electronic device orientation based on the sensor data.

48. The apparatus of claim 42, further comprising means for detecting any change in an electronic device orientation based on the sensor data.

49. The apparatus of claim 42, further comprising means for detecting whether there is a difference between an electronic device orientation and a reference orientation.

50. The apparatus of claim 42, wherein performing an operation comprises switching to an electronic device microphone configuration that maximizes a spatial resolution of a source in the physical coordinates.