Methods and apparatuses for providing tangible control of sound

• US 9,286,898 B2
• Filed: 12/21/2012
• Issued: 03/15/2016
• Est. Priority Date: 11/14/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Xiang, Pei, Liu, Kexi
• Primary Examiner(s): LEGGETT, ANDREA C.
• Application Number:
  US13/725,973
• Publication Number:
  US 20140136981A1
• Time in Patent Office: 1,180 Days
• Field of Search: 715/728
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10H 2210/301 Soundscape or sound field simulation, reproduction or control for musical purposes, e.g. surround or 3D sound; Granular synthesis
• CPC Class Codes: G10H 2220/096 using a touch screen touch screen note input, e.g. using a displayed keyboard G10H2220/241; personal digital assistant [PDA] G10H2230/015
• CPC Class Codes: G10H 2220/355 Geolocation input, i.e. control of musical parameters based on location or geographic position, e.g. provided by GPS, WiFi network location databases or mobile phone base station position databases
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: H04R 29/002 Loudspeaker arrays
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

Methods and apparatuses for providing tangible control of sound are provided and described as embodied in a system that includes a sound transducer array along with a touch surface-enabled display table. The array may include a group of transducers (multiple speakers and/or microphones) configured to perform spatial processing of signals for the group of transducers so that sound rendering (in configurations where the array includes multiple speakers), or sound pick-up (in configurations where the array includes multiple microphones), have spatial patterns (or sound projection patterns) that are focused in certain directions while reducing disturbances from other directions. Users may directly adjust parameters related to sound projection patterns by interacting with the touch surface while receiving visual feedback by exercising one or more commands on the touch surface. The commands may be adjusted according to visual feedback received from the change of the display on the touch surface.

Claims

1. A method of controlling a sound field, the method comprising:

displaying, on a physical space, a graphical representation of one or more sound projection patterns associated with a sound transducer array, wherein the sound transducer array is in communication with the physical space, and wherein the sound projection patterns comprise a physical wave field;

detecting at least one command directed at the graphical representation of the one or more sound projection patterns via the physical space;

modifying the one or more sound projection patterns of the sound transducer array based on the at least one command; and

updating the graphical representation of the one or more sound projection patterns displayed on the physical space based at least in part on the modified one or more sound projection patterns.

2. The method of claim 1, wherein the displaying of the one or more sound projection patterns comprises generating the graphical representation of the one or more sound projection patterns based on a characteristic of the one or more sound projection patterns.

3. The method of claim 2, wherein the characteristic comprises at least one of a beam width, a direction, an origin, a frequency range, a signal-to-noise ratio, and a type of generator or receiver of the one or more sound projection patterns.

4. The method of claim 2, wherein the graphical representation comprises a scale proportional to the characteristic of the one or more sound projection patterns.

5. The method of claim 4, wherein the scale comprises a one-to-one correspondence with the characteristic of the at least one sound projection pattern.

6. The method claim 1, wherein the graphical representation comprises a color scheme assigned to each of the one or more sound projection patterns.

7. The method of claim 6, wherein the color scheme comprises a mapping of the characteristic to a color space.

8. The method of claim 1, further comprising:

determining a location of the sound transducer array with respect to the physical space; and

generating an origin of the graphical representation based on the location.

9. The method of claim 1, further comprising:

determining an orientation of the sound transducer array relative to the physical space; and

generating an orientation vector as a reference on the graphical representation based on the orientation.

10. The method of claim 1, wherein the sound transducer array comprises a microphone array for capturing sound and the one or more sound projection patterns are associated with sound pickup of the microphone array.

11. The method of claim 1, wherein the sound transducer array comprises multiple microphones.

12. The method of claim 11, wherein the multiple microphones are located in a vehicle.

13. The method of claim 1, wherein the sound transducer array comprises multiple speakers.

14. The method of claim 13, wherein the multiple speakers are located in a vehicle.

15. The method of claim 1, wherein detecting the at least one command comprises:

detecting an interaction of a user with the physical space; and

decoding the interaction to determine a desired operation by the user.

16. The method of claim 15, wherein the desired operation comprises concealing the graphical representation of the one or more sound projection patterns.

17. The method of claim 15, further comprising displaying a user interface on the physical space to allow the user to select the desired operation.

18. The method of claim 15, wherein the desired operation comprises selecting the one or more sound projection patterns for application of a second operation thereto.

19. The method of claim 15, wherein the desired operation comprises creating one or more virtual groupings of the one or more sound projection patterns.

20. The method of claim 19, wherein the graphical representation comprises an illustration of the one or more virtual groupings.

21. The method of claim 20, wherein the illustration comprises one or more virtual layers, wherein each of the one or more virtual groupings corresponds to at least one of the one or more virtual layers.

22. The method of claim 15, further comprising:

decoding a second interaction of the user with the physical space; and

decoding a second desired operation by the user, wherein the second desired operation is applied to the one or more virtual groupings.

23. The method of claim 1, wherein the physical space comprises at least one of a touch-sensing surface, a display screen and a tablet display.

24. The method of claim 1,

wherein the at least one command is a gesture, and

wherein the gesture comprises at least one of multiple tapping, drawing one or more circles around the one or more sound projection patterns and grouping multiple sound projection patterns of the one or more sound projection patterns together for manipulating as a group.

25. A sound transducer array in communication with a physical space, the sound transducer array comprising:

a speaker array;

a microphone array, in communication with the speaker array, for capturing sound;

at least one processor in communication with the microphone array and configured to;

display, on the physical space, a graphical representation of one or more sound projection patterns associated with a sound transducer array, wherein the sound transducer array is in communication with the physical space, and wherein the sound projection patterns comprise a physical wave field;

detect at least one command directed at the graphical representation of the one or more sound projection patterns via the physical space;

modify the one or more sound projection patterns of the sound transducer array based on the at least one command; and

update the graphical representation of the one or more sound projection patterns displayed on the physical space based at least in part on the modified one or more sound projection patterns.

26. The sound transducer array of claim 25, wherein the at least one processor, for the displaying of the one or more sound projection patterns, is further configured to generate the graphical representation of the one or more sound projection patterns based on a characteristic of the one or more sound projection patterns.

27. The sound transducer array of claim 26, wherein the characteristic comprises at least one of a beam width, a direction, an origin, a frequency range, a signal-to-noise ratio, and a type of generator or receiver of the one or more sound projection patterns.

28. The sound transducer array of claim 26, wherein the graphical representation comprises a scale proportional to the characteristic of the one or more sound projection patterns.

29. The sound transducer array of claim 26, wherein the scale comprises a one-to-one correspondence with the characteristic of the at least one sound projection pattern.

30. The sound transducer array claim 26, wherein the graphical representation comprises a color scheme assigned to each of the one or more sound projection patterns.

31. The sound transducer array of claim 30, wherein the color scheme comprises a mapping of the characteristic to a color space.

32. The sound transducer array of claim 25, wherein the at least one processor is further configured to:

determine a location of the sound transducer array with respect to the physical space; and

generate an origin of the graphical representation based on the location.

33. The sound transducer array of claim 25, wherein the at least one processor is further configured to:

determine an orientation of the sound transducer array relative to the physical space; and

generate an orientation vector as a reference on the graphical representation based on the orientation.

34. The sound transducer array of claim 33, wherein the one or more sound projection patterns are associated with sound pickup of the microphone array.

35. The sound transducer array of claim 25, wherein the sound transducer array comprises multiple microphones.

36. The sound transducer array of claim 25, wherein the sound transducer array comprises multiple speakers.

37. The sound transducer array of claim 25, wherein the at least one processor, for detecting the at least one command, is further configured to:

detect an interaction of a user with the physical space; and

decode the interaction to determine a desired operation by the user.

38. The sound transducer array of claim 37, wherein the desired operation comprises concealing the graphical representation of the one or more sound projection patterns.

39. The sound transducer array of claim 37, wherein the at least one processor is further configured to display a user interface on the physical space to allow the user to select the desired operation.

40. The sound transducer array of claim 37, wherein the desired operation comprises selecting the one or more sound projection patterns for application of a second operation thereto.

41. The sound transducer array of claim 37, wherein the desired operation comprises creating one or more virtual groupings of the one or more sound projection patterns.

42. The sound transducer array of claim 41, wherein the graphical representation comprises an illustration of the one or more virtual groupings.

43. The sound transducer array of claim 41, wherein the illustration comprises one or more virtual layers, wherein each of the one or more virtual groupings corresponds to at least one of the one or more virtual layers.

44. The sound transducer array of claim 37, wherein the at least one processor is further configured to:

decode a second interaction of the user with the physical space; and

decode a second desired operation by the user, wherein the second desired operation is applied to the one or more virtual groupings.

45. The sound transducer array of claim 25, wherein the physical space comprises at least one of a touch-sensing surface, a display screen and a tablet display.

46. The sound transducer array of claim 25,

wherein the at least one command is a gesture, and

wherein the gesture comprises at least one of multiple tapping, drawing one or more circles around the one or more sound projection patterns and grouping multiple sound projection patterns of the one or more sound projection patterns together for manipulating as a group.

47. A sound transducer array in communication with a physical space, the sound transducer array comprising:

means for displaying, on a physical space, a graphical representation of one or more sound projection patterns associated with a sound transducer array, wherein the sound transducer array is in communication with the physical space, and wherein the sound projection patterns comprise a physical wave field;

means for detecting at least one command directed at the graphical representation of the one or more sound projection patterns via the physical space;

means for modifying the one or more sound projection patterns of the sound transducer array based on the at least one command; and

means for updating the graphical representation of the one or more sound projection patterns displayed on the physical space based at least in part on the modified one or more sound projection patterns.

48. The sound transducer array of claim 47, wherein the means for displaying comprises means for generating the graphical representation of the one or more sound projection patterns based on a characteristic of the one or more sound projection patterns.

49. The sound transducer array of claim 47, further comprising:

means for determining a location of the sound transducer array with respect to the physical space; and

means for generating an origin of the graphical representation based on the location.

50. The sound transducer array of claim 47, further comprising:

means for determining an orientation of the sound transducer array relative to the physical space; and

means for generating an orientation vector as a reference on the graphical representation based on the orientation.

51. The sound transducer array of claim 47, wherein the sound transducer array comprises multiple microphones.

52. The sound transducer array of claim 47, wherein the sound transducer array comprises multiple speakers.

58. The sound transducer array of claim 47,

wherein the at least one command is a gesture, and

wherein the gesture comprises at least one of multiple tapping, drawing one or more circles around the one or more sound projection patterns and grouping multiple sound projection patterns of the one or more sound projection patterns together for manipulating as a group.

53. The sound transducer array of 47, wherein the means for detecting the at least one command comprises:

means for detecting an interaction of a user with the physical space; and

means for decoding the interaction to determine a desired operation by the user.

54. The sound transducer array of claim 53, wherein the desired operation comprises concealing the graphical representation of the one or more sound projection patterns.

55. The sound transducer array of claim 53, further comprising means for displaying a user interface on the physical space to allow the user to select the desired operation.

56. The sound transducer array of claim 53, wherein the desired operation comprises selecting the one or more sound projection patterns for application of a second operation thereto.

57. The sound transducer array of claim 56, further comprising:

means for decoding a second interaction of the user with the physical space; and

means for decoding a second desired operation by the user, wherein the second desired operation is applied to the one or more virtual groupings.

59. A non-transitory computer readable storage medium comprising one or more instructions for controlling a sound field, which when executed by at least one processor, causes the at least one processor to:

display, on a physical space, a graphical representation of one or more sound projection patterns associated with a sound transducer array, wherein the sound transducer array is in communication with the physical space, and wherein the sound projection patterns comprise a physical wave field;

detect at least one command directed at the graphical representation of the one or more sound projection patterns via the physical space;

modify the one or more sound projection patterns of the sound transducer array based on the at least one command; and

update the graphical representation of the one or more sound projection patterns displayed on the physical space based at least in part on the modified one or more sound projection patterns.

60. The non-transitory computer readable storage medium of claim 59, further comprising one or more instructions which when executed by at least one processor, causes the at least one processor to generate the graphical representation of the one or more sound projection patterns based on a characteristic of the one or more sound projection patterns when displaying of the one or more sound projection patterns.

61. The non-transitory computer readable storage medium of claim 59, further comprising one or more instructions which when executed by at least one processor, causes the at least one processor to:

determine a location of the sound transducer array relative to the physical space; and

generate an origin of the graphical representation based on the location.

62. The non-transitory computer readable storage medium of claim 59, further comprising one or more instructions which when executed by at least one processor, causes the at least one processor to:

determine an orientation of the sound transducer array with respective to the physical space; and

generate an orientation vector as a reference on the graphical representation based on the orientation.

63. The non-transitory computer readable storage medium of claim 59, wherein the sound transducer array comprises multiple microphones.

64. The non-transitory computer readable storage medium of claim 59, wherein the sound transducer array comprises multiple speakers.

65. The non-transitory computer readable storage medium of claim 59, wherein the instructions that cause, when execute, the at least one processor to detect the at least one command further comprises instructions that, when executed cause the at least one processor to:

detect an interaction of a user with the physical space; and

decode the interaction to determine a desired operation by the user.

66. The non-transitory computer readable storage medium of claim 65, wherein the desired operation comprises selecting the one or more sound projection patterns for application of a second operation thereto.

67. The non-transitory computer readable storage medium of claim 66, further comprising one or more instructions which when executed by at least one processor, causes the at least one processor to:

decode a second interaction of the user with the physical space; and

decode a second desired operation by the user, wherein the second desired operation is applied to the one or more virtual groupings.

68. The non-transitory computer readable storage medium of claim 59,

wherein the at least one command is a gesture, and

wherein the gesture comprises at least one of multiple tapping, drawing one or more circles around the one or more sound projection patterns and grouping multiple sound projection patterns of the one or more sound projection patterns together for manipulating as a group.