Audio user interaction recognition and application interface

• US 9,746,916 B2
• Filed: 11/12/2012
• Issued: 08/29/2017
• Est. Priority Date: 05/11/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kim, Lae-Hoon, Shin, Jongwon, Visser, Erik
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US13/674,789
• Publication Number:
  US 20130300648A1
• Time in Patent Office: 1,751 Days
• Field of Search: 345156
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G04G 21/00 Input or output devices integrated in time-pieces
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 29/005 Microphone arrays
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Disclosed is an application interface that takes into account the user'"'"'s gaze direction relative to who is speaking in an interactive multi-participant environment where audio-based contextual information and/or visual-based semantic information is being presented. Among these various implementations, two different types of microphone array devices (MADs) may be used. The first type of MAD is a steerable microphone array (a.k.a. a steerable array) which is worn by a user in a known orientation with regard to the user'"'"'s eyes, and wherein multiple users may each wear a steerable array. The second type of MAD is a fixed-location microphone array (a.k.a. a fixed array) which is placed in the same acoustic space as the users (one or more of which are using steerable arrays).

Claims

1. A method for displaying information, the method comprising:

detecting, via a microphone, an ultrasound transmission from a steerable array to determine when a display device is in a gaze direction of a user;

when the display device is in the gaze direction of the user, displaying a first image on the display device; and

when the display device is not in the gaze direction of the user, then displaying a second image on the display.

2. The method of claim 1, wherein the display device comprises a personal display device that is movable into the gaze direction of the user.

3. The method of claim 2, wherein the first image specifically pertains to that which the user is looking at based on the gaze direction.

4. The method of claim 1, wherein the second image is one of a blank display or a non-specific display.

5. The method of claim 1, wherein the gaze direction determination is based upon a horizontal component corresponding to a target and a vertical component corresponding to whether the device is being held up to be viewed.

6. A method for displaying information, the method comprising:

determining a gaze direction of each of a plurality of participants based on a plurality of audio detection components of a fixed array and at least one steerable array;

determining if a display device is in the gaze direction of each of the plurality of participants;

activating the display device to initiate a display presentation when the display device is in the gaze direction of each of the plurality of participants; and

pausing the display presentation when the display device is not in the gaze direction of at least one of the plurality of participants.

7. The method of claim 6, wherein the display presentation includes graphics to accompany an audio presentation by a first participant of the plurality of participants.

8. The method of claim 6, wherein the display presentation comprises an audio-visual presentation, wherein the display presentation is also paused whenever an active speaker is detected, and wherein the display presentation is also muted whenever an active speaker is detected.

9. A method for displaying information on a wearable watch-type display device, the method comprising:

detecting, at a steerable array, an ultrasound emission from the wearable watch-type display device to determine an orientation of the wearable watch-type display device relative to the steerable array; and

sending a signal from the steerable array to the wearable watch-type display device.

10. The method of claim 9, wherein the detecting is performed by an ultrasonic detector of the steerable array.

11. The method of claim 9, further comprising:

displaying a first image on the wearable watch-type display device based on the orientation of the wearable watch-type display device relative to the steerable array; and

displaying a second image on the wearable watch-type display device when the wearable watch-type display device is located outside of a detection range of the steerable array.

12. The method of claim 11, wherein the first image is determined by a gaze direction of a user, and wherein the determination is made utilizing the steerable array and a fixed array.

13. The method of claim 11, wherein a display of the wearable watch-type display device is illuminated if the wearable watch-type display device determines a low-lighting environment.

14. The method of claim 11, wherein the second image is displayed in a low power state to save energy.

15. The method of claim 9, further comprising determining an angle offset of the wearable watch-type display device from a user.

16. A method for displaying information on a wearable watch-type display device, the method comprising:

determining, at a wearable array, when the wearable watch-type display device is in a gaze direction of a user;

receiving, at the wearable watch-type display device, a first image from a mobile device; and

reorienting and redisplaying the first image as a second image on the wearable watch-type display device such that the second image is aligned with the first image on the mobile device.

17. A method for displaying information, the method comprising:

detecting, via a steerable array, an ultrasound transmission from a display device to determine an orientation of the display device relative to a steerable array; and

sending a signal from the steerable array to the display device.

18. The method of claim 17, wherein the orientation of the display device is in a line-of-sight of a user.

19. The method of claim 17, further comprising:

displaying a first image on a display based on the orientation of the display device relative to the steerable array; and

displaying a second image on the display when the display device is located outside of a detection range of the steerable array.

20. The method of claim 17, further comprising detecting, via a microphone, an ultrasound transmission from the steerable array when in a line-of-sight of a user.

21. A system for displaying information, the system comprising a processor configured to:

detect, via a microphone, an ultrasound transmission when a display device is in a gaze direction of a user;

when the display device is in the gaze direction of the user, display a first image on the display device; and

if, when the display device is not in the gaze direction of the user, display a second image on the display.

22. The system of claim 21, wherein the display device comprises a personal display device that is movable into the gaze direction of the user.

23. The system of claim 21, wherein the first image specifically pertains to an item the user is looking at based on the gaze direction.

24. The system of claim 21, wherein the second image is one of a blank display or a non-specific display.

25. The system of claim 21, wherein a gaze direction determination is based on horizontal component corresponding to a target and a vertical component corresponding to whether the display device is being held up to be viewed.

26. The system of claim 21, wherein the display device comprises one of a watch-type device, a bracelet-type device, a necklace-type device, a ring-type device, and an eyeglass-type device.

27. A system for displaying information, the system comprising a processor configured to:

determine a gaze direction of each of a plurality of participants based on a plurality of audio detection components of a fixed array and at least one steerable array;

determine if a display device is in the gaze direction of each of the plurality of participants;

activate the display device to initiate a display presentation when the display device is in the gaze direction of each of the plurality of participants; and

pausing the display presentation when the display device is not in the gaze direction of at least one of the plurality of participants.

28. The system of claim 27, wherein the display presentation comprises graphics to accompany an audio presentation by a first participant of the plurality of participants.

29. The system of claim 27, wherein the display presentation comprises an audio-visual presentation, wherein the display presentation is also paused whenever an active speaker is detected, and wherein the display presentation is also muted whenever an active speaker is detected.

30. The system of claim 27, wherein the display device comprises one of a watch-type device, a bracelet-type device, a necklace-type device, a ring-type device, and an eyeglass-type device.

31. A system for displaying information on a wearable watch-type display device, the system comprising a processor configured to:

detect, at a steerable array, an ultrasound emission from the wearable watch-type display device to determine an orientation of the wearable watch-type display device relative to the steerable array; and

send a signal from steerable array to the wearable watch-type display device.

32. The system of claim 31, wherein the detection of the ultrasound emission is performed by an ultrasonic detector of the steerable array.

33. The system of claim 31, wherein the processor is further configured to:

display a first image on a display based on the orientation of the wearable watch-type display device relative to the steerable array; and

display a second image on the display when the wearable watch-type display device is located outside of a signal detection range of the steerable array.

34. The system of claim 33, wherein the first image is determined by a gaze direction of a user, and wherein the determination is made utilizing at least one of a steerable array and a fixed array.

35. The system of claim 33, wherein a display of the wearable watch-type display device is illuminated if the wearable watch-type display device determines a low-lighting environment.

36. The system of claim 33, wherein the second image is displayed in a low power state to save energy.

37. The system of claim 31, wherein the processor is further configured to determine an angle offset of the wearable watch-type display device from a user.

38. A system for displaying information on a wearable watch-type display device, the system comprising a processor configured to:

determine, at a wearable array, when the wearable watch-type display device is in a gaze direction of a user;

receiving, at the wearable watch-type display device, a first image from a mobile device; and

reorient and redisplay the first image as a second image on the wearable watch-type display device such that the second image is aligned with the first image on the mobile device.

39. A system for displaying information, the system comprising a processor configured to:

detect, via a steerable array or microphone, an ultrasound emission to determine an orientation of a display device relative to the steerable array; and

receive, at the display device, a signal from the steerable array.

40. The system of claim 39, wherein the detection is performed by an ultrasonic detector of the steerable array.

41. The system of claim 39, wherein the receiving is performed by a fixed array coupled to the processor.

42. The system of claim 39, wherein the orientation of the display device is in a line-of-sight of a user.

43. The system of claim 39, wherein the processor is further configured to display a first image on the display based on the orientation of the display device relative to the steerable array.

44. The system of claim 43, wherein the processor is further configured to display a second image on the display when the display device is located outside a detection range of the steerable array.

45. The system of claim 39, wherein the processor is further configured to detect, via a microphone, an ultrasound transmission from the steerable array when the display device is in a line-of-sight of a user.

46. An apparatus for displaying information, the apparatus comprising:

means for detecting an ultrasound transmission to determine when a display device is in a gaze direction of a user;

means for a first image on the display device a first image when the display device is in the gaze direction of the user; and

means for displaying a second image when the display device is not in the gaze direction of the user.

47. The apparatus of claim 46, further comprising means for determining whether the display device comprises a personal display device that is movable into the gaze direction of the user.

48. The apparatus of claim 47, further comprising means for determining whether the first image specifically pertains to an item the user is looking at based on the gaze direction.

49. The apparatus of claim 46, further comprising means for determining whether the second image should be one of a blank display and a non-specific display.

50. The apparatus of claim 46, further comprising

means for determining a gaze direction based on a horizontal component corresponding to a target and a vertical component corresponding to whether the display device is being held up to be viewed.

51. An apparatus for displaying information, the apparatus comprising:

means for determining a gaze direction of each of a plurality of participants based on a plurality of audio detection components of a fixed array and at least one steerable array; and

means for displaying an image.

52. The apparatus of claim 51, further comprising means for determining if the display device is in the gaze direction of each of the plurality of participants.

53. The apparatus of claim 52, further comprising means for activating the display device to complete a display presentation during which the presentation is paused for periods during which the display device is not in the gaze direction of at least one of the plurality of participants and resumed when the display device is in the gaze direction of each of the plurality of participants.

54. The apparatus of claim 53, further comprising means for deactivating the display device once the display presentation is completed.

55. The apparatus of claim 53, further comprising means for determining whether the display presentation comprises graphics to accompany an audio presentation by a first participant of the plurality of participants.

56. The apparatus of claim 53, further comprising means for determining whether the display presentation is an audio/visual presentation, whether the display presentation should be paused whenever an active speaker is detected, and whether the display presentation should be muted whenever an active speaker is detected.

57. An apparatus for displaying information on a wearable display device, the apparatus comprising:

means for detecting an ultrasound emission from the wearable display device in order to determine an orientation of the wearable display device relative to a steerable array; and

means for sending a signal to the wearable display device.

58. The apparatus of claim 57, wherein the wearable display device is a watch-type device.

59. The apparatus of claim 57, wherein the wearable display device is one of a bracelet-type device, a necklace-type device, ring-type device, and an eyeglass-type device.

60. The apparatus of claim 57, further comprising a steerable array that comprises the means for detecting and the means for sending.

61. The apparatus of claim 57, further comprising:

means for displaying a first image on a device based on the orientation of the wearable display device relative to the steerable array; and

means for displaying a second image on the display when the wearable display device is outside a detection range of the steerable array.

62. The apparatus of claim 61, wherein the first image is determined by a gaze direction of a user, and wherein the determination is made utilizing a steerable array and a fixed array.

63. The apparatus of claim 61, further comprising means for detecting a low-lighting environment, and wherein the display is illuminated upon detection of the low-lighting environment.

64. The apparatus of claim 61, further comprising means for determining whether to display the second image in a low power state to save energy.

65. The apparatus of claim 57, further comprising means for determining an angle offset from a user.

66. An apparatus for displaying information on a wearable watch-type display device, the apparatus comprising:

means for determining when the wearable watch-type display device is in a gaze direction of a user;

means for receiving a first image from a mobile device; and

means for reorienting and redisplaying the first image as a second image on the wearable watch-type display device such that the second image is aligned with the first image on the mobile device.

67. An apparatus for displaying information, the apparatus comprising:

means for detecting, via a steerable array, an ultrasound transmission to determine an orientation of a display device relative to the steerable array; and

means for receiving a signal from the steerable array.

68. The apparatus of claim 67, wherein the orientation of the display device is in a line-of-sight of a user.

69. The apparatus of claim 67, further comprising:

means for displaying a first image on the display device based on the orientation of the display device relative to the steerable array; and

means for displaying a second image on the display device when the display device is located outside a detection range of the steerable array.

70. The apparatus of claim 67, further comprising means for detecting, via a microphone, an ultrasound transmission from the steerable array when the orientation of the display device is in a line-of-sight of a user.

71. A wearable watch-type device for displaying information, the wearable watch-type device comprising:

a steerable array, configured to be in communication with a fixed array, for detecting an ultrasound transmission to determine when a display device is in a gaze direction of a user; and

a display for displaying a first image on the display device when the display device is in the gaze direction of the user and for displaying a second image when the display device is not in the gaze direction of the user.

72. The wearable watch-type device of claim 71, wherein the display device comprises a personal display device that is movable into the gaze direction of the user.

73. The wearable watch-type device of claim 72, wherein the first image specifically pertains to an item the user is looking at based on the gaze direction.

74. The wearable watch-type device of claim 71, wherein the second image should be one of a blank display and a non-specific display.

75. The wearable watch-type device of claim 71, further comprising a processor for determining the gaze direction based on a horizontal component corresponding to a target and a vertical component corresponding to whether the display device is being held up to be viewed.

76. A wearable watch-type device comprising a receiver for receiving information pertaining to a system, the system including logic for:

determining a gaze direction of each of a plurality of participants based on a plurality of audio detection components of a fixed array and at least one steerable array;

determining if a display device is in the gaze direction of each of the plurality of participants;

activating the display device to initiate a display presentation when the display device is in the gaze direction of each of the plurality of participants; and

pausing the display presentation when the display device is not in the gaze direction of at least one of the plurality of participants.

77. The wearable watch-type device of claim 76, wherein the display presentation includes graphics to accompany an audio presentation by a first participant of the plurality of participants.

78. The wearable watch-type device of claim 76, wherein the display presentation comprises an audio-visual presentation, wherein the display presentation is also paused whenever an active speaker is detected, and wherein the display presentation is also muted whenever an active speaker is detected.

79. A wearable watch-type device comprising:

a display capable of providing an output to a user;

an ultrasound detector to determine an orientation of the wearable watch-type device relative to a steerable array; and

a receiver for receiving a signal from the detector.

80. The wearable watch-type device of claim 79, further comprising a steerable array comprising the detector.

81. The wearable watch-type device of claim 79, further comprising a display processor capable of displaying a first image on a display based on the orientation of the wearable watch-type device relative to the steerable array and displaying a second image on the display when the wearable watch-type device is outside a detection range of the steerable array.

82. The wearable watch-type device of claim 81, wherein the first image is determined by a gaze direction of a user, and wherein the determination is made utilizing a steerable array and a fixed array.

83. The wearable watch-type device of claim 81, wherein the display is illuminated if the wearable watch-type device determines a low-lighting environment.

84. The wearable watch-type device of claim 81, wherein the second image is displayed in a low power state to save energy.

85. The wearable watch-type device of claim 79, further comprising a microphone capable of enabling the wearable watch-type device to determine an angle offset from the user.

86. A wearable watch-type display device comprising:

means for determining when the wearable watch-type display device is in a gaze direction of a user;

means for receiving a first image from a mobile device; and

means for reorienting and redisplaying the first image as a second image on the wearable watch-type display device such that the second image is aligned with the first image on the mobile device.

87. A wearable watch-type device for displaying information, the wearable watch-type device comprising:

a display;

an ultrasound emitter configured to enable a steerable array to determine an orientation of the wearable watch-type device relative to the steerable array; and

a receiver for receiving a signal from the steerable array.

88. The wearable watch-type device of claim 87, wherein the wearable watch-type device is in a line-of-sight of a user.

89. The wearable watch-type device of claim 87, further comprising a display processor capable of displaying a first image on the display based on the orientation of the wearable watch-type device relative to the steerable array and displaying a second image on the display when the wearable watch-type device is outside a detection range of the steerable array.

90. The wearable watch-type device of claim 87, further comprising a microphone capable of detecting an ultrasound transmission from the steerable array to determine when the wearable watch-type device is in a line-of-sight of a user.

91. A non-transitory computer-readable medium comprising computer-readable instructions for causing a processor of a system to:

detect, at a microphone, an ultrasound transmission to determine when a display device is in a gaze direction of a user; and

when the display device is in the gaze direction of the user, displaying a first image on the display device; and

when the display device is not in the gaze direction of the user, then displaying a second image on the display.

92. The non-transitory computer-readable medium of claim 91, further comprising instructions for causing the processor to determine whether the display device comprises a personal display device that is movable into the gaze direction of the user.

93. The non-transitory computer-readable medium of claim 92, further comprising instructions for causing the processor to display the first image based on the gaze direction.

94. The non-transitory computer-readable medium of claim 91, further comprising instructions for causing the processor to display one of a blank display and a non-specific display based on the gaze direction.

95. The non-transitory computer-readable medium of claim 91, further comprising instructions for causing the processor to determine the gaze direction based on a horizontal component corresponding to a target and a vertical component corresponding to whether the device is being held up to be viewed.

96. A non-transitory computer-readable medium comprising computer-readable instructions for causing a processor of a system to:

determine a gaze direction of each of a plurality of participants based on a plurality of audio detection components of a fixed array and at least one steerable array;

determine if a display device is in the gaze direction of each of the plurality of participants;

activate the display device to initiate a display presentation when the display device is in the gaze direction of each of the plurality of participants; and

pause the display presentation when the display device is not in the gaze direction of at least one of the plurality of participants.

97. The non-transitory computer-readable medium of claim 96, further comprising instructions for causing the processor to display graphics to accompany an audio presentation by a first participant of the plurality of participants.

98. The non-transitory computer-readable medium of claim 96, wherein the display presentation comprises an audio-visual presentation, wherein the display presentation is also paused whenever an active speaker is detected, and wherein the display presentation is also muted whenever an active speaker is detected.

99. A non-transitory computer-readable medium comprising computer-readable instructions for causing a processor of a system to:

detect an ultrasound emission to determine an orientation of a wearable watch-type display device relative to a steerable array; and

send a signal to the wearable watch-type display device.

100. The non-transitory computer-readable medium of claim 99, wherein the detecting and the sending are performed by a steerable array.

101. The non-transitory computer-readable medium of claim 99, further comprising instructions for causing the processor to:

display a first image on a display based on the orientation of the wearable watch-type display device relative to the steerable array; and

display a second image on the display when the wearable watch-type display device is outside a detection range of the steerable array.

102. The non-transitory computer-readable medium of claim 101, further comprising instructions for causing the processor to determine a gaze direction of a user utilizing a steerable array and a fixed array.

103. The non-transitory computer-readable medium of claim 101, further comprising instructions for causing the processor to send the second image to the display while in a low power state to save energy.

104. The non-transitory computer-readable medium of claim 99, further comprising instructions for causing the processor to:

determine a low-lighting environment; and

light a display of the wearable watch-type display device.

105. The non-transitory computer-readable medium of claim 99, further comprising instructions for causing the processor to determine an angle offset of the wearable watch-type display device from a user.

106. A non-transitory computer-readable medium comprising computer-readable instructions for causing a processor of a system to:

determine when a wearable watch-type display device is in a gaze direction of a user;

receive a first image at the wearable watch-type display device from a mobile device; and

reorient and redisplay the first image as a second image on the wearable watch-type display device such that the second image is aligned with the first image on the mobile device.

107. A non-transitory computer-readable medium comprising computer-readable instructions for causing a processor of a system to:

detect an ultrasound emission to determine an orientation of a display device relative to a steerable array; and

receive a signal from the steerable array.

108. The non-transitory computer-readable medium of claim 107, wherein the display device is in a line-of-sight of a user.

109. The non-transitory computer-readable medium of claim 107, further comprising instructions for causing the processor to:

display a first image on a display based on the orientation of the display device relative to the steerable array; and

display a second image on the display when the display device is outside a detection range of the steerable array.

110. The non-transitory computer-readable medium of claim 107, further comprising instructions for causing the processor to detect, via a microphone, an ultrasound transmission from the steerable array when the display device is in a line-of-sight of a user.

111. A system for displaying information, the system comprising a processor configured to:

detect, via a microphone, an ultrasound transmission to determine when a display device is in a gaze direction of a user; and

when the display device is in the gaze direction of the user, display a first image on the display device; and

when the display device is not in the gaze direction of the user, then display a second image on the display.

112. The system of claim 111, wherein the display device comprises a personal display device that is movable into the gaze direction of the user.

113. The system of claim 112, wherein the first image specifically pertains to an item the user is looking at based on the gaze direction.

114. The system of claim 111, wherein the second image corresponds to one of a blank display and a non-specific display.

115. The system of claim 111, wherein the gaze direction is determined based on a horizontal component corresponding to a target and a vertical component corresponding to whether the device is being held up to be viewed.

116. A system for displaying information, the system comprising a processor configured to:

determine a gaze direction of each of a plurality of participants based on one of a plurality of audio detection components of a fixed array and at least one steerable array;

determine if a display device is in the gaze direction of each of the plurality of participants;

activate the display device to initiate a display presentation when the display device is in the gaze direction of each of the plurality of participants; and

pause the display presentation when the display device is not in the gaze direction of at least one of the plurality of participants.

117. The system of claim 116, wherein the display presentation comprises graphics to accompany an audio presentation by a first participant of the plurality of participants.

118. The system of claim 116, wherein the display presentation comprises an audio-visual presentation, wherein the display presentation is also paused whenever an active speaker is detected, and wherein the display presentation is also muted whenever an active speaker is detected.

119. A system for displaying information on a wearable watch-type device, the system comprising a processor configured to:

detect an ultrasound emission from the wearable watch-type device to determine an orientation of the wearable watch-type device relative to a steerable array; and

send a signal to the wearable watch-type device.

120. The system of claim 119, wherein the detection and the sending are performed by a steerable array.

121. The system of claim 119, wherein the processor is further configured to:

display a first image on the wearable watch-type device based on the orientation of the wearable watch-type device relative to the steerable array; and

display a second image on the wearable watch-type device when the wearable watch-type device is outside a detection range of the steerable array.

122. The system of claim 121, wherein the first image is determined by a gaze direction of a user, and wherein the determination is made utilizing a steerable array and a fixed array.

123. The system of claim 121, wherein a display of the wearable watch-type device is an illuminated if the device determines a low-lighting environment.

124. The system of claim 121, wherein the display of the second image is displayed in a low power state to save energy.

125. The system of claim 119, wherein the processor is further configured to determine an angle offset of the wearable watch-type device from a user.

126. A system for displaying information on a wearable watch-type display device, the system comprising a processor configured to:

determine when the wearable watch-type display device is in a gaze direction of a user;

receive a first image from a mobile device; and

reorient and redisplay the first image as a second image on the wearable watch-type display device such that the second image is aligned with the first image on the mobile device.

127. A system for displaying information, the system comprising a processor configured to:

detect, via a steerable array, an ultrasound transmission to determine an orientation of a display device relative to the steerable array; and

receive a signal at the display device from the steerable array.

128. The system of claim 127, wherein the display device is in a line-of-sight of a user.

129. The system of claim 127, wherein the processor is further configured to:

display a first image on a display based on the orientation of the display device relative to the steerable array; and

display a second image on the display when the display device is outside a detection range of the steerable array.

130. The system of claim 127, wherein the processor is further configured to detect, via a microphone, an ultrasound transmission from the steerable array when the display device is in a line-of-sight of a user.