DIRECTIONAL AWARENESS AUDIO COMMUNICATIONS SYSTEM

• US 20200137509A1
• Filed: 10/16/2019
• Published: 04/30/2020
• Est. Priority Date: 10/24/2018
• Status: Active Grant

• Current Assignee: Otto Engineering, Inc.,
• Original Assignee: Otto Engineering, Inc.,
• Inventors: Stanek, Daniel F., Knych, Bernard L.
• Granted Patent: US 11,019,450 B2
• Time in Patent Office: Days
• CPC Class Codes: G08B 7/06 using electric transmission , e.g. involving audible and visible signalling through the use of sound and light sources
• CPC Class Codes: H04R 1/403 loud-speakers
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 2499/13 Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04R 29/002 Loudspeaker arrays
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2400/13 Aspects of volume control, not necessarily automatic, in stereophonic sound systems
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Various embodiments include a directional awareness audio communication system and method. The system may include remote speaker/transmitting device(s) and listener/receiving device(s). The speaker/transmitting device(s) may send real-time location information with audio or separate from the audio to the listener/receiving device(s). The listener/receiving device(s) use the speaker/transmitting device(s) location information relative to the listener/receiving device location and orientation to perform audio processing on the transmitted audio signal. The listener/receiving device(s) provide the processed audio signal in stereo (i.e., at least two speakers such as left and right headphones, vehicle speakers, control center speakers, surround sound speakers, etc.) to a user of the listener/receiving device. The listener/receiving device(s) provides a warning and outputs standard audio if the real-time location information of the speaker/transmitting device(s) is unavailable or unreliable. In various embodiments, the listener device provides haptic and/or visual feedback of the speaker device location with respect to the listener device location.

Claims

1. A directional awareness audio communications system comprising:

a communications device receiver comprising;

a location identification device integrated with or communicatively coupled to the communications device receiver, the location identification device configured to provide receiver location data and receiver orientation data of the communications device receiver;

a location data processor configured to;

receive the receiver location data and the receiver orientation data from the location identification device;

determine whether a transmitter location data signal identifying a remote location of a communications device transmitter has been received;

provide a warning when the transmitter location data signal has not been received; and

compute, when the transmitter location data signal has been received, a directional vector between the communications device transmitter and the communications device receiver based on the transmitter location data signal, the receiver location data, and the receiver orientation data;

an audio processor configured to;

receive a transmitter audio signal from the communications device transmitter; and

operate in an enhanced audio mode when the transmitter location data signal has been received by the location data processor or in a standard audio mode when the transmitter location data signal has not been received by the location data processor,

wherein the audio processor is configured to process the transmitter audio signal based on the directional vector to convert the transmitter audio signal to a directionally-enhanced audio signal when operating in the enhanced audio mode,

wherein the audio processor is configured to provide one of a standard mono audio signal or a standard stereo signal when operating in the standard audio mode; and

at least one speaker integrated with or communicatively coupled to the communications device receiver, the at least one speaker configured to output the directionally-enhanced audio signal, the standard mono audio signal, or the standard stereo signal provided by the audio processor.

2. The directional awareness audio communications system of claim 1, wherein the warning provided by the location data processor is one or more of an audio signal output by the at least one speaker, a visual warning presented at a display device, and a physical warning provided by a haptic device.

3. The directional awareness audio communications system of claim 1, wherein:

the at least one speaker is a plurality of speakers, and

the audio processor is configured to apply head-related transfer function (HRTF) filters to convert the transmitter audio signal to the directionally-enhanced audio signal when operating in the enhanced audio mode.

4. The directional awareness audio communications system of claim 1, wherein:

the at least one speaker is a plurality of speakers, and

the audio processor is configured to apply volume sound processing algorithms to adjust a volume of one or more of the plurality of speakers to provide the directionally-enhanced audio signal when operating in the enhanced audio mode.

5. The directional awareness audio communications system of claim 1, wherein:

the at least one speaker is a plurality of speakers, and

the audio processor is configured to provide a spatially-positioned audible sound with the transmitter audio signal to generate the directionally-enhanced audio signal when operating in the enhanced audio mode.

6. The directional awareness audio communications system of claim 1, comprising a demultiplexer configured to receive a composite signal from the communications device transmitter, the demultiplexer configured to separate the composite signal into the transmitter audio signal provided to the audio processor and the transmitter location data signal provided to the location data processor.

7. The directional awareness audio communications system of claim 1, wherein the communications device receiver separately receives the transmitter audio signal and the transmitter location data signal.

8. The directional awareness audio communications system of claim 1, comprising:

the communications device transmitter comprising;

at least one microphone configured to generate the transmitter audio signal;

a transmitter location identification device integrated with or communicatively coupled to the communications device transmitter, the transmitter location identification device configured to provide transmitter location data of the communications device transmitter; and

a transmitter location data processor configured to receive and format the transmitter location data to generate the transmitter location data signal,

wherein the transmitter audio signal and the transmitter location data signal are either;

transmitted separately from the communications device transmitter to the communications device receiver, or

multiplexed to form a composite signal that is transmitted from the communications device transmitter to the communications device receiver.

9. The directional awareness audio communications system of claim 1, comprising a user-worn device communicatively coupled to the communications device receiver, the user-worn device comprising:

a plurality of haptic sensors configured to pulse in response to a drive signal received during output of the directionally-enhanced audio signal by the at least one speaker; and

at least one processor configured to generate and provide the drive signal to at least one of the plurality of haptic sensors based on the directional vector computed by the location data processor.

10. The directional awareness audio communications system of claim 9, wherein the user-worn device is one or more of:

a headband,

headphones,

ear buds,

eyeglasses, and

a body-worn device.

11. The directional awareness audio communications system of claim 1, comprising a display device communicatively coupled to the communications device receiver, the display device comprising a display screen configured to present a visual indicator based on the directional vector computed by the location data processor, the visual indicator presented during output of the directionally-enhanced audio signal by the at least one speaker,

wherein the visual indicator identifies one or more of:

a direction of the communications device transmitter from the communications device receiver;

a distance of the communications device transmitter from the communications device receiver; and

an identifier corresponding to the communications device transmitter.

12. The directional awareness audio communications system of claim 1, wherein the display device is one or more of:

a head-worn device,

a hand-held device,

a body-worn device, and

a vehicle-mounted device.

13. A method comprising:

providing, by a location identification device integrated with or communicatively coupled to the communications device receiver, receiver location data and receiver orientation data of the communications device receiver;

receiving, by a location data processor of the communications device receiver, the receiver location data and the receiver orientation data from the location identification device;

determining, by the location data processor, whether a transmitter location data signal identifying a remote location of a communications device transmitter has been received;

providing, by the location data processor, a warning when the transmitter location data signal has not been received;

computing, by the location data processor, a directional vector between the communications device transmitter and the communications device receiver based on the transmitter location data signal, the receiver location data, and the receiver orientation data when the transmitter location data signal has been received;

receiving, by an audio processor of the communications device receiver, a transmitter audio signal from the communications device transmitter;

operating, by the audio processor, in an enhanced audio mode by processing the transmitter audio signal based on the directional vector to convert the transmitter audio signal to a directionally-enhanced audio signal when the transmitter location data signal has been received by the location data processor;

operating, by the audio processor, in a standard audio mode by providing one of a standard mono audio signal or a standard stereo signal when the transmitter location data signal has not been received by the location data processor; and

outputting, by at least one speaker integrated with or communicatively coupled to the communications device receiver, the directionally-enhanced audio signal, the standard mono audio signal, or the standard stereo signal provided by the audio processor.

14. The method of claim 13, wherein the warning provided by the location data processor is one or more of an audio signal output by the at least one speaker, a visual warning presented at a display device, and a physical warning provided by a haptic device.

15. The method of claim 13, wherein:

the at least one speaker is a plurality of speakers, and

operating, by the audio processor, in the enhanced audio mode comprises applying head-related transfer function (HRTF) filters to convert the transmitter audio signal to the directionally-enhanced audio signal.

16. The method of claim 13, wherein:

the at least one speaker is a plurality of speakers, and

operating, by the audio processor, in the enhanced audio mode comprises applying volume sound processing algorithms to adjust a volume of one or more of the plurality of speakers to provide the directionally-enhanced audio signal.

17. The method of claim 13, wherein:

the at least one speaker is a plurality of speakers, and

operating, by the audio processor, in the enhanced audio mode comprises providing a spatially-positioned audible sound with the transmitter audio signal to generate the directionally-enhanced audio signal.

18. The method of claim 13, comprising:

receiving, by a demultiplexer of the communications device receiver, a composite signal from the communications device transmitter; and

separating, by the demultiplexer, the composite signal into the transmitter audio signal provided to the audio processor and the transmitter location data signal provided to the location data processor.

19. The method of claim 13, comprising separately receiving, by the communications device receiver, the transmitter audio signal and the transmitter location data signal.

20. The method of claim 13, comprising:

generating, by at least one microphone of the communications device transmitter, the transmitter audio signal;

providing, by a transmitter location identification device integrated with or communicatively coupled to the communications device transmitter, transmitter location data of the communications device transmitter;

receiving and formatting, by a transmitter location data processor of the communications device transmitter, the transmitter location data to generate the transmitter location data signal; and

transmitting, from the communications device transmitter to the communications device receiver, the transmitter audio signal and the transmitter location data signal either separately or as a composite signal.

21. The method of claim 13, comprising:

generating, by at least one processor of a user-worn device communicatively coupled to the communications device receiver, a drive signal based on the directional vector computed by the location data processor; and

pulsing, at least one of a plurality of haptic sensors of the user-worn device, in response to a drive signal received during output of the directionally-enhanced audio signal by the at least one speaker.

22. The method of claim 21, wherein the user-worn device is one or more of:

a headband,

headphones,

ear buds,

eyeglasses, and

a body-worn device.

23. The method of claim 13, comprising presenting, at a display screen of a display device communicatively coupled to the communications device receiver, a visual indicator based on the directional vector computed by the location data processor, the visual indicator presented during output of the directionally-enhanced audio signal by the at least one speaker,

wherein the visual indicator identifies one or more of:

a direction of the communications device transmitter from the communications device receiver;

a distance of the communications device transmitter from the communications device receiver; and

an identifier corresponding to the communications device transmitter.

24. The method of claim 23, wherein the display device is one or more of:

a head-worn device,

a hand-held device,

a body-worn device, and

a vehicle-mounted device.

25. A directional awareness audio communications system comprising:

a communications device receiver comprising;

a location identification device integrated with or communicatively coupled to the communications device receiver, the location identification device configured to provide receiver orientation data of the communications device receiver;

a Radio Direction Finding (RDF) device integrated with or communicatively coupled to the communications device receiver, the RDF device comprising an RDF processor and at least one antenna, the RDF device configured to generate a transmitter location data signal identifying a remote location of a communications device transmitter with respect to the communications device receiver;

a location data processor configured to;

receive the receiver orientation data from the location identification device;

receive the transmitter location data signal from the RDF device; and

compute a directional vector between the communications device transmitter and the communications device receiver based on the transmitter location data signal and the receiver orientation data;

an audio processor configured to;

receive a transmitter audio signal from the communications device transmitter; and

process the transmitter audio signal based on the directional vector to convert the transmitter audio signal to a directionally-enhanced audio signal; and

a plurality of speakers integrated with or communicatively coupled to the communications device receiver, the plurality of speakers configured to output the directionally-enhanced audio signal provided by the audio processor.

26. The directional awareness audio communications system of claim 25, wherein the audio processor is configured to apply head-related transfer function (HRTF) filters to convert the transmitter audio signal to the directionally-enhanced audio signal.

27. The directional awareness audio communications system of claim 25, wherein the audio processor is configured to apply volume sound processing algorithms to adjust a volume of one or more of the plurality of speakers to provide the directionally-enhanced audio signal.

28. The directional awareness audio communications system of claim 25, wherein the audio processor is configured to provide a spatially-positioned audible sound with the transmitter audio signal to generate the directionally-enhanced audio signal.

29. The directional awareness audio communications system of claim 25, comprising the communications device transmitter comprising at least one microphone configured to generate the transmitter audio signal, wherein the transmitter audio signal is transmitted from the communications device transmitter to the communications device receiver.

30. The directional awareness audio communications system of claim 25, comprising a user-worn device communicatively coupled to the communications device receiver, the user-worn device comprising:

a plurality of haptic sensors configured to pulse in response to a drive signal received during output of the directionally-enhanced audio signal by the plurality of speakers; and

at least one processor configured to generate and provide the drive signal to at least one of the plurality of haptic sensors based on the directional vector computed by the location data processor.

31. The directional awareness audio communications system of claim 25, comprising a display device communicatively coupled to the communications device receiver, the display device comprising a display screen configured to present a visual indicator based on the directional vector computed by the location data processor, the visual indicator presented during output of the directionally-enhanced audio signal by the plurality of speakers,

wherein the visual indicator identifies one or more of:

a direction of the communications device transmitter from the communications device receiver;

a distance of the communications device transmitter from the communications device receiver; and

an identifier corresponding to the communications device transmitter.

32. A method comprising:

providing, by a location identification device integrated with or communicatively coupled to a communications device receiver, receiver orientation data of the communications device receiver;

generating, by a Radio Direction Finding (RDF) device integrated with or communicatively coupled to the communications device receiver, a transmitter location data signal identifying a remote location of a communications device transmitter with respect to the communications device receiver;

receiving, by a location data processor of the communications device receiver, the receiver orientation data from the location identification device;

receiving, by the location data processor, the transmitter location data signal from the RDF device;

computing, by the location data processor, a directional vector between the communications device transmitter and the communications device receiver based on the transmitter location data signal and the receiver orientation data;

receiving, by an audio processor of the communications device receiver, a transmitter audio signal from the communications device transmitter;

processing, by the audio processor, the transmitter audio signal based on the directional vector to convert the transmitter audio signal to a directionally-enhanced audio signal; and

outputting, by a plurality of speakers integrated with or communicatively coupled to the communications device receiver, the directionally-enhanced audio signal provided by the audio processor.

33. The method of claim 32, wherein processing the transmitter audio signal comprises applying, by the audio processor, head-related transfer function (HRTF) filters to convert the transmitter audio signal to the directionally-enhanced audio signal.

34. The method of claim 32, wherein processing the transmitter audio signal comprises applying, by the audio processor, volume sound processing algorithms to adjust a volume of one or more of the plurality of speakers to provide the directionally-enhanced audio signal.

35. The method of claim 32, wherein processing the transmitter audio signal comprises providing, by the audio processor, a spatially-positioned audible sound with the transmitter audio signal to generate the directionally-enhanced audio signal.

36. The method of claim 32, comprising:

generating, by at least one microphone of the communications device transmitter, the transmitter audio signal; and

transmitting, from the communications device transmitter to the communications device receiver, the transmitter audio signal.

37. The method of claim 32, comprising:

generating, by at least one processor of a user-worn device communicatively coupled to the communications device receiver, a drive signal based on the directional vector computed by the location data processor; and

pulsing, at least one of a plurality of haptic sensors of the user-worn device, in response to a drive signal received during output of the directionally-enhanced audio signal by the plurality of speakers.

38. The method of claim 32, comprising presenting, at a display screen of a display device communicatively coupled to the communications device receiver, a visual indicator based on the directional vector computed by the location data processor, the visual indicator presented during output of the directionally-enhanced audio signal by the plurality of speakers,

wherein the visual indicator identifies one or more of:

a direction of the communications device transmitter from the communications device receiver;

a distance of the communications device transmitter from the communications device receiver; and

an identifier corresponding to the communications device transmitter.