Localization of a wireless user equipment (UE) device based on audio masking

• US 9,165,547 B2
• Filed: 09/17/2012
• Issued: 10/20/2015
• Est. Priority Date: 09/17/2012
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Nguyen, Nam, Dhakal, Sagar
• Primary Examiner(s): HOLDER, REGINA NEAL
• Application Number:
  US13/621,557
• Publication Number:
  US 20140079223A1
• Time in Patent Office: 1,128 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01S 5/26 Position of receiver fixed by co-ordinating a plurality of position lines defined by path-difference measurements G01S5/28 takes precedence
• CPC Class Codes: G01S 5/30 Determining absolute distances from a plurality of spaced points of known location
• CPC Class Codes: G10K 11/002 Devices for damping, suppressing, obstructing or conducting sound in acoustic devices G10K1/06 - G10K1/10 take precedence; for electro-mechanical transducers for communication H04R3/002
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers

Abstract

A scheme for localizing a wireless user equipment (UE) device'"'"'s relative position with respect to a spatial configuration based on audio signatures received via a multi-channel audio system, e.g., an audio system of a vehicle or home entertainment system. The wireless UE device is configured to capture the audio signatures masked within a background audio signal received from a head unit. The wireless UE device includes a persistent memory module having program instructions for processing the background audio signal including the masked signatures, which may comprise either channel-specific pseudo-random noise (PN) sequences or single-frequency tones, in order to compute time delays or power levels associated with the speaker channels. A localization module is configured to estimate the wireless UE device'"'"'s relative position based on the time delays or power levels.

Claims

1. A method operating on a wireless user equipment (UE) device, said method comprising:

receiving a plurality of audio signatures from a head unit via an audio system having a plurality of speaker channels,

wherein said plurality of audio signatures are masked within an audible background audio signal received from said head unit and recorded by a microphone of said wireless UE device;

receiving an encoded vehicle information signal from said head unit via at least one of said plurality of speaker channels;

decoding said encoded vehicle information signal to obtain an identity of a vehicle in which said head unit is implemented;

correlating said identity with a database to determine a particular spatial configuration;

processing said plurality of audio signatures, by processor of said wireless UE device configured to operate in association with one or more subsystems of said wireless UE device, for determining said wireless UE device'"'"'s location relative to the particular spatial configuration associated with the interior of a vehicle or a room; and

when said wireless UE device is determined to be located within a restricted zone of the particular spatial configuration, modifying a functional aspect of said wireless UE device.

2. The method of claim 1 wherein said plurality of audio signatures comprises a plurality of pseudorandom noise (PN) sequences, each corresponding to a speaker channel of said plurality of speaker channels.

3. The method of claim 2 wherein said processing comprises:

segmenting said background audio signal including masked PN sequences into a plurality of frames, each frame having a length;

summing said plurality of frames to form a single combined frame;

correlating said single combined frame with original PN sequences corresponding to said speaker channels to determine a delay associated with each speaker channel, whereby a plurality of said delays are determined corresponding to said plurality of speaker channels; and

estimating said wireless UE device'"'"'s location based on said plurality of said delays relative to said particular spatial configuration.

4. The method of claim 3 wherein said original PN sequences are stored in a persistent memory module in said wireless UE device.

5. The method of claim 3 wherein said length is equal to a length of said masked PN sequences.

6. The method of claim 1 wherein said plurality of audio signatures comprises a plurality of single-frequency tones, each corresponding to a speaker channel of said plurality of speaker channels.

7. The method of claim 6 wherein said processing comprises:

segmenting said background audio signal including masked single-frequency tones into a plurality of frames, each frame having a length;

summing said plurality of frames to form a single combined frame;

performing a Fourier Transform analysis on said single combined frame and measuring an energy level at each of said masked single-frequency tones; and

estimating said wireless UE device'"'"'s location based on said energy levels relative to said particular spatial configuration.

8. The method of claim 1 wherein said functional aspect of said wireless UE device comprises at least one of call reception, call origination, Short Message Service (SMS) texting, Instant Messaging (IM), a data application, an email application, a word processing application, a camera application, a presence application, gaming application, a music playback application, a video playback application, a social media application, a voice command mode, and a hands-free mode.

9. A wireless user equipment (UE) device comprising:

a processor configured to control one or more subsystems of said wireless UE device;

a microphone; and

a persistent memory module having program instructions which, when executed by said processor, are configured to perform;

facilitating reception of a plurality of audio signatures from a head unit via an audio system having a plurality of speaker channels, wherein said plurality of audio signatures are masked within an audible background audio signal from said head unit and recorded by the microphone;

decoding an encoded vehicle information signal received from said head unit to obtain an identity of vehicle in which said head unit is implemented, wherein said encoded vehicle information signal is received via at least one of said plurality of speaker channels;

correlating said identity with a database to determine a particular spatial configuration;

processing said plurality of audio signatures, by the processor operating in association with one or more of the subsystems of the wireless UE device, for determining said wireless UE device'"'"'s location relative to the particular spatial configuration associated with the interior of a vehicle or a room; and

when

said wireless UE device is determined to be located within a restricted zone of the particular spatial configuration, modifying a functional aspect of said wireless UE device.

10. The wireless UE device of claim 9 wherein said plurality of audio signatures comprises a plurality of pseudo-random noise (PN) sequences, each corresponding to a speaker channel of said plurality of speaker channels.

11. The wireless UE device of claim 9 wherein said plurality of audio signatures comprise a plurality of single-frequency tones, each corresponding to a speaker channel of said plurality of speaker channels.

12. The wireless UE device of claim 9 wherein said functional aspect of said wireless UE device comprises at least one of call reception, call origination, Short Message Service (SMS) texting, Instant Messaging (IM), a data application, an email application, a presence application, a word processing application, a camera application, a gaming application, a music playback application, a video playback application, a social media application, a voice command mode, and a hands-free mode.