Mobile device indoor navigation

• US 9,952,309 B2
• Filed: 08/08/2016
• Issued: 04/24/2018
• Est. Priority Date: 02/23/2011
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Davis, Bruce L., Rodriguez, Tony F., Thagadur Shivappa, Shankar
• Primary Examiner(s): Siddiqui, Kashif
• Application Number:
  US15/231,502
• Publication Number:
  US 20170131384A1
• Time in Patent Office: 624 Days
• CPC Class Codes: G01S 5/22 Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements G01S5/28 takes precedence
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04R 29/007 for public address systems public address systems per se H04R27/00
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/024 Guidance services
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings

Abstract

An audio playback system receives digitally watermarked audio programming and distributes it to audio speakers in a venue, enabling a variety of location and product dependent services to be delivered to mobile devices in the venue. Mobile devices sense audio from speakers and decode digital identifying information, including characteristics to distinguish audio sources. The mobile device communicates with a networked computer to provide the identifying information, which in turn, triggers an alert for output on the mobile device.

Claims

1. A system for mobile device positioning comprising:

a mobile device in a venue, the mobile device configured to detect identifying information of plural different audio sources in sound captured through a microphone of the mobile device in the venue, and configured to determine timing information for sound signals from the different audio sources, wherein the timing information comprises the relative arrival time to the mobile device from the different sources; and

a position calculator configured to obtain positions of the different sources from the identifying information, and configured to calculate position of the mobile device from the position of the different sources and the timing information.

2. The system of claim 1 comprising one or more computers configured to monitor position of the mobile device at the venue, and send an alert to the mobile device when the position of the mobile device is at a position associated with the alert.

3. The system of claim 1 wherein the audio sources comprise loudspeakers of a public audio playback system in the venue.

4. The system of claim 3 wherein the public audio playback system comprises a public address system.

5. The system of claim 1 further including a traffic monitoring system, wherein the traffic monitoring system provides information about traffic in the venue from which a position based alert is generated and sent to the mobile device in the venue.

6. The system of claim 5 wherein the traffic monitoring system comprises a fiber optic sensor network.

7. A non-transitory computer readable medium, on which is stored instructions, which when executed by a computer, perform a method for mobile device positioning comprising:

detecting audio source identifying and timing information from an audio signal captured on a microphone;

providing the source identifying and timing information to a process for computing position of a mobile device in a venue, the source identifying information identifying plural different audio sources from the audio signal captured on the microphone, and the timing information providing timing of sound signals from the different audio sources;

obtaining positions of the plural different audio sources; and

calculating the position of the mobile device based on the timing and position of the plural different audio sources.

8. The computer readable medium of claim 7, wherein the instructions are configured to generate a position based alert on an output device of a mobile device when the position of the mobile device is within a pre-determined position associated with the position based alert in a venue.

9. The computer readable medium of claim 7 wherein the medium comprises a memory of the mobile device, the mobile device comprises a wireless phone, and the microphone is a microphone of the wireless phone.

10. A method of determining position of a mobile device comprising:

receiving, at one location, audio signals from two or more different audio sources that overlap in time, in a microphone of the mobile device, wherein the audio signals sound substantially similar to a human listener, yet have different characteristics to distinguish among the different audio sources;

distinguishing the audio signals from each other based on distinguishing characteristics determined from the audio signals;

determining timing information for sound signals from the different audio sources, wherein the timing information comprises the relative arrival time to the mobile device from the different sources; and

based on the distinguishing characteristics and the timing information, determining position of the mobile device.

11. The method of claim 10 wherein distinguishing the audio signals comprises detecting a digital watermark encoded into host audio content.

12. The method of claim 10 wherein distinguishing the audio signals comprises differentiating source by performing a content fingerprint recognition.

13. The method of claim 10 wherein the distinguishing characteristic comprises a set of frequency tones.

14. The method of claim 11 wherein the distinguishing characteristic comprises a direct sequence spread spectrum modulated audio watermark.

15. The method of claim 11 including:

tracking position derived from audio signals captured through the microphone of the mobile device; and

based on tracking the position, providing feedback on indoor navigation in the venue.

16. The method of claim 15 wherein the feedback comprises a depiction of a path traveled relative to a path in the venue computed based on preferences derived from user input.

17. The method of claim 15 wherein the feedback corresponds to location based alerts computed by:

deriving preferences about products in a venue from input;

determining locations of the products in the venue;

and scheduling location based alerts to be triggered when the mobile device is detected to be in proximity of the locations of the products in the venue.

18. The method of claim 17 wherein the deriving comprises identifying the products in a shopping list entered as the input.

19. The method of claim 10 including tracking orientation of the mobile device based on sampling orientation data from an orientation sensor on the mobile device.

20. The method of claim 19 including providing a product alert on the mobile device based on position derived from audio capture and orientation from sampling orientation data.