SYSTEM AND METHOD OF PERSONALIZED NAVIGATION INSIDE A BUSINESS ENTERPRISE

• US 20190053012A1
• Filed: 10/18/2018
• Published: 02/14/2019
• Est. Priority Date: 12/12/2016
• Status: Active Grant

• Current Assignee: Position Imaging, Inc.
• Original Assignee: Position Imaging, Inc.
• Inventors: Hill, Edward L.
• Granted Patent: US 10,455,364 B2
• Time in Patent Office: Days
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 11/06 using intensity measurements
• CPC Class Codes: G01S 2205/02 Indoor
• CPC Class Codes: G01S 2205/09 for tracking people
• CPC Class Codes: G01S 5/02 using radio waves using satellite radio beacon systems for determining position G01S19/00
• CPC Class Codes: G01S 5/14 Determining absolute distances from a plurality of spaced points of known location
• CPC Class Codes: G06Q 10/04 Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" market predictions or forecasting for commercial activities G06Q30/0202
• CPC Class Codes: G06Q 10/047 Optimisation of routes or paths, e.g. travelling salesman problem
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 90/20 Destination assistance within a business structure or complex
• CPC Class Codes: H04B 17/27 for locating or positioning the transmitter
• CPC Class Codes: H04B 17/318 Received signal strength
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/024 Guidance services
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings

Abstract

Systems and methods for tracking movement of individuals through a building receive, by one or more RF nodes disposed near an entrance to the building, RF signals from RF-transmitting mobile devices carried by persons near the entrance, capture an image of the persons while they are near the entrance, determine an identity and relative distance of each RF-transmitting mobile device from each RF node based on information associated with the RF signals received by that RF node, detect humans in the image, determine a relative depth of each human in the image, and assign the identity of each RF-transmitting mobile device to one of the humans detected in the image based on the relative distance of each RF-transmitting mobile device from each RF node and the relative depth of each human in the image, thereby identifying each individual who to be tracked optically as that individual moves throughout the building.

Claims

1. A system for tracking movement of individuals through a building, the system comprising:

at least one radio-frequency (RF) node disposed near an entrance to the building, the at least one RF node having an RF receiver to receive RF signals from RF-transmitting devices near the entrance to the building;

at least one optical device disposed near the entrance to the building, the at least one optical device capturing an image of a plurality of persons while the plurality of persons is near the entrance to the building; and

a controller in communication with the at least one RF node to obtain therefrom information associated with the RF signals received by the RF receiver of that at least one RF node and in communication with the at least one optical device to obtain therefrom the captured image,

the controller being configured to determine an identity of each RF-transmitting device and a relative distance of each RF-transmitting device from each RF node based on the information associated with the RF signals obtained by the controller from the at least one RF node,

the controller being further configured to detect a plurality of humans in the image obtained by the controller from the at least one optical device and to determine a relative depth of each human detected in the image,

the controller being further configured to assign the identity of each RF-transmitting device to one of the plurality of humans detected in the image based on the determined relative distance of each RF-transmitting device from each RF node and the determined relative depth of each human detected in the image, thereby identifying each individual who is to be tracked optically as that individual moves throughout the building.

2. The system of claim 1, wherein the at least one RF node is configured to determine a relative signal strength indicator (RSSI) value for the RF signals received from each RF-transmitting device, the information obtained by the controller from the at least one RF node includes the RSSI values, and the controller is configured to estimate a distance of each RF-transmitting device from each RF node based on the RSSI values for the RF signals received by that RF node from that RF-transmitting device.

3. The system of claim 1, wherein the controller is further configured to detect in the image a mobile phone held by of one of the plurality of humans detected in the image and to assign the identity of each RF-transmitting device to one of the plurality of humans detected in the captured image based on the which of the plurality of humans detected in the image is holding the detected mobile phone.

4. The system of claim 1, wherein the controller is further configured to detect in the image a predetermined orientation marker and to assign the identity of each RF-transmitting device to one of the plurality of humans detected in the captured image based on a position of the predetermined orientation marker in the image relative to each human detected in the image.

5. The system of claim 1, wherein the controller is further configured to:

arrange, for each RF node, the RF-transmitting mobile devices in a distance order based on the relative distances of the RF-transmitting mobile devices from that RF node;

arrange the humans captured in the image into a depth order based on the relative depths of the plurality of humans detected in the captured image; and

compare the depth order of humans detected in the captured image with the distance order of the RF-transmitting mobile devices when assigning the identity of each RF-transmitting mobile device to one of the plurality of humans detected in the captured image.

6. The system of claim 5, wherein the controller is further configured to arrange the depth order of the plurality of humans in the captured image to be in respect to the at least one RF node before comparing the depth order of humans detected in the image with the distance order of the RF-transmitting mobile devices.

7. The system of claim 1, further comprising a plurality of optical devices disposed throughout the building, and wherein the controller is further configured to optically track each identified individual through the building based on detecting that identified individual in images received from at least some of the plurality of optical devices over time.

8. The system of claim 1, wherein the information carried by RF signals transmitted by a given RF-transmitting mobile device includes a shopping list.

9. The system of claim 8, wherein the controller is further configured to:

determine a route through the building based on items on the shopping list; and

transmit the route to the given RF-transmitting mobile device for display on a screen of the given RF-transmitting mobile device.

10. The system of claim 1, wherein the at least one RF node comprises two or more RF nodes.

11. A method for tracking movement of individuals through a building, the method comprising:

receiving, by at least one radio-frequency (RF) node disposed near an entrance to the building, RF signals from RF-transmitting mobile devices carried by a plurality of persons near the entrance to the building;

capturing an image of the plurality of persons while the plurality of persons is near the entrance to the building;

determining an identity of each RF-transmitting mobile device and a relative distance of each RF-transmitting mobile device from each RF node based on information associated with the RF signals received by the at least one RF node;

detecting a plurality of humans in the captured image;

determining a relative depth of each human detected in the captured image;

assigning the identity of each RF-transmitting mobile device to one of the plurality of humans detected in the captured image based on the determined relative distance of each RF-transmitting mobile device from each RF node and the determined relative depth of each human detected in the captured image, thereby identifying each individual who is to be tracked optically as that individual moves throughout the building.

12. The method of claim 11, further comprising:

determining a relative signal strength indicator (RSSI) value for the RF signals received from each RF-transmitting device; and

computing an estimated distance of each RF-transmitting device from each RF node based on the RSSI values for the RF signals by that RF node received from that RF-transmitting device.

13. The method of claim 11, further comprising detecting in the image a mobile phone held by of one of the plurality of humans detected in the image;

and wherein the step of assigning the identity of each RF-transmitting device to one of the plurality of humans detected in the captured image is based on the which human detected in the image is holding the detected mobile phone.

14. The method of claim 11, further comprising detecting in the image a predetermined orientation marker;

and wherein the step of assigning the identity of each RF-transmitting device to one of the plurality of humans detected in the captured image is further based on a position of the predetermined orientation marker in the image relative to each human detected in the image.

15. The method of claim 11, further comprising:

arranging the RF-transmitting mobile devices in a distance order based on the relative distances of the RF-transmitting mobile devices from the at least one RF node; and

arranging the humans captured in the image into a depth order based on the relative depths of the plurality of humans detected in the captured image; and

wherein the step of assigning the identity of each RF-transmitting mobile device to one of the plurality of humans detected in the captured image includes comparing the depth order of humans detected in the image with the distance order of the RF-transmitting mobile devices.

16. The method of claim 15, further comprising arranging the depth order of humans in the captured image to be in respect to the at least one RF node before comparing the depth order of humans detected in the captured image with the distance order of the RF-transmitting mobile devices.

17. The method of claim 11, further comprising optically tracking movement of each identified individual through the building by comparing successive images that capture that identified individual.

18. The method of claim 11, wherein the information associated with the RF signals transmitted by a given RF-transmitting mobile device includes a shopping list.

19. The method of claim 18, further comprising:

determining a route through the building based on items on the shopping list; and

transmitting the route to the given RF-transmitting mobile device for display on a screen of the given RF-transmitting mobile device.

20. The method of claim 11, further comprising transmitting from the at least one RF node radio signals carrying a current location of a given identified individual within the building to the RF-transmitting mobile device carried by that given identified individual.