Indoor positioning method and system based on wireless receiver and camera

• US 10,412,701 B2
• Filed: 05/16/2017
• Issued: 09/10/2019
• Est. Priority Date: 01/18/2017
• Status: Active Grant

• Current Assignee: Shenzhen University (Guangdong Education Department)
• Original Assignee: Shenzhen University (Guangdong Education Department)
• Inventors: Wu, Kaishun, Xu, Jun, Wang, Lu, Zou, Yongpan
• Primary Examiner(s): Elhag, Magdi
• Application Number:
  US15/760,230
• Publication Number:
  US 20190059070A1
• Time in Patent Office: 847 Days
• CPC Class Codes: G01S 2205/02 Indoor
• CPC Class Codes: G01S 3/043 Receivers
• CPC Class Codes: G01S 3/74 Multi-channel systems specially adapted for direction-finding, i.e. having a single antenna system capable of giving simultaneous indications of the directions of different signals systems in which the directions of different signals are determined sequentially and displayed simultaneously G01S3/04, G01S3/14
• CPC Class Codes: G01S 5/02585 at least one of the measurements being a non-radio measurement
• CPC Class Codes: G01S 5/12 by co-ordinating position lines of different shape, e.g. hyperbolic, circular, elliptical or radial
• CPC Class Codes: H04B 7/0626 Channel coefficients, e.g. channel state information [CSI]
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management
• CPC Class Codes: H04W 64/006 with additional information processing, e.g. for direction or speed determination
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

The invention provides an indoor positioning method and system based on a wireless receiver and a camera, belonging to the field of positioning technology. The method in the invention comprises the following steps: a wireless receiver detects a query WIFI signal transmitted by a target device and extracts a MAC address and CSI of the target device from a query WIFI signal; a server captures the MAC address and the CSI of the target device from the wireless receiver, calculates an incident angle of the target device and the wireless receiver and sends a photographing instruction to a camera which photographs an image and uploads the image to the server; the server obtains the distance between the wireless receiver and the target device through the image pixels, and calculates the position information of the target device according to the coordinates of the wireless receiver. The invention realizes the accurate positioning of the target device by using only a wireless receiver and a camera, so that the cost can be controlled and a real-time calculation can be ensured; the combination of the two beneficial effects can help achieve good positioning results.

Claims

1. An indoor positioning method based on a wireless receiver and a camera, comprising the following steps:

S1;

the wireless receiver detects a query WIFI signal transmitted by a target device;

S2;

the wireless receiver extracts a media access control (MAC) address and channel state information (CSI) used for identifying the target device from a query WIFI signal, and uploads the CSI to a server;

S3;

the server calculates an incident angle of the target device and the wireless receiver according to the CSI uploaded by the wireless receiver, and at the same time sends a photographing instruction to the camera which photographs an image and uploads the image to the server;

S4;

the server obtains a distance between the wireless receiver and the target device through the image pixels, and calculates the position information of the target device according to coordinates of the wireless receivers,

wherein in Step S2, the CSI extraction method comprises;

S21;

initial channel state data are collected, wherein the initial channel state data comprise the channel state data values of M subcarriers in N spatial streams, both N and M being natural numbers greater than 1;

S22;

for each spatial stream, an average value of the channel state data values of P consecutive subcarriers at a same time point is obtained and used as the CSI value, P being a natural number greater than 1 and less than M;

S23;

the CSI value is modified by using a least square best fit algorithm.

2. The indoor positioning method as claimed in claim 1, wherein the number of the wireless receiver and the camera is one respectively.

3. The indoor positioning method as claimed in claim 2, wherein in Step S1, the target device comprises a smart phone, and the positioning of a target population is completed according to the target population carrying the smart phone.

4. The indoor positioning method as claimed in claim 1, wherein in Step S1, the wireless receiver comprises a WIFI probe, a WIFI wireless listener and a wireless receiver.

5. The indoor positioning method as claimed in claim 4, wherein in Step S3, the method for calculating the incident angle of the target device to the wireless receiver on the server side is as follows:

S31;

eigenvalue and eigenvector factorization is performed for a CSI matrix contained in an acquired data packet;

S32;

a basis function of a multi-signal classification algorithm is constructed by using the eigenvalue;

S33;

the incident angle θ

in the range of 0 to 360 degrees is scanned by using a basis function, and a flight time τ

in the range of 1 to 20 nanoseconds is scanned;

for each pair of independent variables (θ

, τ

), when the dependent variable of the base function has a peak, an actual incident path corresponding to the independent variable is obtained;

S34;

detach the smallest independent variable of τ

, and the corresponding θ

value in the independent variable is the incident angle θ

of the target device to the wireless receiver.

6. The indoor positioning method as claimed in claim 5, wherein in Step S4, a method for calculating the distance between the target device and the wireless receiver is as follows:

S41;

the corresponding relationship between the distance and the pixels in the image is calculated according to known wireless receiver and camera positions;

S42;

the wireless receiver is taken as a starting point and a human search algorithm is performed along the angle θ

to identify the position of a human body, that is, the position of a target;

S43;

an actual distance between the target and the wireless receiver is calculated according to the pixels of the human body and the wireless receiver.

7. A system for indoor positioning, comprising:

a target device for sending a query WIFI signal;

a wireless receiver for detecting a query WIFI signal transmitted by a target device and extracting a media access control (MAC) address and a channel state information (CSI) from a query WIFI signal;

a camera for photographing an indoor image and uploading the image to a server; and

a server for calculating an incident angle of a target device and a wireless receiver and sending a photographing instruction to a camera; and

the distance between the wireless receiver and the target device is obtained through the image pixels; and

the position information of the target device is calculated according to the position of the wireless receiver,

wherein the wireless receiver is configured to;

collect initial channel state data, wherein the initial channel state data comprise the channel state data values of M subcarriers in N spatial streams, both N and M being natural numbers greater than 1;

obtain and use, for each spatial stream, an average value of the channel state data values of P consecutive subcarriers at a same time point as the CSI value, P being a natural number greater than 1 and less than M; and

modify the CSI value by using a least square best fit algorithm.

8. The system as claimed in claim 7, wherein the number of the wireless receiver and the camera is one respectively.

9. The system as claimed in claim 7, wherein the target device comprises a smart phone, and the positioning of a target population is completed according to the target population carrying the smart phone;

the wireless receiver comprises a WIFI probe, a WIFI wireless listener and a wireless receiver.