Method and system for determining consumer positions in retailers using location markers

• US 9,898,749 B2
• Filed: 01/30/2013
• Issued: 02/20/2018
• Est. Priority Date: 01/30/2013
• Status: Active Grant

• Current Assignee: Walmart Apollo, LLC (WalMart Inc.)
• Original Assignee: Wal-Mart Stores Texas LLC (WalMart Inc.)
• Inventors: Argue, Stuart, Marcar, Anthony Emile
• Primary Examiner(s): Zimmerman, Matthew
• Application Number:
  US13/754,746
• Publication Number:
  US 20140214481A1
• Time in Patent Office: 1,847 Days
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 30/0261 based on user location

Abstract

A computer-implemented method is disclosed herein. The method includes the step of positioning at least one location marker at a position in a retail store. The method also includes the step of receiving, with a processing device of a position detection server, a video signal from an electronic device possessed by a consumer as the consumer shops in the retail store. At least one image frame of the video signal contains the at least one location marker. The method also includes the step of determining, with the processing device, a location of the consumer within the retail store in response to the receiving step.

Claims

1. A method comprising:

providing a wireless access point located in a retail store;

positioning at least one location marker at a position in the retail store;

providing an application for use on an electronic device possessed by a consumer for connecting to a wireless network by way of the wireless access point and for recording a live video signal and a live audio signal, the live audio signal capturing at least a sound generated proximate to the consumer as the consumer shops in the retail store, the electronic device communicatively coupled to a position detection server;

modifying, with a processor of the electronic device, the live video signal at intervals to create a modified video signal;

transmitting, by the electronic device to the position detection server, the modified video signal and the live audio signal;

parsing, with a processing device of the position detection server, the modified video signal into a plurality of image frames;

selecting, with the processing device, at least one image frame from the plurality of image frames, the at least one image frame comprising the at least one location marker;

correlating, with the processing device, the live audio signal with the at least one image frame;

comparing, with the processing device, the at least one location marker with a plurality of location markers stored in a location marker database at the position detection server;

retrieving, with the processing device, location information associated with the at least one location marker from the location marker database;

receiving, by a real-time positioning system including a plurality of fixed reference points within the retail store, a plurality of wireless signals from a sensor associated with the electronic device;

determining, with the processing device, whether the consumer shopping within the retail store has slowed or stopped to evaluate at least one product in the retail store;

determining, with the processing device, a location of the consumer within the retail store based on the location information, a correlation of the live audio signal with the at least one image frame, and the plurality of wireless signals;

determining, with the processing device, that the at least one product is located within a fixed distance from the location of the consumer;

transmitting, from the processing device to the electronic device, information related to the at least one product, wherein the information comprises at least a promotion associated with the at least one product; and

displaying to the consumer the information related to the at least one product on a display of the electronic device.

2. The method of claim 1 wherein determining, with the processing device, the location of the consumer within the retail store based on the location information, the correlation of the live audio signal with the at least one image frame, and the plurality of wireless signals further comprises:

determining, with the processing device, a distance between the consumer and the position of the at least one location marker.

3. The method of claim 1 wherein:

determining, with the processing device, the location of the consumer within the retail store based on the location information, the correlation of the live audio signal with the at least one image frame, and the plurality of wireless signals further comprises;

determining, with the processing device, a direction within the retail store that the consumer is looking based on a live video signal, the modified video signal, or one or more of the plurality of image frames; and

the direction comprises at least a lower shelf, a middle shelf, or an upper shelf within the retail store.

4. The method of claim 1 wherein positioning the at least one location marker further comprises:

positioning the at least one location marker at the position in the retail store wherein the at least one location marker is a geometric shape bearing a single color.

5. The method of claim 1 wherein positioning the at least one location marker further comprises:

positioning the at least one location marker at the position in the retail store wherein the at least one location marker comprises a series of geometric shapes bearing a common color and arranged substantially along a line.

6. The method of claim 1 wherein positioning the at least one location marker further comprises:

positioning the at least one location marker at the position in the retail store wherein the at least one location marker comprises a series of colored, geometric shapes having different colors situated in a pattern in an array.

7. The method of claim 1 wherein positioning the at least one location marker further comprises:

positioning the at least one location marker at the position in the retail store wherein the at least one location marker comprises a series of colored shape structures each having a different color and shape with respect to one another and arranged in a color and shape pattern substantially in one of a line or an array.

8. The method of claim 1 wherein positioning the at least one location marker further comprises:

positioning the at least one location marker at the position in the retail store wherein the at least one location marker comprises the series of colored shape structures having different colors and dimensional scales situated in a color and dimensional scale pattern substantially along a line or in an array.

9. A system comprising:

a wireless access point located in a retail store;

an application for use on a mobile device possessed by a consumer for connecting to a wireless network by way of the wireless access point and recording a live video signal and a live audio signal, the live audio signal capturing at least a sound generated proximate to the consumer, as the consumer shops in the retail store, wherein a processor of the mobile device modifies the live video signal at intervals to create a modified video signal; and

a position detection server communicatively coupled to the application on the mobile device over the wireless network, the position detection server having a processing device operable to;

receive the modified video signal and the live audio signal from the application,

parse the modified video signal into a plurality of image frames,

select at least one image frame from the plurality of image frames, the at least one image frame containing at least one location marker, and

correlate the live audio signal with the at least one image frame;

wherein the processing device includes;

a video processing module operable to detect the at least one location marker in the at least one image frame,

an identification module operable to compare the at least one location marker with a plurality of location markers stored in a location marker identification database and to identify a location of the at least one location marker,

a real-time positioning system including a plurality of fixed reference points within the retail store for receiving a plurality of wireless signals from a sensor associated with the mobile device;

a position module operable to;

determine whether the consumer shopping within the retail store has slowed or stopped to evaluate at least one product in the retail store;

determine the location within the retail store of the consumer based on an identity of the at least one location marker, a correlation of the live audio signal with the at least one image frame, and the plurality of wireless signals, and

determine that the at least one product is located within a fixed distance from the location of the consumer, and

transmit information related to the at least one product to the application on the mobile device, wherein the information comprises at least a promotion associated with the at least one product.

10. The system of claim 9 wherein the position module is operable to determine a direction within the retail store that the consumer is looking, the direction comprising at least a lower shelf, a middle shelf, or an upper shelf.

11. The system of claim 9 wherein:

the position module is operable to determine a position along a length of the at least one location marker; and

the at least one location marker is a strip style location marker.

12. The system of claim 9 wherein:

the location marker identification database contains at least one distinguishing characteristic for each of the plurality of location markers; and

the at least one distinguishing characteristic is one of color, color pattern, shape pattern, dimensional scale pattern, or number of colored shape structures.

13. A method comprising:

providing a wireless access point located in a retail store;

positioning a plurality of location markers at respective and spaced positions in the retail store;

providing an application for use on an electronic device possessed by a consumer for connecting to a wireless network by way of the wireless access point and recording a live video signal and a live audio signal, the live audio signal capturing at least a sound generated proximate to the consumer, as the consumer shops in the retail store, wherein the electronic device is communicatively coupled to a position detection server;

modifying, with a processor of the electronic device, the live video signal at intervals to create a modified video signal;

transmitting, by the electronic device to the position detection server, the modified video signal and the live audio signal;

parsing, with a processing device of the position detection server, the modified video signal into a plurality of image frames;

selecting, with the processing device, at least one image frame from the plurality of image frames, the at least one image frame comprising at least one location marker of the plurality of location markers;

correlating, with the processing device, the live audio signal with the at least one image frame;

identifying, with the processing device, the at least one location marker from among the plurality of location markers within the retail store;

receiving, by a real-time positioning system including a plurality of fixed reference points within the retail store, a plurality of wireless signals from a sensor associated with the electronic device;

determining, with the processing device, whether the consumer has slowed or stopped to evaluate at least one product in the retail store;

determining, with the processing device, a location of the consumer within the retail store based on the at least one location marker, as identified, a correlation of the live audio signal with the at least one image frame, and the plurality of wireless signals;

determining, with the processing device, that the at least one product is located within a fixed distance from the location of the consumer;

transmitting, from the processing device to the electronic device, information related to the at least one product, wherein the information comprises at least a promotion associated with the at least one product; and

displaying to the consumer the information related to the at least one product on a display of the electronic device.

14. The method of claim 13 wherein positioning the plurality of location markers at the respective and spaced positions in the retail store further comprises:

positioning the plurality of location markers in the retail store that have different configurations with respect to one another, the different configurations comprising each location marker of the plurality of location markers being configured to include a different colored shape structure with respect to all other location markers of the plurality of location markers.

15. The method of claim 13 wherein positioning the plurality of location markers at the respective and spaced positions in the retail store further comprises:

positioning the plurality of location markers in the retail store that have different configurations with respect to one another, the different configurations comprising each location marker of the plurality of location markers is configured to include colored shape structures arranged in a different color pattern with respect to all other location markers of the plurality of location markers.

16. The method of claim 13 wherein positioning the plurality of location markers at the respective and spaced positions in the retail store further comprises:

positioning the plurality of location markers in the retail store that have different configurations with respect to one another, the different configurations comprising each location marker of the plurality of location markers is configured to include colored shape structures arranged in a different color pattern and a different shape pattern with respect to all other location markers of the plurality of location markers.

17. The method of claim 13 wherein positioning the plurality of location markers at the respective and spaced positions in the retail store further comprises:

positioning the plurality of location markers in the retail store that have different configurations with respect to one another, the different configurations comprising each location marker of the plurality of location markers is configured to include colored shape structures arranged in a different color pattern and a different dimensional scale pattern with respect to all other location markers of the plurality of location markers.

18. The method of claim 13 wherein determining, with the processing device, the location of the consumer within the retail store based on the at least one location marker, as identified, the correlation of the live audio signal with the at least one image frame, and the plurality of wireless signals further comprises:

determining, with the processing device, a direction within the retail store that the consumer is looking in response to selecting the at least one image frame and receiving, by the real-time positioning system including the plurality of fixed reference points within the retail store, the plurality of wireless signals from the sensor associated with the electronic device.