Market research method and system for collecting retail store and shopper market research data

• US 5,331,544 A
• Filed: 04/23/1992
• Issued: 07/19/1994
• Est. Priority Date: 04/23/1992
• Status: Expired due to Term

• Current Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Original Assignee: A. C. Nielsen Company, LLC (MOOD Media Corporation)
• Inventors: Lu, Daozheng, Zhang, Jia, Kiewit, David A.
• Primary Examiner(s): Envall, Jr., Roy N.
• Assistant Examiner(s): BAI, ARI
• Application Number:
  US07/872,881
• Time in Patent Office: 817 Days
• Field of Search: 364/401, 364/402, 382/2, 382/57
• US Class Current: 705/7.29
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data

Abstract

A market research system and method are provided. A plurality of cooperating establishments are included in a market research test area. Each cooperating establishment is adapted for collecting and storing market research data. A computer system remotely located from the plurality of cooperating establishments stores market research data collected from the cooperating establishments. The collected market research data includes monitored retail sales transactions and captured video images of retail customers.

Claims

1. A market research method for a marketing research system including a plurality of cooperating establishments in a market research test area;

each said cooperating establishment adapted for collecting and storing market research data, said method comprising the steps of;

monitoring retail sales transactions within each said cooperating establishment;

periodically capturing a video image of a retail customer near a POS terminal within each said cooperating establishment;

combining said monitored retail sales transaction data and said captured video image data; and

transferring said combined data to a central computer for use by market researchers.

2. A market research method as recited in claim 1 further including the steps of:

forming a digital facial feature set from a portion of said captured image corresponding to said retail customer'"'"'s face,

storing, in a computer memory, a plurality of said facial feature sets, each said facial feature set corresponding to a retail customer,

storing with said facial feature set a reference time at which said facial feature set was formed.

3. A market research method as recited in claim 2 further including the steps of:

capturing a current video image of said retail customer at a monitored point of sale,

forming a current facial feature set from said current image,

comparing said current facial feature set with said stored facial feature set,

generating an identification record associated with a retail customer when said current facial feature set matches said stored facial feature set, and

storing said identification record in a computer memory.

4. A market research method as recited in claim 1 further including the steps of:

capturing a video image of a shopper near a predetermined product display.

5. Apparatus for identifying, at a monitored point of sale within a retail store, a person who is one of a preselected group of people, said apparatus comprising:

a first identification subsystem including;

computer means for storing a plurality of reference facial feature sets, each said reference facial feature set corresponding to one person of said preselected group of people,

video camera means for capturing a current image of a person present at said monitored point of sale,

image processing means for extracting a current facial image from said captured current image, for transposing said facial image into a standard setting and for extracting from said standardized facial image a current facial feature set,

means for comparing said current facial feature set with said stored reference facial feature set to identify a match, thereby identifying said person currently present at said point of sale,

means for generating and storing a first current identification record associated with said identified person,

a second identification subsystem including;

means for receiving an input second identification associated with one person of said preselected group of people, and for generating a reference identification'"'"'data set,

computer memory means for storing a plurality of said reference identification data sets,

means for generating a second current identification record associated with a person when a reference identification data set corresponding to a received input second identification matches a stored reference identification data set, and

means for comparing said first and said second current identification records.

6. An image recognition system for identifying a shopper at a plurality of monitored locations within a retail store and for measuring a reference time at which each identification occurs, said system comprising:

a plurality of image data acquisition subsystems each said subsystem comprising,

means for capturing 8 video image, said captured video image including a facial image of a shopper,

means for digitizing said video image and for extracting from said digitized image a digitized representation of said facial image,

means for transposing said digitized representation into a standard setting,

means for forming from said digitized representation a facial feature Set corresponding to a shopper,

means for identifying a reference time for forming said facial feature set,

means for forming an image record comprising, in combination, said facial feature set and said reference time corresponding to said facial feature set, and

means for communicating said image record to an identification subsystem comprising;

means for storing a plurality of said image records,

means for comparing a first said image record with a second said image record and for generating an identification record associated with a shopper when said first image record matches said second image record, and

memory means for storing said identification record.

7. An image recognition system as recited in claim 6 wherein said monitored locations include a point of sale and a predefined product display.

8. A market research system for collecting data from a retail sales establishment, the retail sales establishment having at least one point-of-sale at which a point-of-sale terminal is located, the market research system comprising:

first means for monitoring retail sales transactions at the point-of-sale;

second means, located at the point-of-sale, for capturing a video image of a retail customer who is in the vicinity of the point-of-sale; and

,

third means, connected to the first and second means, for identifying the retail customer in the video image by automatically comparing the video image of the retail customer to a reference image and for storing data related to the retail sales transactions.

9. The market research system of claim 8 wherein the third means further includes:

means for extracting an input facial representation of the retail customer from the video image;

means for storing a reference facial representation of the retail customer; and

,

means for comparing the input facial representation with the reference facial representation in an effort to identify the retail customer.

10. The market research system of claim 9 further including means for storing other data with the reference facial representation of the retail customer, the other data including an identification of the retail customer and an identification of the retail sales establishment.

11. The market research system of claim 9 wherein the third means provides a first identification of the retail customer and wherein the market research system further includes:

means for receiving a second identification of the retail customer; and

means for determining whether the first identification matches the second identification.

12. The market research system of claim 11 further including means, responsive to a match between the first and second identifications, for updating the reference facial representation based upon the input facial representation of the retail customer.

13. A market research system having, within a retail sales establishment, at least one point-of-sale at which a point-of-sale terminal is located and at least one product display, the market research system including:

first means for monitoring retail sales transactions at the point-of-sale;

second means, located at the product display, for capturing a video image of a retail customer who is in the vicinity of the product display; and

,

third means, connected to the first and second means, for determining the identity of the retail sales customer in the video image and for storing data related to the retail sales transactions.

14. The market research system of claim 13 wherein the third means further includes:

means for extracting an input facial representation of the retail customer from the video image;

means for storing a reference facial representation of the retail customer; and

,

means for comparing the input facial representation with the reference facial representation in an effort to identify the retail customer.

15. The market research system of claim 14 further including means for storing other data with the reference facial representation of the retail customer, the other data including an identification of the retail customer and an identification of the retail sales establishment.

16. The market research system of claim 14 wherein the third means provides a first identification of the retail customer and wherein the market research system further includes:

means for receiving a second identification of the retail customer; and

,

means for determining whether the first identification matches the second identification.

17. The market research system of claim 16 further including means, responsive to a match between the first and second identifications, for updating the reference facial representation based upon the input facial representation of the retail customer.

18. The market research system of claim 13 wherein the second means captures a first video image of the retail customer, wherein the market research system further includes fourth means, located at the point-of-sale, for capturing a second video image of the retail customer when the retail customer is in the vicinity of the point-of-sale, and wherein the third means is connected to the fourth means for determining the identity of the retail sales customer in the first and second video images.

19. The market research system of claim 18 wherein the third means further includes:

means for extracting input facial representations of the retail customer from the first and second video images;

means for storing a reference facial representation of the retail customer; and

,

means for comparing the input facial representations with the reference facial representation in an effort to identify the retail customer.

20. The market research system of claim 19 further including means for storing other data with the reference facial representation of the retail customer, the other data including an identification of the retail customer and an identification of the retail sales establishment.

21. The market research system of claim 19 wherein in the third means provides a first identification of the retail customer and wherein the market research system further includes:

means for receiving a second identification of the retail customer; and

means for determining whether the first identification matches the second identification.

22. The market research system of claim 21 further including means, responsive to a match between the first and second identifications, for updating the reference facial representation based upon at least one of the input facial representations of the retail customer.