Passive patron identification systems and methods

• US 9,928,527 B2
• Filed: 12/23/2014
• Issued: 03/27/2018
• Est. Priority Date: 02/12/2014
• Status: Active Grant

• Current Assignee: Nextep Systems, Inc.
• Original Assignee: Nextep Systems, Inc.
• Inventors: Woycik, Thomas Edward, Cummings, Marshall Bruce
• Primary Examiner(s): Zare, Scott A
• Assistant Examiner(s): Danzig, Reva R
• Application Number:
  US14/580,927
• Publication Number:
  US 20150228001A1
• Time in Patent Office: 1,190 Days
• Field of Search: 705 15, 715703, 715764, 235380, 3409322, 340933
• CPC Class Codes: G06Q 20/18 involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
• CPC Class Codes: G06Q 30/0268 at point-of-sale [POS]
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 50/12 Hotels or restaurants

Abstract

A method includes: in response to detection of a patron, capturing N sets of identification data for the patron using N passive patron identification systems, respectively, wherein N is an integer greater than one; calculating N partial confidence values based on N comparisons of the N sets of identification data with N sets of stored identification data, respectively, associated with a unique patron identifier; and, based on the N partial confidence values, calculating an overall confidence value indicating a level of confidence that the patron is associated with the unique patron identifier. The method further includes: based on the unique patron identifier, retrieving stored ordering data that is associated with the unique patron identifier; setting ordering information to be output to the patron based on the overall confidence value and the stored ordering data; and outputting the ordering information to the patron using an ordering terminal.

Claims

1. A method of enhancing an ordering experience, the method comprising:

in response to detection of a patron, capturing N sets of identification data for the patron using N passive data capture devices, respectively,

wherein N is an integer greater than one, the N passive data capture devices including at least two of a wireless transceiver, a first camera arranged to capture images of faces of patrons, a microphone, a scent sensor, an infrared transceiver, a second camera arranged to capture images of wheels of vehicles, and at least one of a third camera arranged to capture images of front portions of vehicles, and a fourth camera arranged to capture images of rear portions of vehicles;

by a server, determining N weighting values for weighting contributions of N partial confidence values;

by the server, based on an ambient condition at an ordering terminal, selectively adjusting at least one of the N weighting values, the selectively adjusting including;

as ambient lighting at the ordering terminal decreases, decreasing first, second, and third ones of the N weighting values associated with images of wheels of vehicles, images of portions of vehicles, and images of faces of patrons, respectively; and

as the ambient lighting at the ordering terminal increases, increasing the first, second, and third ones of the N weighting values associated with images of wheels of vehicles, images of portions of vehicles, and images of faces of patrons, respectively;

by the server, calculating overall confidence values for a plurality of unique patron identifiers, respectively, including, for each unique patron identifier of the plurality of unique patron identifiers;

calculating N partial confidence values for that unique patron identifier based on N comparisons of the N sets of identification data with N sets of stored identification data, respectively, associated with that unique patron identifier;

by weighting the N partial confidence values of that unique patron identifier based on the N weighting values, respectively, calculating the overall confidence value for that unique patron identifier indicating a level of confidence that the patron is associated with that unique patron identifier;

selecting one unique patron identifier of the plurality of unique patron identifiers having the highest one of the overall confidence values;

based on the selected one unique patron identifier, retrieving stored ordering data that is associated with the selected one unique patron identifier;

setting ordering information to be output to the patron based on the overall confidence value of the selected one unique patron identifier and the stored ordering data; and

by the ordering terminal, displaying the ordering information to the patron on a display of the ordering terminal.

2. The method of claim 1 wherein the N sets of identification data include at least two of:

data indicative of an image of a face of the patron;

data indicative of an image of at least a portion of the patron'"'"'s vehicle;

data indicative of a voice of the patron; and

data indicative of a unique identifier of an electronic device that communicates wirelessly.

3. The method of claim 1 wherein the N sets of identification data include data indicative of an image of a wheel of a portion of the patron'"'"'s vehicle.

4. The method of claim 1 wherein the N sets of identification data include data indicative of a side portion of the patron'"'"'s vehicle.

5. The method of claim 1 wherein the N sets of identification data include data indicative of a front portion of the patron'"'"'s vehicle.

6. The method of claim 1 wherein the N sets of identification data include data indicative of a rear portion of the patron'"'"'s vehicle.

7. The method of claim 1 wherein the stored ordering data includes data indicative of at least one previously ordered menu item associated with the selected one unique patron identifier.

8. The method of claim 1 further comprising:

receiving data indicative of an order placed by the patron; and

storing the data indicative of the order placed by the patron in association with the selected one unique patron identifier.

9. The method of claim 8 further comprising:

determining a food preference of the patron based on the order placed by the patron; and

storing data indicative of the food preference of the patron in association with the selected one unique patron identifier.

10. The method of claim 1 wherein setting the ordering information to be output to the patron includes setting an ordering menu to be displayed to the patron on the display of the ordering terminal to a predetermined ordering menu when the overall confidence value of the selected one unique identifier is less than a predetermined value.

11. The method of claim 10 wherein setting the ordering information to be output to the patron includes setting the ordering menu to be displayed to the patron to an adjusted ordering menu that is different than the predetermined ordering menu when the overall confidence value of the selected one unique identifier is greater than the predetermined value.

12. The method of claim 11 further comprising determining locations for menu items on the adjusted ordering menu based on the stored ordering data.

13. The method of claim 11 further comprising changing a visual attribute of at least one menu item on the adjusted ordering menu, relative to the predetermined ordering menu, based on the stored ordering data.

14. The method of claim 10 wherein setting the ordering information to be output to the patron includes removing at least one menu item from the predetermined ordering menu when the overall confidence value of the selected one unique identifier is greater than the predetermined value.

15. The method of claim 14 further comprising determining the at least one menu item for removal from the predetermined ordering menu based on the stored ordering data.

16. The method of claim 1 wherein setting the ordering information to be output to the patron includes setting a language for displaying the ordering information to the patron when the overall confidence value of the selected one unique identifier is greater than a predetermined value.

17. The method of claim 1 wherein setting the ordering information to be output to the patron includes setting the ordering information to include at least one previously ordered menu item associated with the selected one unique patron identifier when the overall confidence value is greater than a predetermined value.

18. The method of claim 1 further comprising, by the server, when the overall confidence value of the selected one unique identifier is less than a predetermined value:

creating a new unique patron identifier in a database; and

storing the N sets of identification data captured in association with the new unique patron identifier.

19. The method of claim 18 further comprising, when the overall confidence value is greater than the predetermined value, by the server, selectively updating at least one of the N sets of stored identification data associated with the selected one unique patron identifier based on at least one of the N sets of identification data captured for the patron, respectively.

20. The method of claim 19 further comprising, when the overall confidence value is greater than the predetermined value, selectively updating the stored ordering data based on data indicative of an order placed by the patron.

21. The method of claim 1 wherein calculating the overall confidence values includes, for each unique patron identifier of the plurality of unique patron identifiers, calculating the overall confidence value for that unique patron identifier based on the equation:

C=1−

Π

_m=1^N(1−

Wm*Cm),

where C is the overall confidence value for that unique patron identifier, Π

denotes use of the product function, m is an integer less than or equal to N, Cm is an m-th one of the N partial confidence values calculated based on an m-th comparison of an m-th one of the N sets of identification data and an m-th one of the N sets of stored identification data, Cm is a value between 0 and 1, and Wm is an m-th one of the N weighting values and is between 0 and 1.

22. The method of claim 1 further comprising:

calculating at least one additional partial confidence value based on at least one comparison of at least one of the N sets of identification data with additional sets of stored identification data, respectively, associated with a general characteristic;

based on the at least one additional partial confidence value, calculating a second overall confidence value indicating a second level of confidence that the patron has the general characteristic; and

,

based on the second overall confidence value, selectively setting the ordering information to be output to the patron further based on the general characteristic.

23. The method of claim 1 further comprising, by the server:

receiving data indicative of an order placed by the patron;

when the overall confidence value of the selected one unique identifier is less than a predetermined value;

creating a new unique patron identifier in a database; and

storing, in association with the new unique patron identifier;

(i) the N sets of identification data captured and (ii) the data indicative of the order placed by the patron; and

when the overall confidence value of the selected one unique identifier is greater than the predetermined value, selectively updating data associated with the selected one unique patron identifier based on;

(i) the N sets of identification data captured and (ii) the data indicative of the order placed by the patron.

24. The method of claim 1 wherein setting the ordering information to be output to the patron includes:

when the overall confidence value of the selected one unique identifier is less than a first predetermined value, setting an ordering menu to be displayed to the patron on the display of the ordering terminal to a predetermined ordering menu;

when the overall confidence value of the selected one unique identifier is greater than the first predetermined value and less than a second predetermined value, setting the ordering menu to be displayed to the patron to an adjusted ordering menu that is different than the predetermined ordering menu; and

when the overall confidence value is greater than the second predetermined value, setting the ordering information to include at least one previously ordered menu item associated with the selected one unique patron identifier.

25. An ordering system, comprising:

N passive data capture devices that, in response to detection of a patron, capture N sets of identification data for the patron, respectively,

wherein N is an integer greater than one, the N passive data capture devices including at least two of a wireless transceiver, a first camera arranged to capture images of faces of patrons, a microphone, a scent sensor, an infrared transceiver, a second camera arranged to capture images of wheels of vehicles, a third camera arranged to capture images of front portions of vehicles, and a fourth camera arranged to capture images of rear portions of vehicles;

a server comprising;

a weighting module that determines N weighting values for weighting contributions of N partial confidence values and that, based on an ambient condition at an ordering terminal, selectively adjusts at least one of the N weighting values, the selective adjustment including;

as ambient lighting at the ordering terminal decreases, decreasing first, second, and third ones of the N weighting values associated with images of wheels of vehicles, images of portions of vehicles, and images of faces of patrons, respectively; and

as the ambient lighting at the ordering terminal increases, increasing the first, second, and third ones of the N weighting values associated with images of wheels of vehicles, images of portions of vehicles, and images of faces of patrons, respectively; and

a confidence calculation module that calculates overall confidence values for a plurality of unique patron identifiers, respectively,

wherein, for each unique patron identifier of the plurality of unique patron identifiers, the confidence calculation module;

calculates N partial confidence values for that unique patron identifier based on N comparisons of the N sets of identification data with N sets of stored identification data, respectively, associated with that unique patron identifier; and

,

by weighting the N partial confidence values for that unique patron identifier based on the N weighting values, respectively, calculates the overall confidence value for that unique patron identifier indicating a level of confidence that the patron is associated with that unique patron identifier; and

a patron identifier selection module that selects one unique patron identifier of the plurality of unique patron identifiers having the highest one of the overall confidence values;

a profile retrieving module that, based on the selected one unique patron identifier, retrieves stored ordering data that is associated with the selected one unique patron identifier; and

a control module that sets ordering information to be output to the patron based on the overall confidence value of the selected one unique patron identifier and the stored ordering data and that displays the ordering information to the patron on a display of the ordering terminal.

26. The ordering system of claim 25 wherein the N sets of identification data include at least two of:

data indicative of an image of a face of the patron;

data indicative of an image of at least a portion of the patron'"'"'s vehicle;

data indicative of a voice of the patron; and

data indicative of a unique identifier of an electronic device that communicates wirelessly.

27. The ordering system of claim 25 wherein the N sets of identification data include data indicative of an image of a wheel of a portion of the patron'"'"'s vehicle.

28. The ordering system of claim 25 wherein the N sets of identification data include data indicative of a side portion of the patron'"'"'s vehicle.

29. The ordering system of claim 25 wherein the N sets of identification data include data indicative of a front portion of the patron'"'"'s vehicle.

30. The ordering system of claim 25 wherein the N sets of identification data include data indicative of a rear portion of the patron'"'"'s vehicle.

31. The ordering system of claim 25 wherein the stored ordering data includes data indicative of at least one previously ordered menu item associated with the selected one unique patron identifier.

32. The ordering system of claim 25 wherein the server further comprises:

an updating module that receives data indicative of an order placed by the patron and that stores the data indicative of the order placed by the patron in association with the selected one unique patron identifier.

33. The ordering system of claim 32 wherein the updating module further:

determines a food preference of the patron based on the order placed by the patron; and

stores data indicative of the food preference of the patron in association with the selected one unique patron identifier.

34. The ordering system of claim 25 wherein the control module sets an ordering menu to be displayed to the patron on the display of the ordering terminal to a predetermined ordering menu when the overall confidence value of the selected one unique patron identifier is less than a predetermined value.

35. The ordering system of claim 34 wherein the control module sets the ordering menu to be displayed to the patron to an adjusted ordering menu that is different than the predetermined ordering menu when the overall confidence value of the selected one unique patron identifier is greater than the predetermined value.

36. The ordering system of claim 35 wherein the control module determines locations for menu items on the adjusted ordering menu based on the stored ordering data.

37. The ordering system of claim 35 wherein the control module changes a visual attribute of at least one menu item on the adjusted ordering menu, relative to the predetermined ordering menu, based on the stored ordering data.

38. The ordering system of claim 34 wherein the control module removes at least one menu item from the predetermined ordering menu when the overall confidence value of the selected one unique patron identifier is greater than the predetermined value.

39. The ordering system of claim 38 wherein the control module determines the at least one menu item for removal from the predetermined ordering menu based on the stored ordering data.

40. The ordering system of claim 25 wherein the control module sets a language for displaying the ordering information to the patron when the overall confidence value of the selected one unique patron identifier is greater than a predetermined value.

41. The ordering system of claim 25 wherein the control module sets the ordering information to include at least one previously ordered menu item associated with the selected one unique patron identifier when the overall confidence value of the selected one unique patron identifier is greater than a predetermined value.

42. The ordering system of claim 25 wherein the server further comprises an updating module that, when the overall confidence value of the selected one unique patron identifier is less than a predetermined value:

creates a new unique patron identifier in a database; and

stores the N sets of identification data captured in association with the new unique patron identifier.

43. The ordering system of claim 42 wherein the server further comprises an updating module that, when the overall confidence value of the selected one unique patron identifier is greater than the predetermined value, selectively updates at least one of the N sets of stored identification data associated with the selected one unique patron identifier based on at least one of the N sets of identification data captured for the patron, respectively.

44. The ordering system of claim 43 wherein the server further comprises an updating module that, when the overall confidence value of the selected one unique patron identifier is greater than the predetermined value, selectively updates the stored ordering data based on data indicative of an order placed by the patron.

45. The ordering system of claim 25 wherein, for each unique patron identifier of the plurality of unique patron identifiers, the confidence calculation module calculates the overall confidence value for that unique patron identifier based on the equation:

C=1−

Π

_m=1^N(1−

Wm*Cm),

where C is the overall confidence value for that unique patron identifier, Π

denotes use of the product function, m is an integer less than or equal to N, Cm is an m-th one of the N partial confidence values calculated based on an m-th comparison of an m-th one of the N sets of identification data and an m-th one of the N sets of stored identification data, Cm is a value between 0 and 1, and Wm is an m-th one of the N weighting values and is between 0 and 1.

46. The ordering system of claim 25 wherein the confidence calculation module further:

calculates at least one additional partial confidence value based on at least one comparison of at least one of the N sets of identification data with additional sets of stored identification data, respectively, associated with a general characteristic;

based on the at least one additional partial confidence value, calculates a second overall confidence value indicating a second level of confidence that the patron has the general characteristic; and

,

based on the second overall confidence value, selectively sets the ordering information to be output to the patron further based on the general characteristic.

47. The ordering system of claim 25 wherein the server further comprises an updating module that:

receives data indicative of an order placed by the patron;

when the overall confidence value of the selected one unique identifier is less than a predetermined value;

creates a new unique patron identifier in a database; and

stores, in association with the new unique patron identifier;

(i) the N sets of identification data captured and (ii) the data indicative of the order placed by the patron; and

when the overall confidence value of the selected one unique identifier is greater than the predetermined value, selectively updates data associated with the selected one unique patron identifier based on;

(i) the N sets of identification data captured and (ii) the data indicative of the order placed by the patron.

48. The ordering system of claim 25 wherein the control module:

when the overall confidence value of the selected one unique identifier is less than a first predetermined value, sets an ordering menu to be displayed to the patron on the display of the ordering terminal to a predetermined ordering menu;

when the overall confidence value of the selected one unique identifier is greater than the first predetermined value and less than a second predetermined value, sets the ordering menu to be displayed to the patron to an adjusted ordering menu that is different than the predetermined ordering menu; and

when the overall confidence value is greater than the second predetermined value, sets the ordering information to include at least one previously ordered menu item associated with the selected one unique patron identifier.