Techniques for automatic real-time calculation of user wait times

• US 10,339,544 B2
• Filed: 07/01/2015
• Issued: 07/02/2019
• Est. Priority Date: 07/02/2014
• Status: Active Grant

• Current Assignee: WaitTime, LLC
• Original Assignee: WaitTime, LLC
• Inventors: Klima, Zachary, Sterling, Thomas, Mars, Jr., John, Mosher, Doyle
• Primary Examiner(s): Knox, Tyler W
• Application Number:
  US14/789,320
• Publication Number:
  US 20160005053A1
• Time in Patent Office: 1,462 Days
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G07C 11/00 Arrangements, systems or apparatus for checking, e.g. the occurrence of a condition, not provided for elsewhere
• CPC Class Codes: G07C 2011/04 related to queuing systems
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A computer-implemented technique can process overhead images of users in a line at a venue to obtain a user wait time for the line. The processing can include (a) identifying a user of the group of users that is second in the line to obtain a target user, (b) detecting when the target user becomes first in the line to obtain a start time, (c) after the target user becomes first in the line, detecting when the target user leaves the line to obtain an end time, (d) determining a period from the start time to the end time, and (e) calculating the user wait time by calculating a product of (i) the determined period and (ii) a quantity of the group of users in the line after the target user leaves the line. The calculated user wait time can then be output.

Claims

1. A computer-implemented method, comprising:

receiving, at a computing system from an overhead camera system, the computing system having one or more processors, overhead images of a group of users in a line at a venue, wherein the overhead camera system includes at least one overhead fish-eye lens camera (i) mounted to a ceiling in an area above the line and (ii) configured to capture the overhead images;

wherein the overhead camera system is configured to capture the overhead images at a frame rate based on a mounting height of the ceiling to which the camera system is mounted, wherein higher mounting heights correspond to higher frame rates and lower mounting heights correspond to lower frame rates;

performing, by the computing system, edge correction on the overhead images by adjusting the edges of the overhead images to account for distortion caused by curvature of the fish-eye lens to obtain corrected overhead images;

applying, by the computing system, a set of filters to the corrected overhead images to at least obtain filtered overhead images, wherein each filter of the set of filters further distinguishes humans from noise;

generating, by the computing system, an x-y coordinate system for each of the filtered overhead images and identifying each user in the filtered overhead images as a point or a circle having a specific x-y coordinate or a specific range of x-y coordinates;

monitoring, by the computing system, the group of users using vector representations in the x-y coordinate system to obtain a user wait time for the line, the monitoring including;

(a) identifying the group of users and a user of the group of users that is second in the line to obtain a target user,

(b) detecting when the target user becomes first in the line to obtain a start time,

(c) after the target user becomes first in the line, detecting when the target user leaves the line to obtain an end time,

(d) determining a period from the start time to the end time, and

(e) calculating the user wait time by calculating a product of (i) the determined period and (ii) a quantity of the group of users in the line after the target user leaves the line; and

outputting, from the computing system, the calculated user wait time.

2. The computer-implemented method of claim 1, further comprising:

combining, by the computing system, two or more of the filtered overhead images to obtain a combined filtered overhead image; and

monitoring, by the computing system, the group of users in the combined filtered overhead image to obtain the user wait time for the line.

3. The computer-implemented method of claim 1, further comprising ignoring or disregarding, at the computing system, a specific target user in calculating the user wait time based on a movement speed of the specific target user, wherein the specific target user is ignored or disregarded when their movement speed is greater than a speed threshold indicative of a high likelihood that the specific target user is not waiting in the line.

4. The computer-implemented method of claim 1, wherein outputting the user wait time includes outputting the user wait time to at least one of (i) a mobile computing device in response to a user request from the mobile computing device and (ii) a remote computing system associated with a mobile application executable by mobile computing devices.

5. The computer-implemented method of claim 1, wherein the line is for one of (i) an entrance to the venue, (ii) an exit from the venue, (iii) a restroom at the venue, and (iv) a concession station at the venue, and wherein the venue is one of (i) an arena or stadium for a sporting or music event, (ii) a theme or amusement park, and (iii) a business or retail location.

11. The computer-implemented method of claim 1, wherein the computing system further trims portions of higher resolution images that are not being utilized in order to decrease processing throughput.

12. The computer-implemented method of claim 1, wherein the set of filters comprises a light filter that removes at least one of bright lights and reflective surfaces that could be inadvertently detected as humans.

13. The computer-implemented method of claim 1, wherein the set of filters comprises an edge detection filter that detects only the edges of objects and filters out other features, and wherein the detected edges are used to distinguish between humans and inanimate objects.

14. The computer-implemented method of claim 13, wherein the edge detection filter comprises both spatial and polychromatic edge filters.

15. The computer-implemented method of claim 1, wherein the set of filters comprises a debug filter that monitors a set of parameters of each user of the group of users, wherein the monitored set of parameters is used to identify the group of users.

16. The computer-implemented method of claim 15, wherein the set of parameters comprises a unique identifier, a height/weight ratio indicative of motion strength, a current motion strength, a positional/movement indicator, an age or duration that each user has been tagged, and a static weight.

17. The computer-implemented method of claim 16, wherein the debug filter further predicts each user'"'"'s path of movement based on their past and current paths of movement and, based on each predicted path of movement, identify the group of users.

6. An automatic, real-time user wait time calculation system, comprising:

an overhead camera system comprising at least one overhead fish-eye lens camera (i) mounted to a ceiling in an area above the line and (ii) configured to capture overhead images of a group of users in a line at a venue; and

a computing system in communication with the overhead camera system and configured to;

capture the overhead images at a frame rate based on a mounting height of the ceiling to which the camera system is mounted, wherein higher mounting heights correspond to higher frame rates and lower mounting heights correspond to lower frame rates;

perform edge correction on the overhead images by adjusting the edges of the overhead images to account for distortion caused by curvature of the fish-eye lens to obtain corrected overhead images;

apply a set of filters to the corrected overhead images to at least obtain filtered overhead images, wherein each filter of the set of filters further distinguishes humans from noise;

generate an x-y coordinate system for each of the filtered overhead images and identifying each user in the filtered overhead images as a point or a circle having a specific x-y coordinate or a specific range of x-y coordinates; and

monitor the group of users using vector representations in the x-y coordinate system to obtain a user wait time for the line, the monitoring including;

(a) identify the group of users and a user of the group of users that is second in the line to obtain a target user,

(b) detect when the target user becomes first in the line to obtain a start time,

(c) after the target user becomes first in the line, detect when the target user leaves the line to obtain an end time,

(d) determine a period from the start time to the end time,

(e) calculate the user wait time by calculating a product of (i) the determined period and (ii) a quantity of the group of users in the line after the target user leaves the line, and

(f) output the calculated user wait time.

7. The system of claim 6, wherein the computing system is further configured to:

combine two or more of the filtered overhead images to obtain a combined filtered overhead image; and

monitor the combined filtered overhead image to obtain the user wait time for the line.

8. The system of claim 6, wherein the computing system is further configured to ignore or disregard a specific target user in calculating the user wait time based on a movement speed of the specific target user, wherein the specific target user is ignored or disregarded when their movement speed is greater than a speed threshold indicative of a high likelihood that the specific target user is not waiting in the line.

9. The system of claim 6, wherein outputting the user wait time includes outputting the user wait time to at least one of (i) a mobile computing device in response to a user request from the mobile computing device and (ii) a remote computing system associated with a mobile application executable by mobile computing devices.

10. The system of claim 6, wherein the line is for one of (i) an entrance to the venue, (ii) an exit from the venue, (iii) a restroom at the venue, and (iv) a concession station at the venue, and wherein the venue is one of (i) an arena or stadium for a sporting or music event, (ii) a theme or amusement park, and (iii) a business or retail location.