Acoustically monitored shopper traffic surveillance and security system for shopping malls and retail space

• US 5,712,830 A
• Filed: 12/28/1995
• Issued: 01/27/1998
• Est. Priority Date: 08/19/1993
• Status: Expired due to Fees

• Current Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Plumlee, William Wayne, Ross, Paul C., Kononov, Alex
• Primary Examiner(s): MULLEN, THOMAS J
• Application Number:
  US08/580,219
• Time in Patent Office: 761 Days
• Field of Search: 367/93, 340/541, 348/150, 377/6, 364/516, 364/517, 902/6, 187/390-392
• US Class Current: 367/93
• CPC Class Codes: G01S 15/02 using reflection of acoustic waves G01S15/66 takes precedence
• CPC Class Codes: G01S 15/50 Systems of measurement, based on relative movement of the target
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G07F 19/207 Surveillance aspects at ATMs
• CPC Class Codes: G08B 13/1636 using pulse-type detection circuits

Abstract

Acoustic surveillance of objects and human traffic in spatial zones of a shopping mall and associated retail selling space is used to detect shopper traffic movement and from it, traffic data such as: shopper volume, shopper flow, crowding, and also unusual motion such as crowd surges that might connote an emergency situation. The apparatus uses phased arrays of acoustic transducers including arrays oriented in a vertical aspect which enables differentiation of non-shopping young children to arrive at more accurate headcount figures. Several specific types of detected movement defined as abnormal trigger an alert to a remote monitoring station. The alerts are automatically prioritized using rule-based criteria. Enhanced surveillance of the alert site by audio links as well as site alert history information are also provided.

Claims

1. For a defined spatial zone having fixed structures and a pattern of normal human movement, apparatus for identifying said human movement and deriving therefrom traffic flow indicia, said apparatus comprising:

means for transmitting periodic bursts of acoustic energy from one or more sites in said zone to generate return echoes from said fixed structures and from individual humans in movement;

an array of horizontally oriented directional microphones at selected ones of said sites and an array of vertically oriented directional microphones mounted at selected ones of said sites,

the adjacent microphones of each said array being disposed at successive incremental horizontal or vertical angles, thereby to create at each site a plurality of adjacent horizontal and/or vertical beams of return echoes from discrete horizontal or vertical sectors of said spatial zone;

a data base comprising;

means for storing data frames representing a time series of spatial maps generated from said return echoes of objects, each said map containing indicia of said moving humans, including data on the distance and relative direction from said transmitting means for each said object; and

means for comparing said maps of successive said data frames to determine the total number of humans and the changes in the spatial location of said moving humans within said spatial zone.

2. Apparatus in accordance with claim 1, wherein said defined spatial zone comprises a shopping area including access portals to an interior space comprising sales counters located along shopper aisles.

3. Apparatus in acccordance with claim 2, further comprising:

means for deriving from said return echoes received by each said vertically arrayed microphone a unique indicia of vertical height of individual moving humans causing said return echoes; and

means for comparing said height indicia to a preselected threshold value, those indicia falling below said threshold being deemed to be children and those indicia at or above said threshold being deemed to be adults.

4. Apparatus in accordance with claim 3, further comprising means for determining, for a given set of return echoes from a moving human received by an array of said vertically oriented directional microphones, which microphone of said array is the last to receive a said return echo, and

means for recording in said data base the unique vertical height value associated with said last microphone, said value being taken as the height of the moving human within said vertical beam.

5. Apparatus in accordance with claim 4, further comprising:

means for locating two or more of said vertical beams of return echoes in adjacent relation at a selected place along one of said aisles;

means for comparing the relative amplitudes of the return echoes received by corresponding ones of said microphones for adjacent ones of said vertical beams of return echoes; and

means for deriving from said comparison an indicia of the vertical height of a human moving through said acoustic energy bursts at said selected place.

6. Apparatus in accordance with claim 3, further comprising:

means for locating two or more of said vertical beams of return echoes in adjacent relation across several or all of said access portals;

means for determining the relative vertical height of individual humans causing said vertical beams of return echoes;

means for accessing data derived from said two or more vertical beams of return echoes to determine the direction of movement of said moving humans through said access portal; and

means for deriving from said last two-named means a running indicia of how many adult shoppers and non-shopping children at any one time are within said shopping area.

7. Apparatus in accordance with claim 3, further comprising:

means for deriving, from information on said changes in the spatial location of said moving humans at a selected said sales counter of said spatial zone, indicia of human traffic slowdown or stoppage at said counter; and

means for recording one or more of the parameters of time, place and duration of said traffic slowdown or stoppage.

8. Apparatus in accordance with claim 3, wherein said data base further comprises data collected as to normal shopper traffic flow rates and density as a function of time of day and location;

and wherein said apparatus further comprises;

means for comparing either or both instantaneous traffic flow velocity and traffic density measures at one or more selected places to said normal data; and

means, including predetermined threshold values representative of non-normal traffic flow rates or density for determining when said instantaneous measures exceed said normal traffic flow rates or density, for signaling an alert.

9. Apparatus in accordance with claim 3, wherein said data base further comprises:

data representative of the quiescent state of said shopping area including its said aisles during after-hours when no customers are present;

means for detecting return echoes denoting movement within said shopping area during after-hours;

and means responsive to detecting of said return echoes for signaling an alert.

10. Apparatus in accordance with claim 9, further comprising means for disabling portions of said spatial map covering areas where after-hours movement is authorized to take place, thereby to avoid triggering said alert due to detection of authorized movement.

11. Apparatus in accordance with claim 1, further comprising means for generating a spatial reference map based only on return echo signals from said fixed structures, and means for composing each said data frame with said fixed structure return echo signals removed.