Staying state analysis device, staying state analysis system and staying state analysis method

• US 10,180,326 B2
• Filed: 10/22/2014
• Issued: 01/15/2019
• Est. Priority Date: 10/29/2013
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Gouda, Youichi, Matsumoto, Yuichi, Yoshio, Hiroaki
• Primary Examiner(s): Yi, Roy Y
• Assistant Examiner(s): AIELLO, JEFFREY P
• Application Number:
  US14/520,769
• Publication Number:
  US 20150120237A1
• Time in Patent Office: 1,546 Days
• Field of Search: 382103, 382107, 701117, 701532, 702150
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion

Abstract

A staying state analysis device measuring a stay frequency of moving objects in a target area and generating a heat map visualizing a state of distribution of the stay frequency includes: a position information sorter sorting pieces of position information of the moving objects according to a degree of possibility that the pieces of position information may include an error due to a missing part that may be in traffic lines of the moving objects; a missing part position detector detecting a position of the missing part in the traffic lines based on at least two groups of pieces of position information sorted by the sorter; a corrected distribution information generator generating corrected distribution information representing the stay frequency of the moving objects corrected based on a result of detection by the missing part position detector; and a heat map generator generating the heat map based on corrected distribution information.

Claims

1. A staying state analysis device for measuring a stay frequency of moving objects in a target area and generating a heat map visualizing a state of distribution of the stay frequency for display on a display device, the staying state analysis device comprising:

a processor; and

a memory storing instructions,

wherein the processor, when performing the instructions stored in the memory, comprises;

a position information sorter that sorts pieces of position information of the moving objects obtained from a moving object detection device in accordance with a degree of possibility that the pieces of position information may include an error due to a missing part of the moving objects that may be created in queues of the moving objects, the position information sorter comprising an occlusion event detector that;

detects, based on the pieces of position information of the moving objects, an occlusion event that may cause the missing part of the moving objects to be created in the queues of the moving objects, and

sorts the pieces of position information based on whether the occlusion event is detected by the occlusion event detector;

a distribution information comparator that generates;

two sets of distribution information for comparison, each representing a state of distribution of the stay frequency of the moving objects, respectively from at least two groups of pieces of position information sorted by the position information sorter, and compares the two sets of distribution information for comparison with each other; and

differential distribution information which is a difference between the two sets of distribution information for comparison;

a missing part position detector that detects a position of the missing part in the queues based on;

the at least two groups of pieces of position information sorted by the position information sorter, and

the differential distribution information;

a corrected distribution information generator that generates corrected distribution information representing the stay frequency of the moving objects corrected based on a result of detection by the missing part position detector; and

a heat map generator that, due to the detected missing part, generates an improved heat map free of either of multiple counted and missed counted moving objects, based on the corrected distribution information generated by the corrected distribution information generator such that the improved heat map visualizes the state of distribution of the stay frequency for display on the display device.

2. The staying state analysis device according to claim 1, wherein the occlusion event detector detects, as the occlusion event, a congestion event in which a plurality of the moving objects are present densely.

3. The staying state analysis device according to claim 1, wherein the occlusion event detector detects, as the occlusion event, a queuing event in which a plurality of the moving objects stand in one of the queues.

4. The staying state analysis device according to claim 1, wherein the heat map generator generates a segmented heat map representing the stay frequency of the moving objects for each of a plurality of division areas defined by segmenting the target area.

5. The staying state analysis device according to claim 1, wherein the heat map generator varies at least one of visualization elements of the heat map including hue, shade, and pattern image to visualize the state of distribution of the stay frequency of the moving objects.

6. The staying state analysis device according to claim 1, wherein the heat map generator generates a point-to-point heat map visualizing a movement frequency of the moving objects between two points in the target area.

7. A staying state analysis system for measuring a stay frequency of moving objects in a target area and generating a heat map visualizing a state of distribution of the stay frequency for display on a display device, the system comprising:

a moving object detection device that detects moving objects in the target area and outputs pieces of position information of the moving objects;

the display device that displays the heat map; and

a plurality of information processing devices,

wherein the plurality of information processing devices jointly comprise;

a position information sorter that sorts the pieces of position information of the moving objects obtained from the moving object detection device in accordance with a degree of possibility that the pieces of position information may include an error due to a missing part of the moving objects that may be created in queues of the moving objects, the position information sorter comprising an occlusion event detector that;

detects, based on the pieces of position information of the moving objects, an occlusion event that may cause the missing part of the moving objects to be created in the queues of the moving objects, and

sorts the pieces of position information based on whether the occlusion event is detected by the occlusion event detector;

a distribution information comparator that generates;

two sets of distribution information for comparison, each representing a state of distribution of the stay frequency of the moving objects, respectively from at least two groups of pieces of position information sorted by the position information sorter, and compares the two sets of distribution information for comparison with each other; and

differential distribution information which is a difference between the two sets of distribution information for comparison;

a missing part position detector that detects a position of the missing part in the queues based on;

the at least two groups of pieces of position information sorted by the position information sorter; and

the differential distribution information;

a corrected distribution information generator that generates corrected distribution information representing the stay frequency of the moving objects corrected based on a result of detection by the missing part position detector; and

a heat map generator that, due to the detected missing part, generates an improved heat map free of either of multiple counted and missed counted moving objects, based on the corrected distribution information generated by the corrected distribution information generator such that the improved heat map visualizes the state of distribution of the stay frequency for display on the display device.

8. A staying state analysis method for performing, with an information processing device, a process of measuring a stay frequency of moving objects in a target area and generating a heat map visualizing a state of distribution of the stay frequency for display on a display device, the method comprising:

sorting pieces of position information of the moving objects obtained from a moving object detection device in accordance with a degree of possibility that the pieces of position information may include an error due to a missing part of the moving objects that may be created in queues of the moving objects;

detecting, based on the pieces of position information of the moving objects, an occlusion event that may cause the missing part of the moving objects to be created in the queues of the moving objects;

sorting the pieces of position information based on the detecting of the occlusion event;

generating;

two sets of distribution information for comparison, each representing a state of distribution of the stay frequency of the moving objects, respectively from at least two groups of pieces of position information sorted by the sorting, and comparing the two sets of distribution information with each other; and

differential distribution information which is a difference between the two sets of distribution information for the comparing;

detecting a position of the missing part in the traffic lines based on;

the at least two groups of pieces of position information sorted by the sorting; and

the differential distribution information;

generating corrected distribution information representing the stay frequency of the moving objects corrected based on a result of the detecting; and

generating, due to the detected missing part, an improved heat map free of either of multiple counted and missed counted moving objects, based on the corrected distribution information,

wherein at least one of the sorting pieces of position information, the detecting a position of the missing part in the traffic lines, the generating corrected distribution information, and the generating the heat map is performed by a processor such that the improved heat map visualizes the state of distribution of the stay frequency for display on the display device.