INFORMATION PROCESSING APPARATUS, CONTROL METHOD, AND PROGRAM

• US 20200134323A1
• Filed: 05/18/2018
• Published: 04/30/2020
• Est. Priority Date: 06/30/2017
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: OAMI, Ryoma
• Granted Patent: US 11,301,692 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An information processing apparatus detects an object queue from a video frame and generates tracking information indicating a position of each tracking target object, where each object included in the object queue is the tracking target object. The information processing apparatus generates queue behavior information related to a behavior of the object queue at a first time point using the tracking information at the first time point. The information processing apparatus computes an estimated position of each tracking target object at a second time point later than the first time point based on the tracking information and the queue behavior information at the first time point. The information processing apparatus updates the tracking information based on the position of each object detected from the video frame at the second time point and the estimated position of each tracking target object at the second time point.

Claims

1. An information processing apparatus comprising:

a generation unit that detects a queue of objects from a video frame and generates tracking information indicating a position of each tracking target object, wherein each object included in the detected queue is handled as the tracking target object;

a queue behavior estimation unit that estimates a behavior of the queue at a first time point, and generates queue behavior information related to the behavior of the queue using the tracking information related to the tracking target object at the first time point;

an estimated position computation unit that computes an estimated position of each tracking target object at a second time point later than the first time point based on the tracking information and the queue behavior information at the first time point; and

an update unit that detects one or more objects from the video frame at the second time point and updates information of each tracking target object indicated in the tracking information based on a position of each detected object and the estimated position of each tracking target object at the second time point.

2. The information processing apparatus according to claim 1,

wherein the update unit updates the tracking information related to the tracking target object by associating the tracking target object whose position at the second time point is estimated with the object detected from the video frame at the second time point.

3. The information processing apparatus according to claim 1,

wherein the queue behavior estimation unit estimates one of a standstill state where all tracking target objects stand still, a whole movement state where all tracking target objects are moving, and a partial movement state where a part of the tracking target objects is moving as a state of the queue and generates the queue behavior information indicating the estimated state of the queue.

4. The information processing apparatus according to claim 3,

wherein in a case where the state of the queue is the partial movement state, the queue behavior estimation unit includes information for identifying a movement region in which the tracking target object is moving and a standstill region in which the tracking target object stands still in the queue behavior information.

5. The information processing apparatus according to claim 4,

wherein the estimated position computation unit computes the estimated position of the tracking target object by estimating that the tracking target object that is positioned in a predetermined range behind the movement region and is in the standstill state will move.

6. The information processing apparatus according to claim 5,

wherein the estimated position computation unit estimates a magnitude of a motion of the tracking target object which is positioned in the predetermined range behind the movement region and is in the standstill state based on a magnitude of a motion of the movement region or a magnitude of a motion of the tracking target object included in the movement region.

7. The information processing apparatus according to claim 4,

wherein the estimated position computation unit computes the position of the tracking target object by estimating that a motion of the tracking target object that is positioned in a predetermined range behind the standstill region and is in the movement state is smaller than a magnitude of a motion indicated in the tracking information.

8. The information processing apparatus according to claim 1,

wherein the update unit preferentially associates the tracking target object in the standstill state among the tracking target objects.

9. A computer-implemented control method comprising:

detecting a queue of objects from a video frame and generating tracking information indicating a position of each tracking target object, wherein each object included in the detected queue is handled as the tracking target object;

estimating a behavior of the queue at a first time point and generating queue behavior information related to the behavior of the queue using the tracking information related to the tracking target object at the first time point;

computing an estimated position of each tracking target object at a second time point later than the first time point based on the tracking information and the queue behavior information at the first time point; and

detecting one or more objects from the video frame at the second time point and updating information of each tracking target object indicated in the tracking information based on a position of each detected object and the estimated position of each tracking target object at the second time point.

10. The control method according to claim 9,

wherein the tracking information related to the tracking target object is updated by associating the tracking target object whose the position at the second time point is estimated with the object detected from the video frame at the second time point.

11. The control method according to claim 9,

wherein one of a standstill state where all tracking target objects stand still, a whole movement state where all tracking target objects are moving, and a partial movement state where a part of the tracking target objects is moving is estimated as a state of the queue, and the queue behavior information indicating the estimated state of the queue is generated.

12. The control method according to claim 11,

wherein in a case where the state of the queue is the partial movement state, information for identifying a movement region in which the tracking target object is moving and a standstill region in which the tracking target object stands still is included in the queue behavior information.

13. The control method according to claim 12,

wherein the estimated position of the tracking target object is computed by estimating that the tracking target object that is positioned in a predetermined range behind the movement region and is in the standstill state will move.

14. The control method according to claim 13,

wherein a magnitude of a motion of the tracking target object which is positioned in the predetermined range behind the movement region and is in the standstill state is estimated based on a magnitude of a motion of the movement region or a magnitude of a motion of the tracking target object included in the movement region.

15. The control method according to claim 12,

wherein the position of the tracking target object is computed by estimating that a motion of the tracking target object that is positioned in a predetermined range behind the standstill region and is in the movement state is smaller than a magnitude of a motion indicated in the tracking information.

16. The control method according to claim 9,

wherein the tracking target object in the standstill state is preferentially associated among the tracking target objects.

17. A non-transitory computer-readable medium storing a program causing a computer to execute the control method according to claim 9.