VIDEO ANALYSIS APPARATUS, MONITORING SYSTEM, AND VIDEO ANALYSIS METHOD

• US 20150256835A1
• Filed: 02/23/2015
• Published: 09/10/2015
• Est. Priority Date: 03/05/2014
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: SAKAI, Atsunori
• Granted Patent: US 10,037,606 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction

Abstract

A video analysis apparatus includes: an identification unit that identifies whether each divided group includes a difference frame with a data size of a predetermined threshold value or more, the group being configured from video data which is encoded video data received from an imaging device captured a monitored base and is divided in units of groups each including a plurality of frames in a chronological order; a decoding unit that performs a decoding process on the plurality of frames of the group identified by the identification unit to include the difference frame with the data size of the predetermined threshold value or more; and a detection unit that performs image analysis on the decoded each frame to detect a moving object.

Claims

1. A video analysis apparatus comprising:

an identification unit that identifies whether each divided group includes a difference frame with a data size of a predetermined threshold value or more, the group being configured from video data which is encoded video data received from an imaging device captured a monitored base and is divided in units of groups each including a plurality of frames in a chronological order;

a decoding unit that performs a decoding process on the plurality of frames of the group identified by the identification unit to include the difference frame with the data size of the predetermined threshold value or more; and

a detection unit that performs image analysis on the decoded each frame to detect a moving object.

2. The video analysis apparatus according to claim 1,

wherein the identification unit identifies whether the group satisfies at least one of

(a) including at least one of the difference frames with the data sizes of the predetermined threshold value or more,

(b) an average value of the data sizes of the difference frames included in the group is the predetermined threshold value or more, and

(c) the difference frames with the data sizes of the predetermined threshold value or more are continuous by a predetermined number or more.

3. The video analysis apparatus according to claim 1, further comprising:

a video management information storage unit that stores a group identifier indicating the group and detection information representing whether a moving object has been detected from at least one frame included in the group indicated by the group identifier, in association with each other; and

a transmission unit that transmits the group to be subjected to the decoding process to the decoding unit,

wherein, with respect to each the divided group of the video data received from the imaging device, the transmission unit transmits the received group to the decoding unit when the detection information associated with a group identifier of a group immediately before the received group in a chronological order is information representing that the moving object has been detected, and transmits, to the decoding unit, the group identified by the identification unit to include the difference frame with the data size of the predetermined threshold value or more when the detection information is information representing that the moving object has not been detected, and

wherein the decoding unit performs a decoding process on the plurality of frames of the group transmitted from the transmission unit.

4. The video analysis apparatus according to claim 3, further comprising:

a plurality of video analysis units each including the decoding unit and the detection unit; and

an analysis information storage unit that manages whether the video analysis unit performs the decoding process or the image analysis,

wherein the transmission units specifies a video analysis unit not performing the decoding process or the image analysis among the plurality of video analysis units, and transmits a group to be subjected to the decoding process to the decoding unit included in the specified video analysis unit.

5. The video analysis apparatus according to claim 1, further comprising:

a video management information storage unit that stores a group identifier indicating the group and detection information representing whether a moving object has been detected from at least one frame included in the group indicated by the group identifier, in association with each other; and

a transmission unit that transmits the group or the frame to be subjected to the image analysis to the detection unit,

wherein, with respect to each the divided group of the video data received from the imaging device, the transmission unit transmits the received group to the decoding unit and transmits the group decoded by the decoding unit to the detection unit when the detection information associated with a group identifier of a group immediately before the received group in a chronological order is information representing that the moving object has been detected, and transmits, in the group identified by the identification unit to include the difference frame with the data size of the predetermined threshold value or more, the difference frame decoded by the decoding unit to the detection unit, when the detection information is information representing that the moving object has not been detected.

6. The video analysis apparatus according to claim 5, further comprising:

a plurality of video analysis units each including the detection unit; and

an analysis information storage unit that manages whether the video analysis unit performs the image analysis,

wherein the transmission unit specifies a video analysis unit not performing the image analysis among the plurality of video analysis units, and transmits a group or a frame to be subjected to the image analysis to the specified video analysis unit.

7. The video analysis apparatus according to claim 1, further comprising:

a determination unit that determines whether the video data, which is the encoded video data received from the imaging device captured the monitored base and has been divided in units of groups each including the plurality of frames in the chronological order, is data to be subjected to the image analysis,

wherein the determination unit transmits the video data determined to be the data to be subjected to the image analysis to the identification unit.

8. The video analysis apparatus according to claim 2, further comprising:

a video management information storage unit that stores a group identifier indicating the group and detection information representing whether a moving object has been detected from at least one frame included in the group indicated by the group identifier, in association with each other; and

a transmission unit that transmits the group to be subjected to the decoding process to the decoding unit,

wherein, with respect to each the divided group of the video data received from the imaging device, the transmission unit transmits the received group to the decoding unit when the detection information associated with a group identifier of a group immediately before the received group in a chronological order is information representing that the moving object has been detected, and transmits, to the decoding unit, the group identified by the identification unit to include the difference frame with the data size of the predetermined threshold value or more when the detection information is information representing that the moving object has not been detected, and

wherein the decoding unit performs a decoding process on the plurality of frames of the group transmitted from the transmission unit.

9. The video analysis apparatus according to claim 8, further comprising:

a plurality of video analysis units each including the decoding unit and the detection unit; and

an analysis information storage unit that manages whether the video analysis unit performs the decoding process or the image analysis,

wherein the transmission units specifies a video analysis unit not performing the decoding process or the image analysis among the plurality of video analysis units, and transmits a group to be subjected to the decoding process to the decoding unit included in the specified video analysis unit.

10. The video analysis apparatus according to claim 2, further comprising:

a video management information storage unit that stores a group identifier indicating the group and detection information representing whether a moving object has been detected from at least one frame included in the group indicated by the group identifier, in association with each other; and

a transmission unit that transmits the group or the frame to be subjected to the image analysis to the detection unit,

wherein, with respect to each the divided group of the video data received from the imaging device, the transmission unit transmits the received group to the decoding unit and transmits the group decoded by the decoding unit to the detection unit when the detection information associated with a group identifier of a group immediately before the received group in a chronological order is information representing that the moving object has been detected, and transmits, in the group identified by the identification unit to include the difference frame with the data size of the predetermined threshold value or more, the difference frame decoded by the decoding unit to the detection unit, when the detection information is information representing that the moving object has not been detected.

11. The video analysis apparatus according to claim 10, further comprising:

a plurality of video analysis units each including the detection unit; and

an analysis information storage unit that manages whether the video analysis unit performs the image analysis,

wherein the transmission unit specifies a video analysis unit not performing the image analysis among the plurality of video analysis units, and transmits a group or a frame to be subjected to the image analysis to the specified video analysis unit.

12. The video analysis apparatus according to claim 2, further comprising:

a determination unit that determines whether the video data, which is the encoded video data received from the imaging device captured the monitored base and has been divided in units of groups each including the plurality of frames in the chronological order, is data to be subjected to the image analysis,

wherein the determination unit transmits the video data determined to be the data to be subjected to the image analysis to the identification unit.

13. A monitoring system for monitoring a monitored base, comprising:

a management server that receives decoded video data from an imaging device captured the monitored base, and divides and manages the received video data in units of groups each including a plurality of frames in a chronological order;

an identification server that identifies whether each divided group includes a difference frame with a data size of a predetermined threshold value or more, the group being configured from the divided video data;

an analysis server that performs a decoding process on the plurality of frames of the group identified by the identification server to include the difference frame with the data size of the predetermined threshold value or more and performs image analysis on the decoded each frame to detect a moving object; and

a monitoring terminal including a display unit that displays information representing that a moving object has been detected according to an instruction from the management server when the analysis server has detected the moving object.

14. The monitoring system according to claim 13,

wherein the identification server identifies whether the group satisfies at least one of

(a) including at least one of the difference frames with the data sizes of the predetermined threshold value or more,

(b) an average value of the data sizes of the difference frames included in the group is the predetermined threshold value or more, and

(c) the difference frames with the data sizes of the predetermined threshold value or more are continuous by a predetermined number or more.

15. The monitoring system according to claim 13,

wherein the management server includes a video management information storage unit that stores a group identifier indicating the group and detection information representing whether a moving object has been detected from at least one frame included in the group indicated by the group identifier, in association with each other,

wherein, with respect to each the divided group of the video data received from the imaging device, the identification server transmits the received group to the analysis server when the detection information associated with a group identifier of a group immediately before the received group in a chronological order is information representing that the moving object has been detected, and transmits, to the analysis server, the group identified by the identification server to include the difference frame with the data size of the predetermined threshold value or more when the detection information is information representing that the moving object has not been detected, and

wherein the analysis server performs a decoding process on the plurality of frames of the group transmitted from the identification server.

16. The monitoring system according to claim 15,

wherein the monitoring system includes a plurality of analysis servers,

wherein the management server further includes an analysis information storage unit that manages whether the analysis servers perform the decoding process or the image analysis, and

wherein the identification server specifies an analysis server not performing the decoding process or the image analysis among the plurality of analysis servers, and transmits a group to be subjected to the decoding process to the specified analysis server.

17. The monitoring system according to claim 14,

wherein the management server includes a video management information storage unit that stores a group identifier indicating the group and detection information representing whether a moving object has been detected from at least one frame included in the group indicated by the group identifier, in association with each other,

wherein, with respect to each the divided group of the video data received from the imaging device, the identification server transmits the received group to the analysis server when the detection information associated with a group identifier of a group immediately before the received group in a chronological order is information representing that the moving object has been detected, and transmits, to the analysis server, the group identified by the identification server to include the difference frame with the data size of the predetermined threshold value or more when the detection information is information representing that the moving object has not been detected, and

wherein the analysis server performs a decoding process on the plurality of frames of the group transmitted from the identification server.

18. The monitoring system according to claim 17,

wherein the monitoring system includes a plurality of analysis servers,

wherein the management server further includes an analysis information storage unit that manages whether the analysis servers perform the decoding process or the image analysis, and

wherein the identification server specifies an analysis server not performing the decoding process or the image analysis among the plurality of analysis servers, and transmits a group to be subjected to the decoding process to the specified analysis server.

19. A video analysis method comprising:

identifying whether each divided group includes a difference frame with a data size of a predetermined threshold value or more, the group being configured from video data which is encoded video data received from an imaging device captured a monitored base and is divided in units of groups each including a plurality of frames in a chronological order;

performing a decoding process on the plurality of frames of the group identified to include the difference frame with the data size of the predetermined threshold value or more; and

performing image analysis on the decoded each frame to detect a moving object.

20. The video analysis method according to claim 19, wherein the identifying identifies whether the group satisfies at least one of

(a) including at least one of the difference frames with the data sizes of the predetermined threshold value or more,

(b) an average value of the data sizes of the difference frames included in the group is the predetermined threshold value or more, and

(c) the difference frames with the data sizes of the predetermined threshold value or more are continuous by a predetermined number or more, and

wherein the decoding process is performed on the plurality of frames of the group satisfying at least one of (a) to (c).