Apparatus and method for monitoring video data and metadata

• US 8,934,012 B2
• Filed: 03/30/2007
• Issued: 01/13/2015
• Est. Priority Date: 04/03/2006
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Miyamaki, Hideo, Tamura, Asako, Tsukuda, Kazuma
• Primary Examiner(s): DAGNEW, MEKONNEN D
• Application Number:
  US11/730,365
• Publication Number:
  US 20070250862A1
• Time in Patent Office: 2,846 Days
• Field of Search: 725 34- 35, 725/46, 725/10, 725/12, 348/143, 348/169, 34833302-33306, 7 34- 35, 7 4/6, 709/203
• US Class Current: 348/143
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream

Abstract

A monitoring apparatus includes a video data obtaining section obtaining video data from a monitoring terminal, a metadata obtaining section obtaining metadata describing information on a monitored subject from the monitoring terminal, a filter setting storage section storing a filter setting, a metadata filter section performing filtering processing on the metadata by using a filter setting stored in the filter setting storage section, and an output section outputting a monitoring result based on the filtering processing result obtained by performing filtering processing in the metadata filter section.

Claims

1. A monitoring apparatus comprising:

a video data obtaining section for obtaining video data from a monitoring terminal;

a metadata obtaining section for obtaining from the monitoring terminal, metadata describing information on a monitored subject, the information comprising details of one or more interactions with a user interface performed by the monitored subject;

a filter setting storage section for storing a filter setting;

a metadata filter section for performing filtering processing on the metadata by using a filter setting stored in the filter setting storage section; and

an output section for outputting a monitoring result based on the filtering processing result obtained by performing filtering processing in the metadata filter section, wherein the output section is further configured to output a picture based on the synthesis of a picture generated from video data obtained by the video data obtaining section, a picture generated from the metadata obtained by the metadata obtaining section, and a picture generated from the filter setting used by the metadata filter section, the monitoring result including a picture having an image section of video data corresponding to the filtering processing result, an image section about at least a part of a criteria of the filtering processing, and an image section about the metadata relating to the monitored subject in the image section of video data corresponding to the filtering processing result, the metadata describing the one or more interactions with the user interface performed by the monitored subject, and obtained by the metadata obtaining section.

2. The monitoring apparatus according to claim 1, further comprising:

a video data storage section for storing the video data;

a metadata storage section for storing the metadata;

a video data playing section for playing video data stored in the video data storage section;

a metadata playing section for playing metadata stored in the metadata storage section; and

a play synchronizing section for causing the metadata playing section to play metadata in synchronization with the video data played by the video data playing section in order to play the video data and the metadata together, wherein the metadata filter section performs filtering processing on the metadata played by the metadata playing section by using a filter setting stored in the filter setting storage section; and

the output section outputs a picture showing the monitoring result by using one of a picture based on the video data played by the video data playing section, a picture based on metadata played by the metadata playing section and a picture showing the filter setting used in the metadata filter section or a picture resulting from the synthesis of multiple pictures.

3. The monitoring apparatus according to claim 2, wherein the video data obtaining section causes the video data storage section to store the obtained video data based on the filtering processing result obtained by performing filtering processing in the metadata filter section.

4. The monitoring apparatus according to claim 1, wherein the video data obtaining section and the metadata obtaining section obtain the video data and the metadata from the monitoring terminal over a network.

5. The monitoring apparatus according to claim 1, wherein the information relating to a monitored subject has at least one of:

moving subject detection information indicating whether a moving subject has been detected or not;

or

moving subject position information indicating the position of a detected moving subject.

6. The monitoring apparatus according to claim 1, wherein the information relating to a monitored subject has information indicating the state of an area monitored by the monitoring terminal.

8. The monitoring apparatus according to claim 1:

wherein an image section of video data corresponding to the filtering processing result, an image section about at least a part of a criteria of the filtering processing, and an image section about the metadata relating to a target in the image section of video data corresponding to the filtering processing result, are displayed on a screen.

7. A monitoring method comprising the steps of:

obtaining video data;

obtaining metadata describing information on a monitored subject, the information comprising details of one or more interactions with a user interface performed by the monitored subject;

performing filtering processing on the metadata by using a filter setting; and

outputting a monitoring result based on the filtering processing result obtained by performing filtering processing, outputting a picture based on the synthesis of a picture generated from video data obtained by the video data obtaining section, a picture generated from the metadata obtained by the metadata obtaining section, and a picture generated from the filter setting used by the metadata filter section, the monitoring result including a picture having an image section of video data corresponding to the filtering processing result, an image section about at least a part of a criteria of the filtering processing, an image section about the metadata relating to the monitored subject in the image section of video data corresponding to the filtering processing result, the metadata describing the one or more interactions with the user interface performed by the monitored subject.