Video data transmitting/receiving method and video monitor system

• US 20030093810A1
• Filed: 10/29/2002
• Published: 05/15/2003
• Est. Priority Date: 10/30/2001
• Status: Active Grant

• Current Assignee: Security Video Camera Systems Inc. (Wi-LAN Inc.)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Taniguchi, Koji
• Granted Patent: US 7,460,601 B2
• Time in Patent Office: Days
• US Class Current: 725/112
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

In a video data transmitting method of sending in real-time video data being externally inputted, when encoding video data being inputted as stream data, start and stop of an encoding process is repeated at a predetermined time interval to carry out a data dividing process whereby a plurality of time-continuous video data are generated as partial video data. Also, metadata of partial video data is generated, which is sent, together with the partial video data, in real-time as partial video metadata.

Claims

1. A method of transmitting in real-time a video data being inputted, comprising:

a video encoding process step of, when making an encoding process on video data being inputted as stream data, repeating to start and end an encoding process at a predetermined time interval and carrying out a data dividing process to generate a plurality of time-continuous video data and outputting same as partial video data;

a video data transmitting step of sending in real-time the partial video data;

a metadata generating step of generating metadata of the partial video data and outputting same as partial video metadata; and

a metadata transmitting step of sending the partial video metadata.

2. A method of transmitting video data according to claim 1, wherein the metadata generating step includes a step of managing a plurality of partial video metadata having a time-continuous relationship as whole video metadata and outputting partial video metadata including, at least, an identifier of the partial video metadata, link information to preceding and succeeding partial video metadata having a time-continuous relationship and link information to the partial video data.

3. A method of transmitting video data according to claim 2, further including a step of outputting a header file including link information to partial video metadata at a leading end prior to outputting partial video metadata positioned at a leading end of whole video metadata, and outputting a footer file including link information to partial video metadata at a terminal end after outputting partial video metadata positioned at a terminal end of whole video metadata.

4. A method of transmitting video data according to claim 1, further comprising a video analyzing process step of carrying out a video analyzing process of video data and outputting a video analysis result at a predetermined time interval, and a scene dividing process step of carrying out a scene dividing process on partial video data on the basis of a predetermined scene dividing condition and outputting a scene dividing result, wherein the metadata generating step includes a step of generating metadata based on a scene of the partial video data on the basis of the scene dividing result and outputting scene metadata having the metadata describing the video analysis result.

5. A method of transmitting video data according to claim 4, wherein the metadata transmitting step includes a step of dividing partial video metadata into scene metadata for handling and sending the scene metadata.

6. A method of transmitting video data according to claim 5, wherein the process of dividing partial video metadata into scene metadata sets, as a scene division determining condition, a condition to determine a similarity of a video analysis result to be outputted at a predetermined time interval and determining video data portions having video analysis results recognized in similarity and a time-continuous relationship as one scene whereby a portion lost in similarity in the video analysis result is determined as a scene boundary thereby carrying out a scene dividing process.

7. A method of transmitting video data according to claim 4, wherein the video analyzing process step includes a step of detecting a moving object in a video image and outputting a detection result of a moving object including a feature amount of a detected moving object, the scene dividing process step including a step of setting a presence or absence of a moving object as a scene dividing condition by the detection result of a moving object and carrying out a scene dividing process to divide between a video data portion a moving object does not exist and a video data portion a moving object exists, the metadata generating step including a step of describing a numeral representative of a presence or absence of a moving object detection in the scene metadata.

8. A method of transmitting video data according to claim 6, wherein the scene dividing process step includes a step of outputting a provisional scene dividing process result in a case a predetermined time elapses from carrying out a preceding scene dividing process and periodically repeating to output a provisional scene dividing process result until a regular scene dividing process is executed on the basis of the scene dividing condition.

9. A method of transmitting video data according to claim 7, wherein the scene dividing process step includes a step of outputting a provisional scene dividing process result in a case a predetermined time elapses from carrying out a preceding scene dividing process and periodically repeating to output a provisional scene dividing process result until a regular scene dividing process is executed on the basis of the scene dividing condition, the metadata generating step including steps of handling scene metadata corresponding to a scene generated by a provisional scene dividing process as provisional scene metadata, and handling scene metadata corresponding to a scene generated by a fixed scene dividing process as fixed scene metadata, the scene metadata including at least scene fixing information to distinguish between two kinds of scene metadata, scene numbers to be assigned to all scenes included in the whole video data, recorded date information representative of scene-recording start date and end date and the video analysis result.

10. A method of receiving video data comprising:

a video data receiving step of receiving whole video data being sent by the method according to claim 9;

a video data storage step of separating the whole video data into a plurality of partial video data to be respectively stored as independent data files to a storage medium;

a metadata receiving step of receiving whole video metadata; and

a metadata storage step of separating the whole video metadata into a header file, a plurality of partial video metadata and a footer file that are to be respectively stored as independent data files to a storage medium.

11. A method of receiving video data according to claim 10, wherein the metadata receiving step includes a step of receiving partial video metadata that metadata is divided into scene metadata and sent, the metadata storage step including a step of storing partial video metadata reconstructed by connecting scene metadata belonging to the partial video metadata into a memory.

12. A method of receiving video data according to claim 10, wherein the metadata storage step distinguishes between provisional scene metadata and fixed scene metadata on the basis of scene fixing information of the scene metadata, and in the case of receiving fixed scene metadata having a same scene number as provisional metadata already written onto the partial video metadata, the fixed scene metadata is additionally written after deleting the provisional scene metadata from the partial video metadata.

20. A video data receiving program for a computer to execute a data process based on a video data receiving method comprising:

a video data receiving step of receiving whole video data being sent by the method according to claim 9;

a video data storage step of separating the whole video data into a plurality of partial video data that are to be, respectively, stored as independent data files to a storage medium;

a metadata receiving step of receiving whole video metadata; and

a metadata storage step of separating the whole video metadata into a header file, a plurality of partial video metadata and a footer file that are to be respectively stored as independent data files to a storage medium.

25. A computer readable storage medium recording a video data receiving program according to claim 20.

30. A video receiving apparatus comprising:

program executing means for executing a video data receiving program according to claim 20;

program executing means for executing a video data displaying program according to claim 21;

communication interface means for receiving video data and metadata;

data storage means for storing and managing video data and metadata;

data display means for displaying video data and displaying metadata; and

search condition setting means for setting a search condition for video data.

13. A method of displayig video data received comprising:

a search condition setting step of setting a search condition for video data;

a partial video metadata search step of analyzing whole video metadata already stored or in a progress of storage on the basis of the search condition and detecting partial video metadata satisfying the search condition;

a scene metadata search step of analyzing detected partial video metadata and detecting scene metadata satisfying the search condition;

a partial video data search step of detecting partial video data corresponding to searched partial video metadata; and

a partial video data displaying step of displaying a scene of partial video data corresponding to searched scene metadata.

14. A method of displaying video data according to claim 13, further comprising a play control condition setting step of setting a play control condition such as video-data display, stop, fast-forward and rewind, the partial video data displaying step including a step of carrying out play control of partial video data according to the play control condition starting from searched scene metadata, the partial video metadata search step including a step of, when reaching a leading or terminal end of the partial video data by play control, making reference to link information of partial video metadata corresponding to partial video data being displayed to search for preceding and succeeding partial video metadata and detecting partial video data corresponding to searched partial video metadata, the partial video data displaying step including a step of smoothly continuously displaying the partial video data and the preceding and succeeding ones of partial video data.

15. A method of displaying video data according to claim 13, wherein the partial video data displaying step includes a step of acquiring the scene fixing information described in the scene metadata and limiting an access to a data portion rear of a scene of the partial video data corresponding to the provisional scene metadata.

16. A method of displaying video data according to claim 13, further comprising a determining condition setting step of setting a significant information determining condition as a determining condition to detect significant information included in video data, a significant information detecting step of analyzing in real-time scene metadata in a progress of reception and detecting scene metadata satisfying the significant information determining condition, and an alert process step of executing a predetermined alert process in a case of detecting significant information, wherein the partial video displaying step includes a step of, when scene metadata including significant information is detected, starting to display video data at a scene of partial video data corresponding to the data.

17. A video data transmitting program for a computer to execute a data process based on a video data transmitting method comprising:

a video encoding process step of, when making an encoding process on video data being inputted as stream data, repeating to start and end an encoding process at a predetermined time interval and carrying out a data dividing process to generate a plurality of time-continuous video data, and outputting the same as partial video data;

a video data transmitting step of sending in real-time the partial video data;

a metadata generating step of generating metadata of the partial video data and outputting the same as partial video metadata; and

a metadata transmitting step of sending the partial video metadata.

18. A video data transmitting program according to claim 17, wherein the metadata generating step includes a step of managing a plurality of partial video metadata having a time-continuous relationship as whole video metadata, and outputting partial video metadata including, at least, an identifier of the partial video metadata, link information to preceding and succeeding partial video metadata having a time-continuous relationship and link information to the partial video data.

19. A video data transmitting program according to claim 17, further comprising a scene dividing process step of carrying out a scene dividing process on partial video data on the basis of a predetermined scene division determining condition and outputting a scene division result, the scene dividing process step including a step of outputting a provisional scene dividing process result in a case a predetermined time elapses from carrying out a preceding scene dividing process and periodically repeating to output a provisional scene dividing process result until a regular scene dividing process is executed on the basis of the scene dividing condition, the metadata generating step including steps of handling scene metadata corresponding to a scene generated by a provisional scene dividing process as provisional scene metadata, and handling scene metadata corresponding to a scene generated by a fixed scene dividing process as fixed scene metadata.

22. A computer readable storage medium recording a video data transmitting program according to claim 17.

23. A computer readable storage medium recording a video data transmitting program according to claim 18.

24. A computer readable storage medium recording a video data transmitting program according to claim 19.

27. A video transmitting apparatus for transmitting video data in real-time, comprising:

program executing means for executing a video data transmitting program according to claim 17;

video data input means for inputting video data acquired from a video camera to the video data transmitting program; and

communication interface means for transmitting video data and metadata of video data.

28. A video transmitting apparatus for sending video data in real-time, comprising:

program executing means for executing a video data transmitting program according to claim 18;

video data input means for inputting video data acquired from a video camera to the video data transmitting program; and

communication interface means for sending video data and metadata of video data.

29. A video transmitting apparatus for sending video data in real-time, comprising:

program executing means for executing a video data transmitting program according to claim 19;

video data input means for inputting video data acquired from a video camera to the video data transmitting program; and

communication interface means for sending video data and metadata of video data.

31. In a video monitor system configured by at least one or more video transmitting apparatuses, a video receiving apparatus for receiving video data being sent from the video transmitting apparatus, and a communication network connecting the both, the video monitor system comprising:

the video transmitting apparatus being a video transmitting apparatus according to claim 27;

a video receiving apparatus being a video receiving apparatus according to claim 30;

the video transmitting apparatus sending video data and metadata of the video data to the video receiving apparatus; and

the video receiving apparatus carrying out centralized monitor of video data received from the video transmitting apparatus and, at the same time, storing received video data to a database.

32. In a video monitor system configured by at least one or more video transmitting apparatuses, a video receiving apparatus for receiving video data being sent from the video transmitting apparatus, and a communication network connecting the both, the video monitor system comprising:

the video transmitting apparatus being a video transmitting apparatus according to claim 28;

a video receiving apparatus being a video receiving apparatus according to claim 30;

the video transmitting apparatus sending video data and metadata of the video data to the video receiving apparatus; and

the video receiving apparatus carrying out centralized monitor of video data received from the video transmitting apparatus and, at the same time, storing received video data to a database.

33. In a video monitor system configured by at least one or more video transmitting apparatuses, a video receiving apparatus for receiving video data being sent from the video transmitting apparatus, and a communication network connecting the both, the video monitor system comprising:

the video transmitting apparatus being a video transmitting apparatus according to claim 29;

a video receiving apparatus being a video receiving apparatus according to claim 30;

the video transmitting apparatus sending video data and metadata of the video data to the video receiving apparatus; and

the video receiving apparatus carrying out centralized monitor of video data received from the video transmitting apparatus and, at the same time, storing received video data to a database.

21. A video data displaying program for a computer to execute a data process based on a method of displaying received video data, comprising:

a search condition setting step of setting a search condition for video data;

a partial video metadata search step of analyzing whole video metadata already stored or in a progress of storage on the basis of the search condition and detecting partial video metadata satisfying the search condition;

a scene metadata search step, of analyzing detected partial video metadata and detecting scene metadata satisfying the search condition;

a partial video data search step of detecting partial video data corresponding to searched partial video metadata; and

a partial video data displaying step of displaying a scene of partial video data corresponding to searched scene metadata.

26. A computer readable storage medium recording a video data displaying program according to claim 21.

34. A method of searching for video data received, comprising:

a search condition setting step of setting a search condition for video data;

a partial video metadata search step of analyzing whole video metadata already stored or in a progress of storage on the basis of the search condition and detecting partial video metadata satisfying the search condition;

a scene metadata search step of analyzing detected partial video metadata and detecting scene metadata satisfying the search condition; and

a partial video data search step of detecting partial video data corresponding to searched partial video metadata.

35. A method of searching for video data according t claim 34, wherein the partial video metadata search step includes a step of, when a leading or terminal end of the partial video data is reached by play control, reference is made to link information of partial video metadata corresponding to partial video data to search for preceding and succeeding partial video metadata and detect partial video data corresponding to searched partial video metadata.

36. A method of recording video data comprising:

a step of, when making an encoding process on video data being inputted as stream data, repeating to start and end an encoding process at a predetermined time interval and carrying out a data dividing process to generate a plurality of time-continuous partial video data and generate metadata of the partial video data thereby receiving video data transmitted by combining the partial video data and metadata thereof together for transmission;

a partial video data storage step of separating received video data into a plurality of partial video data to be respectively stored as independent data files to a storage medium; and

a metadata storage step of separating the metadata into a header file, a plurality of partial video metadata and a footer file that are to be respectively stored as independent data files to a storage medium.