DIGITAL VIDEO RECORDER SYSTEM AND OPERATING METHOD THEREOF

• US 20120063738A1
• Filed: 05/18/2010
• Published: 03/15/2012
• Est. Priority Date: 05/18/2009
• Status: Abandoned Application

• Current Assignee: Jae Min Yoon
• Original Assignee: Jae Min Yoon
• Inventors: Yoon, Jae Min
• Application Number:
  US13/321,504
• Publication Number:
  US 20120063738A1
• Time in Patent Office: Days
• US Class Current: 386/224
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G11B 2020/10537 Audio or video recording
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/329 on a disc [VTOC]
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

The present invention relates to a digital video recorder system and a method for operating the same that classifies sounds sensed by a microphone for each type and stores videos in a range where sounds are generated to search the videos for each sound type, thereby making it possible to more rapidly search the videos.

The present invention includes a camera inputting videos; a microphone inputting sounds; a sound video recorder unit that converts videos and sounds input from the camera and the microphone into digital signals; a sound recognizing unit that analyzes sound converted into the digital signals and classifies the sound type; an video managing unit that manages the video in a range where the specific sounds are generated; a sound video file storage unit that manages the range where the specific sounds are generated in an video file and stores it in a database; an video DB that stores the general video recording file; a sound video DB that stores an video file where the sounds are generated; a sound video information DB that stores the information on the video file for each sound type; a sound video searching unit that searches the video file stored in the video DB, the sound video DB, and the sound video information DB according to the search request of the video file; and a sound video display managing unit that is connected to a user interface to provide the search function of the video file and reproduce the searched video file.

Claims

1. A digital video recorder system, comprising:

an video recorder unit that records videos in monitoring areas;

a sound input unit that inputs sounds in the monitoring areas;

a DVR device that classifies the sounds for each type by recognizing the sounds in the monitoring areas, stores a recorded video or range information where specific sounds are generated, with the range information consisting of a time or frame information at a point where sound starts generating and a time or frame information at a point where sound stops generating, and accesses the corresponding videos and outputs them to an output device according to the search request of the videos for the specific sounds; and

an output device divided into a display and a speaker, thus outputting videos matching with a specific sound inputted into or transmitted to the DVR device.

2. The digital video recorder system according to claim 1, wherein the sound input unit is applied with any one of a dynamic microphone, a condenser microphone, and a ribbon microphone and is applied with any one of a directional microphone and a non-directional microphone according to directivity.

3. The digital video recorder system according to claim 1, wherein at the video recorder unit and the sound input unit are installed a camera and a microphone separately or in at least one pair or in a form of a camera with a built-in microphone and the monitoring area is installed with at least one pair of the same.

4. The digital video recorder system according to claim 1, wherein the DVR device generates and stores only one sound video file for each sound and reproduces the video file of the range where the specific sounds are generated, in response to the search request.

5. The digital video recorder system according to claim 1, wherein the DVR device records, by the kinds of sounds, the range information where the specific sound are generated and reproduces the video range where the specific sounds are generated according to the search request.

6. The digital video recorder system according to claim 1, wherein the DVR device records the range information where the specific sound is generated for each sound in a time unit and reproduces it earlier by 1 second to 5 seconds than the starting time of the video where the specific sounds are generated according to the search request, and playbacks the videos one to five seconds longer than the ending time of the videos where the specific sound are ended.

7. The digital video recorder system according to claim 1, wherein the DVR device displays and stores the range information where the specific sounds are generated in the entire video recording file and reproduces the video range where the specific sounds are generated according to the search request.

8. The digital video recorder system according to claim 1, wherein the DVR device generates and stores, in a pair, one video file and at least one specific sound file for at least one specific sound generated in one video file.

9. The digital video recorder system according to claim 1, wherein the DVR device generates and stores, in a pair, the sound video information file having the range information where one video file and at least one specific sound are generated by the range information where at least one specific sound generated in one video file is generated.

10. The digital video recorder system according to claim 1, wherein the DVR device synchronizes and compresses and stores the sound and video input through the sound input unit and the video recorder unit and records the range information where the specific sounds are generated for each sound, and reproduces the video in the video range where the specific sounds are generated together with the sound according to the search request.

11. The digital video recorder system according to claim 1, wherein the DVR device generates and stores one sound file and one video file for the specific sound in a pair.

12. The digital video recorder system according to claim 1, wherein the DVR device includes:

a sound video input unit that receives the video and sound information on an analog signal from the camera and the microphone and converts it into a digital signal;

a sound recognizing unit that analyzes sound data transferred from the sound video recorder unit and classifies the sound type;

an video managing unit that manages the video in a range where general recording videos and the specific sounds are generated;

a sound video file storage unit that manages the video range where the sounds are generated in a file and stores it in a database and classifies the general recording videos and the videos for the specific sound and stores them as the video file;

a database that stores the general recording video file and the video file for each specific sound;

a sound video searching unit that searches the video file stored in the database through the sound video file storage unit according to the search request of the videos; and

a sound video display managing unit that is connected to a user interface to provide an video searching function and reproduces the video file searched through the sound video searching unit by an output device.

13. The digital video recorder system according to claim 12, wherein the sound recognizing unit classifies the sound type through the sound recognizing algorithm after detecting an endpoint for the sound data and when the sound type is as the specific sound, provides the sound type and the starting time and ending time information on the sound to the video managing unit and the sound video file storage unit.

14. The digital video recorder system according to claim 12, wherein the sound recognizing unit determines whether the input sound data are similar to the sound data stored in the database by the pattern classifying algorithm to determine the sound type.

15. The digital video recorder system according to claim 12, wherein the sound recognizing unit detects the endpoint by using a zero crossing rate (ZCR) and energy for the input sound data and applies a linear predictive coding (LPC) and a mel frequency cepstral coefficients (MFCC) to extract features and determines the sound type by using the pattern classifying algorithm alone or in at least two thereof.

16. The digital video recorder system according to claim 12, wherein the video managing unit displays the sound type and the time range information transmitted from the sound recognizing unit on the DVR recording screen as a sound waveform and stores and manages the videos.

17. The digital video recorder system according to claim 12, wherein the sound video file storage unit includes the information on the sound type, the sound generating time, and the sound ending time and stores the range information between the sound generating time and the sound ending time based on the time or the number of frames in the millisecond unit.

18. The digital video recorder system according to claim 12, wherein the database is configured to include:

an video DB that stores the general video recording file;

a sound video DB that stores the video file in the time range where sounds are generated; and

a sound video information DB that stores the path information and the time range information on the video file for each sound type.

19. The digital video recorder system according to claim 12, wherein the sound video searching unit provides the keyword search, the search for each sound type, and the tag search and brings the video range information where the sounds are generated on the video DB by using the video file path information and the time range information stored in the sound video information DB or brings the path information on the video file where the sounds stored in the sound video DB are generated.

20. The digital video recorder system according to claim 12, wherein the sound video display managing unit provides functions of the time search, the sound type search, the keyword search, the range search, the section search, the tag search, and the channel search for the sound video file.

21. The digital video recorder system according to claim 12, wherein the sound video display managing unit outputs only the videos in a range where the specific sounds are generated or simultaneously outputs the videos and the sounds.

22. The digital video recorder system according to claim 19, wherein the tag search represents time, minute, and second where the specific sounds are generated on a graph representing time, minute, and second corresponding to specific year, month, and day in a scale form and represents a sound type on a lower end of the scale in a text.

23. A digital video recorder system, comprising:

a camera that input videos;

a microphone that inputs sounds;

a sound video recorder unit that converts videos and sounds input from a camera and a microphone into digital signals;

a sound recognizing unit that analyzes the sounds converted into the digital signals and classifies a sound type;

an video managing unit that manages the videos recorded in a range where general recording videos and specific sounds are generated;

a sound video file storage unit that stores in the database the range information concerning the videos where the general videos and the specific sounds are generated and range information where the specific sounds are generated;

an video DB that stores a general video recording file;

a sound video DB that stores an video file in a time range where the sounds are generated;

a sound video information DB that stores path information and time range information on the video files for each sound type;

a sound video searching unit that searches the video information stored in the video DB, the sound video DB, and the sound video information DB according to the search request of the video information where the specific sounds are generated; and

a sound video display managing unit that is connected to a user interface and provides the search function of the video information and reproduces the searched video information.

24. The digital video recorder system according to claim 23, wherein the sound recognizing unit classifies the sound type through the sound recognizing algorithm after detecting an endpoint for the sound data and when the sound type is as the specific sound, provides the sound type and the starting time and ending time information on the sound to the video managing unit and the sound video file storage unit.

25. The digital video recorder system according to claim 23, wherein the sound recognizing unit determines whether the input sound data are similar to the sound data stored in the database by the pattern classification algorithm to determine the sound type.

26. The digital video recorder system according to claim 23, wherein the sound video file storage unit includes the information on the sound type, the sound starting time, and the sound ending time and stores the range information between the sound starting time and the sound ending time based on the time or the number of frames in the millisecond unit.

27. The digital video recorder system according to claim 23, wherein the sound video file storage unit generates and stores only one sound video file for each specific sound.

28. The digital video recorder system according to claim 23, wherein the sound video file storage unit generates and stores range information where sounds are generated for each specific sound.

29. The digital video recorder system according to claim 23, wherein the sound video file storage unit displays, stores and playbacks only the video file of the section where specific sounds are generated, based on a search request.

30. The digital video recorder system according to claim 23, wherein the sound video file storage unit generates and stores, in a pair, one video file and at least one specific sound file for at least one specific sound generated in one video file.

31. The digital video recorder system according to claim 23, wherein the sound video file storage unit generates and stores, in a pair, the sound video information file having the range information where one video file and at least one specific sound are generated by the range information where at least one specific sound generated in one video file is generated.

32. The digital video recorder system according to claim 23, wherein the sound video file storage unit compresses and sores the synchronized video and sounds input through the camera and the microphone.

33. The digital video recorder system according to claim 23, wherein the sound video file storage unit generates and stores one sound file and one video file for the specific sounds in a pair.

34. A method for operating a digital video recorder system, comprising:

receiving videos and sound data;

recognizing specific sounds through the analysis of the sound data;

storing only video data in a database as an video file of the corresponding time period, including a sound type and information on generating time and ending time when the specific sounds are recognized; and

searching videos in a database according to requested conditions and reproducing them as the output of the sounds and the videos when the search of the stored video file is detected.

35. The method for operating a digital video recorder system according to claim 34, wherein the recognition of the specific sound extracts features by using linear predictive coding (LPC) and mel frequency cepstral coefficients (MFCC) and determines and recognizes the sound type by using one or at least two of pattern matching algorithms of dynamic time warping (DTW), hidden Marcov model (HMM), artificial neural network (ANN), support vector machine (SVM), and fuzzy.

36. The method for operating a digital video recorder system according to claim 34, wherein the recognition of the specific sound determines the sound type similarity between the sound data and the reference sound data stored in the database by using any one of the dynamic time warping (DTW), the hidden Marcov model (HMM), the artificial neural network (ANN), the support vector machine (SVM), and the fuzzy.

37. The method for operating a digital video recorder system according to claim 34, wherein when the generation of the specific sounds are recognized, the video recording of the range starts at a time point when the specific sounds are generated, and when the ending of the specific sound is detected, the recording of the range videos are ended, and the video file is generated based on the kinds of sounds, the sound generation time and the ending time, and the sections between the sound generation time and the ending time are classified by the time of milliseconds or the number of video frames.

38. The method for operating a digital video recorder system according to claim 34, wherein the video file stored in the database classifies and stores the information on the general video recording file, the video file where the sounds are generated, and the video file for each sound.

39. The method for operating a digital video recorder system according to claim 34, wherein the video file stored in the database provides the time search, the sound type search, the keyword search, the range search, the section search, the tag search, and the channel search on a screen connected to a user interface, and outputs only the videos in a range where the specific sounds are generated or simultaneously outputs the videos and the specific sounds according to the reproduction of the searched video file.

40. A method for operating a digital video recorder system, comprising:

receiving videos and sound data;

recognizing specific sounds through the analysis of the sound data;

synchronizing and compressing and storing videos and sound data;

storing an information on a sound type, generating time and ending time in a database when the specific sounds are recognized; and

searching an video file in the database according to requested conditions when the video search is requested for a range where the stored specific sounds are generated and reproducing the video range corresponding to the generating time and the ending time where the specific sound is recognized as the output of the sound and videos.

41. The method for operating a digital video recorder system according to claim 40, wherein when the video search is the time search, if year, month, and day are input and time is selected, the video list for each sound generated at the corresponding time is read and displayed in the database and if the corresponding video is selected, the video and the sound are output.

42. The method for operating a digital video recorder system according to claim 40, wherein when the video search is the search of the sound type, if the sound type is selected or the sound type is input by keywords, the video list corresponding to the sound type is read and displayed in the database and if year, month, day, and time information are further input, the video list generated at the corresponding time is displayed and if the specific video is selected, the corresponding video and sound are output.

43. The method for operating a digital video recorder system according to claim 40, wherein when the video search is the tag search, if year, month, and day are selected, the video information generated at the corresponding day are read in the database and is represented by the scale of time unit, minute unit, and second unit and the sound type is represented at the upper end of the scale of the second unit in a text form and when the text (tag) is selected or any location on the range of the scale of the second unit is selected, the corresponding video is output together with sound.