Data storage device and data storage/playback device

• US 5,926,605 A
• Filed: 04/23/1997
• Issued: 07/20/1999
• Est. Priority Date: 04/24/1996
• Status: Expired due to Term

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Ichimura, Satoshi
• Primary Examiner(s): Garber, Wendy
• Assistant Examiner(s): ONUAKU, CHRISTOPHER O
• Application Number:
  US08/847,338
• Time in Patent Office: 818 Days
• Field of Search: 386/6, 386/33, 386/68, 386/69, 386/70, 386/109, 386/111, 386/112, 360/72.1, 360/72.3, 360/72.2
• US Class Current: 386/241
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 5/781 on disks or drums

Abstract

A method and apparatus is provided that reliably saves sections of sounds and images believed to be important by associating the sounds and images with user input, changes in sounds, and changes in images. A condition-matching interval detecting device takes audio data or image data from a data input device and detects a condition-matching interval that matches prescribed conditions set beforehand. The incoming audio data or incoming image data is associated with data indicating the condition-matching interval and is stored temporarily in a temporary storing device. If the user-input detecting device detects user-input data, a sequence from the audio data or the image data stored temporarily in temporary storing device is stored in time-series data storing device, the sequence beginning at least from the start of a condition-matching interval. The association between the user-input data and the memory position within time-series data storing device of the audio data or the image data corresponding to the user-input data is stored in an association storing device.

Claims

1. A data storage device comprising:

a user-input device;

a user-input data detector, coupled to the user-input device, that detects user-input data received from said user-input device;

an audio data input device that receives audio data;

an audio data memory, coupled to the audio data input device, that stores the received audio data;

an image data input device that receives image data;

a condition-matching interval detector, coupled to the audio data input device, that detects intervals in said received audio data that match prescribed conditions specified beforehand, said condition-matching interval detector detecting specific, pre-set keywords uttered by a speaker in said audio data, and uses said detection results to detect a beginning point and an ending point of the condition-matching interval;

a temporary memory, coupled to the image data input device, that temporarily stores said received image data in association with data indicating intervals detected by said condition-matching interval detector;

an image data memory, coupled to the temporary memory, that receives and stores an image data sequence from image data stored in said temporary memory in association with user-input data detected by said user-input data detector, said image data sequence comprising image data in an interval determined by said user-input data from said user-input data detector and by detection results from said condition-matching interval detector; and

a correspondence-relationship memory that stores relationships of said user-input data with memory positions within said image data memory of said received image data when said user-input data was detected and with memory positions of said audio data within said audio data memory.

2. The data storage device of claim 1, wherein when said user-input data detector detects said user-input data, said image data stored in said image data memory, comprises an image data sequence from image data stored in said temporary memory said image data sequence comprising image data beginning at least at a start of an interval detected by said condition-matching interval detector, said interval preceding detection of said user-input data.

3. The data storage device of claim 2, further comprising an image data compressor, coupled to the image data memory, that performs data compression of image data stored in said image data memory using a changeable compression method or compression ratio wherein said interval of said image data determined by detection results of said user-input data from said user-input data detector and detection results from said condition-matching interval detector is compressed by said image data compressor at a higher image quality compared to image data from other intervals.

4. The data storage device of claim 3, wherein said condition-matching interval detector compares an audio signal level from said audio data with a pre-set threshold value, and results of said comparison are used to detect a beginning point and an ending point of said condition-matching interval.

5. The data storage device of claim 3, wherein said condition-matching interval detector detects specific speakers or the switching of speakers in said incoming audio data, and said detection results are used to detect a beginning point and an ending point of said condition-matching interval.

6. The data storage device of claim 3, wherein said image data compressor determines a degree of importance for audio data or image data by combining detection results from said user-input data detector and said condition-matching interval detector, and audio data or image data is compressed using different compression methods or compression amounts based on said degree of importance, said audio data or image data comprising audio data or image data from an interval determined by detection results from said user-input data detector and said condition-matching interval detector.

7. A data storage device comprising:

a user-input device;

a user-input data detector, coupled to the user-input device, that detects user-input data received from said user-input device;

an audio data input device that receives audio data;

an audio data memory, coupled to the audio data input device, that receives and stores audio data from said audio data input device;

an image data input device that receives image data;

a condition-matching interval detector, coupled to the image data input device, that detects intervals in said image data from said image data input device that match prescribed conditions specified beforehand, said condition-matching interval detector detecting specific, pre-set image patterns added in said image data, and uses said detection results to detect a beginning point and an ending point for the condition matching interval;

a temporary memory, coupled to the image input device, that receives and temporarily stores said image data from said image data input device in association with data indicating intervals detected by said condition-matching interval detector;

an image data memory, coupled to the temporary memory, that receives and stores an image data sequence from image data stored in said temporary memory when said user-input data is detected, said image data sequence comprising image data from an interval beginning at least at a start of an interval detected by said condition-matching interval detector preceding detection of said user-input data; and

a correspondence-relationship storage device that stores relationships of said user-input data with memory positions within said image data memory of said image data received when said user-input data was detected and with memory positions of said audio data within said audio data memory.

8. The data storage device of claim 7, wherein said image data input device comprises a video camera outputting an image signal and camera operation signals based on a user'"'"'s manipulation of said camera, and said condition-matching interval detector analyzes said camera usage signals to determine camera operations, and detects a beginning point and an ending point for an interval in said image data that matches prescribed conditions.

9. A data compression/storage/playback device comprising:

a user-input device;

a user-input data detector, coupled to the user-input device, that detects user-input data received from said user-input device;

a data input device that receives audio data or image data;

a condition-matching interval detector, coupled to the data input device, that detects intervals in said audio data or said image data from said data input device that match prescribed conditions specified beforehand, said condition-matching interval detector detecting specific, pre-set keywords uttered by a speaker in said audio data, or specific, pre-set image patterns added in said image data, and uses said detection results to detect a beginning point and an ending point of the condition-matching interval;

a temporary memory, coupled to the data input device, that receives and temporarily stores said audio data or said image data from said data input device in association with data indicating intervals detected by said condition-matching interval detector;

a time-series data memory, coupled to the temporary memory, that stores an audio or image data sequence stored in said temporary memory in association with user-input data detected by said user-input data detector, said image data sequence comprising audio or image data from an interval determined by said user-input data from said user-input data detector and by detection results of said condition-matching interval detector;

a display device, coupled to the user-input detector, that displays said user-input data;

a correspondence-relationship memory that stores relationships between data specifying a display position on said display of said user-input data detected by said user-input data detector and memory positions within said time-series data memory of said audio or image data received when said user-input data was detected;

a specifying device, coupled to the display device, that specifies a display portion related to user-input data displayed on said display device; and

a playback device, coupled to the audio data memory and the image data memory, that receives and plays a prescribed section of audio data or image data from memory positions in said image data memory and said audio data memory, said memory positions being determined by said user-input data indicated by said specifying device and by said relationships stored in said correspondence-relationship memory.

10. A data storage/playback device comprising:

a user-input device;

a user-input data detector, coupled to the user-input device, that detects user-input data received from said user-input device;

an audio data input device that receives audio data;

an audio data memory, coupled to the audio data input device, that receives and stores audio data from said audio data input device;

an image data input device that receives image data;

a condition-matching interval detector, coupled to the audio data input device, that detects intervals in said audio data from said audio data input device that match prescribed conditions specified beforehand, said condition-matching interval detector detecting specific, pre-set keywords uttered by a speaker in said audio data, and uses said detection results to detect a beginning point and an ending point of the condition-matching interval;

a temporary memory, coupled to the image data input device, that receives and temporarily stores said image data from said image data input device in association with data indicating intervals detected by said condition-matching interval detector;

an image data memory, coupled to the temporary memory, that stores an image data sequence stored in said temporary memory in association with user-input data detected by said user-input data detector, said image data sequence comprising image data from an interval determined by said user-input data from said user-input data detector and by detection results from said condition-matching interval detector;

a display device, coupled to the user-input data detector, that displays said user-input data;

a correspondence-relationship memory that stores data specifying a display position on said display device of said user-input data detected by said user-input data detector, and for storing memory positions within said image data memory of said image data received when said user-input data was detected and within said audio data memory of said audio data, and for storing relationships between said data and said user-input data;

a specifying device, coupled to the display device, that specifies a display portion related to user-input data displayed on said display device; and

a playback device, coupled to the image data memory and the audio data memory, that receives and plays a prescribed section of audio data or image data from memory positions in said image data memory and said audio data memory said memory positions being determined by said user-input data indicated by said specifying device, and by said relationships stored in said correspondence-relationship memory.

11. A data storage/playback device comprising:

a user-input device;

a user-input data detector, coupled to the user-input device, that detects user-input data received from said user-input device;

a user input data memory, coupled to the user-input data detector, that receives and stores user-input data from said user-input device detected by said user-input data detector;

an audio data input device that receives audio data;

an audio data storage device, coupled to the audio data input device, that receive and stores audio data from said audio data input device;

an image data input device that receives image data;

a condition-matching interval detector, coupled to the image data input device, that detects intervals in said image data from said image data input device that matched prescribed conditions specified beforehand, said condition-matching interval detector detecting specific, pre-set image patterns added in said image data, and uses said detection results to detect a beginning point and an ending point for the condition matching interval;

a temporary memory, coupled to the image data input device, that receives and temporarily stores said image data from said image data input device in association with data indicating intervals detected by said condition-matching interval detector;

an image data memory, coupled to the temporary memory, that receives and stores an image data sequence from said temporary storage device when said user input is detected, said sequence beginning from at least the start of an interval detected by said condition-matching interval detector preceding detection of said user-input data;

a display device, coupled to the user-input data detector, that displays said user-input data;

a correspondence-relationship memory that stores data specifying a display position on said display device of said user-input data detected by said user-input data detector and for storing memory positions within said image data memory of said image data received when said user-input data was detected and within said audio data memory of said audio data, and for storing relationships between said data and said user-input data;

a specifying device, coupled to the display device, that specifies a display portion related to user-input data displayed on said display device; and

a playback device, coupled to the image data memory and the audio data memory, that receives and plays a prescribed section of audio data or image data from memory positions in said image data memory and said audio data memory, said memory positions being determined by said user-input data indicated by said specifying device, and by said relationships stored in said correspondence-relationship memory.

12. A data storage device comprising:

a user-input device;

a user-input data detector, coupled to the user-input device, that detects user-input data received from said user-input device;

an audio data input device that receives audio data;

an image data input device that receives image data;

an image data memory, coupled to the image data input device, that receives and stores the received image data;

a condition-matching interval detector, coupled to the audio input device, that detects intervals in said received audio data that match prescribed conditions specified beforehand, said condition-matching interval detector detecting specific, pre-set keywords uttered by a speaker in said audio data, and uses said detection results to detect a beginning point and an ending point of the condition-matching interval;

a temporary memory, coupled to the audio data input device, that temporarily stores said received audio data in association with data indicating intervals detected by said condition-matching interval detector;

an audio data memory, coupled to the temporary memory, that stores an audio data sequence from audio data stored in said temporary memory in association with user-input data detected by said user-input data detector, said audio data sequence comprising audio data in an interval determined by said user-input data from said user-input data detector and by detection results from said condition-matching interval detector; and

correspondence-relationship memory that stores relationships of said user-input data with memory positions within said audio data memory of said received audio data when said user-input data was detected and with memory positions of said image data within said image data memory.

13. A method for storing data in a data memory, comprising:

detecting user-input data received from a user-input device;

storing user-input data detected by the detecting step;

receiving audio data or image data;

detecting an interval in said audio data or said image data that match prescribed conditions specified beforehand, the conditions being specific, pre-set keywords uttered by a speaker in said audio data, or specific, pre-set image patterns added in said image data, and uses said detection results to detect a beginning point and an ending point of the condition-matching interval;

temporarily storing said audio data or said image data in association with data indicating said detected interval;

storing an audio data or image data sequence from data stored in the temporary storing step, said sequence comprising an interval determined by detection of said user-input data by the user-input data detecting step and by the interval detected by the interval detecting step, said sequence stored in association with said user-input data detected by the user-input data detecting step;

storing relationships between said user-input data detected by the user-input data detecting step and memory positions corresponding to said user-input data.

14. The method of claim 13, further comprising:

compressing audio data or image data stored in the sequence storing step using a changeable compression method or compression ratio wherein audio data or image data from an interval determined by said user-input data detection step and by the interval detected by the interval detection step is compressed by said compressing step using a compression method or compression ratio different from that used for audio data or image data from other intervals.

15. A method for storing data in a data memory, comprising:

detecting user-input data received from a user-input device;

receiving audio data;

storing the received audio data;

receiving image data;

detecting intervals in said received audio data that match prescribed conditions specified beforehand, the conditions being specific, pre-set keywords uttered by a speaker in said audio data, and uses said detection results to detect a beginning point and an ending point of the condition-matching interval;

temporarily storing said received audio data in association with data indicating intervals detected in the interval detecting step;

storing an image data sequence from image data stored in said temporary storing step in association with user-input data detected in said user-input data detecting step, said image data sequence comprising image data in an interval determined by said user-input data detected in said user-input data detecting step and by the interval detected in the interval detecting step; and

storing relationships of said user-input data with memory positions of said stored image data stored when said user-input data was detected and with memory positions of said stored audio data.

16. The method of claim 15, wherein when said user-input data is detected in the detecting step, said image data stored in said image data storing step comprises an image data sequence from image data stored in said temporary storing step, said image data sequence comprising image data beginning at least at a start of an interval detected in the interval detecting step, said interval preceding detection of said user-input data.