Adaptive environment system and method of providing an adaptive environment

• US 20030108334A1
• Filed: 12/06/2001
• Published: 06/12/2003
• Est. Priority Date: 12/06/2001
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Thomas, McGee, Nevenka, Dimitrova, Radu, Jasinschi, John, Zimmerman
• Application Number:
  US10/011,872
• Publication Number:
  US 20030108334A1
• Time in Patent Office: Days
• US Class Current: 386/95
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06F 16/7854 using shape G06F16/7837 takes precedence
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

An adaptive environment system comprises a recording device for recording a video which is analyzed by a processor and indexed according to features of the video. The video is segmented into at least visual, audio, and textual components, which can be analyzed by the processor. The processor then creates an index file of the features analyzed and stores the video along with the index file on a storage device. The video can then be search according to the index file and a portion of the video identified by the search returned to a display for viewing. In addition, the adaptive environment system may comprise a processing system connectable to a network wherein the network comprises one or more interconnected sensors. The processing system comprises a computer readable medium comprising computer code for instructing one or more processors to: (a) receive recorded data from the one or more sensors connectable to the processing system; (b) analyze the recorded data to identify an event occurring in the recorded data; (c) determine whether a response to the identified event is appropriate; and (d) when a response is appropriate generate a signal associated with the response.

Claims

1. A method of passively recording and indexing events in an operating environment having at least one recording device connected to a network, the network being interconnected to a processor and a storage device, the method comprising:

recording video captured by the recording device;

segmenting the video into at least a video segment and an audio segment;

analyzing the video and audio segments to determine characteristics of the video;

categorizing a portion of the video according to predefined indicia;

associating the characteristics with the analyzed portion of the video; and

storing the video along with the associated category and characteristics on the storage device.

2. The method of claim 1, wherein the segmenting of the video further comprises generating a text transcript of the video.

3. The method of claim 2, further comprising analyzing the text transcript to determine whether a term is used repeatedly.

4. The method of claim 3, wherein the associating further comprises associating the terms used repeatedly with the video.

5. The method of claim 1, wherein a plurality of recording devices are connected to the network.

6. The method of claim 1, wherein the recording device is a video camera.

7. The method of claim 1, wherein the characteristics of the video include a plurality of visual features.

8. The method of claim 1, wherein the analyzing of video segment further comprises using face detection to identify subjects.

9. The method of claim 1, wherein the processor is connected to a display device and the method further comprises:

receiving a request for a portion of the video;

matching the request to the category and characteristics associated with the video;

displaying the portion of the video matching the request.

10. An adaptive environment system, comprising:

a processing system connectable to a network, the network comprising one or more interconnected sensors, the processing system comprising a computer readable medium comprising computer code for instructing one or more processors to;

a. receive recorded data from the one or more sensors connectable to the processing system;

b. analyze the recorded data to identify an event occurring in the recorded data;

c. determine whether a response to the identified event is appropriate; and

d. when a response is appropriate generate a signal associated with the response.

11. The system of claim 10, further comprising a storage device communicatively connected to the processing system and further comprising computer code for instructing the one or more processors to:

de-mix the recorded data into at least a video segment and an audio segment;

perform a probabilistic analysis of the video and audio; and

calculate a probability of the recorded data falling within a category.

12. The system of claim 11, wherein the recorded data is archived in the storage device.

13. The system of claim 10, wherein the computer code comprises a probabilistic engine for analyzing the recorded data.

14. The system of claim 13, wherein the probabilistic engine uses a Bayesian approach.

15. The system of claim 10, wherein when the event identified is a dangerous event, the response is to notify a designated person.

16. The system of claim 10, wherein when the event identified is an energy saving event, the response is to control an appliance interconnected to the network.

17. The system of claim 10, wherein the event identified is a suggestion event and the response is to transmit a message to a user.

18. The system of claim 10, further comprising computer code for instructing the one or more processors to:

create an index of the recorded data;

store the index in an index file; and

store the recorded data along with the index file on a storage device.

19. The system of claim 18, wherein processing system is created to receive a search request from a user and further comprising computer code for instructing the one or more processors to:

match a parameter of the search request to a portion of the index file; and

return a portion of the recorded data corresponding to the section of the index file matching the parameter of the search request.

20. The system of claim 10, wherein the processing system is programmed to analyze an identity of a recorded subject and perform an action if the recorded subject is unrecognized.

21. The system of claim 20, wherein the action is setting off an alarm.

22. The system of claim 20, wherein the action is notifying law enforcement authorities.

23. The system of claim 20, wherein the action is notifying a designated person.

24. A method of classifying and indexing events recorded in an operating environment, the method comprising:

communicatively connecting a recording device to a processor and a storage device;

storing a group of categories in the processor, each of the categories being associated with pre-defined characteristics;

positioning at least the recording device in the operating environment;

recording a video file associated with an event using the recording device;

de-multiplexing the video file into at least three streams of data, each of the streams of data being associated with a respective set of characteristics;

comparing the set of characteristics of each of the streams of data with the predefined characteristics stored in the processor to determine a category for the video file;

creating an index file having the category and other data associated with the video file stored therein; and

storing the video file along with the index file in the storage device so as to be retrievable by a user.

25. A system for classifying and indexing events recorded in an operating environment, comprising:

at least one recording device positioned in the operating environment for recording a video file associated with an event;

a processor communicatively connected to the recording device, the processor storing a group of categories each being associated with pre-defined characteristics and the processor programmed to;

de-mix the video file into at least three streams of data, each of the streams of data being associated with a respective set of characteristics;

compare the set of characteristics of each of the streams of data with the pre-defined characteristics stored in the processor to determine a category for the video file;

create an index file having the category and other data associated with the video file stored therein; and

a storage device communicatively connected to the processor for storing the video file along with the index file so as to be retrievable by a user.

26. The system of claim 25, wherein there are at least three recording devices communicatively connected to the processor.