System for monitoring and alerting based on animal behavior in designated environments

• US 8,704,668 B1
• Filed: 04/19/2006
• Issued: 04/22/2014
• Est. Priority Date: 04/20/2005
• Status: Active Grant

• Current Assignee: Anna Hagstrom, Trevor Darrell
• Original Assignee: Anna Hagstrom, Trevor Darrell
• Inventors: Darrell, Trevor, Hagstrom, Anna
• Primary Examiner(s): Ghayour, Mohammad
• Assistant Examiner(s): Wilson, Brian
• Application Number:
  US11/379,268
• Time in Patent Office: 2,925 Days
• Field of Search: None
• US Class Current: 340/573.3
• CPC Class Codes: A01K 29/005 Monitoring or measuring activity, e.g. detecting heat or mating

Abstract

A system for monitoring and alerting based on animal behavior includes an apparatus to observe one or more animals using a sensor network, a processor to capture tracking information and to interpret animal state based on sensor observations, and a communication device to communicate alerts based on animal state.

Claims

1. A system for monitoring and alerting based on detected animal activity comprising:

two or more sensor nodes, each sensor node comprising at least an audio sensor and a video sensor within a corresponding environment of an enclosed space, each sensor node also incorporating a compression and initial processing unit and a communications unit configured to transmit sensor observations to a processor node, wherein each of the sensors within the two or more nodes is automatically calibrated without requiring a user-aided calibration process;

the processor node is configured to integrate the sensor observations from multiple modalities to detect activity of an animal living in the environment, the processor node comprising;

a decompression/registration module configured to decompress the sensor observations provided by the two or more sensor nodes and to perform spatio-temporal alignment of the sensor observations into a global coordinate frame;

an audio/visual feature analysis and tracking module configured to receive data from the decompression/registration module and to perform audio difference analysis, video foreground/background extraction, contour extraction, and shape/appearance characterization and tracking on the data received from the decompression/registration module;

a database configured to store summaries of registered observations from the decompression/registration module and to store tracked features received from the audio/visual feature analysis and tracking module;

an event detection module configured to compare previous observations stored in the database and at least one a priori model with current sensor observations received from the audio/visual feature analysis and tracking module to detect events of a defined interest;

a filter module configured to select events that are of sufficient interest from the detected events to generate an alert, wherein the selected events are based upon at least one filter property; and

a communication device configured to automatically communicate the alert to a user on one of a plurality of communication modalities selected in accordance with at least one context parameter of the user and at least one context parameter of the animal, wherein the user operates an alert/context specification interface to select the at least one filter property, the at least one context parameter of the user and the at least one context parameter of the animal.

2. The system of claim 1, wherein the plurality of communication modalities comprise a pre-recorded voicemail or a SMS text message sent to a cell phone, a page sent to a pager and an email.

3. The system of claim 1, wherein the at least one filter property is a sensitivity level.

4. The system of claim 1, wherein at least one sensor node of the two or more sensor nodes includes at least one video sensor with wide angle field of view and at least one video sensor with a narrow angle field of view.

5. The system of claim 1, wherein the processor node is coupled to the two or more sensor nodes via a wired or wireless network.

6. The system of claim 1, wherein the at least one context parameter of the user comprises a time of day, a location of the user, and a current task or job being performed by the user.

7. The system of claim 1, wherein the user can remotely view or listen to the sensor observations that generated the alert.

8. The system of claim 1, wherein at least one of the a priori models is constructed to represent animal activity observed over time.

9. The system of claim 1, wherein the processor node is further configured to be controlled remotely via a web server interface.

10. The system of claim 1, wherein the processor node further comprises an activity review interface configured to allow the user to view the current sensor observations, observations corresponding to the event that generated the alert, or a summary of recent animal activity on a control monitor or an Internet connected terminal.

11. The system of claim 1, wherein the at least one context parameter of the animal comprises a medical condition of the animal.

12. The system of claim 1, wherein the corresponding environment of an enclosed space comprises one of a stall, a cage, a paddock, a pasture, a tie-stall, a zoo exhibit space and a designated area in and around a residential home or farm.