Information processing system and associated methodology of surveillance event monitoring

• US 7,840,284 B2
• Filed: 06/15/2007
• Issued: 11/23/2010
• Est. Priority Date: 10/18/2002
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kondo, Tetsujiro, Takeda, Naoki, Kobayashi, Naoki, Fujimori, Yasuhiro, Takahashi, Yasuaki, Ohta, Koji
• Primary Examiner(s): DeCady; Albert
• Assistant Examiner(s): GAMI, TEJAL
• Application Number:
  US11/763,664
• Publication Number:
  US 20070239286A1
• Time in Patent Office: 1,257 Days
• Field of Search: 700/1, 700/10, 345/440
• US Class Current: 700/10
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: G01R 31/382 Arrangements for monitoring battery or accumulator variables, e.g. SoC
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G08B 13/19647 Systems specially adapted for intrusion detection in or around a vehicle
• CPC Class Codes: G08B 13/19652 Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
• CPC Class Codes: G08B 13/1966 Wireless systems, other than telephone systems, used to communicate with a camera
• CPC Class Codes: G08B 13/19663 Surveillance related processing done local to the camera
• CPC Class Codes: G08B 13/19669 Event triggers storage or change of storage policy
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An information processing apparatus performs a monitor processing based on sensor data. A first sensor obtains sensor data of a first format, the first format being video. A second sensor obtains sensor data of a second format, the second format being different from the first format. Surveilled features of an object are extracted from the sensor data obtained and compared to determination parameters in order to determine whether a surveillance event has occurred. When a surveillance event is determined to have occurred, message data reports the surveillance event to a further information processing apparatus. A decision signal is received from the further information processing apparatus, and a switch individually turns ON or OFF each of the first and second sensors according to the decision signal based on an instruction transmitted from the further information processing apparatus.

Claims

1. An information processing apparatus for performing monitor processing based on sensor data, comprising:

a first means for independently sensing data of a first format, the first format being video;

a second means for independently sensing data of a second format, the second format being different from the first format;

means for extracting surveilled features of an object being monitored from the sensor data obtained by the first and second means for sensing, said means for extracting surveilled features of an object being monitored determines an inter-frame difference of the sensor data obtained so as to calculate a center of gravity of an inter-frame difference to indicate a position of a moving object;

means for determining whether a surveillance event has occurred based on a comparison of determination parameters to the surveilled features extracted by the means for extracting;

means for individually switching ON or OFF each of the first and second means for sensing according to a decision signal based on an instruction transmitted from a further information processing apparatus.

2. An information processing apparatus according to claim 1, further comprising:

means for transmitting, when an occurrence of the surveillance event is determined by said means for determining whether a surveillance event has occurred, message data for reporting the occurrence of the surveillance event to the further information processing apparatus;

means for receiving the decision signal transmitted from the further information processing apparatus; and

means for performing a control process based on the decision signal received by said means for receiving.

3. An information processing apparatus according to claim 2, wherein said means for receiving the decision signal:

updates the determination parameters for determining whether the surveillance event has occurred by said means for determining whether a surveillance event has occurred;

controls an extraction process of the features by said means for extracting a feature of an object; and

controls the obtaining process of sensor data by said first and second means for sensing.

4. An information processing apparatus according to claim 2, wherein wireless communication is performed in said means for transmitting and in said means for receiving.

5. An information processing apparatus according to claim 1, wherein said information processing apparatus is driven by a battery.

6. An information processing apparatus according to claim 1, wherein the second format is audio, microwave, or infrared.

7. An information processing method for an information processing apparatus which comprises a first and a second means for sensing, the method comprising:

obtaining sensor data of a first format, the first format being video;

obtaining sensor data of a second format, the second format being different from the first format;

extracting surveilled features of an object being monitored from the sensor data obtained, said extracting surveilled features of an object being monitored determines an inter-frame difference of the sensor data obtained so as to calculate a center of gravity of an inter-frame difference to indicate a position of a moving object;

determining whether a surveillance event has occurred based on a comparison of determination parameters to the surveilled features extracted;

individually switching ON or OFF each of the first and second means for sensing according to a decision signal based on an instruction transmitted from a further information processing apparatus.

8. An information processing apparatus for performing monitor processing based on sensor data, comprising:

a first sensor unit configured to obtain sensor data of a first format, the first format being video;

a second sensor unit configured to obtain sensor data of a second format, the second format being different from the first format;

a feature extracting unit configured to extract surveilled features of an object being monitored from the sensor data obtained by the first and second sensor units, said feature extracting unit configured to extract surveilled features of an object being monitored determines an inter-frame difference of the sensor data obtained so as to calculate a center of gravity of an inter-frame difference to indicate a position of a moving object;

a surveillance event determining unit configured to determine whether a surveillance event has occurred based on a comparison of determination parameters to the surveilled features extracted by the feature extracting unit;

a switching unit configured to individually switch ON or OFF each of the first and second sensor units according to a decision signal based on an instruction transmitted from a further information processing apparatus.

9. An information processing apparatus according to claim 8, further comprising:

transmitter that transmits, when an occurrence of the surveillance event is determined by said surveillance event determining unit, message data for reporting the occurrence of the surveillance event to the further information processing apparatus;

receiver that receives a decision signal transmitted from the further information processing apparatus; and

a controller unit configured to perform control processing based on the decision signal received by said receiver.

10. An information processing apparatus according to claim 9, wherein said controller unit:

updates the determination parameters for determining whether the surveillance event has occurred by said surveillance event determining unit;

controls an extraction process of the features by said feature extracting unit; and

controls an obtaining process of sensor data by said sensor units.

11. An information processing apparatus according to claim 9, wherein wireless communication is performed in the transmitter and in the receiver.

12. An information processing apparatus according to claim 8, wherein said information processing apparatus is driven by a battery.

13. An information processing apparatus according to claim 8, wherein the second format is audio, microwave, or infrared.

14. An information processing method for an information processing apparatus which comprises a first and a second sensor unit configured to:

obtain sensor data of a first format, the first format being video;

obtain sensor data of a second format, the second format being different from the first format;

extract surveilled features of an object being monitored from the sensor data obtained, said extract surveilled features of an object being monitored determines an inter-frame difference of the sensor data obtained so as to calculate a center of gravity of an inter-frame difference to indicate a position of a moving object;

determine whether a surveillance event has occurred based on a comparison of determination parameters to the surveilled features extracted;

turn individually ON or OFF each of the sensor units according to a decision signal based on an instruction transmitted from a further information processing apparatus.