Adaptive multi-modal integrated biometric identification detection and surveillance systems

• US 20060093190A1
• Filed: 09/19/2005
• Published: 05/04/2006
• Est. Priority Date: 09/17/2004
• Status: Active Grant

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Proximex Corporation (Apollo Global Management, Inc.)
• Inventors: Cheng, Ken Prayoon, Chang, Edward Y., Wang, Yuan-Fang
• Granted Patent: US 7,956,890 B2
• Time in Patent Office: Days
• US Class Current: 382/115
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/811 the classifiers operating on different input data, e.g. multi-modal recognition
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G08B 13/196 using television cameras
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A surveillance system is provided that includes at least one sensor disposed in a security area of a surveillance region to sense an occurrence of a potential security breach event; a plurality of cameras is disposed in the surveillance region; at least one camera of the plurality has a view of the security area and can be configured to automatically gather biometric information concerning at least one subject person in the vicinity of the security area in response to the sensing of a potential security breach event; one or more other of the plurality of cameras can be configured to search for the at least one subject person; a processing system is programmed to produce a subject dossier corresponding to the at least one subject person to match biometric information of one or more persons captured by one or more of the other cameras with corresponding biometric information in the subject dossier.

Claims

1. A surveillance method comprising:

using at least one event sensor disposed in a security area of a surveillance region to sense an occurrence of a potential security breach event;

using at least one camera with a view of the security area in which the event is sensed to gather biometric information concerning at least one person in the vicinity of the security area at about the time of the sensing of the event;

producing a subject dossier corresponding to the at least one person; and

matching biometric information of one or more persons captured by one or more other cameras in the vicinity of the at least one camera with corresponding biometric information in the subject dossier.

2. The method of claim 1,

wherein the at least one camera gathers clothing color;

and

wherein matching involves matching clothing color of one or more persons captured by the one or more other cameras with clothing color in the subject dossier.

3. The method of claim 1,

wherein the at least one camera gathers a facial feature signature;

and

wherein matching involves matching facial feature signature of one or more persons captured by the one or more other cameras with a facial feature signature in the subject dossier.

4. The method of claim 1,

wherein the at least one camera gathers hair color;

and

wherein matching involves matching hair color of one or more persons captured by the one or more other cameras with hair color in the subject dossier.

5. The method of claim 1,

wherein the at least one camera gathers skin color;

and

wherein matching involves matching skin color of one or more persons captured by the one or more other cameras with skin color in the subject dossier.

6. The method of claim 1,

wherein the at least one camera gathers one or more of clothing color, facial features, skin color and hair color;

and

wherein matching involves matching at least one of clothing color, facial features, skin color and hair color of one or more persons captured by the one or more other cameras with corresponding one or more of clothing color, facial features, skin color and hair color in the subject dossier.

7. The method of claim 1,

wherein the at least one camera gathers one or both of estimated height and weight;

and

wherein matching involves matching at least one of height and weight of one or more persons captured by the one or more other cameras with corresponding or both of estimated height and weight in the subject dossier.

8. The method of claim 1,

wherein the at least one camera gathers estimated direction of travel of the at least one person;

and further including

determining which cameras are in the vicinity of the at least one camera based upon the estimated direction of travel.

9. The method of claim 1,

wherein the at least one camera gathers estimated speed of travel of the at least one person;

and further including

determining which cameras are in the vicinity of the at least one camera based upon the estimated speed of travel.

10. The method of claim 1,

wherein the at least one camera gathers estimated direction of travel and estimated speed of travel of the at least one person;

and further including

determining which cameras are in the vicinity of the at least one camera based upon the estimated direction of travel and the estimated speed of travel.

11. The method of claim 1,

wherein the at least one camera gathers one or more of clothing color, facial features, skin color, hair color, estimated height and estimated weight;

wherein matching involves matching at least one of clothing color, facial features, skin color, hair color, estimated height and estimated weight of one or more persons captured by the one or more other cameras with corresponding one or more of clothing color, facial features, skin color, hair color, estimated height and estimated weight in the subject dossier.

12. The method of claim 1,

wherein the at least one camera gathers one or more of clothing color, facial features, skin color, hair color, estimated height and estimated weight;

wherein the at least one camera gathers one or both of estimated direction of travel and estimated speed of travel of the at least one person; and

further including

determining which cameras are in the vicinity of the at least one camera based upon at least one of the estimated direction of travel and the estimated speed of travel; and

wherein matching involves matching at least one of clothing color, facial features, skin color, hair color, estimated height and estimated weight of one or more persons captured by the one or more other cameras with corresponding one or more of clothing color, facial features, skin color, hair color, estimated height and estimated weight in the subject dossier.

13. The method of claim 1 further including:

providing to a control console display an image of a person captured by the one or more other cameras having biometric information matching biometric information in the subject dossier.

14. The method of claim 1 further including:

wherein the subject dossier includes at least two biometric signatures; and

further including;

fusing the at least two signatures and including the fused signature in the subject dossier.

15. The method of claim 1 further including:

wherein the subject dossier includes at least two biometric signatures; and

further including;

incrementally fusing the at least two signatures and including the fused signature in the subject dossier.

16. The method of claim 1 further including:

wherein the at least one camera with a view of the security area also serves as an event sensor.

17. A surveillance system comprising:

at least one sensor disposed in a security area of a surveillance region to sense an occurrence of a potential security breach event;

a plurality of cameras;

wherein the at least one camera of the plurality has a view of the security area and can be configured to automatically gather biometric information concerning at least one subject person in the vicinity of the security area in response to the sensing of a potential security breach event in the security area;

wherein one or more other of the plurality of cameras can be configured to search for the at least one subject person;

a processing system;

wherein the processing system is programmable to produce a subject dossier corresponding to the at least one subject person; and

wherein the processing system is programmable to match biometric information of one or more persons captured by one or more of the other cameras with corresponding biometric information in the subject dossier.

18. The system of claim 17,

wherein the at least one camera serves as an event sensor.

19. The system of claim 17,

wherein the processing system is programmable to produce a subject dossier that includes at least one or more of clothing color, facial features, skin color, hair color, estimated height and estimated weight;

wherein the processing system is programmable to match at least one of clothing color, facial features, skin color, hair color, estimated height and estimated weight of one or more persons captured by the one or more other cameras with corresponding one or more of clothing color, facial features, skin color, hair color, estimated height and estimated weight in the subject dossier.

20. A surveillance system comprising:

a plurality of sensors disposed in a surveillance region to sense an occurrence of a potential security breach event;

a plurality of cameras disposed in the surveillance region,

wherein one or more of the plurality of cameras can be configured to automatically gather one or both of biometric information and temporal identifying information concerning at least one subject person in the vicinity of such camera, in response to sensing of a potential security breach event in the vicinity of such camera;

wherein one or more of the plurality of cameras can be configured to search for the at least one subject person;

a processing system;

wherein the processing system is programmable to produce a subject dossier including one or both of biometric information or temporal identifying information corresponding to the at least one subject person; and

wherein the processing system is programmable to match one or both of biometric information or temporal identifying information of one or more persons captured by one or more cameras configured to search for the at least one subject person.