Methods and apparatus related to improved surveillance

• US 8,139,112 B2
• Filed: 08/07/2006
• Issued: 03/20/2012
• Est. Priority Date: 08/07/2006
• Status: Active Grant

• Current Assignee: SightLogix, Inc.
• Original Assignee: SightLogix, Inc.
• Inventors: Cleary, Geoffrey Alan, Chin, Danny
• Primary Examiner(s): Ometz, David
• Assistant Examiner(s): SPINKS, ANTOINETTE T
• Application Number:
  US11/500,100
• Publication Number:
  US 20080030577A1
• Time in Patent Office: 2,052 Days
• Field of Search: 348/159, 348 13-155, 348/441, 348/207.99
• US Class Current: 348/143
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19663 Surveillance related processing done local to the camera

Abstract

A smart camera device incorporates a first processing path for video display processing and a second processing path for detection and/or tracking processing. A sensor device provides input signals including first size data units to both processing paths, at least some of the same input signals are processed by both processing paths. The video display processing generates second size data units which are smaller than first size data units. First size data units provide more information to the detection/processing module than second size data units would have provided if used. IR detection capability is improved by using first size data units. Detection and/or target tracking operations generate control signals used to control the video display processing to enhance the visual perceptibility of a detected target. Detection and/or target tracking operations generate target information signals conveying an indication of target detection, target identification information, target location information, and/or camera control signal.

Claims

1. A method of operating an integrated camera assembly including a camera housing, comprising:

operating a sensor module mounted in said camera housing to generate first fixed size data units, each first fixed size data unit being of a first pixel value size;

performing, within said camera housing, an image processing operation on at least some of said first fixed size data units to produce second size data units, each individual one of the first fixed size data units and second size data units communicating a single pixel value, each second fixed size data unit being of a second pixel value size, said second fixed size data units being of a second fixed size which is smaller than said first fixed size;

generating, within said camera housing, an image output signal from said second fixed size data units;

processing, within said camera housing, at least some of said first fixed size data units, which are also processed by said image processing operation, to perform at least one of a target detection and a target tracking operation; and

outputting, to a device outside said camera housing, said image output signal.

2. The method of claim 1, wherein said each of said first fixed size data units includes a first number of bits and wherein each of said second fixed size data units includes a second number of bits, said second number being less than said first number.

3. The method of claim 1,

wherein said processing to perform at least one of a target detection and a target tracking operation includes generating, within said camera housing, a target information signal;

and

wherein the target information signal communicates at least one of;

an indication that a target has been detected, information identifying the target, information characterizing a detected target, a camera positioning control signal, a second cameral control signal used to control a second camera, or location information relating to tracking the target.

4. The method of claim 1,

wherein said processing at least some of said first fixed size data units to perform at least one of a target detection and a target tracking operation includes:

generating, within said camera housing, a target information signal from said first fixed size data units; and

generating, within said camera housing, an image control signal used to control said image processing operation performed on at least some of said first fixed size data units to produce second size data units, said image processing operation including a visual gain adjustment operation performed by a visual processing module within said camera housing.

5. The method of claim 4,

wherein said visual gain adjustment operation enhances the visual perceptibility of a detected target;

and

wherein generating, within said camera housing, an image output signal from said second fixed size data units includes;

performing an image compression operation on the second fixed size data units generated by said image processing operation.

6. The method of claim 5, wherein said image compression operation is a non-uniform compression operation that is adjusted as a function of said image control signal to enhance the visual perceptibility of a detected target.

7. The method of claim 1, wherein each one of said first fixed size data units is a 16 bit data unit and each one of said second fixed size data units is an 8 bit data unit.

8. The method of claim 4, wherein said sensor module senses infrared electromagnetic radiation.

9. The method of claim 8, further comprising:

discriminating between targets and non-target objects based on detected infrared signals.

10. The method of claim 9, wherein said discrimination is based on said first sized data units which provide more information than said second fixed size data units.

11. The method of claim 9, wherein said discriminating includes comparing a temperature of a possible target to a background temperature.

12. The method of claim 11, further comprising:

generating said background temperature from sensed first size data units.

13. The method of claim 4,

wherein said step of performing, within said camera housing, an image processing operation on at least some of said first fixed size data units to produce second size data units is performed by a first module within said camera housing;

and

wherein said step of processing at least some of said first fixed size data units, which are also processed by said image processing operation, to perform at least one of a target detection and a target tracking operation is performed by a second module within said camera housing, said first and second modules be coupled to each other and to the camera sensor module both said first and second modules receiving said first size data units from said camera sensor module.

14. The method of claim 9, wherein said discriminating includes comparing a temperature of a possible target to a detection temperature threshold corresponding to an expected target temperature.

15. The method of claim 1,

wherein said processing to perform at least one of a target detection and a target tracking operation includes generating a target information signal;

and

wherein said method is performed within a single camera housing, said single camera housing being located in a system including a plurality of cameras coupled to a common control center.

16. An integrated camera assembly, comprising:

a camera housing;

a sensor module configured to generate first fixed size image data units, each first fixed size data unit including a total number of bits which equals the number of bits in a pixel value generated by said sensor module;

an image processing module located inside said camera housing for performing an image processing operation on at least some of said first fixed size data units to produce second size data units, each individual one of the first fixed size data units and second data units communicating a single pixel value, said second size data units being of a second fixed size which is smaller than said first fixed size, each second fixed size data unit communicating less bits than a first fixed size data unit;

a video compression module, located inside said camera housing, coupled to said image processing module configured to generate a compressed image output signal from said second fixed size data units; and

a secondary processing module, located inside said camera housing, configured to process at least some of said first fixed size data units, which are also processed by said image processing module, said secondary processing module at least one of a target detection and a target tracking operation.

17. The integrated camera assembly of claim 16, wherein said secondary processing module includes a detection and tracking module configured to generate a target information signal.

18. The integrated camera assembly of claim 17, wherein the target information signal communicates at least one of:

an indication that a target has been detected, information identifying the target, information characterizing a detected target, a camera positioning control signal, a second cameral control signal used to control a second camera, or location information relating to tracking the target.

19. The integrated camera assembly of claim 17, wherein said secondary processing module includes:

an image processing control module for generating an image processing control signal used to control said image processing performed by said image processing module.

20. The integrated camera assembly of claim 19, further comprising:

a non-uniform image compression module, located inside said camera housing and being coupled to said image processing module, said non-uniform image compression module being configured to perform a video compression operation on said second size data units generated by said image processing module.

21. The integrated camera assembly of claim 20, wherein said image control signal controls said non-uniform image compression module to enhance the visual perceptibility of a detected target.

22. The integrated camera assembly of claim 19, wherein said sensor module includes a visible light sensor.

23. The integrated camera assembly of claim 19, wherein said sensor module includes an infrared electromagnetic radiation sensor.

24. The integrated camera assembly of claim 23, wherein said secondary processing module includes a target discrimination module for discriminating between targets and non-target objects based on detected infrared signals.

25. The integrated camera assembly of claim 24, wherein said discrimination is based on first sized data units which provide more information than said second size data units.

26. The integrated camera assembly of claim 24, wherein said target discrimination module includes a comparator for comparing a temperature of a possible target to a background temperature.

27. The integrated camera assembly of claim 26, wherein said target discrimination module further comprises:

a background temperature determination module for generating said background temperature from sensed first size data units.

28. The integrated camera assembly of claim 26, wherein said discrimination module further includes:

a position determination module for determining if said possible target changes position with time.

29. The integrated camera assembly of claim 24, wherein said discriminating module includes a comparator for comparing a temperature of a possible target to a detection temperature threshold corresponding to an expected target temperature.

30. The integrated camera assembly of claim 20, further comprising:

an Internet Protocol Interface, located inside said camera housing, configured to output compressed video generated by said video compression module and detected target information generated by secondary processing module.