Camera with visible and infra-red imaging

• US 20020140822A1
• Filed: 03/28/2002
• Published: 10/03/2002
• Est. Priority Date: 03/28/2001
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Grosvenor, David Arthur, Hunter, Andrew Arthur, Slatter, David Neil, Cheatle, Stephen Philip, Kahn, Richard Oliver
• Granted Patent: US 7,365,771 B2
• Time in Patent Office: Days
• US Class Current: 348/207.99
• CPC Class Codes: G01S 17/42 Simultaneous measurement of distance and other co-ordinates indirect measurement G01S17/46
• CPC Class Codes: G01S 17/74 Systems using reradiation of electromagnetic waves other than radio waves, e.g. IFF, i.e. identification of friend or foe
• CPC Class Codes: H04N 2209/047 using multispectral pick-up elements
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/651 for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A digital camera 2 provides an infra-red signal 10 and a visible signal 15 from sensors 8, 9, wherein the sensor fields of view overlap or share a common field of view. Analysis of the IR signal 10 provides the location of (20) and information from (13, 14) an active or passive target. Analyser 19 acts on the signal 15 in response to signals 14, 20 for composition control (pan/tilt/zoom/timing) and selection of pictures from signal 15 for storage 18 together with signal 13 providing ancillary information such as personal details of a target wearer. Alternatively the visible and infra-red image signals may be combined to correct for sensitivity of the visible and/or IR sensors to IR and visible wavelengths respectively.

Claims

1. Camera apparatus comprising a digital camera arranged to provide a first image signal corresponding to an infra-red field of view and a second image signal corresponding to a visible field of view, wherein said visible and infra-red fields of view overlap or share a common field of view, and said apparatus includes a signal analyser for analysing said first signal for detecting and determining the location of an infra-red target within its field of view.

2. Camera apparatus according to claim 1 for use with a target or an optical pointer which emits modulated infra-red light bearing information, said camera apparatus being provided with a modulated light detector for responding to said modulated light to provide an information signal.

3. Camera apparatus according to claim 1 for use with a target which bears information in the form of an infra-red light pattern or coding, said camera apparatus being provided with a pattern detector for responding to said pattern or coding to provide an information signal.

4. Camera apparatus according to claim 2 including a signal combiner for combining at least part of said information signal with the second signal to provide a composite output signal.

5. Camera apparatus according to claim 4 wherein said output signal provides an image corresponding to the second signal modified in that said at least part of said information signal underlies the image as in a web page or windows application.

6. Camera apparatus according to claim 3 including a signal combiner for combining at least part of said information signal with the second signal to provide a composite output signal.

7. Camera apparatus according to claim 6 wherein said output signal provides an image corresponding to the second signal modified in that said at least part of said information signal underlies the image as in a web page or windows application.

8. Camera apparatus according to claim 1 and including an adaptive image signal responsive circuit for receiving a said image signal and in response thereto controlling the camera and/or controlling the selection of a selected picture signal from the said image signal.

9. Camera apparatus according to claim 8 wherein said adaptive circuit is arranged for control of the timing of operation of the camera.

10. Camera apparatus according to claim 8 wherein said adaptive circuit is arranged for control of at least one of camera pan, tilt and zoom.

11. Camera apparatus according to claim 8 wherein said adaptive circuit is responsive to the target location.

12. Camera apparatus according to claim 1 and provided with a controller for responding to said target location for controlling at least one of camera tilt, pan and zoom.

13. Camera apparatus according to claim 1 for use with an infra-red target having a transponder, the camera being arranged for interrogating the transponder of any target in the immediate environment and for receiving a response from the transponder.

14. Camera apparatus according to claim 13 and arranged so that the camera is pointed in the general direction of the target upon receipt of a signal from a transponder.

15. Camera apparatus according to claim 1 for use with an infra-red emitting target having a low power “

sleep”

state in which it requires a “

wake-up”

signal before transmitting light, said camera being provided with circuitry for emitting a said “

wake-up”

signal.

16. Camera apparatus according to claim 1 and including a first sensor which is infra-red sensitive for providing said first image signal, and is also sensitive to visible light, for providing said second signal, the apparatus also including at least one infrared and one visible filter, and a filter switcher for switching or placing said filters before the single sensor in sequence to provide said first and second signals.

17. Camera apparatus according to claim 1 and including a first sensor which is infra-red sensitive for providing said first image signal and a spatially separate second sensor which is visible light sensitive for providing said second image signal.

18. Camera apparatus according to claim 1 wherein the first and second signals are provided by first and second image sensors respectively, the first image sensor comprising a first infra-red sensitive sensor element array providing a first plurality of pixels and the second image sensor comprising one or more second element visible light sensitive sensor arrays providing a second plurality of pixels, the first and second sensor element arrays being combined into a single composite sensor element array.

19. Camera apparatus according to claim 18 wherein the first plurality of pixels is substantially less than the second plurality of pixels.

20. Camera apparatus according to claim 19 and including an arrangment for scanning the first and second arrays at respective first and second array rates, wherein the first rate is an increased rate substantially greater than the second rate.

21. Camera apparatus according to claim 20 wherein said increased rate is at least 300 frames per second.

22. Camera apparatus according to claim 1 wherein the first signal is provided by a first sensor, and including a scan control for selectively restricting the area of the first sensor which is scanned.

23. Camera apparatus according to claim 22 wherein the scan control is responsive to said target location for determining said restricted area.

24. Camera apparatus according to claim 22 and including a rate selective circuit for selectively controlling whether the whole of the first sensor is scanned at a first sensor rate or whether the restricted area is scanned at a substantially increased rate.

25. Camera apparatus according to claim 23 wherein said increased rate is at least 300 frames per second.

26. Camera apparatus according to claim 1 and including a combiner for combining the second image signal with information from the first image signal for correcting for sensitivity of the first image signal to infra-red light.

27. A camera system comprising camera apparatus as claimed in claim 1 and at least one target or optical pointer providing an infra-red image.

28. A system according to claim 27 wherein said target or optical pointer is arranged to emit modulated infra-red light.

29. A system according to claim 28 wherein said modulated light carries an information signal.

30. A system according to claim 29 wherein said information signal includes an address or other identifier relating to the target or pointer user.

31. A system according to claim 29 wherein said information signal includes instructions for camera control.

32. A system according to claim 27 wherein said target bears an infra-red pattern providing an information signal.

33. A system according to claim 32 wherein said information signal includes an address or other identifier relating to the target or pointer user.

34. A system according to claim 32 wherein said information signal includes instructions for camera control.

35. A system according to claim 32 and including a source of infra-red light for illuminating said target.

36. A camera system comprising camera apparatus as claimed in claim 13 and at least one target or optical pointer providing an infra-red image, wherein said target comprises a said transponder.

37. A camera system comprising camera apparatus as claimed in claim 15, wherein said target is arranged to have a low power “

sleep”

state in which it requires a said “

wake-up”

signal before transmitting light.

38. Camera apparatus comprising a digital camera arranged to provide a first image signal corresponding to an infra-red field of view and a second image signal corresponding to a visible field of view, wherein said visible and infra-red fields of view overlap or share a common field of view, said apparatus including a combiner for combining the infra-red image information from the first array with the signal from the second array for correcting for sensitivity of the second array to infra-red light