Vehicle-Mountable Imaging Systems and Methods

• US 20100295945A1
• Filed: 04/14/2009
• Published: 11/25/2010
• Est. Priority Date: 04/14/2009
• Status: Active Grant

• Current Assignee: BAE Systems Plc
• Original Assignee: BAE Systems Plc
• Inventors: Moore, David, Morris, Gary, Pybus, Charlie, Plemons, Danny, Breakfield, David K.
• Granted Patent: US 8,564,663 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/108 using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8073 for vehicle security, e.g. parked vehicle surveillance, burglar detection
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Imaging systems, methods, and vehicles having imaging systems.

Claims

1. An imaging system for a ground vehicle, the imaging system comprising:

a plurality of first imaging sensors having a first spectrum, each first sensor having a field-of-view (FOV) and configured to be coupled to a vehicle such that the FOV partially overlaps the FOV of at least one of the other first imaging sensors;

a plurality of second imaging sensors having a second spectrum, each second sensor having a FOV and configured to be coupled to the vehicle such that the FOV is substantially aligned with the FOV of a corresponding first imaging sensor;

a processing unit configured to receive images from the first and second imaging sensors and to generate an image model in substantially real-time by;

warping images from corresponding first and second imaging sensors;

fusing images from corresponding first and second imaging sensors; and

stitching images from imaging sensors with partially overlapping FOVs; and

where the processing unit is configured to be coupled to two or more displays such that the two or more displays can simultaneously each show a different portion of the image model.

2. The imaging system of claim 1, where the processing unit is configured to generate an image model by fusing images with an alpha-blending algorithm.

3. The imaging system of claim 1, where the processing unit is configured to generate an image model by warping images with one or more predefined warping templates each corresponding to an imaging sensor.

4. The imaging system of claim 1, where the processing unit is configured to generate an image model by fusing images with one or more predefined stitching templates.

5. The imaging system of claim 1, where the first imaging sensors are long-wavelength infrared (LWIR) imaging sensors.

6. The imaging system of claim 5, where the second imaging sensors are color daylight (CD) imaging sensors.

7. The imaging system of claim 1, where the image model comprises images covering at least a continuous 180 degrees around the vehicle.

8. The imaging system of claim 7, where the image model comprises images covering a continuous 360 degrees around the vehicle.

9. The imaging system of claim 1, where at least one of the first imaging sensors and the second imaging sensors are analog, and where the processing unit is further configured to convert analog images to digital images prior to generating the image model.

10. The imaging system of claim 1, where the imaging system is configured such that, if the processing unit is coupled to a display, the display can simultaneously show two or more different portions of the image model

11. The imaging system of claim 10, where the imaging system is configured such that, if the processing unit is coupled to a display, the display can simultaneously show a front portion of an image model including images of in front of the vehicle and a mirrored rear portion of an image model including images of behind the vehicle.

12. The imaging system of claim 11 where the imaging system is configured such that, if the processing unit is coupled to the display, the display can also simultaneously show two side portions of an image model, each side portion including images from a different side of the vehicle.

13. The imaging system of claim 1, where the imaging system is further configured such that, if the processing unit is coupled to the display, the display can also show a reference indicator indicative of the orientation of the portion of an image model shown on the display relative to the orientation of the vehicle.

14. The imaging system of claim 1, where the processing unit comprises one or more graphics processors.

15. The imaging system of claim 1, where the processing unit is configured to be coupled to two or more user-input devices each corresponding to a different display.

16. The imaging system of claim 15, where processing unit is configured to be coupled to at least one user-input device that is integral to a corresponding display.

17. The imaging system of claim 15, where the imaging system is configured such that, if the processing unit is coupled to a display and a corresponding user-input device, a user can adjust, via the user-input device, the intensity of images from the first imaging sensors relative to the intensity of fused images from the second imaging sensors in a portion of the image model shown on the display.

18. The imaging system of claim 1, further comprising:

a wireless communication device coupled to the processing unit and configured to transmit at least a portion of the image model to a remote receiver.

19. The imaging system of claim 18, where the wireless communication device is further configured to receive signals from a remote user-input device.

20. The imaging system of claim 18, where the processing unit is further configured to compress at least a portion of the image model prior to the wireless communication device transmitting the at least a portion of the image model to a remote receiver.

21. A vehicle comprising:

a ground vehicle; and

an imaging system coupled to the vehicle, the imaging system comprising;

a plurality of first imaging sensors having a first spectrum, each first sensor having a field-of-view (FOV) and coupled to the vehicle such that the FOV partially overlaps the FOV of at least one of the other first imaging sensors;

a plurality of second imaging sensors having a second spectrum, each second sensor having a FOV and coupled to the vehicle such that the FOV is substantially aligned with the FOV of a corresponding first imaging sensor;

a processing unit configured to receive images from the first and second imaging sensors and to generate an image model in substantially real-time by;

warping images from corresponding first and second imaging sensors;

fusing images from corresponding first and second imaging sensors; and

stitching images from imaging sensors with partially overlapping FOVs; and

two or more displays coupled to the processing unit;

where the imaging system is configured such that the two or more displays can simultaneously each show a different portion of the image model.

22. The vehicle of claim 21, where the ground vehicle is selected from the group consisting of:

M1117 Guardian Armored Security Vehicles (ASVs), High Mobility Multipurpose Wheeled Vehicles (Humvee), Family of Medium Tactical Vehicles (FMTV), Light Medium Tactical Vehicles (LMTV), Medium Tactical Vehicles (MTV), Medium Tactical Vehicle Replacements (MTVR), Heavy Expanded Mobility Tactical Trucks (HEMTT), Heavy Equipment Transport Systems (HETS), Palletized Load System (PLS) vehicles, and Bradley Fighting Vehicles.

23. An imaging system for a ground vehicle, the imaging system comprising:

two imaging sensors, each having a field-of-view (FOV) and configured to be coupled to a vehicle such that the FOV is spaced by a distance from the FOV of the other imaging sensor; and

a processing unit configured to receive images from the imaging sensors;

where the processing unit is configured to be coupled to a display such that the display can show simultaneously a portion of images from each imaging sensor such that the portions are spaced apart by a distance that is proportional to the distance between the FOVs of the imaging sensors.

24. The imaging system of claim 23, where the two imaging sensors are each coupled to a ground vehicle such that the FOV is spaced by a distance from the FOV of the other imaging sensor, and further comprising:

a display coupled to the processing unit such that the display can show simultaneously a portion of images from each imaging sensor such that the portions are spaced apart by a distance that is proportional to the distance between the FOVs of the imaging sensors.

25. A sensor pod comprising:

a housing;

two or more first imaging sensors having a first spectrum, each first imaging sensor having a field-of-view (FOV) and coupled in fixed relation to the housing such that the FOV partially overlaps the FOV of the other sensor; and

two or more second imaging sensors having a second spectrum, each second sensor having a FOV and coupled to the vehicle such that the FOV is substantially aligned with the FOV of a corresponding first imaging sensor.

26. The sensor pod of claim 25, further comprising:

a processing unit configured to receive images from the first and second imaging sensors and to generate an image model in substantially real-time by;

warping images from corresponding first and second imaging sensors;

fusing images from corresponding first and second imaging sensors; and

stitching images from imaging sensors with partially overlapping FOVs.