Systems and method of transmitting information from monochrome sensors

• US 10,341,606 B2
• Filed: 05/24/2017
• Issued: 07/02/2019
• Est. Priority Date: 05/24/2017
• Status: Active Grant

• Current Assignee: Vision Products, LLC
• Original Assignee: SA Photonics
• Inventors: Davey, James Arundell
• Primary Examiner(s): Lee, Michael
• Application Number:
  US15/604,475
• Publication Number:
  US 20180343417A1
• Time in Patent Office: 769 Days
• Field of Search: 348659, 348658, 348661, 348680, 348693, 348719, 348723, 348725, 348756, 348488, 348441, 3484231, 348343, 348263, 348260, 348259, 348237, 3482271, 3482115, 3482072, 3482071, 348164, 348159, 348153, 348141, 348135, 348 73, 348 64, 348 54, 348 53, 348 52, 348 50, 348 49, 348 48, 348 47, 348 33, 345 6, 345 7, 345 8, 345419, 359356, 359630, 359815, 359880
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 5/0733 for distributing synchronisation pulses to different TV cameras
• CPC Class Codes: H04N 7/0806 the signals being two or more video signals H04N7/0803, H04N7/081 take precedence
• CPC Class Codes: H04N 7/10 Adaptations for transmission by electrical cable H04N7/12 takes precedence
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods of multiplexing information from a plurality of monochrome sensors/cameras is provided. The systems and methods provided can be useful to achieve pixel-level time synchronization between information acquired by different monochrome sensors/cameras that are configured to view a scene from different viewing directions.

Claims

1. An imaging system comprising:

a plurality of cameras comprising a plurality of optical sensor arrays, different sensor arrays of the plurality of optical sensor arrays configured to obtain a monochrome image of a scene and produce image data,

a multiplexing unit configured to multiplex image data obtained by different sensor arrays of the plurality of optical sensor arrays and generate a single image stream; and

a transmission line configured to accept the generated single image stream,

wherein the plurality of optical sensor arrays comprises three optical sensor arrays, the three optical sensor arrays comprising respective arrays of pixels, a pixel in the array of pixels associated with a unique set of coordinates designating the position of the pixel in the array of pixels, and

wherein the single image stream comprises a plurality of multiplexed pixels comprising information from co-located pixels of the three optical sensor arrays, the information from the co-located pixels of the three optical sensor arrays being time synchronized.

2. The imaging system of claim 1, wherein the transmission line is configured to accept image data obtained by an RGB color camera comprising a pixel array comprising red, green, and blue sub-pixels configured to detect light in red, green and blue wavelengths, respectively, of the visible spectral range.

3. The imaging system of claim 1, wherein the multiplexing unit is configured to time division multiplex image data obtained by the three optical sensor arrays as a single serial image stream.

4. The imaging system of claim 1, further comprising an image processing unit in communication with said transmission line configured to receive said image stream comprising multiplex image data obtained by different sensor arrays of the plurality of optical sensor arrays.

5. The imaging system of claim 4, wherein said image processing unit is configured to generate time synchronized images from the images acquired by the plurality of cameras that can be displayed on one or more display devices.

6. The imaging system of claim 1, wherein the plurality of optical sensor arrays comprise monochrome sensor arrays.

7. The imaging system of claim 1, wherein the plurality of optical sensor arrays comprise sensor arrays sensitive to light in a wavelength range between about 360 nm and about 12 microns.

8. The imaging system of claim 1, wherein the plurality of optical sensor arrays comprise infrared sensor arrays sensitive to infrared light.

9. The imaging system of claim 1, wherein the plurality of cameras comprise night vision cameras.

10. The imaging system of claim 1, wherein said plurality of cameras further comprise lenses configured to image the scene.

11. The imaging system of claim 1, wherein the plurality of cameras have different fields of view.

12. The imaging system of claim 1, disposed in an aircraft.

13. The imaging system of claim 1, disposed in a ship or boat.

14. The imaging system of claim 1, disposed in terrestrial vehicle.

15. The imaging system of claim 1, disposed on a helmet configured to be worn on the head of a wearer.

16. The imaging system of claim 15, further comprising an image processing unit configured to generate time synchronized images from the images acquired by the plurality of cameras that can be displayed on one or more display devices disposed in front of the wearer'"'"'s left and right eyes.

17. The imaging system of claim 15, wherein said display devices are disposed on said helmet.

18. The imaging system of claim 15, wherein said cameras are disposed on said helmet.

19. The imaging system of claim 1, wherein said transmission line comprises coaxial cable.

20. The imaging system of claim 1, wherein said transmission line comprises a balanced pair.

21. An imaging system comprising:

a plurality of cameras comprising a plurality of optical sensor arrays, different sensor arrays of the plurality of optical sensor arrays configured to obtain a monochrome image of a scene and produce image data,

a multiplexing unit configured to multiplex image data obtained by different sensor arrays of the plurality of optical sensor arrays and generate a single image stream comprising a plurality of multiplexed pixels; and

a transmission line configured to accept the generated single image stream,

wherein different sensor arrays of the plurality of optical sensor arrays comprise respective arrays of pixels, a pixel in the array of pixels associated with a unique set of coordinates designating the position of the pixel in the array of pixels, and

wherein a multiplexed pixel from the plurality of multiplexed pixels comprises information from co-located pixels of different sensor arrays, the information from the co-located pixels of different sensor arrays sensor arrays being time synchronized.

22. The imaging system of claim 21, wherein the transmission line is configured to accept image data obtained by an RGB color camera comprising a pixel array comprising red, green, and blue sub-pixels configured to detect light in red, green and blue wavelengths, respectively, of the visible spectral range.

23. The imaging system of claim 21, further comprising an image processing unit in communication with said transmission line configured to receive said image stream comprising multiplex image data obtained by different sensor arrays of the plurality of optical sensor arrays.

24. The imaging system of claim 23, wherein said image processing unit is configured to generate time synchronized images from the images acquired by the plurality of cameras that can be displayed on one or more display devices.

25. The imaging system of claim 21, wherein the plurality of optical sensor arrays comprise monochrome sensor arrays.