Tilt-shift correction for camera arrays

• US 10,721,418 B2
• Filed: 05/10/2018
• Issued: 07/21/2020
• Est. Priority Date: 05/10/2017
• Status: Active Grant

• Current Assignee: Grabango Co.
• Original Assignee: Grabango Co.
• Inventors: Glaser, William, Van Osdol, Brian
• Primary Examiner(s): Slater, Alison
• Application Number:
  US15/976,857
• Publication Number:
  US 20180332236A1
• Time in Patent Office: 803 Days
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/65 Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An imaging system comprising of a set of cameras, the cameras having a configured relative camera arrangement; and each camera of the set of cameras comprising at least one corrective optical system. The system and method may comprise of multi-camera variations for coordinated alignment in multi-camera variations and/or split-field optical systems.

Claims

1. An imaging system for the monitoring of an environment with at least one shelving aisle comprising of:

a set of cameras comprising of at least ten cameras, the cameras having a configured relative camera arrangement down a shelving aisle, wherein the set of cameras are mounted above and in front of a shelf face;

each camera of the set of cameras comprising a camera sensor with a defined sensor plane and at least one corrective optical system, the corrective optical system comprising a tilt-shift lens optical system with a compound lens and a split-view optical system that captures different sub-regions of interest in a field of view of the camera sensor, wherein the tilt-shift lens optical system applies a perspective transformation to a focal plane of each camera;

wherein the sub-regions captured by the camera sensor comprise a first imaged region and a second imaged region;

wherein the first imaged region of the split-view optical system is optically transformed by the tilt-shift optical system; and

wherein the relative camera arrangement and the perspective transformation are cooperatively configured to image the shelf face at each camera with a focal plane aligned to the shelf face, wherein the sensor plane is not parallel to the focal plane.

2. The system of claim 1, wherein the relative camera arrangement of the set of cameras and the perspective transformation are cooperatively configured for less than 10% adjacent camera overlap in imaging of the shelf face, wherein the adjacent camera overlap is substantially a rectangular region of overlap.

3. The system of claim 1, wherein the relative camera arrangement of the set of cameras and the perspective transformation are cooperatively configured for less than at least 50% adjacent camera overlap in imaging of the shelf face, wherein the adjacent camera overlap is a substantially rectangular region of overlap.

4. The system claim 1, wherein the perspective transformation applied by the tilt-shift lens optical system is configured to reduce perspective distortion of the shelf face wherein defined vertical sides of a captured image of the shelf face has an angle less than two degrees from vertical as captured by each camera.

5. The system of claim 1, wherein the tilt-shift optical system is further configured to align the focal plane within ten degrees of the shelf face.

6. The system of claim 1, further comprises a second tilt-shift lens optical system that is configured to apply a perspective transformation for imaging of a target object in a second region, wherein the target object is a defined horizontal surface region.

7. The system of claim 1, further comprises a second tilt-shift lens optical system that is configured to apply a perspective transformation for imaging of a target object in the second region, wherein the target object is a defined diagonal surface region.

8. The system of claim 1, wherein the set of cameras are integrated into a camera module housing multiple cameras.

9. The system of claim 1, further comprising a monitoring network of interconnected camera modules;

wherein each camera module comprises of distinct subset of cameras from the set of cameras.

10. The system of claim 1, wherein the second imaged region has an effective focal plane different from the first imaged region.

11. The system of claim 1, wherein the split-view optical system comprises a mirror configured to form the second imaged region by redirecting a sub-region of the field of view.

12. The system of claim 1, wherein each camera additionally captures a third imaged region in the field of view of the camera sensor from the split-view optical system.

13. The system of claim 1, wherein the second imaged region contains a floor surface.

14. The system of claim 13, wherein the second imaged region from the split-view optical system is optically transformed by a second tilt-shift lens optical system configured to adjust the focal plane of the second imaged region substantially parallel to a floor surface.

15. The system of claim 14, wherein the second tilt-shift lens optical system orients the focal plane of the second imaged region to at least five feet above the floor surface for tracking of people.

16. The system of claim 1, wherein the cameras are mounted between and above two opposing shelf faces;

and wherein the second imaged region contains a second shelf face.

17. The system of claim 1, further comprising a processing system that collects image data from each of the image data.

18. The system of claim 17, wherein the image data comprises image data of the shelf face with substantially uniform pixel density across the shelf face, wherein the substantially uniform pixel density comprises of image data where pixel density of objects at the bottom of the shelf face are substantially similar in pixel density to objects at the top shelf face.

19. The system of claim 1, wherein image data of each camera is processed such that sub-regions of the image data are processed as distinct image data isolated from the source image data.