System for detecting image abnormalities

• US 10,198,803 B2
• Filed: 04/27/2018
• Issued: 02/05/2019
• Est. Priority Date: 05/01/2007
• Status: Active Grant

• Current Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Original Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Inventors: Giuffrida, Frank, Schultz, Stephen
• Primary Examiner(s): Hsia, Sherrie
• Application Number:
  US15/965,086
• Publication Number:
  US 20180247401A1
• Time in Patent Office: 284 Days
• Field of Search: 348142-144, 382254, 382109, 701 9, 701 3
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

Image capture systems including a moving platform; an image capture device having a sensor for capturing an image, the image having pixels, mounted on the moving platform; and a detection computer executing an abnormality detection algorithm for detecting an abnormality in the pixels of the image immediately after the image is captured by scanning the image utilizing predetermined parameters indicative of characteristics of the abnormality and then automatically and immediately causing a re-shoot of the image.

Claims

1. An image capture method, comprising:

capturing, with a sensor of an image capture device mounted on a moving platform, an image having pixels; and

executing, with a detection computer, an abnormality detection algorithm for detecting an abnormality in the pixels of the image immediately after the image is captured by scanning the image utilizing predetermined parameters indicative of characteristics of the abnormality and then automatically and immediately causing a re-shoot of the image, wherein the abnormality is caused by overstimulation of the sensor of the image capture device, causing at least a portion of the image to be obscured.

2. The image capture method of claim 1, wherein automatically and immediately causing a reshoot of the image is defined further as causing a sequence of re-shoots of the image.

3. The image capture method of claim 2, wherein the image is a first scheduled image scheduled for capture before a second scheduled image, and wherein causing a sequence of re-shoots of the first scheduled image is defined further as causing a sequence of re-shoots of the first scheduled image until the second scheduled image.

4. The image capture method of claim 2, wherein causing a sequence of re-shoots of the image is defined further as causing a sequence of re-shoots of the image without detecting whether the abnormality is captured in the re-shoots of the image.

5. The image capture method of claim 2, wherein causing a sequence of re-shoots of the image is defined further as executing the abnormality detection algorithm for detecting an abnormality in the pixels of the re-shoots of the image immediately after each of the re-shoots of the image is captured by scanning each of the re-shoots of the image utilizing predetermined parameters indicative of characteristics of the abnormality and ending the sequence of re-shoots of the image upon a lack of detection of an abnormality in one or more of the re-shoots of the image.

6. An image capture method, comprising:

capturing, with a sensor of an image capture device mounted on a moving platform, an aerial image having pixels, the sensor having an image area and a dark area bordering the image area; and

executing, with a detection computer, an abnormality detection algorithm for detecting an abnormality in the pixels of the aerial image immediately after the aerial image is captured by scanning the aerial image utilizing predetermined parameters indicative of characteristics of the abnormality and then automatically scheduling a re-shoot of the aerial image such that the re-shoot occurs prior to landing of the moving platform, wherein the abnormality detection algorithm causes the detection computer to scan the aerial image by monitoring pixel values of the aerial image as the pixel values are moved through the dark area of the sensor.

7. The image capture method of claim 6, wherein the abnormality is caused by overstimulation of the sensor of the image capture device, causing at least a portion of the aerial image to be obscured.

8. The image capture method of claim 6, wherein automatically scheduling a re-shoot of the aerial image such that the re-shoot occurs prior to landing of the moving platform is further defined as automatically scheduling a re-shoot of the aerial image such that the re-shoot occurs prior to landing of the moving platform and after completion of a planned flight plan.

9. An image capture method, comprising:

capturing, with a sensor of an image capture device mounted on a moving platform an aerial image having pixels, the sensor having an image area and a dark area bordering the image area; and

executing, with a detection computer, an abnormality detection algorithm for detecting an abnormality in the pixels of the aerial image immediately after the aerial image is captured by scanning the aerial image utilizing predetermined parameters indicative of characteristics of the abnormality and then automatically scheduling a re-shoot of the aerial image such that the re-shoot occurs prior to landing of the moving platform, wherein the abnormality detection algorithm causes the detection computer to scan the aerial image using pattern recognition techniques to detect the abnormality in the pixels of the aerial image.

10. The image capture method of claim 9, wherein the moving platform is an unmanned airplane.

11. The image capture method of claim 9, wherein the moving platform is a manned airplane.

12. The image capture method of claim 9, wherein the moving platform is a robotic device.

13. The image capture method of claim 9, wherein capturing the aerial image further comprises capturing the aerial image at a pre-determined time.

14. The image capture method of claim 9, wherein capturing the aerial image further comprises capturing the aerial image at a pre-determined position of the moving platform.

15. The image capture method of claim 9, wherein the aerial image is a first scheduled aerial image scheduled for capture before capture of a second scheduled aerial image, and wherein automatically scheduling the re-shoot of the first scheduled aerial image such that the re-shoot occurs prior to landing of the moving platform further comprises automatically scheduling the re-shoot of the first scheduled aerial image before the capture of the second scheduled aerial image.

16. The image capture method of claim 9, wherein automatically scheduling the re-shoot of the aerial image such that the re-shoot occurs prior to landing of the moving platform further comprises automatically scheduling the re-shoot of the aerial image using multiple re-shoots until a re-shot image is captured that does not contain the abnormality.

17. The image capture method of claim 9, wherein if the abnormality is detected, the aerial image is flagged as bad.

18. The image capture method of claim 9, wherein the sensor is part of a digital camera.

19. The image capture method of claim 9, further comprising capturing one or more re-shot aerial image having pixels.

20. The image capture method of claim 19, further comprising combining one or more of the pixels of the aerial image with one or more of the pixels of the one or more re-shot aerial image.

21. An image capture method, comprising:

capturing, with a sensor of an image capture device mounted on a moving platform an aerial image having pixels, the sensor having an image area and a dark area bordering the image area; and

executing, with a detection computer, an abnormality detection algorithm for detecting an abnormality in the pixels of the aerial image immediately after the aerial image is captured by scanning the aerial image utilizing predetermined parameters indicative of characteristics of the abnormality and then automatically scheduling a re-shoot of the aerial image such that the re-shoot occurs prior to landing of the moving platform, wherein the abnormality is caused by overstimulation of the sensor of the image capture device, causing at least a portion of the aerial image to be obscured.