Electronic camera with automatic image tracking and multi-frame registration and accumulation

• US 5,365,269 A
• Filed: 10/22/1992
• Issued: 11/15/1994
• Est. Priority Date: 10/22/1992
• Status: Expired due to Term

• Current Assignee: Aplegen Incorporated (Avi-Tech Holdings Ltd.)
• Original Assignee: Santa Barbara Instrument Group, Inc.
• Inventors: Iongmire, Mathew J., Holmes, Alan W.
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): Le, Vu
• Application Number:
  US07/964,775
• Time in Patent Office: 754 Days
• Field of Search: 358/125, 358/211, 358/222, 358/105, 358/125, 358/211, 358/222, 358/109, 250/203.1, 250/203.6, 348/297, 348/294, 348/295, 348/143, 348/144, 348/169-172, 348/208, 348/215, 348/214
• US Class Current: 348/297
• CPC Class Codes: G01S 3/7865 using correlation of the live video image with a stored image
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene

Abstract

An optical image (54) of an astronomical scene is focussed by a telescope (16) onto a charge-coupled-device (CCD) photosensor array (50) to produce successive electronic pixel images (92) of the scene which are registered and co-added to produce an accumulated image (96) which is substantially free of streaking caused by rotation of the earth. A current image (92) is registered with an accumulated image (94) by sensing the coordinates of a selected bright star (90) in both images (92,94), computing the offset ΔI between the coordinates, and shifting the current image (92) by the offset ΔI prior to addition to the accumulated image. The telescope (16) may have a clock drive (24) to which the offset ΔI is also applied to correct for mechanical tracking errors.

Claims

1. An electronic camera, comprising:

optoelectronic sensor means for receiving a light image of a scene which moves continuously relative to the sensor means over a sensing interval, and for producing a periodically updated current electronic image corresponding to said scene at respective periodically updated current times over said sensing interval;

image memory means for storing prior electronic images of said scene taken at respective times prior to a current time;

offset sensor means for sensing an offset between a current image and its prior images corresponding to a relative movement between said scene and said sensor means during the time interval between the most recent of said prior times and the current time; and

shift and accumulate means for electronically shifting each current image by said offset and adding each shifted current image to its respective prior images in registration therewith to produce an accumulated image of said scene that is substantially streak-free.

7. An electronic camera as in claim 1, in which the optoelectronic sensor means comprises a charge-coupled-device (CCD) photosensor array.

2. An electronic camera, comprising:

optoelectronic sensor means for receiving a light image of a scene which moves continuously relative to the sensor means over a sensing interval, and for producing a periodically updated current electronic image corresponding to said scene at a current time over said sensing interval;

image memory means for storing a prior electronic image of said scene taken at a time prior to the current time;

offset sensor means for sensing an offset between said current image and said prior image corresponding to a relative movement between said scene and said sensor means during the time interval between said prior time and the current time; and

shift and accumulate means for electronically shifting said current image by said offset and adding said shifted current image to said prior image in registration therewith to produce an accumulated image of said scene that is substantially streak-free;

said current and prior images each comprising pixels;

said image memory means comprising current memory means for storing said pixels of said current image at respective current addresses and accumulated memory means for storing said pixels of said prior image at respective accumulated addresses; and

said shift and accumulate means comprising;

shifting means for computing shifted current addresses by altering said respective current addresses by values corresponding to said offset; and

accumulating means for reading and adding pixels stored at said shifted current addresses in the current memory means to pixels stored in said accumulated addresses in the accumulated memory means, and storing said added pixels at said accumulated addresses in the accumulated memory means.

3. An electronic camera as in claim 2, further comprising:

a housing for supporting the optoelectronic sensor means;

drive means for moving the housing in a path which approximates a movement of said scene relative to said sensor means; and

drive adjustment means for controlling the drive means to adjust said movement of the housing by an amount which produces a coarse registration of said current image with said prior image, with said offset sensor means sensing an offset between said current image and said prior image after said coarse registration, and said shift and accumulate means providing a fine registration of said current image with said prior image.

4. An electronic camera, comprising:

optoelectronic sensor means for receiving a light image of a scene which moves continuously relative to the sensor means over a sensing interval, and for producing a periodically updated current electronic image corresponding to said scene at a current time over said sensing interval;

image memory means for storing a prior electronic image of said scene taken at a time prior to the current time;

offset sensor means for sensing an offset between said current image and said prior image corresponding to a relative movement between said scene and said sensor means during the time interval between said prior time and the current time; and

shift and accumulate means for electronically shifting said current image by said offset and adding said shifted current image to said prior image in registration therewith to produce an accumulated image of said scene that is substantially streak-free;

free;

said current and prior images comprising pixels; and

the offset sensor means comprising;

coordinate sensor means for sensing the coordinates of a selected pixel in said current and prior images respectively; and

computing means for computing said offset as the difference between said sensed coordinates in said current and prior images respectively.

5. An electronic camera as in claim 4, in which the coordinate sensor means comprises means for sensing said coordinates of said selected pixel as being the coordinates of the centroids of a selected object in said current and prior images respectively.

6. An electronic camera as in claim 4, in which the coordinate sensor means comprises means for sensing said coordinates of said selected pixel as being the coordinates of the brightest pixels of a selected object in said current and prior images respectively.

8. An electronic camera, comprising:

optoelectronic sensor means for receiving a light image of a scene which moves continuously relative to the sensor means over a sensing interval, and for producing a periodically updated current electronic image corresponding to said scene at a current time over said sensing interval, said optoelectronic sensor means comprising a charge-coupled-device (CCD) photosensor array;

image memory means for storing a prior electronic image of said scene taken at a time prior to the current time;

offset sensor means for sensing an offset between said current image and said prior image corresponding to a relative movement between said scene and said sensor means during the time interval between said prior time and the current time;

shift and accumulate means for electronically shifting said current image by said offset and adding said shifted current image to said prior image in registration therewith to produce an accumulated image of said scene that is substantially streak-free; and

means for subtracting a dark frame image produced by said photosensor array from said accumulated image.

9. An electronic camera, comprising:

optoelectronic sensor means for receiving a light image of a scene which moves continuously relative to the sensor means over a sensing interval, and for producing a periodically updated current electronic image corresponding to said scene at a current time over said sensing interval, said optoelectronic sensor means comprising a charge-coupled-device (CCD) photosensor array;

image memory means for storing a prior electronic image of said scene taken at a time prior to the current time;

offset sensor means for sensing an offset between said current image and said prior image corresponding to a relative movement between said scene and said sensor means during the time interval between said prior time and the current time;

shift and accumulate means for electronically shifting said current image by said offset and adding said shifted current image to said prior image in registration therewith to produce an accumulated image of said scene that is substantially streak-free; and

means for multiplying said accumulated image by the reciprocal of a flat frame image produced by said photosensor array.

10. An electronic camera, comprising:

optoelectronic sensor means for receiving a light image of a scene which moves continuously relative to the sensor means over a sensing interval, and for producing a periodically updated current electronic image corresponding to said scene at a current time over said sensing interval;

image memory means for storing a prior electronic image of said scene taken at a time prior to the current time;

offset sensor means for sensing an offset between said current image and said prior image corresponding to a relative movement between said scene and said sensor means during the time interval between said prior time and the current time; and

shift and accumulate means for electronically shifting said current image by said offset and adding said shifted current image to said prior image in registration therewith to produce an accumulated image of said scene that is substantially streak-free;

said optoelectronic sensor means comprising a frame transfer charge-coupled-device (CCD) photosensor array including an imaging area which is exposed to said light image for sensing said current image and a darkened storage area to which said current image is transferred from said imaging area.

11. A method of utilizing an electronic camera to produce an image of a scene which moves continuously relative to the camera over a sensing interval, comprising the steps of:

(a) operating the camera to produce periodically updated electronic images of said scene at respective periodically updated times over said sensing interval;

(b) electronically shifting each of said updated images into registration with the immediately preceding image; and

(c) electronically adding each of said updated images to its respective prior images to produce an accumulated image of said scene that is substantially streak-free,

12. A method of utilizing an electronic camera to produce an image of a scene which moves continuously relative to the camera over a sensing interval, comprising the steps of:

(a) operating the camera to produce periodically updated electronic images of said scene at respective periodically updated times over said sensing interval;

(b) electronically shifting each of said updated images into registration with the immediately preceding image; and

(c) electronically adding each of said updated images to its respective prior images to produce an accumulated image of said scene that is substantially streak-free.

step (c) comprising the substeps of;

(e) electronically sensing the offset between said first and second images; and

(f) electronically shifting said second image relative to said first image by said offset.

13. A method as in claim 12, further comprising the steps of:

(g) mechanically moving said camera in a path which approximates a movement of said scene relative to the camera; and

(h) adjusting said mechanical movement by an amount which produces a coarse registration of said second image with said first image;

wherein step (c) comprises electronically shifting said second image into a fine registration with said first image after said coarse registration step.

14. A method as in claim 12, in which step (e) comprises the substeps of:

(g) electronically sensing the centroid of a selected object in said first image;

(h) electronically sensing the centroid of said selected object in said second image; and

(i) computing said offset as being the offset between said centroids of said selected object in said first and second images respectively.

15. A method as in claim 12, in which step (e) comprises the substeps of:

(g) electronically sensing the brightest point of a selected object in said first image;

(h) electronically sensing the brightest point of said selected object in said second image;

(i) computing said offset as being the offset between said brightest points of said object in said first and second images respectively.

16. A method of utilizing an electronic camera to produce an image of a scene which moves continuously relative to the camera over a sensing interval, comprising the steps of:

(a) operating the camera to produce periodically updated electronic images of said scene at respective periodically updated times over said sensing interval;

(b) electronically shifting each of said updated images into registration with the immediately preceding image; and

(c) electronically adding each of said updated images to its respective prior images to produce an accumulated image of said scene that is substantially streak-free.

(e) operating the camera to produce a dark frame image; and

(f) after performing step (d), subtracting said dark frame image from the sum of said first and second images.

17. A method of utilizing an electronic camera to produce an image of a scene which moves continuously relative to the camera over a sensing interval, comprising the steps of:

(a) operating the camera to produce periodically updated electronic images of said scene at respective periodically updated times over said sensing interval;

(b) electronically shifting each of said updated images into registration with the immediately preceding image; and

(c) electronically adding each of said updated images to its respective prior images to produce an accumulated image of said scene that is substantially streak-free.

(e) operating the camera to produce a flat frame image; and

(f) after performing step (d), multiplying the sum of said first and second images by the reciprocal of said flat frame image.