System for accurately repositioning imaging devices

• US 7,688,381 B2
• Filed: 03/26/2004
• Issued: 03/30/2010
• Est. Priority Date: 04/08/2003
• Status: Active Grant

• Current Assignee: Ken Vanbree
• Original Assignee: Ken Vanbree
• Inventors: VanBree, Ken
• Primary Examiner(s): Tran; Sinh
• Assistant Examiner(s): Cutler; Albert H
• Application Number:
  US10/811,019
• Publication Number:
  US 20040201756A1
• Time in Patent Office: 2,195 Days
• Field of Search: 348/239, 348/207.1, 348/207.11, 348 36- 39, 348/94, 348/95, 3482081-2085, 348/373, 348/375, 348/376, 396/58, 396/87, 396/428, 382/285, 382/286, 382/287, 700/59, 700/259
• US Class Current: 348/373
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

The invention provides a system and a method for accurately repositioning an imaging device in order to acquire or project a new image of a scene of interest. Accurate repositioning of an imaging device is necessary for generating or displaying high quality time-lapse image sequences for a variety of applications.

Claims

1. An imaging system to reposition an image capture device in a position relative to a subject of interest according to six degrees of freedom as preserved in association with a reference image of the subject of interest, comprising:

an image capture device;

an automatic repositioning apparatus on which the image capture device is mounted, which, in turn, is mounted on a stable platform, said automatic repositioning apparatus operable to orient the image capture device relative to a subject of interest according to six degrees of freedom;

an acquired reference image of the subject of interest, wherein said acquired reference image is acquired of a random or arbitrary scene of interest, identifying fixed points in said reference image, and wherein said reference image comprises a computational model generated from an initial image of said subject of interest;

a computational device coupled to the automatic repositioning apparatus, including a user interface, such computational device capable of receiving images from the image capture device and receiving the reference image, performing a comparison, and communicating adjustments to reposition the image capture device along any of six degrees of freedom, wherein said image capture device captures a new image of the scene of interest, which new image is input to the computational device through a bi-directional path, and said reference image is input to the computational device through said path, whereupon said computational device determines the difference in position of the imaging device, and transmits this information to said automatic repositioning apparatus through said bi-directional path and said user interface indicates the amount and direction of movement required to accurately reposition the imaging device relative to the scene of interest and where the automatic repositioning apparatus accurately repositions the imaging device if the required displacement is within the range of motion of the apparatus, and if the required displacement is outside the range of motion of the automatic repositioning apparatus, then the user interface instructs the operator to move the stable platform the required distance in the required directions.

2. An imaging system as in claim 1 wherein the communication of position adjustments is via signals to the automatic repositioning apparatus from the computational device.

3. A method for repositioning an image capture device relative to a subject of interest according to six degrees of freedom comprising the steps of:

a) initializing an imaging system, where said imaging system includes an image capture device, an automatic repositioning apparatus which also serves to provide a mount for said image capture device, and which, in turn, is mounted on a stable platform, and said automatic repositioning apparatus is connected to a computational device which includes a user interface, wherein initializing includes the steps of;

a.1) obtaining a reference image of the subject of interest, wherein said reference image is acquired of a random or arbitrary scene of interest, identifying fixed points in said reference image, and wherein said reference image comprises a computational model generated from an initial image of said scene of interest, wherein said reference image includes multiple reference points in 3-dimensional space;

a.2) repositioning the image capture device relative to the subject of interest, where such repositioning uses six degrees of freedom;

b) imaging the subject of interest;

c) computing the difference between the reference image of the subject of interest and the image capture device image, said computational device capable of receiving the reference image image capture such that when said imaging device captures a new image of the scene of interest, which image is input to the computational device, as is the reference image of scene of interest, such that said computational device determines the difference in position of the image capture device, transmits position difference information to the automatic repositioning apparatus and indicates via the user interface amount and direction of movement to accurately reposition the image capture device relative to scene of interest;

d) refining the position of the image capture device by the automatic repositioning apparatus and where the required displacement is outside the range of motion of the automatic repositioning apparatus, then the user interface instructs the operator to move the stable platform the required distance in the required directions, so that the image capture device is in the same position relative to the subject of interest as that position from which the reference image was obtained, where such refining the position of the image capture device occurs along six degrees of freedom.

4. A method as in claim 3 wherein said computational model is a three dimensional model.

5. A method as in claim 3 where the reference image is obtained after fixed reference points have been selected in the subject of interest.

6. A method as in claim 3 where the step of initializing includes extracting reference points from more than one image of the subject of interest representing more than one camera center.

7. A method as in claim 3 where time has elapsed between the initialization process and the repositioning of the image capture device.

8. An apparatus for positioning an imaging device and coupling to an image capture device and where such automatic repositioning apparatus positions said image capture device along six degrees of freedom, such that the positioning of the image capture device is controllable and said apparatus orients the image capture device relative to a subject of interest using six degrees of freedom to orient the image capture device, and wherein said positioning of said image capture device relies on a reference image of the subject of interest, wherein said reference image is based on an initial acquired image of a random or arbitrary scene of interest, where said initial acquired image enables the identification of fixed points in said reference image, and wherein said reference image comprises a computational model generated from said initial acquired image of said subject of interest;

and

where said automatic repositioning apparatus, coupled to said image capture device, is mounted on a stable platform, and said automatic repositioning apparatus is connected to a computational device, said computational device capable of receiving the reference image, such that when said image capture device captures a new image of the scene of interest, which image is input to the computational device, as is the reference image of scene of interest, whereupon said computational device determines the difference in position of the image capture device, and transmits position difference information to the automatic repositioning apparatus, and, the user interface indicates amount and direction of movement to accurately reposition the image capture device relative to the scene of interest, and the user interface instructs the operator to move the stable platform the required distance in the required directions where the required displacement is outside the range of motion of the automatic repositioning apparatus.