Vision system computer modeling apparatus including interaction with real scenes with respect to perspective and spatial relationship as measured in real-time

• US 20030132935A1
• Filed: 01/23/2003
• Published: 07/17/2003
• Est. Priority Date: 06/07/1995
• Status: Active Grant

• Current Assignee: John Ellenby, Peter Ellenby, Thomas Ellenby
• Original Assignee: John Ellenby, Peter Ellenby, Thomas Ellenby
• Inventors: Ellenby, Peter, Ellenby, Thomas, Ellenby, John
• Granted Patent: US 6,690,370 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

Vision systems for use in modeling an environment or scene are presented. A user views a scene through an electronic camera and is presented with CAD type functionality for creating graphical representation of the addressed scene. The apparatus having knowledge of where it is with respect to objects being addressed and with respect to where it has been previously, the model perspective and size can be continuously updated to reflect the presend view of the scene in real time as the camera addresses from any point in space.

Claims

1. ) Apparatus for creating computer models comprising:

an electronic camera;

position and attitude measurement apparatus;

a display; and

a computer operable for;

running CAD software, acquiring images from said electronic camera, receiving position and attitude information relating to a present system position and attitude of said electronic camera, computing perspective adjustments, combining imagery from said electronic camera with imagery from said CAD software, displaying combined imagery at said display;

said electronic camera, position and attitude measurement apparatus each in communication with said computer.

2. ) Apparatus of claim 1 further comprising:

a range measurement apparatus, said computer further being operable for receiving range information relating to the distance between the apparatus and a point in the scene being addressed, said range measurement apparatus being in communication with said computer.

3. ) Apparatus of claim 1, said displaying combined imagery includes forming a composite image of the real scene with a computer model graphic superimposed thereon in proper perspective.

4. ) Apparatus of claim 1, the elements of said apparatus being integrated into a handheld mobile system.

5. ) Apparatus of claim 4, said position measurement apparatus being a GPS receiver.

6. ) Computer modeling apparatus comprised of:

a computer in communication with each of the following;

an electronic camera;

a position determining means;

an attitude determining means;

a range determining means; and

a display,

said electronic camera having an imaging axis and an image plane, the imaging axis defining a system pointing direction, the intersection of the imaging axis and image plane defining a position reference point;

said computer arranged to run CAD software in conjunction with software to communicate with said position, attitude and range determining means and said display;

said position determining means arranged to determine the position of the reference point,

said attitude determining means arranged to determine the system pointing direction,

said range determining means arranged to determine the distance from the camera to a point on an object in a scene being addressed, and

said display having a substantially planar image field with its normal direction aligned to the pointing direction.

7. ) A computer apparatus of claim 6, said computer including a computer software object model responsive to the position and attitude of the apparatus.

8. ) A computer apparatus of claim 7,

said response being a translation of perspective whereby the perspective of the scene being addressed from the camera viewpoint corresponds to the perspective of the displayed model.

9. ) Computer modeling methods comprising the steps:

viewing a scene with an electronic camera;

measuring position and attitude of said camera;

recording a first point associated with said measurements;

changing either the position state or attitude state of the camera;

recording at least one other point associated with the new position and attitude state; and

displaying said points superimposed with an image captured with said electronic camera.

10. ) Computer modeling methods of claim 9, further comprising the steps forming a computer model be connecting a plurality of points with line segments.

11. ) Computer modeling methods of claim 9, further comprising the steps forming polygon objects which correspond to planar elements of a real scene.

12. ) Computer modeling methods of claim 11, further comprising the steps applying color and texture attributes to said polygons to form portions of an object model.

13. ) Computer modeling methods of claim 9, further comprising a step to re-acquire a previously defined from a new position to improve the accuracy by averaging.