Hybrid Interface for Interactively Registering Images to Digital Models

• US 20100080489A1
• Filed: 09/30/2008
• Published: 04/01/2010
• Est. Priority Date: 09/30/2008
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ramos, Gonzalo, Ofek, Eyal, Drucker, Steven M., Cohen, Michael F., Chen, Billy
• Application Number:
  US12/242,745
• Publication Number:
  US 20100080489A1
• Time in Patent Office: Days
• US Class Current: 382/285
• CPC Class Codes: G06T 2207/20101 Interactive definition of point of interest, landmark or seed
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 10/248 by interactive preprocessing or interactive shape modelling, e.g. feature points assigned by a user
• CPC Class Codes: G06V 20/39 Urban scenes
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces

Abstract

The first image may be displayed adjacent to the second image where the second image is a three dimensional image. An element may be selected in the first image and a matching element may be selected in the second image. A selection may be permitted to view a merged view where the merged view is the first image displayed over the second image by varying the opaqueness of the images. If the merged view is not acceptable, the method may repeat and if the merged view is acceptable; the first view onto the second view and the merged view may be stored as a merged image.

Claims

1. A method of combining a first image and a second image comprising:

Displaying the first image adjacent to the second image wherein the second image is a three dimensional image;

Selecting an element in the first image;

Selecting a matching element in the second image;

Allowing a selection to view a merged view wherein the merged view comprises the first image displayed over the second image;

If the merged view is not acceptable, repeating the method;

If the merged view is acceptable;

merging the first view onto the second view;

Storing the merged view as a merged image.

3. The method of claim 1, further comprising merging the first image and second image automatically when sufficient confidence in the merged view exists.

4. The method of claim 1, further comprising displaying wireframes of elements wherein the wireframes comprise outlines of the elements.

5. The method of claim 1, wherein the elements comprise one selected from a group comprising a road, regions, sub-regions, visible object, visible faces;

streets, rivers, and bodies of water.

6. The method of claim 1, wherein the first image is opaque and the second image can be seen through the first image.

7. The method of claim 1, wherein the first image is first color and the second image is a second color and the first and second images blend into a third color if they are placed over each other.

8. The method of claim 1, further comprising after having lined up a portion of the first image with a portion the second image, selecting to have an application complete a merger of the first image and second image.

9. The method of claim 1, further comprising allowing an opaque-ness of the second image to be varied.

10. The method of claim 1, further comprising automatically varying opaqueness of the second image when the first image is overlaid the second image.

11. The method of claim 1, further comprising highlighting edges of the objects in the first and second image.

12. The method of claim 11, further comprising registering the edges of the objects in the first image with the edges in the second image.

13. The method of claim 1, further comprising coloring areas in the matched image with a high degree of mismatch a first color and coloring areas with a high degree of match a second color.

14. The method of claim 1, further comprising displaying the first image and the second image at a lower resolution and selecting a portion of the first image to display over the second image.

15. The method of claim 1, further comprising using algorithms to assist in creating the merged image wherein the algorithm is selected from a group comprising:

an algorithm that averages the first image and the second image,

an algorithm that creates the merged image to have a maximum of matching pixels between the first image and the second image and

an algorithm that creates the merged image to have a minimum of non-matching pixels between the first image and the second image.

16. The method of claim 1, wherein the merged view and separate view are displayed on a single display at a same time.

2. The method of claim 2, further comprising selecting to highlight elements of the first or second image and lowering the resolution of other elements of the first or second image.

17. A computer storage medium comprising computer executable instructions for combining a first image and a second image, the instructions comprising instructions for:

Displaying the first image adjacent to the second image wherein the second image is a three dimensional image;

Rotating the geometry of elements in the first image and second image toward the face of the first image or the second image;

Selecting an element in the first image;

Selecting a matching element in the second image;

Searching the first image and second image for element matches and if element matches are found, indicating the element matches;

Allowing a selection to view a merged view wherein the merged view comprises the first image displayed over the second image wherein the first image is opaque and the second image can be seen through the first image;

If the quality of the element matches is above a threshold, moving from the split view to the merged view;

If the merged view is not acceptable, repeating the method;

If the merged view is acceptable;

merging the first view onto the second view; and

Storing the merged view as a merged image.

18. The computer storage medium of claim 17, further comprising computer executable code for automatically varying opaqueness of the second image when the first image is overlaid the second image.

19. The computer storage medium of claim 17, further comprising computer executable code for coloring areas in the matched image with a high degree of mismatch a first color and coloring areas with a high degree of match a second color.

20. The computer storage medium of claim 17, further comprising computer executable code for using algorithms to assist in creating the merged image wherein the algorithm is selected from a group comprising:

an algorithm that averages the first image and the second image,

an algorithm that creates the merged image to have a maximum of matching pixels between the first image and the second image and

an algorithm that creates the merged image to have a minimum of non-matching pixels between the first image and the second image.