Computer-resident mechanism for manipulating, navigating through and mensurating displayed image of three-dimensional geometric model

• US 6,346,938 B1
• Filed: 04/27/1999
• Issued: 02/12/2002
• Est. Priority Date: 04/27/1999
• Status: Active Grant

• Current Assignee: III Holdings 1, LLC
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Faulkner, Timothy B., Chan, Ellery Y.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US09/300,577
• Time in Patent Office: 1,022 Days
• Field of Search: 345/419, 345/423, 345/424, 345/427, 345/629, 345/630
• US Class Current: 345/419
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)

Abstract

An image processing system renders, displays and provides virtual user navigation through multiple size and aspect views of a three-dimensional (3D) geometric model of an object, such as an urban scene. A user interface, such as a mouse or joystick device, is coupled to a digital image processor and is employed to supply image manipulation signals to the digital image processor for manipulating images displayed upon a digital image display device. The digital image display device contains an overview display window that displays the object from a ‘bird'"'"'s eye’ or map perspective, and an inset display window that displays the object from a ‘down inside the scene’ perspective. In response to user interface-sourced commands, the processor can swap the two image perspectives and/or controllably navigate through the inset image.

Claims

1. A method of displaying and manipulating an image of a three-dimensional (3D) geometric model of an object, such as an urban scene, comprising the steps of:

(a) simultaneously displaying, in a first display window of a digital image display system, a first image of said object that presents said object from a first 3D model perspective and, in a second display window of said digital image display system, a second image of said object that presents said object from a second 3D model perspective, different from said first 3D model perspective; and

(b) simultaneously performing an effectively continuous transition of the image contents of said first display window from said first 3D model perspective of said object toward said second 3D model perspective of said object, and an effectively continuous transition of image contents of said second display window from said second 3D model perspective of said object toward said first 3D model perspective of said object.

2. A method according to claim 1, wherein said first 3D model perspective presents an overview image of said object from a first distance map perspective, and said second 3D model perspective presents an in-scene image of said object from a second distance perspective, closer to said object than said first distance map perspective.

3. A method according to claim 2, further including the step of:

(c) manipulating said in-scene image of said object in a manner that displays movement through said in-scene image from a perspective different from said overview image of said object.

4. A method according to claim 1, further including the step (c) of, during step (b), controllably reversing said effectively continuous transition of image contents of said first display window, and said effectively continuous transition of image contents of said inset viewport display window.

5. A method according to claim 1, wherein step (b) includes using an interpolation mechanism to cause effectively smooth transitions of said first and second images of said object.

6. A method according to claim 1, wherein step (a) further comprises controllably introducing, in a successive animated manner, images of a selected portion of said three-dimensional (3D) geometric model of said object into said first and second display windows of said digital image display device, in accordance with object model introduction representative signal inputs from said user interface.

7. A method of displaying and manipulating an image of a three-dimensional (3D) geometric model of an object, such as an urban scene, comprising the steps of:

(a) displaying, in an overview viewport display window of a digital image display system, a first image of said object that presents said object from a first 3D model perspective, said overview viewport display window having a first display area;

(b) displaying, in an inset viewport display window of said digital image display system, a second image of said object that presents said object from a second 3D model perspective, different from said first 3D model perspective, said inset viewport display window having a second display area different than said first display area; and

(c) navigating through said second image of said object, so as to manipulate said second image of said object displayed in said inset viewport display window.

8. A method according to claim 7, wherein step (c) includes displaying a virtual user icon within said second image, and operating a user interface of said digital image display system in a manner that is effective to manipulate the 3D location and/or orientation of said virtual user icon within said second image.

9. A method according to claim 8, wherein step (c) includes in response to operation of said user interface to manipulate said 3D location and/or orientation of said virtual user icon within said second image, displaying movement through said second image, from a first in-scene viewing location to a second in-scene viewing location of said second 3D model perspective of said object.

10. A method according to claim 9, wherein step (c) comprises operating said user interface to locate said second user viewing location in said second image, locating a look-at location in said second image so as to define said second in-scene viewing direction from said second user viewing location in said second image of said second 3D model perspective of said object, and thereafter effecting movement through said second image, from said first user viewing location to said second user viewing location, while displaying said look-at location of said second image as viewed while traveling along a navigation path from said first user viewing location to said second user viewing location.

11. A method according to claim 8, wherein said virtual user icon is configured to simulate a user'"'"'s head at a user viewing location, viewing direction including a line-of-sight therefrom, and a look-at point at a viewed location in said second image of said object.

12. A method according to claim 11, wherein said virtual user icon is configured to simulate a distance of said user'"'"'s head above a surface of said object upon which said virtual user icon is placed.

13. A method according to claim 11, wherein said distance of said user'"'"'s head above a surface of said object upon which said virtual user icon is placed is adjustable.

14. A method according to claim 7, wherein step (c) includes using an interpolation mechanism to manipulate said second image of said object so as to display a gradual continuous movement of said second image as viewed from different user locations of said second 3D model perspective of said object.

15. A method according to claim 7, wherein step (a) comprises maintaining said first image of said object in a fixed display orientation while navigating through said second image of said object in step (c).

16. A method according to claim 15, wherein said object comprises an urban region and said second image of said object comprises a generally street level image of said urban region.

17. A method according to claim 7, further including step (d) of performing an effectively continuous transition of image contents of said overview viewport display window from an overview image of said object having a first distance perspective, toward an in-scene image of said object having a second distance perspective, that is closer to said object than said first distance perspective, while simultaneously performing an effectively continuous transition of image contents of said inset viewport display window from said in-scene image of said object toward said overview image of said object.

18. A method according to claim 17, further including step (e) of, during step (d), controllably reversing said effectively continuous transition of image contents of said overview viewport display window toward said in-scene image, and said effectively continuous transition of image contents of said inset viewport display window from said in-scene image of said object toward said overview image of said object.

19. A method according to claim 7, wherein step (c) further includes measuring dimensions of features within said second image using a mensuration icon that interconnects respective look-from and look-at points in said second image.

20. A method according to claim 7, wherein steps (a) and (b) further comprise controllably introducing, in a successive animated manner, different views of a selected portion of said first and second images of said three-dimensional (3D) geometric model of said object into said overview and inset viewports of said digital image display device, in accordance with object model introduction representative signal inputs from said user interface.

21. A virtual user icon for a display and manipulation of a image of a three-dimensional (3D) geometric model of an object, such as an urban scene, in a display window of a digital image display system, comprising a viewpoint element that is configured to simulate a user'"'"'s head at a user viewing location in said image, a viewing direction indicator including a line-of-sight therefrom, and a look-at point element positionable at a viewed location in said image.

22. A virtual user icon according to claim 21, wherein said icon is further configured to simulate a distance of said user'"'"'s head above a surface of said object upon which said icon is placed in said image.

23. An image processing system comprising:

a digital image display device;

a digital image processor which is operative to operate upon a three-dimensional (3D) geometric model of an object, such as an urban scene, and to controllably display multiple images of said object upon said digital image display device; and

a user interface coupled to said digital image processor and being operative under user control to supply image manipulation signals to said digital image processor for causing the manipulation of images displayed upon said digital image display device; and

wherein

said digital image processor is operative to simultaneously display in a first display window of a digital image display device a first image of said object that presents said object from a first 3D model perspective, and to display in a second display window of said digital image display system a second image of said object that presents said object from a second 3D model perspective, different from said first 3D model perspective and, in response to a first prescribed operation of said user interface, to simultaneously cause an effectively continuous transition of the image contents of said first display window from said first 3D model perspective of said object toward said second 3D model perspective of said object, and an effectively continuous transition of image contents of said second display window from said second 3D model perspective of said object toward said first 3D model perspective of said object.

24. An image processing system according to claim 23, wherein said digital image processor is operative, in response to a second prescribed operation of said user interface, to controllably reverse said effectively continuous transition of image contents of said first display window, and said effectively continuous transition of image contents of said inset viewport display window.

25. An image processing system according to claim 23, wherein said first 3D model perspective presents an overview image of said object from a first distance perspective, said second 3D model perspective presents an in-scene image of said object from a second distance perspective, closer to said object than said first distance perspective.

26. An image processing system according to claim 25, wherein said digital image processor is operative to manipulate said in-scene image of said object in a manner that displays movement through said in-scene image from a perspective different from said overview image of said object.

27. An image processing system according to claim 26, wherein said digital image processor is operative to cause said display device to display a virtual user icon within said in-scene image, and to manipulate the 3D location and/or orientation of said virtual user icon within said in-scene image in accordance with operation of said user interface.

28. An image processing system according to claim 23, wherein said display device maintains said overview image of said object in a fixed display orientation during navigation through said in-scene image of said object.

29. An image processing system according to claim 23, wherein said digital image processor is controllably operative to introduce, in a successive animated manner, views of a selected portion of said three-dimensional (3D) geometric model of said object into said first and second display windows of said digital image display device, in accordance with object model introduction representative signal inputs from said user interface.

30. An image processing system comprising:

a digital image display device;

a digital image processor which is operative to operate upon a three-dimensional (3D) geometric model of an object, such as an urban scene, and to controllably display multiple images of said object upon said digital image display device; and

a user interface coupled to said digital image processor and being operative under user control to supply image manipulation signals to said digital image processor for causing the manipulation of images displayed upon said digital image display device; and

wherein

said digital image display device contains an overview viewport display window displaying a first image of said object that presents said object from a first 3D model perspective, said overview viewport display window having a first display area, and an inset viewport display window displaying a second image of said object that presents said object from a second 3D model perspective, different from said first 3D model perspective, said inset viewport display window having a second display area different than said first display area; and

said digital image processor is controllably operative to navigate through said second image of said object in accordance with navigation signal inputs from said user interface, so as to manipulate said second image of said object displayed in said inset viewport display window.

31. An image processing system according to claim 30, wherein said digital image processor is operative to cause said digital image display device to display a virtual user icon within said second image, and to manipulate the 3D location and/or orientation of said virtual user icon within said second image in response to operation of said user interface, and thereby display movement through said second image, from a first in-scene viewing location to a second in-scene viewing location of said second 3D model perspective of said object.

32. An image processing system according to claim 30, wherein said digital image processor is operative to execute an interpolation mechanism to manipulate said second image of said object so as to display a gradual continuous movement of said second image as viewed from different user locations of said second 3D model perspective of said object.

33. An image processing system according to claim 32, wherein said virtual user icon is configured to simulate a user'"'"'s head at a user viewing location, viewing direction including a line-of-sight therefrom, and a look-at point at a viewed location in said second image of said object.

34. An image processing system according to claim 33, wherein said virtual user icon is configured to simulate a distance of said user'"'"'s head above a surface of said object upon which said virtual user icon is placed.

35. An image processing system according to claim 33, wherein said distance of said user'"'"'s head above a surface of said object upon which said virtual user icon is placed is adjustable.

36. An image processing system according to claim 30, wherein said digital image processor is operative to cause said display device to display a mensuration icon that interconnects respective look-from and look-at points in said second image.

37. An image processing system according to claim 30, wherein said digital image processor is operative to cause an effectively continuous transition of image contents of said overview viewport display window from an overview image of said object having a first distance perspective, toward an in-scene image of said object having a second distance perspective, that is closer to said object than said first distance perspective, while simultaneously causing an effectively continuous transition of image contents of said inset viewport display window from said in-scene image of said object toward said overview image of said object.

38. An image processing system according to claim 37, wherein said digital image processor is operative, in response to a second prescribed operation of said user interface, to controllably reverse said effectively continuous transition of image contents of said overview viewport display window toward said in-scene image, and said effectively continuous transition of image contents of said inset viewport display window from said in-scene image of said object toward said overview image of said object.

39. An image processing system according to claim 30, wherein said digital image processor is controllably operative to introduce, in a successive animated manner, views of a selected portion of said three-dimensional (3D) geometric model of said object into said overview and inset viewports of said digital image display device, in accordance with object model introduction representative signal inputs from said user interface.

40. An image processing system comprising:

a digital image display device;

a digital image processor which is operative to process a three-dimensional (3D) geometric model of an object, such as an urban scene, and to controllably display an image of said object within a viewport of said digital image display device; and

a user interface coupled to said digital image processor and being operative under user control to supply image manipulation signals to said digital image processor for causing the manipulation of an image displayed within said viewport of said digital image display device; and

wherein

said digital image processor is controllably operative to introduce, in a successive animated manner, at least one selected portion of said three-dimensional (3D) geometric model of said object, into said viewport of said digital image display device, in accordance with object model introduction representative signal inputs from said user interface.

41. An image processing system according to claim 40, wherein said digital image processor is operative to controllably grow, at a prescribed location of said viewport of said digital image display device, and in said successive animated manner, said at least one selected portion of said three-dimensional (3D) geometric model of said object from a first size to a second size, in response to said object model introduction representative signal inputs from said user interface.

42. An image processing system according to claim 40, wherein said digital image processor is operative to controllably translate into a prescribed location of said viewport of said digital image display device, and in a successive animated manner, said at least one selected portion of said three-dimensional (3D) geometric model of said object, in response to said object model introduction representative signal inputs from said user interface.

43. An image processing system according to claim 40, wherein said digital image display device contains an overview viewport display window displaying a first image of said object that presents said object from a first 3D model perspective, said overview viewport display window having a first display area, and an inset viewport display window displaying a second image of said object that presents said object from a second 3D model perspective, different from said first 3D model perspective, said inset viewport display window having a second display area different than said first display area, and wherein said digital image processor is controllably operative to introduce, in said successive animated manner, different views of said at least one selected portion of said three-dimensional (3D) geometric model of said object into said overview and inset viewports of said digital image display device, in accordance with said object model introduction representative signal inputs from said user interface.

44. An image processing system according to claim 40, wherein said digital image processor is operative to execute an interpolation mechanism to successively introduce said at least one selected portion of said three-dimensional (3D) geometric model of said object into said viewport of said digital image display device.

45. An image processing system according to claim 40, wherein said digital image processor is operative to controllably remove, in a successive animated manner, at least one prescribed portion of said three-dimensional (3D) geometric model of said object displayed by digital image display device.

46. An image processing system according to claim 40, wherein said digital image processor is operative to controllably remove, in a successive animated manner, said at least one selected portion of said three-dimensional (3D) geometric model of said object that has been introduced into and displayed by digital image display device.