Three-dimensional cartographic user interface system

• US 7,654,826 B2
• Filed: 10/04/2005
• Issued: 02/02/2010
• Est. Priority Date: 10/04/2004
• Status: Active Grant

• Current Assignee: Solid Terrain Modeling
• Original Assignee: Solid Terrain Modeling
• Inventors: Fisher, Mark E., Faulkner, Lawrence Q., Luton, Justin
• Primary Examiner(s): Saadat; Cameron
• Application Number:
  US11/244,012
• Publication Number:
  US 20060075356A1
• Time in Patent Office: 1,582 Days
• Field of Search: 434/130, 434/150
• US Class Current: 434/130
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G09B 25/06 for surveying; for geography, e.g. relief models globes G09B27/00; maps G09B29/00
• CPC Class Codes: G09B 29/001 Planning boards
• CPC Class Codes: G09B 29/10 Map spot or coordinate position indicators; Map reading aids optical projection apparatus per se G03B
• CPC Class Codes: G09B 29/12 Relief maps relief models G09B25/06

Abstract

A three-dimensional cartographic computer user interface system for enhancing geo-spatial comprehension and geographic information system user interactivity is disclosed. The system has at least one computer and operating system, user input means, and at least one positionable projection display means, including storage, retrieval and playback control means for the projected content. The system has user input device software responsive to input from at least one user input device which is operable on a three-dimensional user interface surface of the system, and software for the display and control of cartographic-related projected imagery, and software for the display and control of three-dimensional user interface-related content superimposed within the cartographic-related projected imagery. The system includes at least one cartographic map having at least one surface portion which is three-dimensionally shaped to represent topographic terrain of at least one geographical location and optionally includes a substantially planar surface onto which cartographic-related content is projected.

Claims

1. A three-dimensional cartographic computer user interface system for enhancing geo-spatial comprehension and geographic information system user interactivity, comprising:

a video-content projector;

a computer having operating software;

said computer being in communication with said video-content projector; and

a cartographic map comprising;

a surface portion, wherein the surface portion comprises a three-dimensionally shaped area to represent topographic terrain of a geographical location, and

a user input device that enables a user to choose a position on the surface portion;

wherein the cartographic map transmits data pertaining to the chosen position on the map to the computer; and

wherein said projector displays imagery onto said surface portion of said cartographic map in response to a communication from said computer based on said position chosen on the surface of the map.

2. The three-dimensional cartographic computer user interface system of claim 1 wherein said imagery comprises of cartographic-related video-projected imagery.

3. The three-dimensional cartographic computer user interface system of claim 1 wherein said imagery comprises of three-dimensional user interface-related content.

4. The three-dimensional cartographic computer user interface system of claim 1 further comprising a user input device position monitoring and reporting means and wherein said user input device is selected from a group consisting of computer mice, track balls, track pads, CAD-program input devices, computer keyboards, computer numeric pads, styluses, physical pointing devices, laser pointers, light-emitting pointers, input devices with infrared position-sensing means, positionable geo-spatial data simulation objects with position-sensing means, user input device interaction within a software user interface depiction of a computer keyboard, user input device interaction within a software user interface depiction of a computer numeric pad.

5. The three-dimensional cartographic computer user interface system of claim 2 wherein said software is capable of ortho-rectifying said three-dimensional user interface-related content within said surface portion of said cartographic map.

6. The three-dimensional cartographic computer user interface system of claim 3 wherein said software is capable of ortho-rectifying said cartographic-related video-projected imagery within said surface portion of said cartographic map.

7. The three-dimensional cartographic computer user interface system of claim 2 wherein said cartographic-related video-projected imagery is selected from a group consisting of imagery which is alphanumerical, graphical, pictorial, photographic, vector-based, rasterized, topographical, cartographical, geo-spatial, geological, geographical, oceanographical, distance-related, measurement-related, mineral related, fuel related, slope-related, altitude-related, map legend related, environment-related, atmospheric-related, computer-generated, emergency-specific, hazard-specific, fire-specific, flood-specific, spill-specific, avalanche-specific, battle-specific, location-specific, latitude and longitude data, civil engineering-related, GPS-related, GIS-related, geo-spatial-related, coordinate data, point of view data, or angle of view data, heading data, bearing data, azimuth data, elevation-specific, computer-generated simulation, analysis data, computational data, view shed-related data, view shed-related analysis, land development-related, land management-related, waste-related, hazardous waste management-related, augmented reality ‘

AR’

content, AR data, AR information, legal-related, liability-related, map signs, map symbols, map abbreviations, military-related, non-military-related, paleontology-related, archeology-related, recreation-related, survey-related, inspectorate-related, retrieved from a database, stored on a computer readable storage device, derived from live video transmissions, a graphical depiction of an atmospheric-condition measurement device, a graphical depiction of an atmospheric-condition instrument, a graphical depiction of an instrument panel, a graphical depiction of a thermometer, a graphical depiction of a barometer, a graphical depiction of a directional indicator, a graphical depiction of a wind sock, a graphical depiction of a chronographic device, a graphical depiction of a clock, and indicia.

8. The three-dimensional cartographic computer user interface system of claim 1 further comprising a user-positionable map-related software object.

9. The three-dimensional cartographic computer user interface system of claim 1 further comprising a user-positionable map-related physical object.

10. The three-dimensional cartographic computer user interface system of claim 9 further comprising a physical object position monitoring and reporting means and said user-positionable map-related physical object being further equipped with a user input means.

11. The three-dimensional cartographic computer user interface system of claim 10 wherein said user-positionable map-related physical object has a user positionable member.

12. The three-dimensional cartographic computer user interface system of claim 10 wherein said user-positionable map-related physical object has a motion-control positionable member;

said motion-control positionable member being controllable by said computer.

13. The three-dimensional cartographic computer user interface system of claim 12 wherein said motion-control positionable member comprises of a camera and a transmitter for conveying a video signal from said camera to said computer.

14. The three-dimensional cartographic computer user interface system of claim 12 wherein said motion-control positionable member comprises of a light-emitting element.

15. The three-dimensional cartographic computer user interface system of claim 14 wherein said light-emitting element can adjust the amount of light emitted in response to signals from said computer.

16. The three-dimensional cartographic computer user interface system of claim 14 wherein said light adjustment means comprises of a view-shed light-shaping apparatus to shape emitted-light in accordance with view-shed data of said software.

17. The three-dimensional cartographic computer user interface system of claim 3 wherein said software displays and controls said user interface-related content through a graphical representation of a user selectable software menu which is projectable onto a surface portion of said cartographic map of said system, whereby user interactivity within said user selectable software menu with a input device executes a software routine.

18. The three-dimensional cartographic computer user interface system of claim 17 wherein said graphical representation of a user selectable software menu is further comprised of a sub-menu providing a user selectable menu choice, whereby said sub-menu is projectable onto said cartographic map of said system in response to user interactivity with said user selectable software menu from a user input device.

19. The three-dimensional cartographic computer user interface system of claim 3 wherein said software displays and controls said three dimensional user interface related content through a graphical representation of a user selectable software tool which is projectable onto said cartographic map of said system, whereby user interactivity within said graphical representation with a input device executes a software routine.

20. The three-dimensional cartographic computer user interface system of claim 3 wherein said software displays and controls said three dimensional user interface related content through a graphical representation of a of a user selectable software tool palette which is projectable onto said cartographic map of said system, whereby user interactivity within said graphical representation with a input device executes a software routine.

21. The three-dimensional cartographic computer user interface system of claim 1 wherein said surface portion of said cartographic map comprises high-resolution printed content.

22. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides a positionable computer user interface element within a projectable portion of said cartographic map and said positionable computer user element is movable by a user employing an input device in a conventional click-and-drag manner.

23. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides a positionable computer user interface element within a projectable portion of said cartographic map and said positionable computer user element is movable by a user employing an input device in a conventional cut-and-paste manner.

24. The three-dimensional cartographic computer user interface system of claim 1 further comprising user input device position monitoring and reporting means wherein said user input device is further equipped with multi-axis user input means and multi-axis signal transmission means for conveying multi-axis user input signal to said computer.

25. The multi-axis user input means of claim 24 wherein said multi-axis user input means is equipped to receive pitch, yaw and roll user input and is equipped to transmit signal pertaining to said pitch, yaw and roll user input.

26. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides for positioning of an adjustable computer user interface element within a projectable portion of said cartographic map, wherein said adjustable computer user interface element is selected from among the group consisting of knobs, slideable elements and buttons.

27. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides for positioning of an adjustable computer user interface element within a projectable portion of said cartographic map, wherein said adjustable computer user interface element is switchably controllable via input made by a user from a user input device.

28. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides for positioning of an adjustable computer user interface element within a projectable portion of said cartographic map, wherein said adjustable computer user interface element is variably controllable via input made by a user from a user input device.

29. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides for positioning of an adjustable computer user interface element within a projectable portion of said cartographic map, wherein the orientation of said adjustable computer user interface element is controllable via input made by a user from a user input device.

30. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides for positioning of an adjustable computer user interface element within a projectable portion of said cartographic map, wherein said adjustable computer user interface element is further comprised of an editable alphanumeric text field.

31. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides a drawing function of a drawing program.

32. The three-dimensional cartographic computer user interface system of claim 1 wherein said software is capable of adjusting the size, shape and registration of said imagery onto said surface portion of said cartographic map.

33. The three-dimensional cartographic computer user interface system of claim 1 wherein said software is capable of converting orthophotos into a nadir perspective view.

34. The three-dimensional cartographic computer user interface system of claim 1 wherein said software is capable of scaling the eye-distance of a perspective view relative to that of the projector-to-model distance.

35. The three-dimensional cartographic computer user interface system of claim 1 further comprising a second projector for projecting cartographic-related video-projected imagery and three-dimensional user interface-related content onto said surface portion of said cartographic map with said first projector in a manner which is substantially seamless in appearance.

36. The three-dimensional cartographic computer user interface system of claim 1 further comprising a second cartographic map adjacent to said first map in a manner which is substantially seamless in appearance.

37. The three-dimensional cartographic computer user interface system of claim 1 further comprising a computer networking means linking a plurality of three-dimensional cartographic computer user interface systems, whereby user interactivity inputted on one system is conveyed via said network communications means to and viewable on another system.

38. The three-dimensional cartographic computer user interface system of claim 37 wherein said software is capable of transferring files between said plurality of three-dimensional cartographic computer user interface systems.

39. The three-dimensional cartographic computer user interface system of claim 37 wherein said networking means comprises of a network selected from the group consisting of WANs, LANs, computer networks, wireless computer networks, large publicly accessible networks, and the internet.

40. The three-dimensional cartographic computer user interface system of claim 1 wherein said computer further comprises a video display card, a computer monitor and a communications link between said video display card and a computer monitor, and said software is capable of scaling imagery displayable on said computer monitor differently from video-image content projected onto said cartographic map.

41. The three-dimensional cartographic computer user interface system of claim 1 wherein said software is capable of providing video content pertaining to the position, track and video-camera field of view of a series of video-content imagery captured from above a landscape, whereby said software superimposes in relative scale, said position, track and video-camera field of view of said series of video-content imagery within said cartographic-related video-projected imagery.

42. The three-dimensional cartographic computer user interface system of claim 41 wherein said software is capable of simultaneously displaying said video-camera field of view on a computer monitor.

43. The three-dimensional cartographic computer user interface system of claim 1 wherein the surface portion of said cartographic map is further comprised of a substantially planar surface area to facilitate positioning of a user input device having a communications link with said computer.

44. The three-dimensional cartographic computer user interface system of claim 1 wherein a surface portion of said cartographic map is further comprised of a substantially planar surface area upon which a control panel element is projected, wherein said control panel element is a among the group consisting of atmospheric-condition measuring instruments, cartographic-related measuring instruments, emergency-condition monitoring and reporting means, clocks, chronographs, calendars, timing apparatus, user input device selectable software tools, user input device selectable tool palettes, user input device cartographic user interface adjustment means, cartographic elements, text, editable alphanumeric text fields, cartographic-related information, map legends, indicia, menus, and sub-menus.

45. The three-dimensional cartographic computer user interface system of claim 43 wherein said substantially planar surface area is further comprised of a control panel element area which is formed at a different height than said substantially planar surface area, wherein said control panel element is projected by said video-content projector into said control panel element area.

46. The three-dimensional cartographic computer user interface system of claim 1 wherein said user input device comprises of an elongated pointer member having a position-sensing means mounted adjacent proximate to one end, and said three-dimensional cartographic computer user interface system further comprising multi-axis pointer monitoring and reporting means, whereby positioning of said one end of said elongated pointer member on the surface of said cartographic map provides multi-axis positioning data which is conveyable via a communications link with said computer.

47. The three-dimensional cartographic computer user interface system of claim 46 wherein said multi-axis pointer monitoring means is equipped to receive and triangulate signals pertaining to the positioning of said one end of said elongated pointer member and equipped with software to calculate multi-axis positioning-related data and display said multi-axis positioning-related data within said cartographic-related video-projected imagery.

48. The three-dimensional cartographic computer user interface system of claim 1 wherein a surface portion of said cartographic map is further comprised of an electronic grid matrix having position-sensing means responsive to the proximity of an end element of a user input device pointer means and said three-dimensional cartographic computer user interface system is equipped with software to calculate multi-axis positioning-related data and display said multi-axis positioning-related data within said cartographic-related video-projected imagery.

49. The three-dimensional cartographic computer user interface system of claim 1 wherein a surface portion of said cartographic map is further comprised of an electronic grid matrix having position-sensing means responsive to the proximity of an end of a user'"'"'s finger.

50. The three-dimensional cartographic computer user interface system of claim 1 wherein said software provides a user-positionable cartographic map-related object positionable on said surface portion of said cartographic map.

51. The three-dimensional cartographic computer user interface system of claim 4 wherein said computer is capable of receiving data transmitted from said user input device via a wireless communications link.

52. The three-dimensional cartographic computer user interface system of claim 50 further comprising software object editing means having a software object editing routine.

53. The three-dimensional cartographic computer user interface system of claim 52 wherein said software object editing routine is selected from any one or more of a group consisting of:

scale, rotation, skew, perspective, shape, duplication, deletion, labeling, image-editing, text-editing within a software object, text-editing adjacent to a software object, an software object editing routine of a drawing program, and software object editing routine of a CAD program.

54. The three-dimensional cartographic computer user interface system of claim 1 further comprising a positionable object having a computer-controllable substance-emission means equipped to emit a substance at a controllable rate wherein said substance is selected from among the group consisting a smoke, a fluid, and a granular material.

55. The three-dimensional cartographic computer user interface system of claim 1 further comprising a positionable object having the appearance of a vehicle wherein said positionable object has a power supply, electro-mechanical propulsion means, and motion-control means responsive to said software.

56. The three-dimensional cartographic computer user interface system of claim 1 wherein said cartographic map has a surface portion incorporating a display comprising a planar pixelated material, wherein said planar pixelated material is selected from the group consisting of:

LCD screens, LED screens, plasma screens, television screens, and pixelated material.

57. The three-dimensional cartographic computer user interface system of claim 56 wherein said display is further comprised of touch-sensitive inputting means.

58. The three-dimensional cartographic computer user interface system of claim 1 wherein said portion of said cartographic map is formed of a flexible pixelated material, and said computer having:

a.) a video display card,

b.) a communications link between said video display card and said at least one flexible pixelated material, and

c.) a video-content formatting and display means for sizing, shaping and displaying video content in accordance with the size and shape of said flexible pixelated material.

59. The three-dimensional cartographic computer user interface system of claim 1 further comprising dynamic-condition monitoring and display means, and said software is responsive to input made by a user from a user input device operative on an upper surface of said cartographic map, wherein the display of dynamic imagery captured at one or more physical locations and occurring over a span of time, is controllable by said input and is projected by said video-content projection means onto an upper surface of said cartographic map.

60. The three-dimensional cartographic computer user interface system claim 59 wherein said software is responsive to input made by a user from a user input device operative on an upper surface of said cartographic map, wherein said input controls said display of dynamic imagery captured at one or more physical locations and occurring over a span of time, displaying said dynamic imagery as selected by a user from among a selection of chronological points in time within said span of time.

61. The three-dimensional cartographic computer user interface system of claim 59 wherein said dynamic imagery is selected from a group consisting of:

black and white photographic content, time-lapse photographic content, black and white video content, color video content, high definition ‘

HD’

video content, slow-motion video content, high frame rate video content, time-lapse video content, film converted to video content, sequential imagery content, composited imagery content, and cumulative imagery content.

62. The three-dimensional cartographic computer user interface system of claim 1 further comprising a map lighting control wherein a portion of said cartographic-related video-projected imagery is comprised of a mask having an adjustable opacity via said software which is responsive to user input from a user input device, whereby a decreasing of the mask opacity causes an increase of projected light in the masked area of the projected imagery, and conversely, an increase of the mask opacity causes a decrease of projected light in the masked area.

63. The three-dimensional cartographic computer user interface system of claim 1 further comprising a map lighting control wherein a portion of video-projected imagery is comprised of a mask having an opacity adjustment range via said software which is responsive to user input from a user input device, whereby a decreasing of the mask opacity causes an increase of projected light on a upper surface area of said cartographic map to increase the brightness of said upper surface area, and conversely, an increase of the mask opacity causes a decrease of projected light decrease the brightness of said upper surface area, and either type of opacity adjustment can be made by a user to improve said upper surface area visibility according to the then-current ambient light in the viewing environment.

64. The three-dimensional cartographic computer user interface system of claim 1 further comprising a database of data pertaining to a geographical location and said software is capable of accessing said data from said database and displaying said data, wherein said data is selected from a group consisting of:

situation-awareness-related data, emergency-awareness-related data, forecasting, simulations, GIS simulations, wind speeds and directions, air temperatures, times of day, times of month, times of year, seasons, humidity levels, altitudes, elevations, terrain types, soil types, fire temperatures, fuel levels, present fire paths, anticipated fire paths, simulated fire paths, structures in fire paths, fire breaks, fuels, bodies of water, fire suppressant types, fire suppressant locations, water drop locations, and fire crew locations.

65. The three-dimensional cartographic computer user interface system of claim 64 further comprising simulation-related data, and drawing software having the functionality of a drawing program, wherein a user selectable software tool of said drawing software provides a drawing functionality whereby a drawing on a portion of an upper surface of said cartographic map can be defined by a user as a simulation point in time, and said software is capable of being responsive to said simulation-related data accessed from said database to cause simulation changes to said drawing over a user-selectable period of time and at user-selectable rates.

66. The three-dimensional cartographic computer user interface system of claim 64 wherein said simulation-related data is selected from a group consisting of:

landslides, avalanches, spills, hurricane damage, tornado damage, floods, run-offs, glacial movements, overflowing rivers, overflowing bodies of water, the spread of a ground-based hazardous material, airborne hazardous material, fallout, melt-offs, environmental impact scenarios, and military engagements.

67. The three-dimensional cartographic computer user interface system of claim 1 wherein said user input device comprises of a light-emitting handheld stylus, and said three-dimensional cartographic computer user interface system further comprises stylus-orientation monitoring and reporting means, map-orientation monitoring and reporting means, stylus-light direction-calculating software, and signal triangulation means, whereby stylus-orientation monitoring and reporting means signal and map-orientation monitoring and reporting means signal are monitored by said signal triangulation means, and said stylus-light direction-calculating software is responsive to said signal triangulation means to calculate where light, when emitted from said light-emitting handheld stylus, is located on the surface of the 3D user interface.

68. The three-dimensional cartographic computer user interface system of claim 67 wherein said stylus-orientation monitoring and reporting means signal monitored by said signal triangulation means, is selected from the group consisting of radio frequency signals, light signals and sound signals.

69. The three-dimensional cartographic computer user interface system of claim 67 wherein said map-orientation monitoring and reporting means signal monitored by said signal triangulation means, is selected from the group consisting of radio frequency signals, light signals and sound signals.

70. The three-dimensional cartographic computer user interface system of claim 67 wherein said stylus-orientation monitoring and reporting means signal monitored by said signal triangulation means comprises a three-axis stylus-orientation monitoring and reporting means.

71. The three-dimensional cartographic computer user interface system of claim 67 wherein said stylus-orientation monitoring and reporting means signal monitored by said signal triangulation means comprises an inclinometer.

72. The three-dimensional cartographic computer user interface system of claim 1, wherein said imagery is cartographic-related video-projected imagery and three-dimensional user interface-related content.