Generating Cinematic Flyby Sequences Following Paths and GPS Tracks

• US 20150170403A1
• Filed: 05/29/2012
• Published: 06/18/2015
• Est. Priority Date: 06/14/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: BARCAY, Daniel
• Granted Patent: US 9,508,002 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps

Abstract

A visualization system and method allow moving objects to be visualized in a GIS system as an interactive animation by moving an icon or 3D graphical model in an interactive virtual environment of the GIS. A line may also be drawn behind the icon/3D model representing the path traveled during a window of time. Additionally, the evolution of time-dependent data associated with the moving object may be encoded and visualized in the GIS.

Claims

1. A computer-implemented method for animated visualization of geo-located objects in a geographic information system, comprising:

determining a first position of a first moving object to be visualized at a first time in an interactive three-dimensional environment of the geographic information system based on geographic positioning data associated with the first moving object over a period of time;

positioning a graphical representation of the first moving object at the first time in the interactive three-dimensional environment according to the determined first position;

determining a second position of the first moving object to be visualized at a second time in the interactive three-dimensional environment based on the geographic positioning data associated with the first moving object;

defining a first path of a virtual camera in the interactive three-dimensional environment based on the determined first and second positions of the first moving object at the respective first and second times, the first moving object to be visualized in the interactive three-dimensional environment from a perspective of the virtual camera;

automatically generating in real-time an animation of the graphical representation of the first moving object in the interactive three-dimensional environment based on the defined first path of the virtual camera so as to visualize a smooth transition of the first moving object from the first position at the first time to the second position at the second time in the interactive three-dimensional environment; and

dynamically rendering the generated animation and views of geographic information within the interactive three-dimensional environment on a display from the perspective of the virtual camera moving along the first path from the first position to the second position,

wherein the determining the first and second positions, the positioning, the defining, the generating, and the rendering are performed by one or more computing devices implementing the interactive three-dimensional environment of the geographic information system.

2. The method of claim 1, wherein the graphical representation of the first moving object in the interactive three-dimensional environment is one of a graphical icon or a graphical three-dimensional model.

3. The method of claim 1, wherein the dynamically rendering the generated animation further includes dynamically rendering a visual trace in association with the first moving object so as to visually track a movement of the first moving object along the first path in the interactive three-dimensional environment, the visual trace extending along the first path from a point on the first moving object positioned at the second position at the second time to the first position at the first time.

4. The method of claim 1, wherein the defining comprises:

interpolating the first path of the virtual camera in the interactive three-dimensional environment based on the determined first and second positions of the first moving object in the interactive three-dimensional environment.

5. The method of claim 1, wherein the geographic positioning data is encoded using an encoding language, and the encoded geographic positioning data is interpreted to derive the first and second positions of the first moving object at the respective first and second times in the interactive three-dimensional environment.

6. The method of claim 1, wherein the geographic positioning data associated with the first moving object includes geographic location information, time information, and elevation information associated with the first moving object over the period of time.

7. The method of claim 6, wherein:

the geographic positioning data associated with the first moving object further includes numerical values measuring time-dependent properties of the first moving object at the first and second times, the time-dependent properties to be visualized in the interactive three-dimensional environment; and

the dynamically rendering further comprises dynamically rendering on the display a graphical representation of the time-dependent properties of the first moving object so as to visualize any changes in the time-dependent properties environment from the perspective of the virtual camera moving along the first path from the first time to the second time in the interactive three-dimensional environment.

8. The method of claim 1, wherein the rendered views include a spatial view and a temporal view of the geographic information in the interactive three-dimensional environment.

9. The method of claim 8, wherein the period of time is an adjustable time window in the interactive three-dimensional environment, the defining of the first path of the virtual camera includes defining the first path of the virtual camera in the interactive three-dimensional environment based on a change in position of the first moving object during the time window, and the dynamically rendering includes dynamically updating the rendered animation and views of the geographic information in accordance with the time window.

10. The method of claim 9, further comprising:

determining positions of a second moving object to be visualized during the time window in the interactive three-dimensional environment based on geographic positioning data associated with the second moving object;

positioning a graphical representation of the second moving object at a third position in the interactive three-dimensional environment based on the determined positions of the second moving object during the time window;

defining a second path of the virtual camera in the interactive three-dimensional environment based on the determined positions of the second moving object during the time window;

automatically generating in real-time an animation of the graphical representation of the second moving object during the time window in the interactive three-dimensional environment based on the defined second path of the virtual camera so as to visualize a smooth transition of the first and second moving objects during the time window in the interactive three-dimensional environment; and

dynamically rendering on the display the generated animation of the graphical representation of the second moving object with the generated animation of the graphical representation of the first moving object and the views of the geographic information within the interactive three-dimensional environment from the perspective of the virtual camera moving along the second path during the time window.

11. The method of claim 1, further comprising:

enabling a user to manually adjust the rendered views of the geographic information in the interactive three-dimensional environment using a user interface control provided in the interactive three-dimensional environment; and

dynamically updating in real-time the rendered animation and the rendered views of the geographic information on the display based on input received from the user via the provided user interface control.

12. The method of claim 11, wherein the period of time is an adjustable time window in the interactive three-dimensional environment, the user interface control is a time slider control that enables the user to manually adjust the time window in the interactive three-dimensional environment, and the dynamically updating comprises:

adjusting the time window in the interactive three-dimensional environment in accordance with the input received from the user via the time slider control; and

dynamically updating the rendered animation and the temporal view of the geographic information based on the adjusted time window.

13. A geographic information system for animated visualization of geo-located objects in an interactive three-dimensional environment, comprising:

one or more processors;

an object positioner configured to determine a first position of a first moving object to be visualized at a first time in the interactive three-dimensional environment based on geographic positioning data associated with the first moving object over a period of time, to position a graphical representation of the first moving object at the first time in the interactive three-dimensional environment according to the determined first position, and to determine a second position of the first moving object to be visualized at a second time in the interactive three-dimensional environment based on the geographic positioning data associated with the first moving object;

a path planner configured to define a first path of a virtual camera in the interactive three-dimensional environment based on the determined first and second positions of the first moving object at the respective first and second times, the first moving object to be visualized in the interactive three-dimensional environment from a perspective of the virtual camera;

an object animator configured to automatically generate in real-time an animation of the first graphical representation of the first moving object in the interactive three-dimensional environment based on the first path of the virtual camera so as to visualize a smooth transition of the first moving object from the first position at the first time to the second position at the second time in the interactive three-dimensional environment; and

a renderer configured to dynamically render the generated animation and views of geographic information within the interactive three-dimensional environment on a display from the perspective of the virtual camera moving along the first path from the first position to the second position,

wherein the object positioner, the path planner, the object animator, and the renderer are implemented using the one or more processors.

14. The system of claim 13, wherein the renderer is further configured to dynamically render a visual trace in association with the first moving object so as to visually track a movement of the first moving object along the first path in the interactive three-dimensional environment, the visual trace extending along the first path from a point on the first moving object positioned at the second position at the second time to the first position at the first time.

15. The system of claim 13, wherein the path planner is configured to interpolate the first path of the virtual camera in the interactive three-dimensional environment based on the determined first and second positions of the first moving object in the interactive three-dimensional environment.

16. The system of claim 13, wherein the geographic positioning data is encoded using an encoding language, and the encoded geographic positioning data is interpreted to derive the first and second positions of the first moving object at the respective first and second times in the interactive three-dimensional environment.

17. The system of claim 13, wherein the geographic positioning data associated with the first moving object includes geographic location information, time information, and elevation information associated with the first moving object over the period of time.

18. The system of claim 17, wherein the geographic positioning data associated with the first moving object further includes numerical values measuring time-dependent properties of the first moving object at the first and second times, the time-dependent properties to be visualized in the interactive three-dimensional environment, and wherein the renderer is further configured to dynamically render a graphical representation of the time-dependent properties of the first moving object so as to visualize any changes in the time-dependent properties environment from the perspective of the virtual camera moving along the first path from the first time to the second time in the interactive three-dimensional environment.

19. The system of claim 13, wherein the views rendered by the rendering engine include a spatial view and a temporal view of the geographic information in the interactive three-dimensional environment.

20. The system of claim 19, wherein:

the period of time is an adjustable time window in the interactive three-dimensional environment;

the first path of the virtual camera in the interactive three-dimensional environment is defined based on a change in position of the first moving object during the time window;

the object positioner is further configured to determine positions of a second moving object to be visualized during the time window in the interactive three-dimensional environment based on geographic positioning data associated with the second moving object, and to position a graphical representation of the second moving object at a third position in the interactive three-dimensional environment based on the determined positions of the second moving object during the time window;

the path planner is further configured to define a second path in the interactive three-dimensional environment based on the determined positions of the second moving object during the time window; and

the renderer is further configured to;

automatically generate in real-time an animation of the graphical representation of the second moving object during the time window in the interactive three-dimensional environment based on the defined second path of the virtual camera so as to visualize a smooth transition of the first and second moving objects during the time window in the interactive three-dimensional environment; and

dynamically render on the display the generated animation of the graphical representation of the second moving object with the generated animation of the graphical representation of the first moving object and the views of the geographic information within the interactive three-dimensional environment from the perspective of the virtual camera moving along the second path during the time window.

21. A computer-implemented method for animated visualization of geo-located objects in a geographic information system, comprising:

positioning a graphical representation of a moving object in an interactive three-dimensional environment over a period of time based on geographic positioning data associated with the moving object, the geographic positioning data including a plurality of geographic locations corresponding to the moving object over time, each location in the plurality of locations associated with a timestamp;

generating a cinematic path for a virtual camera in the interactive three-dimensional environment that keeps the moving object in-view while maximizing contextual understanding of the geographic landscape of the interactive three-dimensional environment, and minimizes nausea through constraining the camera motion in specific ways as it traverses the path;

constraining rotation speed of the virtual camera based on a distance of the camera to the moving object and a speed of the moving object as an input to both the tilt and the range of the camera; and

smoothing the movement of the virtual camera through adaptive key-framing of the track data.

22. The method of claim 21, wherein the graphical representation of the moving object in the interactive three-dimensional environment is one of a graphical icon or a graphical three-dimensional model.

23. The method of claim 21, wherein the geographic positioning data is encoded using an encoding language, and the encoded geographic positioning data is interpreted to derive the position of the moving object over the period of time in the interactive three-dimensional environment.

24. The method of claim 21, wherein the geographic positioning data associated with the moving object includes geographic location information, time information, and elevation information associated with the first moving object over the period of time.

25. The method of claim 21, wherein the period of time is an adjustable time window in the interactive three-dimensional environment.

26. The method of claim 21, wherein the cinematic path may be a multiple of real-time.

27. The method of claim 21, wherein generating a cinematic path further comprises:

selecting one or more keyframes of geographic information, a focus-point of each keyframe being chosen based on an analysis of the cinematic path, wherein the more keyframes selected will cause improved precision of the virtual camera following the cinematic path.

28. The method of claim 21, wherein constraining the rotation speed of the virtual camera further comprises:

applying damping to the virtual camera rotation, wherein the damping allows for a maximum rotation speed for one or more keyframes.

29. The method of claim 28, wherein the maximum rotation speed is calculated for each keyframe depending on the range and tilt of the virtual camera.