System and method of integrated spatial and temporal navigation
First Claim
1. A method, comprisingdetermining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface;
- in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; and
temporally controlling by the processor, display of a transitional effect having a timeline allowing rewind and forward time control using a same interaction method used for spatial navigation control;
displaying a transitional effect during the transitioning; and
temporally controlling the displaying of the transitional effect, andwherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera surface to the second camera surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
4 Assignments
0 Petitions
Accused Products
Abstract
The system displays an image portraying a virtual space as viewed by a virtual camera at a first location on a spatially navigable camera surface within the virtual space. A user begins a drag operation. Based on the dragging, the virtual camera is spatially translated from the first location on the spatially navigable region to a second location on the spatially navigable region. The orientation of the virtual camera at the second location may be automatically set to either point towards the pre-defined look-at point or to point in a direction normal to the spatially navigable region at the second location. The system then displays an image portraying the virtual space in accordance with the location and orientation of the virtual camera at the second location in the spatially navigable camera surface. While the drag operation continues, the system determines that further translating the virtual camera would place the virtual camera beyond the spatially navigable region. In response, the system begins displaying a transition, which may be an interpolated animation of the virtual camera, an animation semi-transparently blended with a slate, a pre-authored animation of the virtual camera, or other visual effect. While further continuing to drag, and based on the same, the system either advances display of the transition, reverses display of the transition, or otherwise temporally controls the display of the transition.
41 Citations
46 Claims
-
1. A method, comprising
determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; -
in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; and temporally controlling by the processor, display of a transitional effect having a timeline allowing rewind and forward time control using a same interaction method used for spatial navigation control; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera surface to the second camera surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
2. A method, comprising
controlling by a processor, a transition effect having a timeline allowing rewind and forward time control when a viewpoint or virtual camera is interactively moved out of or off of an original 3D camera surface occurring when the viewpoint or virtual camera reaches an edge of the original camera surface, and interactively inputting a continuous stream of two-dimensional data to translate the viewpoint or virtual camera on the original camera surface, and then transitioning the viewpoint or virtual camera to a nonadjacent destination camera surface; -
displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect with the continuous stream of two-dimensional data, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the original camera surface to the destination camera surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects. - View Dependent Claims (3, 4, 5, 6, 7, 8)
-
-
9. A method, comprising
controlling by a processor, a transition effect having a timeline when a viewpoint or virtual camera is interactively moved out of or off of an original 3D camera surface; -
displaying a view from the viewpoint or virtual camera on the original camera surface, which is nonadjacent to a destination camera surface; interactively inputting a continuous stream of two-dimensional data to translate the viewpoint or virtual camera on the original camera surface; transitioning the viewpoint or virtual camera to the nonadjacent destination camera surface; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect with the continuous stream of two-dimensional data, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the original camera surface to the destination camera surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
10. A method of unified spatial and temporal control, comprising:
-
allowing a user to spatially move a viewpoint on a first viewpoint surface using a computer with a processor; and allowing a user to temporally control rewind and forward time of a sequence of transition images when spatial movement on the first viewpoint surface encounters an edge or predefined point of the first viewpoint surface; interactively inputting a continuous stream of two-dimensional data to translate the viewpoint on the first viewpoint surface, and then transitioning the viewpoint to a nonadjacent destination camera surface; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect with the continuous stream of two-dimensional data, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first viewpoint surface to the destination camera surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects. - View Dependent Claims (11)
-
-
12. A method of integrated spatial and temporal navigation, comprising:
-
determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; enabling temporal navigation of display of an animation having a timeline allowing rewind and forward time control during the transitioning; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera surface to the second camera surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A method of integrated navigation control, comprising:
-
displaying or rendering by a processor, a subject or scene according to a current viewpoint on an original camera 3D surface that is facing the subject or scene and that is spatially separated from a destination viewing surface that is also facing the subject or scene; generating a continuous stream of two-dimensional input data; according to a first portion of the two-dimensional input data, translating the current viewpoint on the original camera 3D surface; after the translating and according to a later portion of the continuous stream of two-dimensional input data, temporally controlling by the processor, the display of a transition effect having a timeline allowing rewind and forward time control as the current viewpoint transitions from the original camera 3D surface to the destination camera 3d surface; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect with the continuous stream of two-dimensional data, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the original camera 3D surface to the destination camera 3d surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects. - View Dependent Claims (20, 21, 22)
-
-
23. A method of integrated navigation control, comprising:
-
displaying or rendering by a processor, a subject or scene according to a current viewpoint on an original camera 3D surface that is facing the subject or scene and that is spatially separated from a destination viewing surface that is also facing the subject or scene; generating a continuous stream of two-dimensional input data; according to a first portion of the two-dimensional input data, translating the current viewpoint on the original camera 3D surface; and after the translating and according to a later portion of the continuous stream of two-dimensional input data, temporally controlling by the processor, the display of a transition effect having a timeline as the current viewpoint transitions from the original camera 3D surface to the destination camera 3d surface, and wherein the transition effect is at least one of a pre-determined video clip, an interpolated movement of the current view from the original viewing surface to the destination viewing surface, an image, a slate, a pre-arranged camera movement, an animation, and a combination of two or more of the preceding transition effects.
-
-
24. A method, comprising determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D region;
-
in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D region that is not adjacent to the first camera 3D region; interactively controlling by the processor, a rate of display of a visual transition having a timeline for transition between the first and second camera regions which are spatially navigable; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D region to the second camera 3D region, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects. - View Dependent Claims (25, 26, 27, 28)
-
-
29. A method, comprising:
-
determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; seamlessly switching by the processor, from an interactive spatial navigation mode to an interactive temporal display mode having a timeline with one ongoing interactive input operation; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects. - View Dependent Claims (30, 31)
-
-
32. A method, comprising:
-
interactively generating input data with a constant mode of interactive control; according to a first part of the input data, spatially navigating a subject by determining by a processor, spatial navigation points in a bounded locus of three-dimensional spatially navigable points, where, before the generating, the locus of points are arranged in relation to the subject to be viewed; displaying images portraying the subject as viewed from the determined spatial navigation points; after displaying the images, and when the spatial navigating indicates navigation out of or off of the locus of points, using a second part of the continuous stream of two-dimensional input data to control a rate of displaying by the processor, a sequence of other images allowing rewind and forward time control;
where the second part of the continuous stream of input data chronologically follows the first part of the continuous stream of input data;displaying a transitional effect during the navigating; and temporally controlling the displaying of the transitional effect with the two-dimensional input data, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of a viewpoint or virtual camera moving from the locus of points, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
33. A method for interactive visual navigation, comprising:
-
interactively generating a continuous stream of two-dimensional input data with a single mode of interaction; according to a first part of the continuous stream of two-dimensional input data, spatially navigating a subject by determining by a processor, spatial navigation points in a bounded locus of three-dimensional spatially navigable points, where before the generating the locus of points are arranged in relation to the subject to be viewed; displaying images portraying the subject as viewed from the determined spatial navigation points; after displaying the images, and when the spatial navigating indicates navigation out of or off of the locus of points, using a second part of the continuous stream of two-dimensional input data to control a rate of displaying by the processor, a sequence of other images allowing rewind and forward time control;
where the second part of the continuous stream of input data chronologically follows the first part of the continuous stream of input data;displaying a transitional effect during the navigating; and temporally controlling the displaying of the transitional effect with the two-dimensional input data, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of a viewpoint or virtual camera moving from the locus of points, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
34. A method of integrated spatial and temporal navigation of a virtual space, comprising:
-
displaying by a processor, a rendering or image portraying the virtual space as viewed by a virtual camera at a first location on or in a spatially navigable camera surface within the virtual space, where the virtual camera has an orientation that is either normal to the spatially navigable camera surface or is pointed toward a fixed look-at point in the virtual space; beginning a drag or move operation of a two-dimensional input device; based on the moving or dragging, by the processor, spatially translating the virtual camera from the first location in the spatially navigable region to a second location in or on the spatially navigable region; automatically setting the orientation of the virtual camera at the second location to either point towards the pre-defined look-at point or to point in a direction normal to the spatially navigable region at the second location; displaying by the processor, a rendering or image portraying the virtual space in accordance with the location and orientation of the virtual camera at the second location in the spatially navigable camera surface; continuing the drag or move operation of the two-dimensional input device; determining by the processor, that further translating the virtual camera according to the continued dragging or moving of the two-dimensional input device would place the virtual camera beyond the spatially navigable region; in response to the determining, beginning the display of a transition comprising at least one of an interpolated animation of the virtual camera, an animation semi-transparently blended with a slate, and a pre-authored animation of the virtual camera; while further continuing the drag or move operation of the two-dimensional input device, performing at least one of advancing display of the transition based on the further continuing drag or move operation of the two-dimensional input device causing forward time control, reversing display of the transition based on the further continuing drag or move operation of the two-dimensional input device causing rewind time control, and pausing, stopping, or automatically completing display of the transition based on cessation of the drag or move operation of the two-dimensional input device; displaying a transitional effect during the spatial translating; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the virtual camera moving from the first location to the second location, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
35. A computer readable storage containing a data structure for controlling a computer, the data structure comprising:
-
a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface and the viewpoint or virtual camera is transitioned to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; the first and second camera surfaces are for constrained camera navigation not adjoining another, interrelated by transitions with timelines allowing rewind and forward time control which together define views of a scene or model that can be spatially navigated by a user; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
36. A computer readable storage containing a data structure for controlling a computer, the data structure comprising:
-
data describing a set of mutually non-adjacent camera surfaces for constrained spatial camera navigation and for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge including a first camera 3D surface or viewpoint surface which is transitioned to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface, displaying a transitional effect during the transitioning, temporally controlling the displaying of the transitional effect, wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of a viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects; and data describing a set of interactively controllable timeline based transition effects between the surfaces allowing rewind and forward time control. - View Dependent Claims (37)
-
-
38. A computer readable storage containing a data structure for controlling a computer, the data structure comprising a set of non-adjacent camera surfaces that are spatially navigable and that are connected by interactively controllable visual temporal transitions allowing rewind and forward time control, a model or scene has been interactively translated off of or to a pre-defined point or edge including a first camera 3D surface or viewpoint surface which is transitioned to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface, a transitional effect displayed during the transitioning, a temporal control of displaying of the transitional effect, wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of a viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
39. A computer readable storage containing a data structure for controlling a computer, the data structure comprising:
-
view surface boundaries including a first view surface boundary which is transitioned to a second view surface boundary that is not adjacent to the first view surface boundary, as a result of a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to the first view surface boundary; a timeline based transition between the view surface boundaries allowing rewind and forward time control; a transition duration indicating a length of the transition; a transitional effect during the transitioning; and a temporal control of the displaying of the transitional effect, wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of a viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
40. A computer-readable storage for enabling a computer to perform a process, the process comprising:
-
allowing a user to spatially move a viewpoint on a first viewpoint surface; allowing a user to temporally control allowing rewind and forward time of a sequence of transition images when spatial movement on the first viewpoint surface encounters an edge or predefined point of the first viewpoint surface and transitioning the viewpoint to a second viewpoint surface that is not adjacent to the first viewpoint surface; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of a viewpoint or virtual camera moving from the first viewpoint surface to the second viewpoint surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
41. A computer-readable storage for enabling a computer to perform a process, the process comprising:
-
determining that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera surface or viewpoint surface; enabling temporal navigation of display of an animation during the transitioning allowing rewind and forward time control; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first viewpoint surface to the second viewpoint surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
42. An apparatus, comprising:
-
a determination unit that determines that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; a transition unit, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; a spatial navigation unit allowing a user to spatially move the viewpoint on the viewpoint surface; a temporal navigation unit allowing a user to temporally control rewind and forward time control of a sequence of transition images; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
43. An apparatus, comprising:
-
a determining unit, determining that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; a transitioning unit, in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera surface or viewpoint surface; a navigation unit enabling temporal navigation using rewind and forward time control of display of an animation during the transitioning; a display unit displaying a transitional effect during the transitioning; and a control unit temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
44. A method, comprising determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface;
-
in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; performing by the processor, temporal navigation control allowing rewind and forward time control and spatial navigation control of respective interrelated temporal and spatial images with a same interaction method; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
45. A method of navigation used when an environment allows time based control by controlling a time based speed and sign of a transition in the environment and allows position based spatial navigation control by controlling a position in the environment, comprising:
-
determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface; in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; controlling by a processor, the time based display of a transitional effect using a same interaction method used for the position based spatial navigation control; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
-
46. A method, comprising determining by a processor, that a viewpoint or virtual camera for viewing a model or scene has been interactively translated off of or to a pre-defined point or edge of a first camera 3D surface or viewpoint surface;
-
in response to the determining, transitioning the viewpoint or virtual camera to a second camera 3D surface or viewpoint surface that is not adjacent to the first camera 3D surface or viewpoint surface; temporally controlling by a processor, display of a transitional effect by controlling a sign of time as well as a speed of time using same interaction method used for spatial navigation control; displaying a transitional effect during the transitioning; and temporally controlling the displaying of the transitional effect, and wherein the transitional effect is at least one of a pre-determined video clip, an interpolation of the viewpoint or virtual camera moving from the first camera 3D surface to the second camera 3D surface, a two-dimensional slate, a pre-arranged camera movement, and a combination or concatenation of two or more of the preceding transitional effects.
-
Specification