Method for inter-scene transitions

• US 10,032,306 B2
• Filed: 12/15/2015
• Issued: 07/24/2018
• Est. Priority Date: 11/12/2004
• Status: Active Grant

• Current Assignee: Smarter Systems, Inc.
• Original Assignee: EveryScape Incorporated
• Inventors: Oh, Byong Mok
• Primary Examiner(s): Chen, Frank
• Application Number:
  US14/969,669
• Publication Number:
  US 20160148413A1
• Time in Patent Office: 952 Days
• Field of Search: None
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2210/44 Morphing
• CPC Class Codes: G06T 2215/12 Shadow map, environment map
• CPC Class Codes: G06T 3/04 Context-preserving transformations, e.g. by using an importance map panospheric to cylindrical image transformations G06T3/12
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof

Abstract

A method and system for creating a transition between a first scene and a second scene on a computer system display, simulating motion. The method includes determining a transformation that maps the first scene into the second scene. Motion between the scenes is simulated by displaying transitional images that include a transitional scene based on a transitional object in the first scene and in the second scene. The rendering of the transitional object evolves according to specified transitional parameters as the transitional images are displayed. A viewer receives a sense of the connectedness of the scenes from the transitional images. Virtual tours of broad areas, such as cityscapes, can be created using inter-scene transitions among a complex network of pairs of scenes.

Claims

1. A method for creating in a computer system a transition between a first scene and a second scene simulating motion, the first scene observed from a first viewpoint including a first digital image having color data and the second scene observed from a second viewpoint including a second digital image having color data, the method comprising:

a. determining, for each digital image, a directional vector corresponding to a pan and tilt of a camera that captured the digital image and indicating an orientation of the scene corresponding to the digital image with respect to a coordinate system local to the digital image;

b. transforming, for each digital image, corresponding digital image data to rotate the digital image so that the directional vector of the transformed digital image is parallel to a particular axis of a global coordinate system;

c. further transforming digital image data of at least one of the transformed digital images by (i) rotating the at least one transformed digital image so that the directional vector is parallel with the directional vector of another transformed digital image and (ii) translating the at least one transformed digital image to align the directional vectors, thereby achieving alignment of corresponding features in each of the transformed digital images;

d. defining a common ground plane shared by the first transformed digital image and the second transformed digital image;

e. defining a footprint of structures within the first transformed digital image and the second transformed digital image on the ground plane;

f. extruding from the footprint geometries, wherein the footprint and the extruded geometries define a three-dimensional geometry representative of the structures;

g. determining a view position along a path and a corresponding orientation for a transitional image in relation to the three-dimensional geometry; and

h. projectively mapping color data from the first digital image and the second digital image based on the three-dimensional geometry and the view position to create a transitional image.

2. The method according to claim 1, wherein the first digital image and the second digital image are representative of photographs.

3. The method according to claim 1, wherein the first digital image and the second digital image are panoramic images.

4. The method according to claim 3, wherein the first and second digital images represent a 360 degree view.

5. The method for creating a transition between a first scene and a second scene simulating motion according to claim 1, the method further comprising:

displaying on the display the first digital image, one or more transitional images, and the second digital image sequentially.

6. The method according to claim 1, wherein the geometries include at least one of a perspective rectangle and a perspective triangle.

7. The method according to claim 1 wherein a plurality of transitional images are created from different positions along the path.

8. The method according to claim 1 further comprising:

displaying on the display the first digital image with a first navigational icon embedded; and

when the first navigational icon is activated, displaying the transitional image, such that there is simulated motion from the first digital image to the second digital image.

9. The method according to claim 8, wherein displaying a transitional image includes at least one of alpha-blending, morphing and motion-blurring the first digital image and the second digital image.

10. The method according to claim 1, the method further comprising:

displaying the first scene;

receiving an indication of the view position; and

when the indication of the view position is received, displaying the transitional image that includes at least one transitional scene, such that there is simulated motion from the first scene to the second scene.

11. A computer program product comprising a non-transitory computer-readable medium having computer code thereon for creating a transition between a first scene and a second scene simulating motion, the first scene observed from a first viewpoint including a first digital image having color data and the second scene observed from a second viewpoint including a second digital image having color data, the computer code comprising:

computer code for determining, for each digital image, a directional vector corresponding to a pan and tilt of a camera that captured the digital image and indicating an orientation of the scene corresponding to the digital image with respect to a coordinate system local to the digital image;

computer code for transforming, for each digital image, corresponding digital image data to rotate the digital image so that the directional vector of the transformed digital image is parallel to a particular axis of a global coordinate system;

computer code for further transforming digital image data of at least one of the transformed digital images by (i) rotating the at least one transformed digital image so that the directional vector is parallel with the directional vector of another transformed digital image and (ii) translating the at least one transformed digital image to align the directional vectors, thereby achieving alignment of corresponding features in each of the transformed digital images;

computer code for defining a common ground plane shared by the first transformed digital image and the second transformed digital image;

computer code for defining a footprint of structures within the first transformed digital image and the second transformed digital image on the ground plane;

computer code for extruding from the footprint geometries, wherein the footprint and the extruded geometries define a three-dimensional geometry representative of the structures;

computer code for determining a view position along a path and a corresponding orientation for a transitional image in relation to the three dimensional geometry; and

computer code for projectively mapping color data from the first digital image and the second digital image based on the three-dimensional geometry and the view position to create a transitional image.

12. The computer program product according to claim 11, wherein the first digital image and the second digital image are representative of photographs.

13. The computer program product according to claim 11, wherein the first digital image and the second digital image are panoramic images.

14. The computer program product according to claim 13, wherein the first and second digital images represent a 360 degree view.

15. The computer program product according to claim 11, the computer code further comprising:

computer code for displaying on the display the first digital image, one or more transitional images, and the second digital image sequentially.

16. The computer program product according to claim 11, wherein the geometries include at least one of a perspective rectangle and perspective triangle.

17. The computer program product according to claim 11, wherein a plurality of transitional images are created from different positions along the path.

18. The computer program product according to claim 11, further comprising:

computer code for displaying on the display the first digital image with a first navigational icon embedded; and

computer code for displaying the transitional image, such that there is simulated motion from the first digital image to the second digital image when the first navigational icon is activated.

19. The computer program product according to claim 18, wherein the computer code for displaying a transitional image includes at least one of alpha-blending, morphing and motion-blurring the first digital image and the second digital image.

20. The computer program product according to claim 11, the computer code further comprising:

computer code for displaying the image of the first scene;

computer code for receiving an indication of the view position; and

computer code for displaying the transitional image that includes at least one transitional scene, such that there is simulated motion from the first scene to the second scene when the indication of the view position is received.