Method and apparatus for virtual walkthrough

• US 20060033741A1
• Filed: 11/24/2003
• Published: 02/16/2006
• Est. Priority Date: 11/25/2002
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: MentorWave Technologies Ltd. (Alphabet Inc.)
• Inventors: Amira, Rony, Royz, Gadi
• Granted Patent: US 7,443,402 B2
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: Y10S 345/959 Object path adherence

Abstract

Method for producing an interactive virtual movie, which simulates the walking of a user within a real site and exploring the same, comprising the steps of: (a) Defining first minimal conditions for the creation of a new node; (b) Defining second minimal conditions for linking between nodes; (c) Moving a scanning apparatus along routes within the site, measuring the x,y, displacement coordinates, and angular orientation of the scanning apparatus at any given time, and creating a new node at least whenever such first minimal conditions are met; (d) Obtaining an image data at each node location reflecting a camera unit field of view, and associating the said image data and its orientation with the x,y, location coordinates of the present node; (e) Finding and registering neighborhood links between pairs of nodes to generally create chains of nodes, each link assignment connecting between any two nodes satisfies at least said second minimal conditions required for linking between nodes, wherein more than one link may be assigned to a node (f) Further associating and registering with each created link an exit angular orientation from a first node in the pair and entry angular orientation to the second node in the pair.

Claims

1. A method for producing an interactive virtual movie, which simulates the walking of a user within a real site and exploring the same, comprising:

a. Defining first minimal conditions for the creation of a new node;

b. Defining second minimal conditions for linking between nodes;

c. Moving a scanning apparatus along routes within the site, measuring the x,y, displacement coordinates, and angular orientation of the scanning apparatus at any given time, and creating a new node at least whenever such first minimal conditions are met;

d. Obtaining an image data at each node location reflecting a camera unit field of view, and associating the said image data and its orientation with the x,y, location coordinates of the node;

e. Finding and registering neighborhood links between pairs of nodes to generally create chains of nodes, each link assignment connecting between any two nodes satisfies at least said second minimal conditions required for linking between nodes, wherein more than one link may be assigned to a node;

f. Further associating and registering with each created link an exit angular orientation from a first node in the pair and entry angular orientation to the second node in the pair.

2. Method according to claim 1 wherein satisfying any one of the conditions included in said first minimal conditions will result in the creation of a new node.

3. Method according to claim 1 wherein one of said first minimal conditions is a maximal predefined displacement D between two nodes sampled by the apparatus.

4. Method according to claim 1 wherein one of said first minimal conditions is a maximal predefined allowed angular change δ

°

in the orientation of the apparatus after leaving a node.

5. Method according to claim 1 further comprising elimination or merging of nodes when some third conditions are met;

6. Method according to claim 5 wherein said third conditions comprise closeness of nodes below a predefined distance d, and a 360°

in at least one of the nodes.

7. Method according to claim 1 wherein each image data comprises a plurality of frames, and wherein each frame angular orientation is also registered.

8. Method according to claim 1, wherein said interactive virtual movie comprises:

a. A plurality of nodes;

b. Links connecting between nodes, wherein with each link between two nodes is associated with an exit angular indication from one node, and an entry angular indication to the other node, plurality of links may be associated with one node;

c. Image data reflecting a camera unit field of view for each node, and orientation indications for said image data;

9. A virtual interactive movie according to claim 8, wherein the display of the movie comprises the steps of:

a. Providing to the user with means for selecting, turning, and advancing;

b. Displaying to the user a selected user field of view within the image data of a node;

c. When the user turns to a specific direction, displaying to the user the user the field of view portion of the image data which corresponds to said specific direction or close to it;

d. When the user directs to one of the exit directions of the present node, and chooses to advance;

displaying to the user a portion of the image data of the next node linked to said present node by said exit direction, said displayed portion of the image data corresponds to the entry direction associated with said link.

e. When the user selecting a node other than the present node, displaying to him a user field of view portion of the image data of said other node.

10. Apparatus for producing an interactive virtual movie, which simulates the walking of a user within a real site, comprising:

a. A movable platform;

b. Position and orientation unit for obtaining at any given time position and orientation of the platform, and providing the same to an imaging unit;

c. Imaging units for creating a node any time when some first minimal conditions are met, obtaining image data, and associating said image data and its orientation with the node location, thereby forming a node package;

d. Data unit for;

1) receiving node packages from the imaging unit;

2) calculating neighborhood between nodes;

3) registering links between found neighboring nodes, including registering for each link entry and exit directions to and from nodes;

4) calculating possible merging and/or eliminating of nodes;

5) saving in a database within the data unit a linked graph which is the result of steps 1-4;

6) importing linked graph/s from removable media or network device to the database; and

7) exporting linked graph/s from the database to a removable media or a network device.

e. A control unit for;

1) Activation and deactivation of the device;

2) Defining parameters necessary for the operation of the apparatus;

3) Providing control over the import and export operations;

4) Monitoring and coordinating the operation of the various units and elements of the apparatus.

11. Apparatus according to claim 10, wherein the data unit is located on the movable platform;

12. Apparatus according to claim 10, wherein the data unit is located away from the platform;

13. Apparatus according to claim 10, wherein the imaging unit comprises of one or more cameras.

14. Apparatus according to claim 13, further comprising mechanism for rotating and/or positioning the cameras.

15. Apparatus according to claim 14, further comprising sensors for measuring the orientation of the cameras with respect to the platform.

16. Apparatus according to claim 10, wherein said first minimal conditions comprise at least the parameter of a maximal predefined displacement D between two nodes as measured by the position and orientation unit.