Method and system for computer assisted localization, site navigation, and data navigation

• US 20020069013A1
• Filed: 10/05/2001
• Published: 06/06/2002
• Est. Priority Date: 10/05/2000
• Status: Active Grant

• Current Assignee: Siemens Corp. (Siemens AG)
• Original Assignee: Siemens Corporate Research Incorporated (Siemens AG)
• Inventors: Kumar, Vijay, Zhang, Xiang, Bascle, Benedicte, Navab, Nassir
• Granted Patent: US 6,587,783 B2
• Time in Patent Office: Days
• US Class Current: 701/200
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence

Abstract

A method and system for computer assisted site navigation comprises the steps of capturing an image of a scene for providing real-time image data; calibrating the camera and localizing the image by utilizing the image data and retrieved marker registration and floor-map data for providing position and orientation data; transmitting the data to a web server; utilizing the image data and information on the scene retrieved from a database for deriving an augmented view; and displaying the augmented view.

Claims

1. A method for computer assisted site navigation, comprising the steps of:

capturing an image of a scene for providing real-time image data;

calibrating said camera and localizing said image utilizing said image data and retrieved marker registration and floor-map data for providing position and orientation data;

transmitting said data to a web server;

utilizing said image data and information on said scene retrieved from a database for deriving an augmented view; and

displaying said augmented view.

2. A method for computer assisted site navigation as recited in claim 1, including a step of processing said image data to extract features and to detect markers in said image.

3. A method for computer assisted site navigation as recited in claim 1, including a step of displaying said position and information data for providing navigation guidance.

4. A method for computer assisted site navigation as recited in claim 1, wherein said step of transmitting said data to a web server comprises transmitting said data by way of a local area network (LAN).

5. A method for computer assisted site navigation as recited in claim 1, wherein said step of transmitting said data to a web server comprises transmitting said data by way of wireless communication.

6. A method for computer assisted site navigation, comprising the steps of:

capturing an image of a scene including markers on a video camera for providing real-time image data;

processing said image data for providing feature extraction and marker detection data;

utilizing said feature extraction and marker detection data and stored information including marker registration and floor-maps for calibrating said camera, localizing said image, and computing coordinates for deriving position and orientation data;

displaying said position and orientation data;

transmitting said data to a web server;

utilizing said image data and information on said scene retrieved from a database for deriving an augmented view; and

displaying said augmented view.

7. A method for computer assisted site navigation as recited in claim 6, including the steps of:

utilizing said position and orientation data to identify and retrieve a stored message; and

displaying said message.

8. A method for computer assisted site navigation as recited in claim 7, wherein said step of displaying said message comprises displaying an instruction.

9. A method for computer assisted site navigation as recited in claim 6, including the step of:

positioning a user-selected image within said augmented image in a manner and position in accordance with a user'"'"'s command.

10. A method for computer assisted site navigation as recited in claim 6, including the step of responding to a voice instruction by a user.

11. A method for computer assisted site navigation as recited in claim 6, wherein said step of utilizing said position and orientation data to identify and retrieve a stored message comprises a step of responding to an user-inputted password and for selecting a corresponding message.

12. A system for computer assisted site navigation comprises:

means for capturing an image of a scene for providing real-time image data;

means for calibrating said camera and localizing said image utilizing said image data and retrieved marker registration and floor-map data for providing position and orientation data;

means for transmitting said data to a web server;

means for utilizing said image data and information on said scene retrieved from a database for deriving an augmented view; and

means for displaying said augmented view.

13. A system for computer assisted site navigation comprises:

means for capturing an image of a scene including markers on a video camera for providing real-time image data;

means for processing said image data for providing feature extraction and marker detection data;

means for utilizing said feature extraction and marker detection data and stored information including marker registration and floor-maps for calibrating said camera, localizing said image, and computing coordinates for deriving position and orientation data;

means for displaying said position and orientation data;

means for transmitting said data to a web server;

means for utilizing said image data and information on said scene retrieved from a database for deriving an augmented view; and

means for displaying said augmented view.