Ins-based user orientation and navigation

• US 20040107072A1
• Filed: 12/03/2002
• Published: 06/03/2004
• Est. Priority Date: 12/03/2002
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Hathout, Jean-Pierre, Schmidt, Hauke, Dietrich, Arne
• Granted Patent: US 6,975,959 B2
• Time in Patent Office: Days
• US Class Current: 702/153
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01S 19/49 whereby the further system is an inertial position system, e.g. loosely-coupled
• CPC Class Codes: G01S 19/53 Determining attitude

Abstract

A mobile device for enhanced navigation and orientation including a visualization interface, a first sensor for providing signals indicative of a movement of the mobile device, a second sensor for providing further signals indicative of a movement of the mobile device, and a processor receiving signals from the first and second sensors, calculating a position and an orientation of the mobile device from the received signals, and generating a real time simulation of an environment via the visualization interface based on the position and orientation of the mobile device. According to an embodiment, the first and second sensors are implemented as an inertial sensor and a GPS receiver, respectively.

Claims

1. A mobile device for enhanced navigation and orientation comprising:

a visualization interface;

a first sensor for providing signals indicative of a movement of the mobile device;

a second sensor for providing further signals indicative of a movement of the mobile device; and

a processor receiving the signals from the first sensor and the second sensor, the processor calculating a three-dimensional position and a three-dimensional orientation of the mobile device from the received signals, and generating a real time simulation of an environment via the visualization interface based on the calculated position and orientation.

2. The mobile device of claim 1, wherein the first sensor includes an inertial sensor.

3. The mobile device of claim 1, wherein by manual movement of the mobile device, sensed by the first and second sensors, a user controls a point of view, a location and an attitude in at least one of a two-dimensional and a three-dimensional simulation of the environment.

4. The mobile device of claim 2, wherein the inertial sensor includes linear acceleration sensors that measure accelerations of the mobile device along x, y, and z directional axes, respectively.

5. The mobile device of claim 4, wherein the inertial sensor further includes rotational velocity sensors that measure rotational velocities of the mobile device about x, y, and z axes respectively.

6. The mobile device of claim 3, wherein the second sensor is a GPS receiver.

7. The mobile device of claim 6, wherein navigational information derived from the GPS receiver is used to determine a bias of the inertial sensor.

8. The mobile device of claim 2, wherein the processor uses signals from the inertial sensor to activate/deactivate user control operations.

9. The mobile device of claim 2, further comprising:

means for receiving navigational information pertinent to a specific environment.

10. The mobile device of claim 9, wherein the navigational information pertains to at least one of fairs, exhibits, museums, conferences, public buildings and campuses.

11. The mobile device of claim 9, wherein the navigational information pertains to marine coastal areas and potential navigational hazards.

12. The mobile device of claim 9, wherein the navigational information pertains to aeronautical navigation.

13. The mobile device of claim 12, wherein the visualization interface is configured to display simulated aeronautical instrumentation as a backup to installed on-board aeronautical instrumentation.

14. The mobile device of claim 1, wherein the first and second sensors include GPS receivers.

15. A mobile device for enhanced navigation and orientation comprising:

a user interface having a visual display; and

an inertial sensor, the inertial sensor detecting a movement of the mobile device, the inertial sensor providing feedback signals for user control and for generating an image in the visual display.

16. The mobile device of claim 15, wherein the inertial sensor generates signals from which a location and an attitude of the mobile device are derived.

17. The mobile device of claim 16, further comprising:

a processor; and

a means for receiving local navigation image information;

wherein the processor computes a location and an attitude of the mobile device from the signals generated by the inertial sensor, and from the location, attitude, and information from the receiving means, the processor generates an image of a local environment, the image representing a depiction of the local environment viewed from the computed location and attitude of the mobile device.

18. The mobile device of claim 17, further comprising:

a GPS receiver;

wherein the processor computes the location with aid of GPS information derived from the GPS receiver.

19. The mobile device of claim 16, wherein the inertial sensor includes linear acceleration sensors for sensing acceleration in x, y, and z directional axes, and rotational velocity sensors for sensing rotational velocity about the x, y, and z axes.

20. The mobile device of claim 17, wherein in response to particular signals received from the inertial sensor, the processor one of activates and deactivates controls of the user interface.

21. A mobile device for enhanced navigation and orientation comprising:

a visualization interface; and

a sensor for detecting an attitude of the mobile device and generating corresponding signals, the signals from the sensor being used as feedback for user control and for generating an image in the visualization interface that corresponds in viewpoint to the detected attitude of the mobile device.

22. The mobile device of claim 21, wherein the sensor includes at least one inertial sensor, the at least one inertial sensor detecting a rotational velocity of the mobile device.

23. The mobile device of claim 22, further comprising:

a position sensor;

means for receiving local navigation image information; and

a processor, the processor using the signals provided by the position sensor, signals provided by the sensor for detecting an attitude of the mobile device, and received local navigation image information to generate a real-time two-dimensional view and a three-dimensional simulation of a navigated environment.

24. The mobile device of claim 23, further comprising:

a GPS receiver coupled to the processor for assisting in calculation of a position of the mobile device.

25. A method for navigating using a mobile device having a visual display, the method comprising:

detecting a first set of signals indicative of movement of the mobile device;

detecting a second set of signals indicative of movement of the mobile device;

determining a position of the mobile device based on at least one of the first set of signals and the second set of signals;

determining an orientation of the mobile device based on at least one of the first set of signals and the second set of signals; and

generating at least one of a two-dimensional and a three-dimension view of an environment based on the position and orientation of the mobile device.

26. The method of claim 25, further comprising:

controlling user functions of the mobile device based on the first set of signals.

27. The method of claim 25, wherein the first set of signals is generated by an inertial sensor.

28. The method of claim 27, wherein the first set of signals are representative of a linear acceleration of the mobile device in x, y, and z directional axes, and a rotational velocity of the mobile device about the x, y, and z axes.

29. The method of claim 27, wherein the second set of signals is generated by a GPS receiver.

30. The method of claim 29, further comprising:

calibrating a position determined from the first set of signals provided by the inertial sensor using position information derived from the second set of signals provided by the GPS receiver.

31. The method of claim 25, further comprising:

receiving local navigation image information; and

generating the at least one of a two-dimensional and a three-dimension view of the environment based on the position and orientation of the mobile device using the received local navigation image information.

32. The method of claim 31, further comprising:

navigating a virtual space using received local navigation image information that provides graphical details of the virtual space.

33. The method of claim 31, further comprising:

receiving local maritime image information at a coastal area; and

generating a map view of the coastal area and a three-dimensional view of the coast including hazards using the received local maritime image information.

34. The method of claim 25, further comprising:

in an aeronautical transport vehicle, simulating on-board navigational instruments in a user interface using data derived from the first set of signals and the second set of signals.

35. A visual navigation system comprising:

a source of navigation information, the information including map information and image information, the source further including means for transmitting the navigation information;

a mobile device including;

means for receiving navigation information from the source,

an inertial sensor,

a GPS receiver, and

a processor coupled to the inertial sensor, the GPS receiver, and the means for receiving, the processor including;

a navigation module, the navigation module calculating a position of the mobile device using data from the inertial sensor and the GPS receiver, and generating map data using the received map information and the calculated position; and

a user interface generator module, the user interface generator module calculating an orientation of the mobile device using data from the inertial sensor, generating a three-dimensional simulation using the position calculated by the navigation module, the calculated orientation and received image information, and controlling user functions in accordance with signals received via the inertial sensor.