Navigation in buildings with rectangular floor plan

• US 8,810,649 B2
• Filed: 06/30/2011
• Issued: 08/19/2014
• Est. Priority Date: 06/30/2011
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kulik, Victor
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): GEROLEO, FRANCIS
• Application Number:
  US13/174,231
• Publication Number:
  US 20130002857A1
• Time in Patent Office: 1,146 Days
• Field of Search: 348/135
• US Class Current: 348/135
• CPC Class Codes: G01C 17/38 Testing, calibrating, or compensating of compasses
• CPC Class Codes: G01C 21/1654 with electromagnetic compass
• CPC Class Codes: G01C 21/1656 with passive imaging devices, e.g. cameras
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation

Abstract

An apparatus and method for providing a direction based on an angle of a reference wall is provided. A mobile device uses an angle of a horizontal feature from an image to calibrate a sensor and future sensor measurements. The angle of the horizontal feature is determined by image processing and this angle is mapped to one of four assumed parallel or perpendicular angles of an interior of a building. A sensor correction value is determined from a difference between the sensor-determined angle and the image-processing determined angle. The image processing determined angle is assumed to be very accurate and without accumulated errors or offsets that the sensor measurements may contain.

Claims

1. A method of navigation in a mobile device using a reference wall, the method comprising:

determining a reference angle (θ

_REF) of the reference wall, comprising;

determining a building containing the reference wall;

finding the building on an overhead map; and

computing the reference angle (θ

_REF) from the overhead map;

capturing, with a camera in the mobile device, a local image containing a horizontal feature;

processing the local image to determine a horizontal feature angle (θ

_HF), wherein the horizontal feature angle (θ

_HF) measures an angle from a current orientation of the mobile device to the horizontal feature;

selecting a wall angle, of the horizontal feature, equal to an integer multiple of 90°

from the reference angle (θ

_REF); and

determining an angle of the current orientation of the mobile device based on a combination of the horizontal feature angle (θ

_HF) and the wall angle.

2. The method of claim 1, wherein the reference angle (θ

_REF) is an absolute angle with respect to North.

3. The method of claim 1, wherein the reference wall is an exterior wall.

4. The method of claim 1, wherein the local image comprises an interior wall.

5. The method of claim 1, wherein determining the reference angle (θ

_REF) further comprises;

capturing an initial image;

wherein computing the reference angle (θ

_REF) is based on the initial image.

6. The method of claim 1, wherein the horizontal feature comprises a horizontal edge of a door frame.

7. The method of claim 1, wherein the horizontal feature comprises a horizontal edge of a window.

8. The method of claim 1, wherein the horizontal feature comprises an interface edge between a wall and one of a floor and a ceiling.

9. The method of claim 1, wherein the wall angle is a modulo of {the reference angle (θ

_REF)+n*90°

, 360°

}, wherein n is an integer.

10. The method of claim 9, wherein the n is 0.

11. The method of claim 9, wherein the n is −

1.

12. The method of claim 1, wherein selecting the wall angle is based on inertial sensor measurements.

13. The method of claim 12, further comprising calibrating an inertial sensor.

14. The method of claim 13, wherein calibrating the inertial sensor comprises:

deriving a sensor misalignment (θ

_ERROR) based on;

a current orientation (θ

_SENSOR) of the mobile device based on the inertial sensor measurements from the inertial sensor; and

the angle of the current orientation of the mobile device; and

calibrating the inertial sensor based on the sensor misalignment (θ

_ERROR).

15. The method of claim 1, further comprising determining a position of the mobile device based on the angle of the current orientation of the mobile device.

16. The method of claim 1, further comprising determining motion of the mobile device based on the angle of the current orientation of the mobile device.

17. The method of claim 1, further comprising setting a direction of motion of the mobile device to the wall angle to perform wall matching.

18. The method of claim 1,

wherein the building is indexed in a database, and further comprising:

looking up the reference angle (θ

_REF) from the database.

19. A mobile device for navigation using a reference wall, the mobile device comprising:

a camera;

an inertial sensor; and

a processor and memory comprising code for;

determining a reference angle (θ

_REF) of the reference wall, comprising;

determining a building containing the reference wall;

finding the building on an overhead map; and

computing the reference angle (θ

_REF) from the overhead map;

capturing, with the camera in the mobile device, a local image containing a horizontal feature;

processing the local image to determine a horizontal feature angle (θ

_HF), wherein the horizontal feature angle (θ

_HF) measures an angle from a current orientation of the mobile device to the horizontal feature;

selecting a wall angle, of the horizontal feature, equal to an integer multiple of 90°

from the reference angle (θ

_REF); and

determining an angle of the current orientation of the mobile device based on a combination of the horizontal feature angle (θ

_HF) and the wall angle.

20. A mobile device for navigation using a reference wall, the mobile device comprising:

means for determining a reference angle (θ

_REF) of the reference wall, comprising;

means for determining a building containing the reference wall;

means for finding the building on an overhead map; and

means for computing the reference angle (θ

_REF) from the overhead map;

means for capturing a local image containing a horizontal feature;

means for processing the local image to determine a horizontal feature angle (θ

_HF), wherein the horizontal feature angle (θ

_HF) measures an angle from a current orientation of the mobile device to the horizontal feature;

means for selecting a wall angle, of the horizontal feature, equal to an integer multiple of 90°

from the reference angle (θ

_REF); and

means for determining an angle of the current orientation of the mobile device based on a combination of the horizontal feature angle (θ

_HF) and the wall angle.

21. A non-transient computer-readable storage medium including program code stored thereon, for navigation using a reference wall, comprising program code for:

determining a reference angle (θ

_REF) of the reference wall, comprising;

determining a building containing the reference wall;

finding the building on an overhead map; and

computing the reference angle (θ

_REF) from the overhead map;

receiving, from a camera in the mobile device, a local image containing a horizontal feature;

processing the local image to determine a horizontal feature angle (θ

_HF), wherein the horizontal feature angle (θ

_HF) measures an angle from a current orientation of the mobile device to the horizontal feature;

selecting a wall angle, of the horizontal feature, equal to an integer multiple of 90°

from the reference angle (θ

_REF); and

determining an angle of the current orientation of the mobile device based on a combination of the horizontal feature angle (θ

_HF) and the wall angle.