Method and computer program for providing location data to mobile devices

• US 10,157,189 B1
• Filed: 08/12/2016
• Issued: 12/18/2018
• Est. Priority Date: 04/09/2014
• Status: Active Grant

• Current Assignee: Vortex Intellectual Property Holding LLC
• Original Assignee: Vortex Intellectual Property Holding LLC
• Inventors: Houri, Cyril
• Primary Examiner(s): NAKHJAVAN, SHERVIN K
• Application Number:
  US15/236,223
• Time in Patent Office: 858 Days
• Field of Search: None
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences

Abstract

Method for providing position-based information to a mobile device with at least one imaging device includes obtaining, using the imaging device, an image including a stationary pattern of pixels, searching through a database of pixel patterns for a pixel pattern that most closely matches the pattern of pixels in the obtained at least one image, the database containing pixel patterns and positional information about the pixel patterns, and retrieving from the database as a result of the searching, positional information about one of the pixel patterns that is deemed to most closely match the pattern of pixels in the obtained at least one image. Data is provided to the mobile device, i.e., to a data output device or functionality thereof, dependent on the retrieved positional information about one of the pixel patterns that is deemed to most closely match the pattern of pixels in the obtained at least one image.

Claims

1. A method for providing position-based information to a first mobile device with at least one imaging device, comprising:

obtaining, using the at least one imaging device of the first mobile device, at least one image including a stationary pattern of pixels;

receiving, at the first mobile device, from a second mobile device a database containing pixel patterns and positional information about the pixel patterns, the database being generated at the second mobile device by;

obtaining, using at least one imaging device of the second mobile device, at least one image including a pixel pattern; and

processing, using a processor of the second mobile device, each of the at least one obtained image based in part on a position of the second mobile device when the at least one image was obtained to derive the positional information about the pixel pattern;

searching, at the first mobile device, through the database of pixel patterns received from the second mobile device for a pixel pattern that most closely matches the pixel pattern in the obtained at least one image;

retrieving from the database as a result of the searching, positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image; and

providing data to the first mobile device dependent on the retrieved positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image.

2. The method of claim 1, further comprising:

modifying the database of pixel patterns with positional information at the first mobile device by;

obtaining, using the at least one imaging device of the first mobile device, at least one image including a pixel pattern; and

processing, using a processor of the first mobile device, each of the at least one obtained image based in part on a position of the first mobile device when the at least one image was obtained to derive positional information about the pixel pattern.

3. The method of claim 1, wherein, after being received from the second mobile device, the database is entirely resident on the first mobile device.

4. The method of claim 1, wherein the step of processing, using the processor of the second mobile device, each of the at least one obtained image based in part on a position of the second mobile device when the at least one image was obtained to derive the positional information about the pixel pattern comprises

processing, using the processor of the second mobile device, each of the at least one obtained image based in part on a position of the second mobile device when the at least one image was obtained and at least one of a size of the pixel pattern in the image and angular orientation of the pixel pattern relative to an imaging direction in which the image was obtained by the second mobile device to derive the positional information about the pixel pattern.

5. The method of claim 1, wherein the step of obtaining, using the at least one imaging device of the first mobile device, at least one image comprises obtaining the at least one image using a panoramic camera attached to the first mobile device.

6. The method of claim 1, wherein the first mobile device is a pilotless drone.

7. The method of claim 1, wherein the step of providing data to the first mobile device dependent on the retrieved positional information comprises displaying on a screen of the first mobile device, indications of the position of the first mobile device and surrounding structure.

8. The method of claim 1, wherein the step of providing data to the first mobile device dependent on the retrieved positional information comprises displaying on a screen of the first mobile device, indications of the position of the first mobile device and the position of the pixel pattern in the obtained at least one image.

9. The method of claim 1, wherein the step of providing data to the first mobile device dependent on the retrieved positional information comprises displaying on a screen of the first mobile device, indications of the position of the first mobile device and surrounding structure, and the position of the pixel pattern in the obtained at least one image.

10. The method of claim 1, wherein the step of providing data to the first mobile device dependent on the retrieved positional information comprises displaying on a screen of the first mobile device, a map including the position of the first mobile device.

11. The method of claim 1, wherein the step of providing data to the first mobile device dependent on the retrieved positional information comprises providing data configured to visually convey information on a display of the first mobile device.

12. The method of claim 1, wherein the step of providing data to the first mobile device dependent on the retrieved positional information comprises providing data configured to audibly convey information via the first mobile device.

13. A navigation method, comprising:

determining an initial position of the first mobile device to be guided as according to the method of claim 1, and then

guiding movement of the first mobile device, after the initial position of the first mobile device is determined, by analyzing using the processor of the first mobile device, movement of the first mobile device relative to the initial position.

14. The method of claim 13, wherein the step of guiding movement of the first mobile device comprises obtaining multiple images each including a common pixel pattern and obtained at different times separated by movement of the first mobile device and analyzing, using the processor of the first mobile device, the multiple images to determine relative movement of the first mobile device.

15. The method of claim 13, wherein the step of guiding movement of the first mobile device comprises obtaining multiple images at different times separated by movement of the first mobile device and analyzing, using the processor of the first mobile device, changes in patterns in the multiple images to determine relative movement of the first mobile device.

16. The method of claim 13, further comprising:

determining an accurate updated position of the first mobile device to be guided, after the movement of the first mobile device has been guided by analyzing movement of the first mobile device relative to the initial position; and

then

using this updated position, guiding movement of the first mobile device, after the updated position of the first mobile device is determined, by analyzing using the processor of the first mobile device, movement of the first mobile device relative to the updated position.

17. The method of claim 13, wherein the first mobile device is a pilotless drone.

18. The method of claim 1, further comprising:

analyzing, using the processor of the first mobile device, in combination with the retrieved positional information, a difference between the most closely matching pixel pattern and the pixel pattern in the obtained at least one image to derive positional information about a position of the first mobile device which is different than the retrieved positional information, and

wherein the step of providing data to the first mobile device dependent on the retrieved positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image comprises providing data to the first mobile device dependent on the derived positional information about the position of the first mobile device.

19. A computer program embodied on non-transitory computer-readable medium and configured to:

generate a database containing pixel patterns and positional information about the pixel patterns by;

directing at least one imaging device of a first mobile device to obtain images each including a pixel pattern; and

directing a processor of the first mobile device to process each obtained image based in part on a position of the first mobile device when the at least one image was obtained to derive the positional information about the pixel pattern;

provide the database to a second mobile device from the first mobile device to enable the second mobile device to obtain position-based information based on analysis of pixel patterns with reference to the database; and

provide position-based information to the first mobile device by

directing the at least one imaging device of the first mobile device to obtain at least one image including a stationary pixel pattern;

directing the processor to search through the database of pixel patterns for a pixel pattern that most closely matches the pixel pattern in the obtained at least one image;

directing the processor to retrieve from the database as a result of the searching, positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image;

obtaining data dependent on the retrieved positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image; and

conveying the obtained data via a data output device of the first mobile device.

20. A method for using a mobile device, comprising:

generating, at the mobile device, a database containing pixel patterns and positional information about the pixel patterns by;

obtaining, using at least one imaging device of the mobile device, at least one image including a pixel pattern; and

processing, using a processor of the mobile device, each of the at least one obtained image based in part on a position of the mobile device when the at least one image was obtained to derive the positional information about the pixel pattern;

providing the database, generated at the mobile device, to another mobile device; and

after the database is generated,

providing position-based information to the mobile device by

obtaining, using the at least one imaging device, at least one image including a stationary pattern;

searching through the database of pixel patterns for a pixel pattern that most closely matches the pixel pattern in the obtained at least one image;

retrieving from the database as a result of the searching, positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image; and

providing data to the mobile device dependent on the retrieved positional information about one of the pixel patterns that is deemed to most closely match the pixel pattern in the obtained at least one image.