Position determining techniques using image analysis of marks with encoded or associated position data

• US 9,881,378 B2
• Filed: 02/12/2016
• Issued: 01/30/2018
• Est. Priority Date: 02/12/2016
• Status: Active Grant

• Current Assignee: Vortex Intellectual Property Holding LLC
• Original Assignee: Vortex Intellectual Property Holding LLC
• Inventors: Houri, Cyril
• Primary Examiner(s): Do, Anh H
• Application Number:
  US15/042,254
• Publication Number:
  US 20170236285A1
• Time in Patent Office: 718 Days
• Field of Search: 382233, 382232, 382190, 382103, 235380, 235382, 235435, 34099516, 353 15, 353 69, 353 70, 369103, 701455
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/225 based on a marking or identifier characterising the area
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps

Abstract

Method for determining position of a mobile device having an imaging device includes obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position, decoding the mark to derive data about the position of the mark using a database of marks and their positions, and analyzing appearance of the mark in the image in combination with the derived data about the position of the mark to derive the position of the mobile device. Mark appearance analysis may involve analyzing an angle between an imaging direction of the imaging device and a surface of the mark.

Claims

1. A method for determining position of a mobile device having an imaging device, comprising:

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark; and

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device,

the analyzing step comprising analyzing an angle between an imaging direction of the imaging device and a surface of the mark using the processor.

2. The method of claim 1, wherein the mark is a two-dimensional mark.

3. The method of claim 1, wherein the known-position object is an object fixed in position.

4. The method of claim 1, wherein the analyzing step is performed on the mobile device.

5. The method of claim 1, wherein the decoding step comprises accessing a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks.

6. The method of claim 1, wherein the decoding step comprises:

wirelessly transmitting the mark to a site remote from the mobile device, a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks being accessed at the remote site to output the position of the mark wirelessly transmitted from the mobile device; and

receiving at the mobile device from the remote site, the data about the position of the mark output from the database.

7. A method for destination guiding using an imaging device of a mobile device, comprising;

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark;

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device;

determining a target location in response to receiving user input by means of a user interface coupled to the mobile device;

determining, using the processor, a route between the position of the imaging device and the target location; and

marking the route on a map and displaying the map with the marked route on the mobile device,

the analyzing step comprising analyzing an angle between an imaging direction of the imaging device and a surface of the mark using the processor.

8. The method of claim 7, wherein the target location is a retail establishment, an entertainment venue, a residence or a business.

9. The method of claim 7, wherein the decoding step comprises accessing a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks.

10. The method of claim 7, wherein the decoding step comprises:

wirelessly transmitting the mark to a site remote from the mobile device, a database resident in at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks being accessed at the remote site to output the position of the mark wirelessly transmitted from the mobile device; and

receiving at the imaging device from the remote site, the data about the position of the mark output from the database.

11. A method for selecting information for presentation on a mobile device including an imaging device, comprising;

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark;

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device;

determining information to present, from among a plurality of different information items, based on the position of the imaging device; and

presenting the information using an output device of the mobile device,

the analyzing step comprising analyzing an angle between an imaging direction of the imaging device and a surface of the mark using the processor.

12. The method of claim 11, wherein the decoding step comprises accessing a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks.

13. The method of claim 11, wherein the decoding step comprises:

wirelessly transmitting the mark to a site remote from the mobile device, a database resident in at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks being accessed at the remote site to output the position of the mark wirelessly transmitted from the mobile device; and

receiving at the imaging device from the remote site, the data about the position of the mark output from the database.

14. A method implemented at a server to provide position data about mobile devices, comprising:

maintaining a database resident on at least one memory component accessible to the server and containing data about a plurality of marks and the position of each of the plurality of marks;

wirelessly receiving at the server from a mobile device, an image including a mark obtained by an imaging device of the mobile device using a communications device at the server;

accessing the database, using a processor at the server, to obtain the position of the mark as output from the database upon inputting the mark in the received image;

analyzing appearance of the mark in the received image, using the processor, in combination with the position of the mark output from the database to derive position of the imaging device which is considered position of the mobile device; and

generating a transmission to the mobile device to cause a positional information providing system to change data about position of the mobile device being provided by the positional information providing system.

15. The method of claim 14, further comprising wirelessly transmitting the position of the imaging device from the server to the mobile device.

16. The method of claim 14, wherein the positional information providing system is a display of the mobile device, further comprising:

receiving a target location from the mobile device; and

determining a route between the position of the mobile device and the received target location;

the transmission generating step comprising generating a transmission including the determined route to enable the determined route to be marked on a map displayed on the display of the mobile device.

17. The method of claim 14, wherein the positional information providing system is a display of the mobile device, further comprising:

determining information to present, from among a plurality of different information items, based on the position of the imaging device; and

the transmission generating step comprising generating a transmission including the determined information to enable the determined information to be displayed on the display of the mobile device.

18. A method for determining position of a mobile device having an imaging device, comprising:

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark; and

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device,

the decoding step comprising accessing a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks.

19. A method for determining position of a mobile device having an imaging device, comprising:

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark; and

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device,

the decoding step comprising;

wirelessly transmitting the mark to a site remote from the mobile device, a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks being accessed at the remote site to output the position of the mark wirelessly transmitted from the mobile device; and

receiving at the mobile device from the remote site, the data about the position of the mark output from the database.

20. A method for destination guiding using an imaging device of a mobile device, comprising;

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark;

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device;

determining a target location in response to receiving user input by means of a user interface coupled to the mobile device;

determining, using the processor, a route between the position of the imaging device and the target location; and

marking the route on a map and displaying the map with the marked route on the mobile device,

the decoding step comprises accessing a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks.

21. A method for destination guiding using an imaging device, comprising;

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark;

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device;

determining a target location in response to receiving user input by means of a user interface coupled to the mobile device;

determining, using the processor, a route between the position of the imaging device and the target location; and

marking the route on a map and displaying the map with the marked route on the mobile device,

the decoding step comprising;

wirelessly transmitting the mark to a site remote from the mobile device, a database resident in at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks being accessed at the remote site to output the position of the mark wirelessly transmitted from the mobile device; and

receiving at the imaging device from the remote site, the data about the position of the mark output from the database.

22. A method for selecting information for presentation on a mobile device including an imaging device, comprising;

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark;

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device;

determining information to present, from among a plurality of different information items, based on the position of the imaging device; and

presenting the information using an output device of the mobile device,

the decoding step comprising accessing a database resident on at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks.

23. A method for selecting information for presentation on a mobile device including an imaging device, comprising;

obtaining an image of a mark on a known-position object from the imaging device, the mark having an encoded position;

decoding the mark, using a processor, to derive data about the position of the mark;

analyzing appearance of the mark in the image in combination with the derived data about the position of the mark, using the processor, to derive the position of the imaging device;

determining information to present, from among a plurality of different information items, based on the position of the imaging device; and

presenting the information using an output device of the mobile device,

the decoding step comprising;

wirelessly transmitting the mark to a site remote from the mobile device, a database resident in at least one memory component and containing data about a plurality of marks and the position of each of the plurality of marks being accessed at the remote site to output the position of the mark wirelessly transmitted from the mobile device; and

receiving at the imaging device from the remote site, the data about the position of the mark output from the database.