Crowd sourced vision and sensor-surveyed mapping

• US 9,641,814 B2
• Filed: 05/19/2010
• Issued: 05/02/2017
• Est. Priority Date: 05/19/2010
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Wirola, Lauri, Syrjarinne, Jari
• Primary Examiner(s): Karikari, Kwasi
• Application Number:
  US13/697,589
• Publication Number:
  US 20130201365A1
• Time in Patent Office: 2,540 Days
• Field of Search: 4554561
• CPC Class Codes: G01S 5/0264 at least one of the systems being a non-radio wave positioning system
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management

Abstract

A system for enhancing the provision of location information based on previously stored visual data. Apparatuses may utilize sensors to sense at least visual information at a location. The sensed visual information may include attributes that may be defined as one or more visual elements in the recorded visual information. The one or more visual elements may then be stored in a mapping database in association with the location.

Claims

1. A method, comprising:

utilizing sensing resources in an apparatus to sense at least visual information corresponding to the location of the apparatus;

utilizing the sensing resources in the apparatus to sense electronic signals and/or fields at the location of the apparatus;

identifying attributes of the location by defining one or more visual elements within the visual information corresponding to the attributes;

extracting the defined one or more visual elements from the sensed visual information; and

creating a representation of the location in a mapping database by recording the extracted one or more visual elements, rather than the sensed visual information, in association with the location in the mapping database,

wherein recording the extracted one or more visual elements in association with the location in the mapping database comprises determining if any of the extracted one or more visual elements already exist in the mapping database by at least using the electronic signals and/or fields sensed at the location to find the extracted one or more visual elements in the mapping database.

2. The method of claim 1, wherein the sensing resources comprise at least a camera and the visual information is an electronic image captured at the location.

3. The method of claim 1, wherein the attributes of the location may comprise physical objects, hallways, doorways, shapes or colors in the location.

4. The method of claim 1, wherein recording the one or more visual elements in association with the location in the mapping database comprises identifying the location as a new location when the one or more visual elements do not already exist in the mapping database.

5. The method of claim 1, wherein the mapping database comprises representations for one or more locations that are combined together in the mapping database to form a map, the one or more locations being combined together based at least on common visual elements in the one or more visual elements corresponding to each representation of a location.

6. The method of claim 5, wherein the map corresponds to a structure interior, the representations of locations corresponding to areas within the structure interior.

7. A computer program product comprising computer executable program code recorded on a non-transitory computer readable storage medium, the computer executable program code comprising:

code configured to cause an apparatus to perform the method of claim 1.

8. An apparatus, comprising:

at least one processor; and

at least one memory including executable instructions, the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to perform at least the following;

utilize sensing resources in an apparatus to sense at least visual information corresponding to the location of the apparatus;

utilize the sensing resources in the apparatus to sense electronic signals and/or fields at the location of the apparatus;

identify attributes of the location by defining one or more visual elements within the visual information corresponding to the attributes;

extract the defined one or more visual elements from the sensed visual information; and

create a representation of the location in a mapping database by recording the extracted one or more visual elements, rather than the sensed visual information, in association with the location in the mapping database,

wherein recording the extracted one or more visual elements in association with the location in the mapping database comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to determine if any of the extracted one or more visual elements already exist in the mapping database by at least using the electronic signals and/or fields sensed at the location to find the extracted one or more visual elements in the mapping database.

9. The apparatus of claim 8, wherein the sensing resources comprise at least a camera and the visual information is an electronic image captured at the location.

10. The apparatus of claim 8, wherein the attributes of the location may comprise physical objects, hallways, doorways, shapes or colors in the location.

11. The apparatus of claim 8, wherein recording the one or more visual elements in association with the location in the mapping database further comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to identify the location as a new location when the one or more elements do not already exist in the mapping database.

12. The apparatus of claim 8, wherein the mapping database comprises representations for one or more locations that are combined together in the mapping database to form a map, the one or more locations being combined together based at least on common visual elements in the one or more visual elements corresponding to each representation of a location.

13. The apparatus of claim 12, wherein the map corresponds to a structure interior, the representations of locations corresponding to areas within the structure interior.

14. A system, comprising:

an apparatus; and

a mapping database;

the apparatus utilizing sensing resources in the apparatus to sense at least visual information corresponding to the location of the apparatus and identifying attributes of the location by defining one or more visual elements within the visual information corresponding to the attributes;

the apparatus further utilizing the sensing resources in the apparatus to sense electronic signals and/or fields at the location of the apparatus;

the apparatus further extracting the defined one or more visual elements from the sensed visual information; and

the apparatus further creating a representation of the location in the mapping database by recording the extracted one or more visual elements, rather than the sensed visual information, in association with the location in the mapping database,

wherein recording the extracted one or more visual elements in association with the location in the mapping database comprises the apparatus determining if any of the extracted one or more visual elements already exist in the mapping database by at least using the electronic signals and/or fields sensed at the location to find the extracted one or more visual elements in the mapping database.