Extended fingerprint generation

• US 9,304,970 B2
• Filed: 05/19/2010
• Issued: 04/05/2016
• Est. Priority Date: 05/19/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Wirola, Lauri, Syrjarinne, Jari
• Primary Examiner(s): Raymond, Edward
• Application Number:
  US13/697,604
• Publication Number:
  US 20130116968A1
• Time in Patent Office: 2,148 Days
• Field of Search: 702/150, 702/151, 702/155, 702182-185, 702/188
• US Class Current: 1/1
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 5/02522 The radio-map containing measured values of non-radio values
• CPC Class Codes: G01S 5/02526 using non-dedicated equipment, e.g. user equipment or crowd-sourcing
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management

Abstract

A system for creating a representation of a location based on information sensed at the location. For example, apparatuses may comprise various sensors that sense apparatus-related information (e.g., motion, direction, etc.) while also visual, signal, field, etc. information pertaining to a location. Apparatuses may store sensed information about the apparatus while at a particular location, and about the particular location itself, in a mapping database, which may then associate the various types of sensed information with information already stored in the database in order to create a representation of the location.

Claims

1. A method, comprising:

determining in an apparatus whether to initiate information sensing at an instance in time, wherein information sensing at the instance in time comprises;

performing at least two of;

(1) sensing the motion of the apparatus and recording the sensed motion information;

(2) sensing visual information corresponding to a location, extracting visual elements from the sensed visual information and recording the extracted visual elements; and

(3) sensing at least one of electromagnetic signal and magnetic field information and recording the at least one of sensed signal and field information;

correlating at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information to generate correlated sensed information corresponding to the instance in time; and

storing the correlated sensed information corresponding to the instance in time in association with stored correlated sensed information corresponding to previous instances in time.

2. The method of claim 1, wherein sensing the motion of the apparatus comprises sensing at least one of direction, motion and acceleration.

3. The method of claim 1, wherein sensing visual information comprises sensing at least one of video and still image information.

4. The method of claim 3, wherein extracting visual elements from the sensed visual information comprises defining one or more physical features of the location from the at least one of video and still image information.

5. The method of claim 1, wherein correlating at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information comprises calculating dimensions by evaluating the sensed motion information in view of time information based on the instance in time.

6. The method of claim 5, wherein correlating at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information further comprises determining one or more of orientation, dimension and position for the extracted visual elements based on the at least one of sensed signal and field information and the calculated dimensions.

7. The method of claim 1, wherein the correlated sensed information corresponding to the instance in time is associated with stored correlated sensed information corresponding to previous instances in time based at least on the extracted visual elements.

8. A computer program product comprising computer executable program code recorded on a non-transitory computer readable storage medium, the computer executable program code comprising:

code configured to cause an apparatus to determine whether to initiate information sensing at an instance in time, wherein code for causing the apparatus to perform information sensing at the instance in time further comprises;

code configured to cause the apparatus to perform at least two of;

(1) sensing the motion of the apparatus and recording the sensed motion information;

(2) sensing visual information corresponding to a location, extracting visual elements from the sensed visual information and recording the extracted visual elements; and

(3) sensing at least one of electromagnetic signal and magnetic field information and recording the at least one of sensed signal and field information;

code configured to cause the apparatus to correlate at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information to generate correlated sensed information corresponding to the instance in time; and

code configured to cause the apparatus to store the correlated sensed information corresponding to the instance in time in association with stored correlated sensed information corresponding to previous instances in time.

9. The computer program product of claim 8, wherein sensing the motion of the apparatus comprises sensing at least one of direction, motion and acceleration.

10. The computer program product of claim 8, wherein sensing visual information comprises sensing at least one of video and still image information.

11. The computer program product of claim 10, wherein the code configured to cause the apparatus to extract visual elements from the sensed visual information further comprises code configured to cause the apparatus to define one or more physical features of the location from the at least one of video and still image information.

12. The computer program product of claim 8, wherein the code configured to cause the apparatus to correlate at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information further comprises code configured to cause the apparatus to calculate dimensions by evaluating the sensed motion information in view of time information based on the instance in time.

13. The computer program product of claim 12, wherein the code configured to cause the apparatus to correlate at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information further comprises the code configured to cause the apparatus to determine one or more of orientation, dimension and position for the extracted visual elements based on the at least one of sensed signal and field information and the calculated dimensions.

14. The computer program product of claim 8, wherein the correlated sensed information corresponding to the instance in time is associated with stored correlated sensed information corresponding to previous instances in time based at least on the extracted visual elements.

15. An apparatus, comprising:

at least one processor; and

at least one memory including executable instructions, the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to perform at least the following;

determine whether to initiate information sensing at an instance in time, wherein information sensing at the instance in time comprises;

performing at least two of;

(1) sensing the motion of the apparatus and recording the sensed motion information;

(2) sensing visual information corresponding to a location, extracting visual elements from the sensed visual information and recording the extracted visual elements; and

(3) sensing at least one of electromagnetic signal and magnetic field information and recording the at least one of sensed signal and field information;

correlate at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information to generated correlated sensed information corresponding to the instance in time; and

store the correlated sensed information corresponding to the instance in time in association with stored correlated sensed information corresponding to previous instances in time.

16. The apparatus of claim 15, wherein the apparatus further comprises motion sensing resources comprising at least one of directional, motion and acceleration sensors.

17. The apparatus of claim 15, wherein the apparatus further comprises visual sensing resources comprising a camera and the visual information is at least one of video and still image information.

18. The apparatus of claim 17, wherein the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to extract visual elements from the sensed visual information further comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to define one or more physical features of the location from the at least one of video of and still image information.

19. The apparatus of claim 15, wherein the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to correlate at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information further comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to calculate dimensions by evaluating the sensed motion information in view of time information based on the instance in time.

20. The apparatus of claim 19, wherein the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to correlate at least two of the sensed motion information, the extracted visual elements and the at least one of sensed signal and field information further comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to determine one or more of orientation, dimension and position for the extracted visual elements based on the at least one of sensed signal and field information and the calculated dimensions.

21. The apparatus of claim 15, wherein the correlated sensed information corresponding to the instance in time is associated with stored correlated sensed information corresponding to previous instances in time based at least on the extracted visual elements.