Provision of target specific information

• US 9,451,219 B2
• Filed: 12/31/2004
• Issued: 09/20/2016
• Est. Priority Date: 12/31/2004
• Status: Expired due to Fees

• Current Assignee: Piece Future Pte., Ltd.
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Paalasmaa, Joonas, Kahari, Markus, Sorvari, Antti
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): LE, TUAN H
• Application Number:
  US11/791,629
• Publication Number:
  US 20070268392A1
• Time in Patent Office: 4,281 Days
• Field of Search: 34833301-33309
• US Class Current: 1/1
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01S 19/51 Relative positioning
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management

Abstract

The invention concerns an electronic device for providing information (PUB_INFO, PERSON1_INFO) concerning one or more targets (PUB, PERSON1), relative to which target the device is to be aligned in a set manner, and in connection with which device are arranged at least one source (GPS, BM, COMP, TS, MEM) of first information (X, Y, ALT, O_device, IMSI_10.1), including at least a source of position and orientation information, in order to define the position of the device and the target, or for positioning the target and an aimer (CAM, DISP) for aligning the target relative to the device in a set manner, and in connection with which device, second information relating to the target can be arranged, which second information is arranged, in connection with the application of the aimer, to be brought to the attention of the user by the device. The aimer consists of a camera and a viewfinder (CAM, DISP).

Claims

1. An apparatus comprising:

a processor; and

at least one memory including computer program instructions,

the at least one memory and the computer program instructions configured to, with the processor, cause the apparatus to perform at least the following;

determine position and orientation information of the apparatus when the apparatus captures an image of a target object shown in a viewfinder of the apparatus,

determine a distance between the target object and the apparatus based on one or more zoom settings of the viewfinder, distance sensor data collected by the apparatus, or a combination thereof,

transmit an information request via a network to a source, wherein the information request includes the position and orientation information of the apparatus and the distance without the image,

receive feedback information corresponding to the target object via the network from the source, wherein the feedback information includes identification of the target object, and

display a real-time image of the target object and the feedback information concurrently in the viewfinder,

wherein the target object is identified by the source based on the position and orientation information of the apparatus and the distance without using the image.

2. The apparatus according to claim 1, wherein the feedback information includes audio data.

3. The apparatus according to claim 1, wherein the apparatus is further caused to:

calculate a location and an altitude of the target object based on the distance, and the position and orientation information of the apparatus.

4. The apparatus according to claim 3, wherein the target object is at least partially blocked by an obstacle in the viewfinder.

5. The apparatus according to claim 3, wherein the target object is at least partially blocked by an obstacle in the viewfinder.

6. The apparatus according to claim 1, wherein the feedback information concerning the target object includes at least one reference to the network, which when activated, initiates downloading additional information concerning the target object to the apparatus.

7. A method comprising:

determining, at an apparatus, position and orientation information of the apparatus when the apparatus captures an image of a target object shown in a viewfinder of the apparatus;

determining, at the apparatus, a distance between the target object and the apparatus based on one or more zoom settings of the viewfinder, distance sensor data collected by the apparatus, or a combination thereof;

transmitting an information request from the apparatus via a network to a source, wherein the information request includes the position and orientation information of the apparatus and the distance without the image;

receiving feedback information corresponding to the target object from the source via the network to the apparatus, wherein the feedback information includes identification of the target object; and

displaying a real-time image of the target object and the feedback information concurrently in the viewfinder,

wherein the target object is identified by the source based on the position and orientation information of the apparatus and the distance without using the image.

8. The method according to claim 7, wherein the feedback information includes audio data.

9. The method according to claim 7, further comprising:

calculating a location and an altitude of the target object based on the distance, and the position and orientation information of the apparatus.

10. The method according to claim 7, wherein the feedback information concerning the target object includes at least one reference to the network, which when activated, initiates downloading additional information concerning the target object to the apparatus.

11. The method according to claim 7, wherein the target object is at least partially blocked by an obstacle in the viewfinder.

12. An apparatus comprising:

a processor; and

at least one memory including computer program instructions,

the at least one memory and the computer program instructions configured to, with the processor, cause the apparatus embedded in a source to perform at least the following;

receive via a network an information request addressed to the source, wherein the information request includes position and orientation information of a user device when the user device captures an image of a target object shown in a viewfinder of the user device and the information request excludes the image;

determine a distance between the target object and the user device based on one or more zoom settings of the viewfinder, distance sensor data collected by the user device, or a combination thereof;

determine an identification of the target object by calculating a location and an altitude of the target object based on the position and orientation information of the user device and the distance without the image; and

transmit feedback information corresponding to the target object from the source via the network to the user device, wherein the feedback information includes the identification of the target object.

13. The apparatus according to claim 12, wherein the feedback information concerning the target object includes at least one reference to the network, which when activated at the user device, initiates downloading additional information concerning the target object to the user device.

14. A method comprising:

receiving, by an apparatus via a network, an information request addressed to the apparatus, wherein the information request includes position and orientation information of a user device when the user device captures an image of a target object shown in a viewfinder of the user device and the information request excludes the image;

determining, by the apparatus, a distance between the target object and the user device based on one or more zoom settings of the viewfinder, distance sensor data collected by the user device, or a combination thereof;

determining, by the apparatus, an identification of the target object by calculating a location and an altitude of the target object based on the position and orientation information of the user device and the distance without the image; and

transmitting feedback information corresponding to the target object from the apparatus via the network to the user device, wherein the feedback information includes the identification of the target object.

15. The method according to claim 14, wherein the feedback information concerning the target object includes at least one reference to the network, which when activated at the user device, initiates downloading additional information concerning the target object to the user device.

16. The method according to claim 15, wherein the target object is at least partially blocked by an obstacle in the viewfinder.