Provision of target specific information

• US 9,596,414 B2
• Filed: 08/01/2016
• Issued: 03/14/2017
• Est. Priority Date: 12/31/2004
• Status: Expired due to Fees

• Current Assignee: Piece Future Pte., Ltd.
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Paalasmaa, Joonas, Kahari, Markus, Sorvari, Antti
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): LE, TUAN H
• Application Number:
  US15/225,334
• Publication Number:
  US 20160344939A1
• Time in Patent Office: 225 Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01S 19/51 Relative positioning
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management

Abstract

The invention concerns an electronic device (10) for providing information (PUB_INFO, PERSON1_INFO) concerning one or more targets (PUB, PERSON1), relative to which target the device is to be aligned in a set manner, and in connection with which device are arranged—at least one source (GPS, BM, COMP, TS, MEM) of first information (X, Y, ALT, O_device, IMSI_10.0), including at least a source of position and orientation information, in order to define the position of the device and the target, or for positioning the target and—aiming means (CAM, DISP) for aligning the target relative to the device in a set manner, and in connection with which device, second information relating to the target can be arranged, which second information is arranged, in connection with the application of the aiming means, to be brought to the attention of the user by means of the device. The aiming means consist camera and viewfinder means (CAM, DISP).

Claims

1. A method comprising:

determining, at an apparatus, position and orientation information of the apparatus when a field of view of a viewfinder of the apparatus covers a target object;

determining, at the apparatus, a distance between the target object and the apparatus based on one or more zoom settings of the viewfinder, distance sensor data collected by the apparatus, or a combination thereof;

transmitting an information request from the apparatus via a network to another apparatus, wherein the information request includes the position and orientation information of the apparatus and the distance;

receiving feedback information corresponding to the target object from the another apparatus via the network to the apparatus, wherein the feedback information includes identification of the target object; and

rendering the feedback information in the viewfinder, a sound-reproducing device, or a combination thereof,

wherein the target object is identified by the another apparatus based on the position and orientation information of the apparatus and the distance without using image recognition.

2. A method of claim 1, further comprising:

rendering, in the viewfinder, the feedback information concurrently with an image of the target object, a current position of the target object, audio data relayed to the target object, or a combination thereof.

3. A method of claim 2, further comprising:

continuously receiving the feedback information corresponding to the target object from the another apparatus via the network to the apparatus, when target object moves out of the field of view of the viewfinder, wherein the feedback information includes a direction to turn the viewfinder to the target object after moving.

4. A method of claim 3, further comprising:

rendering, in the viewfinder, the feedback information concurrently with an image of the target object, a current position of the target object, audio data relayed to the target object, or a combination thereof.

5. A method of claim 1, further comprising:

cropping out from the viewfinder one or more objects other than the target object;

taking at least one image form the viewfinder as cropped; and

displaying, in the viewfinder, the feedback information concurrently with the at least one image.

6. A method of claim 5, wherein the cropping is done using the one or more zoom settings of the viewfinder.

7. A method of claim 1, wherein the another apparatus is a server or a user device.

8. An apparatus comprising:

a processor, and

at least one memory including computer program instructions,

the at least one memory and the computer program instructions configured to, with the processor, cause the apparatus to perform at least the following;

determine position and orientation information of the apparatus when a target object is shown in a viewfinder of the apparatus,

determine position and orientation information of the apparatus when a field of view of a viewfinder of the apparatus covers a target object;

determine a distance between the target object and the apparatus based on one or more zoom settings of the viewfinder, distance sensor data collected by the apparatus, or a combination thereof;

transmit an information request from the apparatus via a network to another apparatus, wherein the information request includes the position and orientation information of the apparatus and the distance;

receive feedback information corresponding to the target object from the another apparatus via the network to the apparatus, wherein the feedback information includes identification of the target object; and

render the feedback information in the viewfinder, a sound-reproducing device, or a combination thereof,

wherein the target object is identified by the another apparatus based on the position and orientation information of the apparatus and the distance without using image recognition.

9. An apparatus of claim 8, wherein the apparatus is further caused to:

render, in the viewfinder, the feedback information concurrently with an image of the target object, a current position of the target object, audio data relayed to the target object, or a combination thereof.

10. An apparatus of claim 9, wherein the apparatus is further caused to:

continuously receive the feedback information corresponding to the target object from the another apparatus via the network to the apparatus, when target object moves out of the field of view of the viewfinder, wherein the feedback information includes a direction to turn the viewfinder to the target object after moving.

11. An apparatus of claim 10, wherein the apparatus is further caused to:

render, in the viewfinder, the feedback information concurrently with an image of the target object, a current position of the target object, audio data relayed to the target object, or a combination thereof.

12. An apparatus of claim 8, wherein the apparatus is further caused to:

crop out from the viewfinder one or more objects other than the target object;

take at least one image form the viewfinder as cropped; and

display, in the viewfinder, the feedback information concurrently with the at least one image.

13. An apparatus of claim 12, wherein the cropping is done using the one or more zoom settings of the viewfinder.

14. An apparatus of claim 8, wherein the another apparatus is a server or a user device.

15. A method comprising:

receiving, by an apparatus from a plurality of ad hoc devices via a network, information requests addressed to the apparatus, wherein each of the information request includes position and orientation information of each of the ad hoc devices when a target object moves in a filed of view of a viewfinder of the each ad hoc device;

determining, by the apparatus, a distance between the target object and the each ad hoc device based on one or more zoom settings of the viewfinder, distance sensor data collected by the each ad hoc device, or a combination thereof;

determining, by the apparatus, an identification of the target object by calculating a location and an altitude of the target object based on the position and orientation information of the each ad hoc device and the distance; and

transmitting feedback information corresponding to the target object from the apparatus via the network to the each ad hoc device, wherein the feedback information includes the identification of the target object.

16. A method of claim 15, further comprising:

continuously transmitting the feedback information corresponding to the target object from the apparatus via the network to the each ad hoc device, when target object continues moving,

wherein the feedback information includes a direction to turn the viewfinder, when the target object moves out of the field of view of the viewfinder.

17. A method of claim 15, wherein the apparatus is a server or a user device.

18. An apparatus comprising:

a processor, and

at least one memory including computer program instructions,

the at least one memory and the computer program instructions configured to, with the processor, cause the apparatus to perform at least the following;

receive, from a plurality of ad hoc devices via a network, information requests addressed to the apparatus, wherein each of the information request includes position and orientation information of each of the ad hoc devices when a target object moves in a filed of view of a viewfinder of the each ad hoc device;

determine a distance between the target object and the each ad hoc device based on one or more zoom settings of the viewfinder, distance sensor data collected by the each ad hoc device, or a combination thereof;

determine an identification of the target object by calculating a location and an altitude of the target object based on the position and orientation information of the each ad hoc device and the distance; and

transmit feedback information corresponding to the target object from the apparatus via the network to the each ad hoc device, wherein the feedback information includes the identification of the target object.

19. An apparatus of claim 18, wherein the apparatus is further caused to:

continuously transmit the feedback information corresponding to the target object from the apparatus via the network to the each ad hoc device, when target object continues moving,

wherein the feedback information includes a direction to turn the viewfinder, when the target object moves out of the field of view of the viewfinder.

20. An apparatus of claim 18, wherein the apparatus is a server or a user device.