DEVICES AND METHODS FOR LOCALIZATION OF MULTIPLE DEVICES

• US 20180189972A1
• Filed: 06/23/2016
• Published: 07/05/2018
• Est. Priority Date: 06/30/2015
• Status: Abandoned Application

• Current Assignee: Thomson Licensing (Vantiva SA)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Application Number:
  US15/741,161
• Publication Number:
  US 20180189972A1
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 3/147 using affine transformations
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04W 4/02 Services making use of location information

Abstract

Seamless localization of multiple devices, by matching overlaps between images captured by the devices. A first device (201) sends a request (300) to other devices (211, 221, 231), receives the images captured by their cameras (311, 312, 313) and rotates them according to the orientations of the capture devices towards a determined direction. Overlaps between images are detected and corresponding positions of the devices are computed (330) from these overlaps. Finally, the positions are sent back (350) to the devices. Metadata related to image and devices can be used to scale the captured images, thus allowing to use simpler image processing algorithms. Methods and devices are claimed.

Claims

1. A method for localization of a set of second devices, the method comprising at a processor of a first device:

receiving, from the second devices to be localized, at least an image captured by the second device and an orientation angle of the second device towards a common determined direction;

rotating each received image of an angle, wherein the value of the angle is the opposite value to the orientation angle of the second device towards the common determined direction;

detecting overlapping areas between the rotated images;

determining, using detected overlapping areas, geometrical transformations between the captured images;

determining, using determined geometrical transformations, the corresponding positions of the second devices; and

sending to at least one of the second devices its position.

2. The method according to claim 1 wherein the common determined direction is the south-north direction to the magnetic North pole.

3. The method according to claim 1 further comprising receiving from the second devices metadata related to at least one of the device and the image.

4. The method according to claim 3 comprising scaling the captured image so that the pixel dimensions correspond to a determined size.

9. Computer program comprising program code instructions executable by a processor for implementing the steps of a method according to claim 1.

10. Computer program product which is stored on a non-transitory computer readable medium and comprises program code instructions executable by a processor for implementing the steps of a method according to claim 1.

5. A data processing device for localization of a set of second devices, comprising:

an interface configured to;

receive at least a captured image from the second devices and an orientation of the second device towards a common determined direction; and

send to the second devices their localization positions; and

a processor configured to;

send a localization request to at least a second device;

receive, from the second devices to be localized, at least an image captured by the second device and an orientation angle of the second device towards a common determined direction;

rotate each received image of an angle, wherein the value of the angle is the opposite value to the orientation angle of the second device towards the common determined direction;

detect overlapping areas between the rotated images;

determine, using detected overlapping areas, geometrical transformations between the captured images;

determine, using determined geometrical transformations, the corresponding positions of the second devices; and

send to the second devices their localization positions.

6. The device according to claim 5, further comprising:

a camera positioned on the same side as the screen and configured to capture an image of the scene facing the screen;

a magnetometer configured to measure the orientation towards a determined direction;

a screen configured to display application data to the user;

an interface configured to send the captured image to the first device; and

a processor configured to;

capture an image of the scene facing the screen through the integrated camera.

7. The device according to claim 5 wherein the interface is further configured to receive from the second devices metadata related to at least one of the device and the image.

8. The device according the claim 7 wherein the processor is further configured to scale the captured image according to metadata related to at least one of the device and the image so that the pixel dimensions of captured images for the second devices are similar.