Method and apparatus to obtain differential location information

• US 9,897,450 B2
• Filed: 05/20/2015
• Issued: 02/20/2018
• Est. Priority Date: 05/20/2015
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Aksu, Emre Baris, Hannuksela, Miska Matias
• Primary Examiner(s): Mawari, Redhwan K
• Application Number:
  US14/717,986
• Publication Number:
  US 20160342596A1
• Time in Patent Office: 1,007 Days
• CPC Class Codes: G01C 21/1656 with passive imaging devices, e.g. cameras
• CPC Class Codes: G01S 19/14 specially adapted for specific applications
• CPC Class Codes: G01S 19/49 whereby the further system is an inertial position system, e.g. loosely-coupled
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

In accordance with an example embodiment of the invention there is at least a method and apparatus to perform operations including determining, by a media recording device, a differential location sample identifying a current location in time associated with the media recording device relative to a reference location; and at least one of storing and transmitting, by the media recording device, the differential location sample in an audio-visual media file. In accordance with another example embodiment of the invention there is at least a method and apparatus to perform operations including receiving and parsing, by a parser device, a plurality of differential location samples of an audio-visual media file to identify an absolute location of a media recording device.

Claims

1. A method, comprising:

determining, by a media recording device, a differential location sample identifying a current location in time associated with the media recording device relative to a reference location;

identifying initial velocity and acceleration data of the media recording device towards an indicated direction, wherein the initial velocity and acceleration data comprises x, y, and z axis values based on a pre-selected axis convention;

storing in an audio-visual media file the differential location sample expressed in terms of the identified initial velocity and acceleration data of the media recording device towards the indicated direction, wherein the initial velocity and acceleration data are determined from sensing using at least one of an accelerometer and an altitude sensor of the media recording device; and

transmitting, by the media recording device, the differential location sample in the audio-visual media file.

2. The method according to claim 1, wherein the audio-visual media file comprises a data sample definition referencing mechanism to indicate the differential location sample data storage format which has associated sampling time information to store the differential location sample data in the audio-visual media file.

3. The method according to claim 1, wherein the reference location in time is obtained from a time-aligned sample of a geographical location track associated with the media recording device, wherein the geographical location track is based on actual geographical coordinate data or virtual reality geographical coordinate data determined by the media recording device.

4. The method according to claim 1, comprising identifying and storing an orientation associated with the media recording device with the differential location sample in the audio-visual media file, wherein the orientation associated with the media recording device comprises camera view orientation data of the media recording device.

5. The method according to claim 1 performed by a non-transitory computer readable medium including computer program code, and the computer program code executed by at least one processor.

6. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, where the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus to at least;

determine, with a media recording device, a differential location sample identifying a current location in time associated with the media recording device relative to a reference, location;

identify initial velocity and acceleration data of the media recording device towards an indicated direction, wherein the initial velocity and acceleration data comprises x, y, and z axis values based on a pre-selected axis convention;

storing in an audio-visual media file the differential location sample expressed in terms of the identified initial velocity and acceleration data of the media recording device towards the indicated direction, wherein the initial velocity and acceleration data are determined from sensing using at least one of an accelerometer and an altitude sensor of the media recording device; and

transmit, with the media recording device, the differential location sample in the audio-visual media file.

7. The apparatus according to claim 6, wherein the audio-visual media file comprises a data sample definition referencing mechanism to indicate the differential location sample data storage format which has associated sampling time information to store the differential location sample data in the audio-visual media file.

8. The apparatus according to claim 6, wherein the reference location in time is obtained from a time-aligned sample of a geographical location track associated with the media recording device, wherein the geographical location track is based on actual geographical coordinate data or virtual reality geographical coordinate data determined by the media recording device.

9. The apparatus according to claim 6, wherein the at least one memory including the computer program code is configured with the at least one processor to cause the apparatus to:

identify and storing an orientation associated with the media recording device with the differential location sample in the audio-visual media file, wherein the orientation associated with the media recording device comprises camera view orientation data of the media recording device.

10. A method, comprising:

receiving, by a parser device, a plurality of differential location samples of an audio-visual media file, wherein each differential location sample identifies a location associated in time with a media recording device relative to a reference location and an initial velocity and acceleration data of the media recording device toward an indicated direction, wherein the initial velocity and acceleration data comprises x, y, and z axis values based on a pre-selected axis convention determined from at least one of an accelerometer and an altitude sensor of the media recording device; and

parsing the plurality of differential location samples to determine an absolute location of the media recording device, comprising;

determining that a current differential location sample comprises coordinate data;

identifying an initial location associated with the coordinate data;

determining that the current differential location sample comprises initial velocity and acceleration data, wherein the initial velocity data is using a pre-selected axis convention;

identifying sensor characteristics information related to measurement sensitivities for determining the absolute location; and

based on at least the initial location, the initial velocity, the acceleration data, and the sensor characteristics information determining the absolute location of the media recording device.

12. The method according to claim 10, wherein the audio-visual media file comprises a data sample definition referencing mechanism to indicate the differential location sample data storage format which has associated sampling time information to store the differential location sample data in the audio-visual media file.

13. The method according to claim 10, wherein the reference location in time is from a time-aligned sample of a geographical location track associated with the media recording device, wherein the geographical location track is based on actual geographical coordinate data or virtual reality geographical coordinate data determined by the media recording device.

14. The method according to claim 10, wherein the plurality of differential location samples comprises an orientation associated with the media recording device, wherein the orientation associated with the media recording device comprises camera view orientation data of the media recording device.

11. An apparatus, comprising:

at least one processor; and

at least one memory including computer program code, where the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus to at least;

receive, with a parser device, a plurality of differential location samples of an audio-visual media file, wherein each differential location sample identifies a location associated in time with a media recording device relative to a reference location and an initial velocity and acceleration data of the media recording device toward an indicated direction, wherein the initial velocity and acceleration data comprises x, y, and z axis values based on a pre-selected axis convention determined from at least one of an accelerometer and an altitude sensor of the media recording device; and

parse, with the parser device, the plurality of differential location samples to determine an absolute location of the media recording device, comprising;

determining that a current differential location sample comprises coordinate data;

identifying an initial location associated with the coordinate data;

determining that the current differential location sample comprises initial velocity and acceleration data, wherein the initial velocity data is using a pre-selected axis convention;

identifying sensor characteristics information related to measurement sensitivities for determining the absolute location; and

based on at least the initial location, the initial velocity, the acceleration data, and the sensor characteristics information determining the absolute location of the media recording device.