Apparatus, method and computer program product for tying information to features associated with captured media objects

• US 8,238,693 B2
• Filed: 08/16/2007
• Issued: 08/07/2012
• Est. Priority Date: 08/16/2007
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Nokia Corporation
• Inventors: Nurminen, Jukka K., Karonen, Olli
• Primary Examiner(s): Bella, Matthew
• Assistant Examiner(s): TORRES, JOSE
• Application Number:
  US11/839,794
• Publication Number:
  US 20090049004A1
• Time in Patent Office: 1,818 Days
• Field of Search: 382/305, 382/286, 705/26.1
• US Class Current: 382/286
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/687 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04W 4/02 Services making use of location information

Abstract

An apparatus, method and computer program product are provided for tying items of information to features in an area associated with a captured media object. An information provider may associate physical coordinates and temporal information with an item of information. When a media object is captured, metadata indicating the location and direction from which, and the time at which, the media object was captured, and/or, in the instance where the media object is an image, a focal and zoom setting of the device that captured the image, may be generated and stored with the media object. When the media object is viewed, this information, as well as other metadata associated with the capturing and/or reproducing of the media object, as well as the media object itself, may be used to estimate the area corresponding to the media object and to determine item(s) of information corresponding with features in the estimated area.

Claims

1. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

cause a reproduction of a media object having metadata associated therewith;

provide one or more items of information to a mobile device associated with one or more features in a three-dimensional estimated area corresponding to the media object; and

estimate the area corresponding to the media object by determining a range of three-dimensional physical coordinates associated with the media object based at least in part on the metadata associated with the media object,

wherein at least one item of information comprises an advertisement associated with a feature in the estimated area.

2. The apparatus of claim 1, wherein the media object comprises an audio file and the metadata comprises a location and direction from which the audio file was captured and a time at which the audio file was captured.

3. The apparatus of claim 1, wherein the media object comprises an image, the metadata comprises a location from which the image was captured, a direction of view at the time the image was captured, and a time at which the image was captured, and the estimated area corresponding to the image comprises an estimate of an area visible in the image.

4. The apparatus of claim 3, wherein the metadata further comprises a focal and a zoom setting of a camera module at the time the image was captured by the camera module.

5. The apparatus of claim 3, wherein the apparatus is further caused to:

cause the capture of an image;

determine a location from which the image was captured and a direction of view at the time the image was captured; and

associate the determined location and direction with the image as metadata.

6. The apparatus of claim 1, wherein the apparatus is further caused to:

transmit the range of physical coordinates; and

receive, in response, the one or more items of information associated with one or more features in the estimated area, wherein the items of information are selected by comparing the physical coordinates associated with the media object to one or more physical coordinates associated with a respective one or more items of information.

7. The apparatus of claim 6, wherein the apparatus is further caused to:

transmit a location associated with the mobile device responsible for reproducing the media object, wherein at least one item of information is selected based at least in part on the location associated with the mobile device.

8. The apparatus of claim 6, wherein the apparatus is further caused to:

transmit a time associated with the reproduction of the media object, wherein at least one item of information is selected based at least in part on the time associated with the reproduction of the media object.

9. The apparatus of claim 1, wherein the one or more items of information comprise at least one of a website, a link to a website, an audio file, a video file, or a combination thereof.

10. An apparatus of claim 1, wherein a value of the advertisement is dependent upon the location of the mobile device and a location of a subject of the advertisement.

11. A method comprising:

providing a media object for reproduction, said media object having metadata associated therewith;

providing, by a processor, one or more items of information to a mobile device associated with one or more features in a three-dimensional estimated area corresponding to the media object; and

estimating the area corresponding to the media object by determining a range of three-dimensional physical coordinates associated with the media object based at least in part on the metadata associated with the media object,

wherein at least one item of information comprises an advertisement associated with a feature in the estimated area.

12. The method of claim 11, wherein the media object comprises an audio file and the metadata comprises a location and direction from which the audio file was captured and a time at which the audio file was captured.

13. The method of claim 11, wherein the media object comprises an image, the metadata comprises a location from which the image was captured, a direction of view at the time the image was captured, and a time at which the image was captured, and the estimated area corresponding to the image comprises an estimate of an area visible in the image.

14. The method of claim 11, further comprising:

transmitting the range of physical coordinates; and

receiving, in response, the one or more items of information associated with one or more features in the estimated area, wherein the items of information are selected by comparing the physical coordinates associated with the media object to one or more physical coordinates associated with a respective one or more items of information.

15. The method of claim 14 further comprising:

transmitting a location associated with the mobile device responsible for reproducing the media object, wherein at least one item of information is selected based at least in part on the location associated with the electronic device.

16. The method of claim 14 further comprising:

transmitting a time associated with the reproduction of the media object, wherein at least one item of information is selected based at least in part on the time associated with the reproduction of the media object.

17. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the method of claim 11.

18. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

select one or more items of information provided to a mobile device associated with one or more features in a three-dimensional estimated area corresponding to a media object;

estimate the area corresponding to the media object by determining a range of three-dimensional physical coordinates associated with the media object based at least in part on the metadata associated with the media object; and

provide access to the one or more items of information selected,

wherein at least one item of information comprises an advertisement associated with a feature in the estimated area.

19. The apparatus of claim 18, wherein the media object comprises an audio file and the metadata comprises a location and direction from which the audio file was captured and a time at which the audio file was captured.

20. The apparatus of claim 18, wherein the media object comprises an image, the metadata comprises a location from which the image was captured, a direction of view at the time the image was captured, and a time at which the image was captured, and the estimated area corresponding to the image comprises an estimate of an area visible in the image.

21. The apparatus of claim 20, wherein the metadata further comprises a focal and a zoom setting of a camera module at the time the image was captured by the camera module.

22. The apparatus of claim 18, wherein the apparatus is further caused to:

receive one or more links to a corresponding one or more items of information;

receive physical coordinates associated with respective items of information;

store the link and physical coordinates associated with respective items of information, such that the link is mapped to the corresponding physical coordinates; and

compare the physical coordinates associated with the media object to the stored physical coordinates associated with one or more items of information for selecting the one or more items of information.

23. The apparatus of claim 22, wherein the apparatus is further caused to determine to transmit the link associated with respective items of information selected to provide access to the one or more items of information.

24. The apparatus of claim 22, wherein the apparatus is further caused to download the items of information from respective links corresponding with the items of information selected and to transmit the items of information.

25. The apparatus of claim 22, wherein the apparatus is further caused to:

receive a location associated with the mobile device reproducing the media object,

wherein in order to select one or more items of information associated with one or more features in the estimated area corresponding to the media object, the apparatus is further caused to select at least one item of information based at least in part on the location of the mobile device reproducing the media object.

26. The apparatus of claim 22, wherein the apparatus is further caused to:

receive a time associated with the mobile device reproducing the media object,

select at least one item of information based at least in part on the time of the mobile device reproducing the media object to select one or more of the items of information.

27. A method comprising:

selecting, by a processor, one or more items of information provided to a mobile device associated with one or more features in a three-dimensional estimated area corresponding to a media object;

estimating the area corresponding to the media object by determining a range of three-dimensional physical coordinates associated with the media object based at least in part on the metadata associated with the media object; and

providing access to the one or more items of information selected,

wherein at least one item of information comprises an advertisement associated with a feature in the estimated area.

28. The method of claim 27, wherein the media object comprises an audio file and the metadata comprises a location and direction from which the audio file was captured and a time at which the audio file was captured.

29. The method of claim 27, wherein the media object comprises an image, the metadata comprises a location from which the image was captured, a direction of view at the time the image was captured, and a time at which the image was captured, and the estimated area corresponding to the image comprises an estimate of an area visible in the image.

30. The method of claim 27, further comprising:

receiving one or more links to a corresponding one or more items of information;

receiving physical coordinates associated with respective items of information; and

storing the link and physical coordinates associated with respective items of information, such that the link is mapped to the corresponding physical coordinates, wherein selecting one or more items of information associated with one or more features in the estimated area corresponding to the media object comprises comparing the physical coordinates associated with the media object to the stored physical coordinates associated with one or more items of information.

31. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the method of claim 27.

32. An apparatus comprising:

means for selecting one or more items of information provided to a mobile device associated with one or more features in a three-dimensional estimated area corresponding to a media object;

means for estimating the area corresponding to the media object by determining a range of three-dimensional physical coordinates associated with the media object based at least in part on the metadata associated with the media object; and

means for providing access to the one or more items of information selected,

wherein at least one item of information comprises an advertisement associated with a feature in the estimated area.