METHOD AND APPARATUS FOR PROVIDING MEDIA MIXING WITH REDUCED UPLOADING

• US 20120203925A1
• Filed: 02/07/2011
• Published: 08/09/2012
• Est. Priority Date: 02/07/2011
• Status: Active Grant

• Current Assignee: Piece Future Pte., Ltd.
• Original Assignee: Nokia Corporation
• Inventors: Curcio, Igor Danilo Diego, Mate, Sujeet Shyamsundar, Cricri, Francesco
• Granted Patent: US 8,805,954 B2
• Time in Patent Office: Days
• US Class Current: 709/235
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 4/38 for collecting sensor information

Abstract

A method for providing media mixing with reduced uploading may include receiving device situation description data and content analysis data from each of a plurality of devices. The device situation description data and content analysis data received from each of the plurality of devices may be descriptive of media data associated with a common event and recorded separately at respective ones of the plurality of devices. The method may further include determining media segments defining one or more portions of the media data to be requested from selected ones of the plurality of devices based on the device situation description data and content analysis data, causing communication of a request for corresponding ones of the media segments to respective devices among the selected ones of the plurality of devices, and causing generation of mixed content based on receipt of the media segments. A corresponding apparatus and user terminal-side method and apparatus are also provided.

Claims

1. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform:

receiving device situation description data and content analysis data from each of a plurality of devices, the device situation description data and content analysis data received from each of the plurality of devices being descriptive of media data associated with a common event and recorded separately at respective ones of the plurality of devices;

determining media segments defining one or more portions of the media data to be requested from selected ones of the plurality of devices based on the device situation description data and content analysis data;

causing communication of a request for corresponding ones of the media segments to respective devices among the selected ones of the plurality of devices; and

causing generation of mixed content based on receipt of the media segments.

2. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to receive device situation description data by receiving raw sensor data and device context data or by receiving derived sensor data and device context data responsive to analysis performed at respective ones of the plurality of devices.

3. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to receive device situation description data by receiving sensor data and device context data while corresponding content is being recorded at respective ones of the plurality of devices or after recording of the corresponding content has been completed.

4. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to receive content analysis data by receiving media analysis data descriptive of content features extracted from the media data by respective ones of the plurality of devices.

5. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, further cause the apparatus to cause provision of a quality metric to the plurality of devices or perform audio time alignment based on feature vectors received from the plurality of devices.

6. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to cause communication of the request including identifying media segments to be sent by respective ones of the selected ones of the plurality of devices based on temporal data or based on priority.

7. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to cause communication of the request including identifying a single media or multiple medium for the media segments to be sent by respective ones of the selected ones of the plurality of devices.

8. A method comprising:

receiving device situation description data and content analysis data from each of a plurality of devices, the device situation description data and content analysis data received from each of the plurality of devices being descriptive of media data associated with a common event and recorded separately at respective ones of the plurality of devices;

determining media segments defining one or more portions of the media data to be requested from selected ones of the plurality of devices based on the device situation description data and content analysis data;

causing communication of a request for corresponding ones of the media segments to respective devices among the selected ones of the plurality of devices; and

causing generation of mixed content based on receipt of the media segments.

9. The method of claim 8, wherein receiving device situation description data comprises receiving raw sensor data and device context data or receiving derived sensor data and device context data responsive to analysis performed at respective ones of the plurality of devices.

10. The method of claim 8, wherein receiving device situation description data comprises receiving sensor data and device context data while corresponding content is being recorded at respective ones of the plurality of devices or after recording of the corresponding content has been completed.

11. The method of claim 8, wherein receiving content analysis data comprises receiving media analysis data descriptive of content features extracted from the media data by respective ones of the plurality of devices.

12. The method of claim 8, further comprising causing provision of a quality metric to the plurality of devices or perform audio time alignment based on feature vectors received from the plurality of devices.

13. The method of claim 8, wherein causing communication of the request comprises identifying media segments to be sent by respective ones of the selected ones of the plurality of devices based on temporal data or based on priority.

14. The method of claim 8, wherein causing communication of the request comprises identifying a single media or multiple medium for the media segments to be sent by respective ones of the selected ones of the plurality of devices.

15. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform:

causing provision of device situation description data and content analysis data from a user terminal to a service platform, the device situation description data and content analysis data being descriptive of media data associated with an event for which content is separately recorded by other devices associated with the service platform;

receiving a request for one or more corresponding media segments from the service platform, the media segments defining one or more portions of the media data determined to be requested by the service platform based on the device situation description data and content analysis data; and

causing provision of the media segments requested to the service platform to enable mixing of the media segments at the service platform with other media segments from the other devices.

16. The apparatus of claim 15, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to receive the request by receiving a request identifying the media segments based on temporal data or based on priority.

17. The apparatus of claim 15, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to cause provision of the device situation description data by causing provision of raw sensor data and device context data or causing provision of sensor data and device context data responsive to analysis performed at the user terminal.

18. A method comprising:

causing provision of device situation description data and content analysis data from a user terminal to a service platform, the device situation description data and content analysis data being descriptive of media data associated with an event for which content is separately recorded by other devices associated with the service platform;

receiving a request for one or more corresponding media segments from the service platform, the media segments defining one or more portions of the media data determined to be requested by the service platform based on the device situation description data and content analysis data; and

causing provision of the media segments requested to the service platform to enable mixing of the media segments at the service platform with other media segments from the other devices.

19. The method of claim 18, wherein receiving the request comprises receiving a request identifying the media segments based on temporal data or based on priority.

20. The method of claim 18, wherein causing provision of the device situation description data comprises causing provision of raw sensor data and device context data or causing provision of sensor data and device context data responsive to analysis performed at the user terminal.