Event-based media grouping, playback, and sharing

• US 9,143,601 B2
• Filed: 11/09/2011
• Issued: 09/22/2015
• Est. Priority Date: 11/09/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Padmanabhan, Udiyan, Messing, William, Shetter, Martin, Gershanovich, Tatiana, Ricker, Michael J., Peters, Jannes Paul, Sarin, Raman Kumar, Matthews, Joseph H. III, Gonzalez, Monica, Park, Jae Pum
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US13/292,997
• Publication Number:
  US 20130117365A1
• Time in Patent Office: 1,413 Days
• Field of Search: 709/204, 709/223, 709/231, 709/245, 706/46, 382/103, 707/E17.005, 707/E17.108, 707/E17.009
• US Class Current: 1/1
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

Exemplary methods, apparatus, and systems are disclosed for capturing, organizing, sharing, and/or displaying media. For example, using embodiments of the disclosed technology, a unified playback and browsing experience for a collection of media can be created automatically. For instance, heuristics and metadata can be used to assemble and add narratives to the media data. Furthermore, this representation of media can recompose itself dynamically as more media is added to the collection. While a collection may use a single user'"'"'s content, sometimes media that is desirable to include in the collection is captured by friends and/or others at the same event. In certain embodiments, media content related to the event can be automatically collected and shared among selected groups. Further, in some embodiments, new media can be automatically incorporated into a media collection associated with the event, and the playback experience dynamically updated.

Claims

1. A computer-implemented method, comprising:

receiving a first instance of digital media, the first instance of digital media including location and time data for the first instance of digital media;

receiving a second instance of digital media, the second instance of digital media including location and time data for the second instance of digital media;

clustering the first instance of digital media and the second instance of digital media into an event-related group of digital media for an event based at least in part on the location and time data for the first instance of digital media and on the location and time data for the second instance of digital media;

receiving an indication of a selection of a media-sharing setting from among a plurality of available media-sharing settings;

determining a set of one or more recipients for the event-related group of digital media based at least in part on the indication of the selection;

outputting the event-related group of digital media in a presentation for viewing by the set of one or more recipients;

receiving a third instance of digital media, the third instance of digital media including location and time data for the third instance of digital media;

clustering the third instance of digital media into the event-related group of digital media for the event based at least in part on the location and time data for the first instance of digital media, the location and time data for the second instance of digital media, and the location and time data for the third instance of digital media;

updating the presentation with the third instance of digital media to produce an updated presentation; and

outputting data for the updated presentation so that the updated presentation of the event-related group of digital media is available for viewing by the set of one or more recipients, the updated presentation including the third instance of digital media,

the clustering the third instance of digital media into the event-related group of digital media, the updating the presentation with the third instance of digital media, and the outputting data for the updated presentation being performed automatically without user input upon the third instance of digital media being received.

2. The method of claim 1, wherein the digital media comprises one or more of digital image data, digital video data, or digital audio data.

3. The method of claim 1, wherein the plurality of available media-sharing settings comprises two or more of a setting for sharing with users uploading media from the event, a setting for sharing with recipients identified as friends from a list of friends, a setting for sharing with recipients identified as friends from a list of friends who are identified as also being at the event, a setting for sharing with recipients identified as friends from a list of friends or identified as friends of the recipients identified as friends, or a setting for sharing with recipients individually selected by a user.

4. The method of claim 1, wherein the outputting the group of digital media comprises transmitting the event-related group of digital media to one or more of the set of one or more recipients or transmitting the event-related group of digital media to a social network server along with data indicating permissions for viewing the event-related group of digital media.

5. The method of claim 1, wherein the determining the set of one or more recipients comprises:

identifying one or more subjects in the first instance of the digital media or in the second instance of the digital media, wherein the identifying the one or more subjects is performed using data accessed from one or more social network servers, facial recognition, or both data accessed from one or more social network servers and facial recognition; and

including the identified one or more subjects among the set of one or more recipients.

6. The method of claim 1, further comprising analyzing the first instance of digital media and the second instance of digital media to determine supplemental presentation data that is displayed to a user when the first instance of digital media and the second instance of digital media are displayed to the set of one or more recipients, wherein the supplemental presentation data comprises one of a title for the first instance of the digital media, a title for the second instance of the digital media, an indication of a user who created the first instance of the digital media, or an indication of a user who created the second instance of the digital media.

7. The method of claim 1, wherein the first instance of digital media is received from a mobile device operated by a first user, and wherein the second instance of digital media is received from a mobile device operated by a second user different than the first user.

8. The method of claim 1, wherein the first instance of digital media and the second instance of digital media are received from a single mobile device.

9. The method of claim 1, wherein the third instance of digital media is received from one of the recipients, and wherein the third instance of digital media comprises data indicating a comment to one of the first instance of digital media data or the second instance of digital media data.

10. The method of claim 1, wherein the method is performed by a mobile device.

11. The method of claim 1, wherein the receiving the first instance of digital media or the receiving the second instance of digital media is initiated by the capturing of digital media at a mobile device without further input by a user.

12. The method of claim 1, wherein said set of one or more recipients is at least two.

13. The method of claim 1, wherein the determining the set of one or more recipients comprises:

identifying one or more subjects in the first instance of the digital media or in the second instance of the digital media, wherein the identifying the one or more subjects is performed using data accessed from one or more social network servers; and

including the identified one or more subjects among the set of one or more recipients.

14. The method of claim 1, further comprising:

automatically notifying the set of one or more recipients of the event-related group of digital media.

15. The method of claim 1, wherein the clustering the first instance of digital media and the second instance of digital media comprises (a) grouping the first and second instances of digital media together into a common folder of a file structure, the grouping being performed automatically as the second instance of digital media is received;

or (b) supplementing the second instance of digital media with supplemental data that identifies the second instance of digital media as being part of the same event as the first instance of digital media, the supplementing being performed automatically as the second instance of digital media is received.

16. A system, comprising:

a memory or storage device storing a program;

a processing unit operable to execute the program, wherein said execution of the program causes the processing unit to;

receive a first instance of digital media, the first instance of digital media including location and time data for the first instance of digital media;

receive a second instance of digital media, the second instance of digital media including location and time data for the second instance of digital media;

cluster the first instance of digital media and the second instance of digital media into an event-related group of digital media for an event based at least in part on the location and time data for the first instance of digital media and on the location and time data for the second instance of digital media;

receive an indication of a selection of a media-sharing setting from among a plurality of available media-sharing settings;

determine a set of one or more recipients for the event-related group of digital media based at least in part on the indication of the selection;

output the event-related group of digital media in a presentation for viewing by the set of one or more recipients;

receive a third instance of digital media, the third instance of digital media including location and time data for the third instance of digital media;

cluster the third instance of digital media into the event-related group of digital media for the event based at least in part on the location and time data for the first instance of digital media, the location and time data for the second instance of digital media, and the location and time data for the third instance of digital media;

update the presentation with the third instance of digital media to produce an updated presentation; and

output data for the updated presentation so that the updated presentation of the event-related group of digital media is available for viewing by the set of one or more recipients, the updated presentation including the third instance of digital media,

the clustering the third instance of digital media into the event-related group of digital media, the updating the presentation with the third instance of digital media, and the outputting data for the updated presentation being performed automatically without user input upon the third instance of digital media being received.

17. The system of claim 16, wherein the digital media comprises one or more of digital image data, digital video data, or digital audio data.

18. The system of claim 16, wherein the plurality of available media-sharing settings comprises two or more of a setting for sharing with users uploading media from the event, a setting for sharing with recipients identified as friends from a list of friends, a setting for sharing with recipients identified as friends from a list of friends who are identified as also being at the event, a setting for sharing with recipients identified as friends from a list of friends or identified as friends of the recipients identified as friends, or a setting for sharing with recipients individually selected by a user.

19. The system of claim 16, wherein the outputting the group of digital media comprises transmitting the event-related group of digital media to one or more of the set of one or more recipients or transmitting the event-related group of digital media to a social network server along with data indicating permissions for viewing the event-related group of digital media.

20. The system of claim 16, wherein the determining the set of one or more recipients comprises:

identifying one or more subjects in the first instance of the digital media or in the second instance of the digital media, wherein the identifying the one or more subjects is performed using data accessed from one or more social network servers, facial recognition, or both data accessed from one or more social network servers and facial recognition; and

including the identified one or more subjects among the set of one or more recipients.

21. The system of claim 16, wherein said execution of the program further causes the processing unit to analyze the first instance of digital media and the second instance of digital media to determine supplemental presentation data that is displayed to a user when the first instance of digital media and the second instance of digital media are displayed to the set of one or more recipients, wherein the supplemental presentation data comprises one of a title for the first instance of the digital media, a title for the second instance of the digital media, an indication of a user who created the first instance of the digital media, or an indication of a user who created the second instance of the digital media.

22. The system of claim 16, wherein the first instance of digital media is received from a mobile device operated by a first user, and wherein the second instance of digital media is received from a mobile device operated by a second user different than the first user.

23. The system of claim 16, wherein the first instance of digital media and the second instance of digital media are received from a single mobile device.

24. The system of claim 16, wherein the third instance of digital media is received from one of the recipients, and wherein the third instance of digital media comprises data indicating a comment to one of the first instance of digital media data or the second instance of digital media data.

25. The system of claim 16, wherein the system is a mobile device.

26. The system of claim 16, wherein the receiving the first instance of digital media or the receiving the second instance of digital media is initiated by the capturing of digital media at a mobile device without further input by a user.

27. The system of claim 16, wherein said set of one or more recipients is at least two.

28. The system of claim 16, wherein the determining the set of one or more recipients comprises:

identifying one or more subjects in the first instance of the digital media or in the second instance of the digital media, wherein the identifying the one or more subjects is performed using data accessed from one or more social network servers; and

including the identified one or more subjects among the set of one or more recipients.

29. The system of claim 16, wherein said execution of the program further causes the processing unit to automatically notify the set of one or more recipients of the event-related group of digital media.

30. The system of claim 16, wherein the clustering the first instance of digital media and the second instance of digital media comprises (a) grouping the first and second instances of digital media together into a common folder of a file structure, the grouping being performed automatically as the second instance of digital media is received;

or (b) supplementing the second instance of digital media with supplemental data that identifies the second instance of digital media as being part of the same event as the first instance of digital media, the supplementing being performed automatically as the second instance of digital media is received.

31. One or more computer-readable memory or storage devices storing computer-executable instructions which when executed by a computer cause the computer to perform a method, the method comprising:

receiving a first instance of digital media, the first instance of digital media including location and time data for the first instance of digital media;

receiving a second instance of digital media, the second instance of digital media including location and time data for the second instance of digital media;

clustering the first instance of digital media and the second instance of digital media into an event-related group of digital media for an event based at least in part on the location and time data for the first instance of digital media and on the location and time data for the second instance of digital media;

receiving an indication of a selection of a media-sharing setting from among a plurality of available media-sharing settings;

determining a set of one or more recipients for the event-related group of digital media based at least in part on the indication of the selection;

outputting the event-related group of digital media in a presentation for viewing by the set of one or more recipients;

receiving a third instance of digital media, the third instance of digital media including location and time data for the third instance of digital media;

clustering the third instance of digital media into the event-related group of digital media for the event based at least in part on the location and time data for the first instance of digital media, the location and time data for the second instance of digital media, and the location and time data for the third instance of digital media;

updating the presentation with the third instance of digital media to produce an updated presentation; and

outputting data for the updated presentation so that the updated presentation of the event-related group of digital media is available for viewing by the set of one or more recipients, the updated presentation including the third instance of digital media,

the clustering the third instance of digital media into the event-related group of digital media, the updating the presentation with the third instance of digital media, and the outputting data for the updated presentation being performed automatically without user input upon the third instance of digital media being received.