Forming a multimedia product using video chat

• US 9,247,306 B2
• Filed: 05/21/2012
• Issued: 01/26/2016
• Est. Priority Date: 05/21/2012
• Status: Expired due to Fees

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: O'Keefe, Brian Joseph, Parulski, Kenneth Alan
• Primary Examiner(s): HOGUE, DENNIS A
• Application Number:
  US13/476,057
• Publication Number:
  US 20130307997A1
• Time in Patent Office: 1,345 Days
• Field of Search: 348/207.99, 348/207.1, 348/211.3, 348/222.1, 348/231.3, 348/239, 348 1401- 1416, 358/1.9, 358/1.16, 705/3, 705/14, 705/300, 705/319, 709/204, 709/205, 709/206, 715/201, 715/203, 715/730, 715/751, 715/753, 715/758, 725/105, 725/109
• US Class Current: 1/1
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

A method for forming a composite multimedia product pertaining to a digital image captured of a scene. The method includes sharing the digital image with a remote user, and facilitating a conversation with the remote user across a communication network. A portion of the conversation that is relevant to the shared digital image is automatically extracted and combined with the digital image to form the composite multimedia product.

Claims

1. A method for forming a composite multimedia product, comprising:

capturing a digital image of a scene;

sharing the digital image with a remote user;

facilitating a conversation with the remote user across a communication network, the conversation pertaining to the shared digital image, wherein the conversation with the remote user across the communication network comprises a video chat conversation;

automatically extracting a portion of the conversation that is relevant to the shared digital image; and

forming the composite multimedia product by combining the digital image and the extracted portion of the conversation, wherein the extracted portion of the conversation comprises an audio segment extracted from the conversation, and wherein the composite multimedia product comprises the digital image and the audio segment extracted from the conversation, wherein the composite multimedia product further comprises a first digital image of a first video chat participant and a second digital image of a second video chat participant;

wherein the method is performed at least in part using a data processor.

2. The method of claim 1, wherein said forming of the composite multimedia product includes storing the audio segment extracted from the conversation as metadata associated with the digital image.

3. The method of claim 1, wherein the composite multimedia product is stored using a story share format.

4. The method of claim 1, wherein the composite multimedia product includes a multimedia slideshow.

5. The method of claim 4, wherein the multimedia slideshow includes a representation of the digital image together with at least one of video content extracted from the conversation, audio content extracted from the conversation, or text content extracted from the conversation.

6. The method of claim 1, wherein the composite multimedia product comprises an image component portion and a metadata component portion combined into a single data file.

7. The method of claim 6, further comprising presenting on a user interface a preview of a product including the image component portion and the metadata component portion of the composite multimedia product.

8. The method of claim 1, wherein the composite multimedia product comprises a combination of still images and video clips.

9. The method of claim 1, wherein the composite multimedia product comprises a still image portion, a video clip portion, and a metadata portion.

10. The method of claim 1, wherein the automatically extracting a portion of the conversation that is relevant to the shared digital image comprises analyzing the conversation to identify portions where a user exhibits a loudest sound level or a highest excitement level.

11. The method of claim 1, wherein the automatically extracting a portion of the conversation that is relevant to the shared digital image comprises:

analyzing facial expressions of users in the video chat conversation; and

identifying portions of the video chat conversation where the user exhibits a highest excitement level based on the facial expressions.

12. The method of claim 11, wherein the forming the composite multimedia product further comprises a video clip from the video chat conversation corresponding to an identified portion of the video chat conversation where the user exhibited a highest excitement level.

13. The method of claim 1, wherein the composite multimedia product further comprises a first text portion and a second text portion, wherein the first text portion comprises a textual representation of a portion of the conversation spoken by a first chat participant, and wherein the second text portion comprises a textual representation of a portion of the conversation spoken by a second chat participant.

14. The method of claim 1, further comprising:

detecting participation in the conversation; and

automatically suggesting a plurality of composite multimedia products, wherein the plurality of composite multimedia products comprises the composite multimedia product.

15. The method of claim 1, further comprising automatically converting the extracted portion of the conversation into text, wherein said forming the composite multimedia product comprises combining the digital image, the extracted portion of the conversation, and the text, and wherein the composite multimedia product comprises the text.

16. A computer program product for forming a composite multimedia product comprising a non-transitory tangible computer readable storage medium storing an executable software application for causing a data processing system to perform operations comprising:

capturing a digital image of a scene;

sharing the digital image with a remote user;

facilitating a conversation with the remote user pertaining to the shared digital image, wherein the conversation with the remote user across the communication network comprises a video chat conversation;

automatically extracting a portion of the conversation that is relevant to the shared digital image; and

forming the composite multimedia product by combining the digital image and the extracted portion of the conversation, wherein the extracted portion of the conversation comprises an audio segment extracted from the conversation, and wherein the composite multimedia product comprises the digital image and the audio segment extracted from the conversation, and wherein the composite multimedia product further comprises a first digital image of a first video chat participant and a second digital image of a second video chat participant.

17. An image capture device, comprising:

an image sensor configured to capture a digital image;

an optical system configured to form an image of a scene onto the image sensor;

a data processing system;

a communication system configured to communicate across a communication network;

a storage memory configured to store captured images; and

a program memory communicatively connected to the data processing system and storing instructions configured to cause the data processing system to implement a method for forming a composite multimedia product, wherein the method includes;

capturing a digital image of a scene using the image sensor;

using the communication system to share the digital image with a remote user;

facilitating a conversation with the remote user across the communication network, wherein the conversation pertains to the shared digital image, wherein the conversation with the remote user across the communication network comprises a video chat conversation;

automatically extracting a portion of the conversation that is relevant to the shared digital image; and

forming the composite multimedia product by combining the digital image and the extracted portion of the conversation, wherein the extracted portion of the conversation comprises an audio segment extracted from the conversation, and wherein the composite multimedia product comprises the digital image and the audio segment extracted from the conversation, and wherein the composite multimedia product further comprises a first digital image of a first video chat participant and a second digital image of a second video chat participant.

18. The device of claim 17, wherein the composite multimedia product comprises an image component portion and a metadata component portion combined into a single data file, and wherein the storage memory is configured to store the single data file containing the image component portion and the metadata component portion.