Method and device for augmenting user-input information related to media content

• US 10,277,933 B2
• Filed: 04/27/2012
• Issued: 04/30/2019
• Est. Priority Date: 04/27/2012
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Inventors: Venkitaraman, Narayanan, Basapur, Santosh S., Chaysinh, Shirley A., Lee, Young S., Mandalia, Hiren M.
• Primary Examiner(s): Klicos, Nicholas
• Application Number:
  US13/457,534
• Publication Number:
  US 20130290859A1
• Time in Patent Office: 2,559 Days
• Field of Search: 715744
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: H04N 21/254 Management at additional data server, e.g. shopping server, rights management server arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

Disclosed is a method of augmenting user-input information that includes associating a first secondary device with primary media content, receiving user-input information input at the first secondary device, and analyzing the user-input information to identify user-content metadata. The method further includes at least one of: receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content and identifying associations between the user-content metadata and the primary-content metadata.

Claims

1. A method of augmenting user comments, the method comprising:

associating a first secondary device with a primary media device, the primary media device for displaying media content, and wherein the first secondary device comprises a secondary display device, a user interface for entering an input, and a client application for providing the user interface;

receiving, in the first secondary device, a user comment that is provided as the input at the first secondary device by a user of the first secondary device, wherein the input of the user comment is during and responsive to a display of a primary media content on the primary media device for viewing by the user;

analyzing the user comment to automatically generate user-content metadata comprising one or more of a keyword from the user comment and a key phrase from the user comment;

at least one of;

receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content,

wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at a time of the display of the primary media content on the primary media device for viewing by the user, the time associated with the input of the user comment; and

further comprises information spoken by the person during or proximate to the time; and

in one or more devices, using the user-content metadata and the primary-content metadata to automatically generate an identified association between the user comment and the primary-content metadata, the generating comprising analyzing the user-content metadata and the primary-content metadata to identify one or more associations between the user-content metadata and the primary-content metadata,

wherein the primary-content metadata comprises information relating to a specific viewable object displayed in a scene in the primary media content, and wherein the identified association includes information that relates the user comment to the specific viewable object displayed by the primary media device during the receiving of the user comment by the first secondary device.

2. The method of claim 1 wherein the specific viewable object displayed in a scene in the primary media content is one of:

a person, a feature, an article, an item associated with a brand identity, an item associated with model information, an item associated with review information, an item associated with price information, an item associated with specifications information, an item of clothing, an item of food, a room, and a scene location.

3. The method of claim 1 further comprising enhancing viewable primary media content by displaying at least a part of the user comment along with the primary media content.

4. The method of claim 1:

further comprising providing for display to a user of the first secondary device one or more of the identified associations;

wherein the user comment includes at least one of;

a text-based and a voice-based user comment.

5. The method of claim 4 wherein deriving primary-content metadata is accomplished by at least one of:

a server, the first secondary device, the primary media source, and the primary media device.

6. The method of claim 1 further comprising storing the identified associations for retrieval by a second secondary device separate from the first secondary device to which the user comment was first input.

7. The method of claim 6 further comprising viewing the identified associations on a user interface displayed on the first secondary device.

8. The method of claim 1:

further comprising communicating at least a portion of the primary-content metadata from the first secondary device to a server;

wherein the primary-content metadata are derived from the primary media content provided at least in part by the first secondary device.

9. The method of claim 8 further comprising transmitting primary-content metadata to the first secondary device for association with user-content metadata.

10. A method of operating a first secondary device in a manner that complements operation of a primary media device for displaying media content, the method comprising:

establishing an association of the first secondary device with respect to the primary media device, wherein the first secondary device comprises a secondary display device, a user interface for entering a user comment, and a client application for providing the user interface;

receiving, in the first secondary device, the user comment that is provided to the first secondary device by a user of the first secondary device, wherein the user comment relates to a primary media content that is concurrently output by the primary media device for viewing by the user during the receiving;

analyzing the user comment, wherein the user comment comprises a user comment responsive to the output of the primary media content;

analyzing the primary media content; and

in one or more devices, automatically generating an identified association of the user comment, based at least on a first result from the analyzing of the user comment and a second result from the analyzing of the primary media content, wherein the first result comprises one or more of a keyword from the user comment and a key phrase from the user comment, and the second result comprises information relating to a specific viewable object displayed in a scene in the primary media content, to identify one or more associations between the user comment and the primary media content;

wherein the information relating to the specific viewable object comprises information identifying a person speaking in the primary media content at a time of the concurrent output of the primary media content on the primary media device for viewing by the user, the time associated with the receiving of the user comment; and

further comprises information spoken by the person during or proximate to the time; and

wherein the identified association includes information that relates the user comment to the specific viewable object displayed by the primary media device during the receiving of the user comment by the first secondary device.

11. The method of claim 10 wherein analyzing the user comment includes identifying user-content metadata associated with the user comment.

12. The method of claim 11 wherein analyzing the primary media content includes at least one of:

analyzing the primary media content to identify primary-content metadata associated with the primary media content and accessing pre-derived primary-content metadata.

13. The method of claim 12 wherein analyzing the user comment includes utilizing an extractor that extracts at least one keyword or key phrase from the user comment to form at least a part of the user-content metadata.

14. The method of claim 13 wherein analyzing the primary media content includes utilizing one or both of a media analyzer and an object detector to identify one or more of:

an object, a location, speech, and text, to form at least a part of the primary-content metadata.

15. The method of claim 14 wherein identifying associations between the user comment and the primary media content includes identifying primary-content metadata that are similar to user-content metadata.

16. The method of claim 15 further comprising creating augmented user-input information by augmenting at least a portion of the user comment to include at least a portion of primary-content metadata that are associated therewith.

17. The method of claim 16 further comprising storing the augmented user-input information for retrieval by at least one of the first secondary device and a second secondary device.

18. The method of claim 16 wherein the primary media device is a display device and the first secondary device is a mobile device wherein the user interface is configured to provide viewing of at least a portion of the augmented user-input information.

19. A system for receiving supplemental information related to a primary media content, the system comprising:

a mobile device associated with and distinct from another device, wherein the mobile device comprises a display device, a user interface, and a client application for providing the user interface;

the user interface of the mobile device, configured to receive and display a user comment on the mobile device, wherein the user comment is received from a user responsive to a viewing of the primary media content;

a transmitter inside the mobile device configured to transmit at least a portion of the user comment to the other device that contains the primary media content, the primary media content comprising a scene that was viewable by a user of the mobile device at a time when the user comment was, at least in part, input into the mobile device during the viewing of the primary media content; and

a receiver inside the mobile device configured to receive a communication from the other device, wherein the communication includes an augmented user-input information that comprises the user comment and further includes one or more of;

an object list that includes association information that relates the user comment to a specific viewable object displayed in the scene, and object-identification information that includes association information that relates the user comment to a specific physical object viewable in the scene,

wherein the augmented user-input information further includes one or more of;

primary-content metadata derived from primary media content that are associated with the scene, and user-content metadata derived from the user comment,

wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at the time, and further comprises information spoken by the person during or proximate to the time, and

wherein the association information is automatically generated based at least on a result from an analysis of the user comment, the result comprising one or more of a keyword from the user comment and a key phrase from the user comment, and further based at least on an analysis of the primary media content.

20. A method of enhancing primary media content, the method comprising:

receiving a user comment on a secondary device associated with and distinct from a primary media device, wherein the secondary device comprises a secondary display device, a user interface for entering the user comment, and a client application for providing the user interface;

obtaining user-content metadata from the user comment, the user-content metadata comprising one or more of a keyword from the user comment and a key phrase from the user comment;

receiving, in the secondary device, primary-content metadata related to a primary media content that was displayed on the primary media device at a time, for viewing by a user of the secondary device during the receiving of the user comment in the secondary device;

wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at the time, and further comprises information spoken by the person during or proximate to the time, and

determining whether the user comment is responsive to the display of the primary media content by analyzing the user-content metadata and the primary-content metadata; and

in one or more devices, based at least on the determining whether the user comment is responsive to the display of the primary media content, generating an augmented user comment by automatically associating the primary-content metadata and the user comment, wherein the augmented user comment includes automatically generated association information that relates the user comment to a specific viewable physical object displayed in one or more scenes viewable in the primary media content.

21. The method of claim 20 further including enhancing the primary media content by displaying at least a part of the augmented user comment on the primary media device when the augmented user comment is being viewed by the user on the secondary device.

22. The method of claim 21 further including displaying at least a part of the augmented user comment on the secondary device.