METHOD AND DEVICE FOR AUGMENTING USER-INPUT INFORMATION REALTED TO MEDIA CONTENT

• US 20130290859A1
• Filed: 04/27/2012
• Published: 10/31/2013
• Est. Priority Date: 04/27/2012
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: General Instrument Corporation (CommScope Holding Company, Inc.)
• Inventors: Venkitaraman, Narayanan, Basapur, Santosh S., Chaysinh, Shirley A., Lee, Young S., Mandalia, Hiren M.
• Granted Patent: US 10,277,933 B2
• Time in Patent Office: Days
• US Class Current: 715/744
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: H04N 21/254 Management at additional data server, e.g. shopping server, rights management server arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

Disclosed is a method of augmenting user-input information that includes associating a first secondary device with primary media content, receiving user-input information input at the first secondary device, and analyzing the user-input information to identify user-content metadata. The method further includes at least one of: receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content and identifying associations between the user-content metadata and the primary-content metadata.

Claims

1. A method of augmenting user-input information, the method comprising:

associating a first secondary device with primary media content;

receiving user-input information input at the first secondary device;

analyzing the user-input information to identify user-content metadata;

at least one of;

receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content; and

identifying associations between the user-content metadata and the primary-content metadata.

2. The method of claim 1 wherein the associations identified include information that relates the user-input information to a specific object in or attribute of the primary media content.

3. The method of claim 1 further comprising enhancing viewable primary media content by displaying at least a part of the user-input information along with the primary media content.

4. The method of claim 1:

further comprising providing for display to a user of the first secondary device one or more of the identified associations;

wherein the user-input information includes at least one of;

a text-based and a voice-based user comment.

5. The method of claim 4 wherein deriving primary-content metadata is accomplished by at least one of:

a server, the first secondary device, a primary media source, and a primary media device.

6. The method of claim 1 further comprising storing the identified associations for retrieval by a second secondary device separate from the first secondary device to which the user-input information was first input.

7. The method of claim 6 further comprising viewing the identified associations on a user interface displayed on the first secondary device.

8. The method of claim 1:

further comprising communicating at least a portion of the primary-content metadata from the first secondary device to a server;

wherein the primary-content metadata are derived from the primary media content provided at least in part by the first secondary device.

9. The method of claim 8 further comprising transmitting primary-content metadata to the first secondary device for association with user-content metadata.

10. A method of operating a first secondary device in a manner that complements operation of a primary media device, the method comprising:

establishing an association of the first secondary device with respect to a primary media device;

receiving user-input information at the first secondary device, wherein the user-input information relates to primary media content output by the primary media device;

analyzing the user-input information;

analyzing the primary media content; and

identifying associations between the user-input information and the primary media content.

11. The method of claim 10 wherein analyzing the user-input information includes identifying user-content metadata associated with the user-input information.

12. The method of claim 11 wherein analyzing the primary media content includes at least one of:

analyzing the primary media content to identify primary-content metadata associated with the primary media content and accessing pre-derived primary-content metadata.

13. The method of claim 12 wherein analyzing the user-input information includes utilizing an extractor that extracts at least one keyword or key phrase from the user-input information to form at least a part of the user-content metadata.

14. The method of claim 13 wherein analyzing the primary media content includes utilizing one or both of a media analyzer and an object detector to identify one or more of:

an object, a location, speech, and text, to form at least a part of the primary-content metadata.

15. The method of claim 14 wherein identifying associations between the user-input information and the primary media content includes identifying primary-content metadata that are similar to user-content metadata.

16. The method of claim 15 further comprising augmenting at least a portion of the user-input information to include at least a portion of primary-content metadata that are associated therewith.

17. The method of claim 16 further comprising storing the augmented user-input information for retrieval by at least one of the first secondary device and a second secondary device.

18. The method of claim 16 wherein the primary media device is a display device and the first secondary device is a mobile device having a user interface for entering the user-input information and for viewing at least a portion of the augmented user-input information.

19. A system for receiving supplemental information related to primary media content, the system comprising:

a mobile device;

a user interface configured to receive and display user-input information on the mobile device;

a transmitter inside the mobile device configured to transmit at least a portion of the user-input information to another device that contains primary media content related to a scene that was viewable by a user of the mobile device when the user-input information was, at least in part, input into the mobile device; and

a receiver inside the mobile device configured to receive a communication from the other device, wherein the communication includes an augmentation to the user-input information that further includes one or more of;

an object list, object-identification information, and primary-content metadata derived from primary media content that are associated with the scene and user-content metadata derived from the user-input information.

20. A method of enhancing primary media content, the method comprising:

receiving a user comment on a secondary device;

obtaining user-content metadata from the user comment;

receiving primary-content metadata related to primary media content viewed by a user of the secondary device;

determining if the user comment is related to the primary media content by analyzing the user-content metadata and primary-content metadata; and

generating an augmented user comment by associating the primary-content metadata and the user comment, wherein the augmented user comment includes information that relates the user comment to a specific object or attribute of one or more scenes viewable in the primary media content.

21. The method of claim 20 further including enhancing the primary media content by displaying at least a part of the augmented user comment on a primary media device when the augmented user comment is being viewed by the user on the secondary device.

22. The method of claim 21 further including displaying at least a part of the augmented user comment on the secondary device.