PRODUCING COMPREHENSIBLE SUBTITLES AND CAPTIONS FOR AN EFFECTIVE GROUP VIEWING EXPERIENCE

• US 20200135225A1
• Filed: 10/25/2018
• Published: 04/30/2020
• Est. Priority Date: 10/25/2018
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Vaughn, Garfield, Benboubakeur, Moncef, Narodicka, Julija, Baughman, Aaron K.
• Granted Patent: US 10,950,254 B2
• Time in Patent Office: Days
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

One or more processors identify one or more users expected to consume media content having associated subtitle data. A user profile associated with each of the one or more users is received, and one or more features are extracted from each user profile. The one or more features are representative of a characteristic of the user. A group profile is created for the one or more users based upon the extracted features. The subtitle data associated with the media content is received, and one or more portions of the subtitle data are modified based upon the group profile to generate augmented subtitle data. The augmented subtitle data is sent to a display device for being rendered in the display device.

Claims

1. A computer-implemented method, comprising:

identifying, by one or more processors, one or more users expected to consume media content, the media content having associated subtitle data;

receiving a user profile associated with a plurality of the one or more users;

extracting one or more features from each user profile, the one or more features representative of a characteristic of the user;

creating a group profile for the plurality of the one or more users based upon the extracted features;

receiving the subtitle data associated with the media content;

modifying one or more portions of the subtitle data based upon the group profile to generate augmented subtitle data; and

sending the augmented subtitle data to a display device for being rendered in the display device.

2. The computer-implemented method of claim 1, further comprising:

rendering the augmented subtitle data in the display device.

3. The computer-implemented method of claim 2, further comprising:

presenting the media content by the display device in synchronization with the rendering of the augmented subtitle data.

4. The computer-implemented method of claim 1, further comprising:

determining a change in a level of engagement of one of more of the users with the media content; and

further modifying the subtitle data to obtain a higher level of engagement of the one or more users with the media content.

5. The computer-implemented method of claim 4, wherein determining the level of engagement based upon an input from one or more sensors within the viewing environment.

6. The computer-implemented method of claim 1, wherein extracting the one or more features is based upon cognitive processing of the user profile.

7. The computer-implemented method of claim 1, wherein creating the group profile includes determining a value of a feature that satisfies a best match within a threshold value of the feature among the one or more users.

8. The computer-implemented method of claim 1, wherein the user profile is based upon one or more of previous content consumed by the user, social media posts by the user, and input from a sensor associated with the user.

9. The computer-implemented method of claim 1, wherein the one or more features include one or more of a language usage, a parental guide rating, a demographic characteristic, a mood, an experience, a motion, physical health, and a lexicon of the user.

10. The computer-implemented method of claim 1, wherein modifying the one or more portions of the subtitle data utilizes machine learning.

11. The computer-implemented method of claim 1, further comprising:

identifying a source of the media content.

12. The computer-implemented method of claim 1, wherein the identifying of the one or more users includes receiving a list of the one or more users.

13. The computer-implemented method of claim 1, wherein the receiving of the subtitle data associated with the media content is responsive to requesting the subtitled data.

14. A computer usable program product comprising one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices, the stored program instructions comprising:

program instructions to identify, by one or more processors, one or more users expected to consume media content, the media content having associated subtitle data;

program instructions to receive a user profile associated with a plurality of the one or more users;

program instructions to extract one or more features from each user profile, the one or more features representative of a characteristic of the user;

program instructions to create a group profile for the plurality of the one or more users based upon the extracted features;

program instructions to receive the subtitle data associated with the media content;

program instructions to modify one or more portions of the subtitle data based upon the group profile to generate augmented subtitle data; and

program instructions to send the augmented subtitle data to a display device for being rendered in the display device.

15. The computer usable program product of claim 14, further comprising:

program instructions to render the augmented subtitle data in the display device.

16. The computer usable program product of claim 14, further comprising:

program instructions to present the media content by the display device in synchronization with the rendering of the augmented subtitle data.

17. The computer usable program product of claim 14, wherein the computer usable code is stored in a computer readable storage device in a data processing system, and wherein the computer usable code is transferred over a network from a remote data processing system.

18. The computer usable program product of claim 14, wherein the computer usable code is stored in a computer readable storage device in a server data processing system, and wherein the computer usable code is downloaded over a network to a remote data processing system for use in a computer readable storage device associated with the remote data processing system.

19. A computer system comprising one or more processors, one or more computer-readable memories, and one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the stored program instructions comprising:

program instructions to identify, by one or more processors, one or more users expected to consume media content, the media content having associated subtitle data;

program instructions to receive a user profile associated with a plurality of the one or more users;

program instructions to extract one or more features from each user profile, the one or more features representative of a characteristic of the user;

program instructions to create a group profile for plurality of the one or more users based upon the extracted features;

program instructions to receive the subtitle data associated with the media content;

program instructions to modify one or more portions of the subtitle data based upon the group profile to generate augmented subtitle data; and

program instructions to send the augmented subtitle data to a display device for being rendered in the display device.

20. The computer system of claim 19, the stored program instructions further comprising:

program instructions to render the augmented subtitle data in the display device.