DISPLAY OF DATA OF EXTERNAL SYSTEMS IN SUBTITLES OF A MULTI-MEDIA SYSTEM

• US 20150326949A1
• Filed: 05/12/2014
• Published: 11/12/2015
• Est. Priority Date: 05/12/2014
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Burton, Peter H., Gupta, Manvendra, Litani, Helena
• Application Number:
  US14/274,830
• Publication Number:
  US 20150326949A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 5/278 Subtitling
• CPC Class Codes: H04N 7/0882 for the transmission of character code signals, e.g. for teletext circuits for the digital non-picture data signal H04N7/035

Abstract

A computer-implemented method for displaying data from external computing systems in subtitles of a multi-media system is provided. The computer-implemented method comprises analyzing data of an incoming media stream from at least one external computing system, wherein the data is analyzed to identify at least one of a text-based data, a voice-based data, or a video-based data of the least one external computing system that is associated with the multi-media system. The computer-implemented method further comprises augmenting at least one subtitle of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data. The computer-implemented method further comprises generating at least one annotation of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data.

Claims

1. A computer-implemented method for displaying data from external computing systems in subtitles of a multi-media system, the method comprising the steps of:

analyzing, by one or more processors, data of an incoming media stream from at least one external computing system, wherein the data is analyzed to identify at least one of a text-based data, a voice-based data, or a video-based data of the least one external computing system that is associated with a multi-media system;

performing, by the one or more processors, voice to text conversion of the identified at least one of the text-based data, the voice-based data, or the video-based data;

identifying, by the one or more processors, media content of at least one of the text-based data, the voice-based data, or the video-based data, during the voice to text conversion, wherein media content is converted to uniform resource identifiers;

augmenting, by the one or more processors, at least one subtitle of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data; and

generating, by the one or more processors, at least one annotation of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data.

2. The computer-implemented method according to claim 1, wherein the analyzed data of incoming media stream includes data of at least one social media source of the external computing system, and wherein the at least one subtitle of the multi-media system, and the generated annotation of the multi-media system includes the analyzed data of the at least one social media source.

3. The computer-implemented method of claim 1, further comprises the steps of:

identifying, by the one or more processors, a logotype graphical representation of an entity, wherein the logotype graphical representation is included in the media content during the voice to text conversion; and

converting, by the one or more processors, the logotype graphical representation to uniform resource identifiers of the entity, wherein the uniform resource identifiers of the entity include at least one of a product identity, or commercial offerings of the entity.

4. The computer-implemented method of claim 3, wherein the uniform resource identifiers of the entity are displayed in at least one subtitle of the multi-media system, and wherein the uniform resource identifiers of the entity are accessible, via a click, in the display of the at least one subtitle of the multi-media system.

5. The computer-implemented method of claim 1, wherein augmentation of the at least one subtitle of the multi-media system is at least one of a text display, or a visual display of the identified and converted at least one of the text-based data, the voice-based data, or the video-based data of the at least one subtitle of the multi-media system.

6. The computer-implemented method of claim 1, wherein the analyzing step, further comprises the steps of:

extracting, by the one or more processors, tags, of the data of the incoming media stream that are associated with the multi-media system, wherein the tags includes at least one of media content of the least one of text-based data, the voice-based data, or the video-based data of the least one external computing system;

recording, by the one or more processors, in a repository of the multi-media system, time, date, and location of the data of the incoming media stream of the at least one external computing system, wherein the repository includes searchable data, including, media content of data of the incoming media stream from the at least one or more external computing system; and

recording, by the one or more processors, in the repository of the multi-media system, identity of the data of the incoming media stream of the at least one external computing system, wherein the identity includes, at least one of a creator, or owner of the data of the incoming media stream.

7. The computer-implemented method of claim 6, wherein the time, date, and location of the data of the incoming media stream includes an identification of time, date, and location of the incoming media stream data creation, and wherein the identification of time, date, and location of the incoming media stream data creation is displayed in at least one subtitle of the multi-media system.

8. A computer system for displaying data from external computing systems in subtitles of a multi-media system, the computer system comprises:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices and program instructions which are stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the program instructions comprising;

program instructions to analyze data of an incoming media stream from at least one external computing system, wherein the data is analyzed to identify at least one of a text-based data, a voice-based data, or a video-based data of the least one external computing system that is associated with a multi-media system;

program instructions to perform voice to text conversion of the identified at least one of the text-based data, the voice-based data, or the video-based data;

program instructions to identify media content of at least one of the text-based data, the voice-based data, or the video-based data, during the voice to text conversion, wherein media content is converted to uniform resource identifiers;

program instructions to augment at least one subtitle of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data; and

program instructions to generate at least one annotation of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data.

9. The computer system of claim 8, wherein the analyzed data of incoming media stream includes data of at least one social media source of the external computing system, and wherein the at least one subtitle of the multi-media system, and the generated annotation of the multi-media system includes the analyzed data of the at least one social media source.

10. The computer system of claim 8, further comprises:

program instructions to identify a logotype graphical representation of an entity, wherein the logotype graphical representation is included in the media content during the voice to text conversion; and

program instructions to convert the logotype graphical representation to uniform resource identifiers of the entity, wherein the uniform resource identifiers of the entity include at least one of a product identity, or commercial offerings of the entity.

11. The computer system of claim 10, wherein the uniform resource identifiers of the entity are displayed in at least one subtitle of the multi-media system, and wherein the uniform resource identifiers of the entity are accessible, via a click, in the display of the at least one subtitle of the multi-media system.

12. The computer system of claim 8, wherein augmentation of the at least one subtitle of the multi-media system is at least one of a text display, or a visual display of the identified and converted at least one of the text-based data, the voice-based data, or the video-based data of the at least one subtitle of the multi-media system.

13. The computer system of claim 8, further comprises:

program instructions to extract tags, of the data of the incoming media stream that are associated with the multi-media system, wherein the tags includes at least one of media content of the least one of text-based data, the voice-based data, or the video-based data of the least one external computing system;

program instructions to record in a repository of the multi-media system, time, date, and location of the data of the incoming media stream of the at least one external computing system, wherein the repository includes searchable data, including, media content of data of the incoming media stream from the at least one or more external computing system; and

program instructions to record, in the repository of the multi-media system, identity of the data of the incoming media stream of the at least one external computing system, wherein the identity includes, at least one of a creator, or owner of the data of the incoming media stream.

14. The computer system of claim 13, wherein the time, date, and location of the data of the incoming media stream includes an identification of time, date, and location of the incoming media stream data creation, and wherein the identification of time, date, and location of the incoming media stream data creation is displayed in at least one subtitle of the multi-media system.

20. The computer program product of claim 8, further comprises:

program instructions to extract tags, of the data of the incoming media stream that are associated with the multi-media system, wherein the tags includes at least one of media content of the least one of text-based data, the voice-based data, or the video-based data of the least one external computing system;

program instructions to record in a repository of the multi-media system, time, date, and location of the data of the incoming media stream of the at least one external computing system, wherein the repository includes searchable data, including, media content of data of the incoming media stream from the at least one or more external computing system; and

program instructions to record, in the repository of the multi-media system, identity of the data of the incoming media stream of the at least one external computing system, wherein the identity includes, at least one of a creator, or owner of the data of the incoming media stream.

15. A computer program product for displaying data from external computing systems in subtitles of a multi-media system, the computer program product comprises:

one or more computer-readable tangible storage devices and program instructions stored on at least one of the one or more storage devices, the program instructions comprising;

program instructions to analyze data of an incoming media stream from at least one external computing system, wherein the data is analyzed to identify at least one of a text-based data, a voice-based data, or a video-based data of the least one external computing system that is associated with a multi-media system;

program instructions to perform voice to text conversion of the identified at least one of the text-based data, the voice-based data, or the video-based data;

program instructions to identify media content of at least one of the text-based data, the voice-based data, or the video-based data, during the voice to text conversion, wherein media content is converted to uniform resource identifiers;

program instructions to augment at least one subtitle of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data; and

program instructions to generate at least one annotation of the multi-media system with the identified and converted at least one of the text-based data, the voice-based data, or the video-based data.

16. The computer program product of claim 15, wherein the analyzed data of incoming media stream includes data of at least one social media source of the external computing system, and wherein the at least one subtitle of the multi-media system, and the generated annotation of the multi-media system includes the analyzed data of the at least one social media source.

17. The computer program product of claim 15, further comprises:

program instructions to identify a logotype graphical representation of an entity, wherein the logotype graphical representation is included in the media content during the voice to text conversion; and

program instructions to convert the logotype graphical representation to uniform resource identifiers of the entity, wherein the uniform resource identifiers of the entity include at least one of a product identity, or commercial offerings of the entity.

18. The computer program product of claim 17, wherein the uniform resource identifiers of the entity are displayed in at least one subtitle of the multi-media system, and wherein the uniform resource identifiers of the entity are accessible, via a click, in the display of the at least one subtitle of the multi-media system.

19. The computer program product of claim 15, wherein augmentation of the at least one subtitle of the multi-media system is at least one of a text display, or a visual display of the identified and converted at least one of the text-based data, the voice-based data, or the video-based data of the at least one subtitle of the multi-media system.