Barrage message processing

• US 10,834,355 B2
• Filed: 03/25/2019
• Issued: 11/10/2020
• Est. Priority Date: 01/04/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cao, Xiao Cao, Huang, Yu, Jin, Yuan, Peng, Chengyu, Qian, Yin, Shao, Xiao Rui, Wang, Jian Jun
• Primary Examiner(s): Monshi, Samira
• Application Number:
  US16/362,926
• Publication Number:
  US 20190222792A1
• Time in Patent Office: 596 Days
• Field of Search: None
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/44504 Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits

Abstract

Approaches presented herein enable displaying a barrage message. Specifically, one or more objects and location information for each object in a frame of a video are identified. A barrage message to be displayed in the frame of the video is obtained. The barrage message is displayed without covering any object in the frame.

Claims

1. A computer-implemented method for displaying a barrage message, comprising:

tracking a visual focus of a user as the user is consuming a video;

identifying an object in a frame of the video that is a subject of the visual focus of the user;

obtaining a plurality of barrage messages that are related to the subject of the visual focus of the user;

ranking each of the plurality of barrage messages based on at least one item selected from the group consisting of a degree of relevance to the object and a set of user preferences in a user profile;

selecting, from among the plurality of barrage messages, the barrage message to be displayed in the frame of the video of the user based on the ranking;

displaying the barrage message in a non-obscuring display location within the frame of the video; and

selecting at least one lower ranked barrage message, for which display to the user does not occur, based on the ranking and a number of non-obscuring barrage messages that can be displayed in the frame of the video.

2. The computer-implemented method of claim 1, further comprising identifying a character object from among the one or more objects, obtaining information of the character object, and saving the information as metadata.

3. The computer-implemented method of claim 1, further comprising sorting the one or more objects of the frame of the video based on background data.

4. The computer-implemented method of claim 3, wherein the background data is selected from a group consisting of data input by a user, information related to each of the one or more objects, search volume data related to each of the one or more objects, a size related to each of the one or more objects, a user preference, and a visual focus of a user.

5. The computer-implemented method of claim 1, further comprising determining an object corresponding to the barrage message and displaying the barrage message nearby the corresponding object.

6. The computer-implemented method of claim 1, further comprising determining a topic related to the barrage message and displaying a picture related to the topic.

7. A computer program product for displaying a barrage message, the computer program product being stored on a computer readable storage device and including program instructions that cause at least one computer device to:

track a visual focus of a user as the user is consuming a video;

identifying an object in a frame of the video that is a subject of the visual focus of the user;

obtain a plurality of barrage messages that are related to the subject of the visual focus of the user;

rank each of the plurality of barrage messages based on at least one of a degree of relevance to the objects and a set of user preferences in a user profile;

select, from among the plurality of barrage messages, the barrage message to be displayed in the frame of the video of the user based on the ranking;

display the barrage message in a non-obscuring display location within the frame of the video; and

select at least one lower ranked barrage message, for which display to the user does not occur, based on the ranking and a number of non-obscuring barrage messages that can be displayed in the frame of the video.

8. The computing program product of claim 7, further comprising program instructions to identify a character object from among the one or more objects, obtain information of the character object, and save the information as metadata.

9. The computing program product of claim 7, further comprising program instructions to sort the one or more objects of the frame of the video based on background data.

10. The computing program product of claim 9, wherein the background data is selected from a group consisting of information related to each of the one or more objects, search volume data related to each of the one or more objects, a size related to each of the one or more objects, a set of user preferences recorded in a user profile, and a visual focus of a user.

11. The computing program product of claim 7, further comprising program instructions to determine an object corresponding to the barrage message and display the barrage message nearby the corresponding object such that a display of the lower ranked barrage message to the specific user does not occur.

12. The computing program product of claim 7, further comprising program instructions to set the barrage message in a scope of the object'"'"'s location to be transparent, display the barrage message by bypassing the scope of the object'"'"'s location, and destroy the barrage message in the scope of the object'"'"'s location.

13. A computer system for displaying a barrage message, the computer system comprising:

a memory medium comprising program instructions;

a bus coupled to the memory medium; and

a processor for executing the program instructions, the instructions causing the system to;

track a visual focus of a user as the user is consuming a video;

identify an object in a frame of the video that is a subject of the visual focus of the user;

obtain a plurality of barrage messages that are related to the subject of the visual focus of the user;

rank each of the plurality of barrage messages based on at least one of a degree of relevance to the objects and a set of user preferences in a user profile;

select, from among the plurality of barrage messages, the barrage message to be displayed in the frame of the video of the user based on the ranking;

display the barrage message in a non-obscuring display location within the frame of the video; and

select at least one lower ranked barrage message, for which display to the user does not occur, based on the ranking and a number of non-obscuring barrage messages that can be displayed in the frame of the video.

14. The computer system of claim 13, further comprising program instructions to identify a character object from among the one or more objects, obtain information of the character object, and save the information as metadata.

15. The computer system of claim 13, further comprising program instructions to sort the one or more objects of the frame of the video based on background data.

16. The computer system of claim 15, wherein the background data is selected from a group consisting of data input by user, information related to each of the one or more objects, search volume data related to each of the one or more objects, a size related to each of the one or more objects, a user preference, and a visual focus of a user.

17. The computer system of claim 13, further comprising program instructions to determine an object corresponding to the barrage message and display the barrage message nearby the corresponding object.