AUTOMATIC IDENTIFICATION OF RELATIONSHIPS BETWEEN A CENTER OF ATTENTION AND OTHER INDIVIDUALS/OBJECTS PRESENT IN AN IMAGE OR VIDEO

• US 20200134315A1
• Filed: 10/31/2018
• Published: 04/30/2020
• Est. Priority Date: 10/31/2018
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: TRIM, Craig M., RAKSHIT, Sarbajit K., POVAR, Victor, KATAHIRA, Reinaldo T.
• Granted Patent: US 11,244,162 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

A computer-implemented method includes: accessing, by a computing device, content stored or captured by a user device; determining, by the computing device, context associated with the content; determining, by the computing device, a center of attention of the content based on the context; identifying, by the computing device, relationships between the center of attention and one or more other individuals or objects present in the content; and outputting, by the computing device, information identifying the relationships for displaying the information identifying the relationships on a content viewer application.

Claims

1. A computer-implemented method comprising:

accessing, by a computing device, content stored or captured by a user device;

determining, by the computing device, context associated with the content;

determining, by the computing device, a center of attention of the content based on the context;

identifying, by the computing device, relationships between the center of attention and one or more other individuals or objects present in the content; and

outputting, by the computing device, information identifying the relationships for displaying the information identifying the relationships on a content viewer application.

2. The computer-implemented method of claim 1, further comprising obtaining data related to the center of attention, wherein the identifying the relationships is based on the obtaining the data.

3. The computer-implemented method of claim 2, wherein the data related to the center of attention includes at least one selected from the group consisting of:

social media data;

family history data;

personal information;

emotional state data; and

biometrics information.

4. The computer-implemented method of claim 1, wherein the user device is a wearable computing device.

5. The computer-implemented method of claim 1, wherein the user device displays the information identifying the relationships in the form of tags.

6. The computer-implemented method of claim 1, wherein the determining the context is based on metadata stored within the content or pixel-based classification information associated with the content.

7. The computer-implemented method of claim 1, wherein the determining the context comprises identifying an event associated with the content.

8. The computer-implemented method of claim 1, further comprising receiving user input confirming or correcting the relationships and updating future identification of relationships based on the user input.

9. The computer-implemented method of claim 1, wherein the accessing the content comprises accessing live content in real time.

10. The computer-implemented method of claim 1, wherein a service provider at least one of creates, maintains, deploys and supports the computing device.

11. The computer-implemented method of claim 1, wherein the accessing the content, the determining the context, the determining the center of attention, the identifying the relationships, and the outputting the information identifying the relationships are provided by a service provider on a subscription, advertising, and/or fee basis.

12. The computer-implemented method of claim 1, wherein the computing device includes software provided as a service in a cloud environment.

13. The computer-implemented method of claim 1, further comprising deploying a system, wherein the deploying the system comprises providing a computer infrastructure operable to perform the accessing the content, the determining the context, the determining the center of attention, the identifying the relationships, and the outputting the information identifying the relationships.

14. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to:

access footage from a camera;

determine a context associated with the footage;

determine a center of attention of the content based on the context;

identify relationships between the center of attention and one or more other individuals present in the footage; and

output information identifying the relationships for displaying the information identifying the relationships on a content viewer application.

15. The computer program product of claim 14, wherein the user device displays the information identifying the relationships in the form of tags.

16. The computer program product of claim 14, wherein the determining the context is based on metadata stored within the content or pixel-based classification information associated with the content.

17. The computer program product of claim 14, wherein the determining the context comprises identifying an event associated with the content.

18. The computer program product of claim 14, wherein the accessing the footage comprises accessing the footage live in real time.

19. A system comprising:

a processor, a computer readable memory and a computer readable storage medium associated with a computing device;

program instructions to access content stored or captured by a user device and selected, by a user via a user interface associated with a content viewer application, to be analyzed for relationship identification;

program instructions to determine context associated with the content;

program instructions to determine a center of attention of the content based on the context;

program instructions to identify relationships between the center of attention and one or more other individuals or objects present in the content; and

program instructions to output information identifying the relationships for displaying the information identifying the relationships on a content viewer application,

wherein the program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

20. The system of claim 19 further comprising program instructions to obtain data related to the center of attention, wherein:

the identifying the relationships is based on the obtaining the data; and

the data related to the center of attention includes at least one selected from the group consisting of;

social media data;

family history data;

personal information;

emotional state data; and

biometrics information.