Providing an annotation linking related entities in onscreen content
First Claim
1. A system comprising:
- a graph-based data store of entities connected by edges;
at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the system to;
receive a selection of a first entity represented by a visual cue in first annotation data for a screen capture image of a screen of a mobile device;
determine entities related to the first entity in the graph-based data store;
identify a second entity in the screen capture image that is one of the entities related to the first entity;
generate second annotation data, the second annotation data including a visual element linking the first entity and the second entity; and
provide the second annotation data for display with the screen on the mobile device.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are provided for providing insight for entities in mobile onscreen content. For example, a method includes receiving, from a mobile device, an indication of selection of a first entity represented by a visual cue in first annotation data for a screen capture image of a screen of the mobile device and determining entities related to the first entity in a graph-based data store. The method may also include identifying a second entity in the screen capture image that is one of the entities related to the first entity, generating second annotation data, the second annotation data including a visual element linking the first entity and the second entity, and providing the second annotation data for display with the screen on the mobile device.
-
Citations
28 Claims
-
1. A system comprising:
-
a graph-based data store of entities connected by edges; at least one processor; and memory storing instructions that, when executed by the at least one processor, cause the system to; receive a selection of a first entity represented by a visual cue in first annotation data for a screen capture image of a screen of a mobile device; determine entities related to the first entity in the graph-based data store; identify a second entity in the screen capture image that is one of the entities related to the first entity; generate second annotation data, the second annotation data including a visual element linking the first entity and the second entity; and provide the second annotation data for display with the screen on the mobile device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method comprising:
-
receiving, from a mobile device, an indication of selection of a first entity represented by a visual cue in first annotation data for a screen capture image of a screen of the mobile device; determining entities related to the first entity in a graph-based data store; identifying a second entity in the screen capture image that is one of the entities related to the first entity; generating second annotation data, the second annotation data including a visual element linking the first entity and the second entity; and providing the second annotation data for display with the screen on the mobile device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A mobile device comprising:
-
a display; at least one processor; and memory storing instructions that, when executed by the at least one processor, cause the mobile device to; receive a selection of a first entity having a selectable visual cue in first annotation data displayed with a screen on the display of the mobile device, the annotation data being generated using an image capture of the screen, provide the selection of the first entity to a server, receive second annotation data, the second annotation data including at least one visual element linking the first entity and a second entity identified in the screen, the first entity and the second entity being connected by at least one relationship in a graph-based data store, and display the second annotation data with the screen on the display of the mobile device. - View Dependent Claims (20, 21)
-
-
22. A mobile device comprising:
-
a display; a graph-based data store of entities connected by edges; at least one processor; and memory storing instructions that, when executed by the at least one processor, cause the mobile device to; receive a selection of a first entity represented by a visual cue in first annotation data for a screen capture image, the first annotation data being displayed with a screen on the display of the mobile device, determine entities related to the first entity in the graph-based data store, identify a second entity in the screen capture image that is one of the entities related to the first entity, generate second annotation data, the second annotation data including a visual element linking the first entity and the second entity, and displaying the second annotation data with the screen on the display of the mobile device. - View Dependent Claims (23, 24, 25, 26, 27, 28)
-
Specification