CONTENT ANNOTATION TOOL

• US 20160373796A1
• Filed: 09/02/2016
• Published: 12/22/2016
• Est. Priority Date: 05/01/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Schneiderman, Henry Will, Sipe, Michael Andrew, Paglia, Marco, Kser, Mikkel Crone
• Granted Patent: US 10,070,170 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content

Abstract

A content annotation tool is disclosed. In a configuration, a portion of a movie may be obtained from a database. Entities, such as an actor, background music, text, etc. may be automatically identified in the movie. A user, such as a content producer, may associate and/or provide supplemental content for an identified entity to the database. A selection of one or more automatically identified entities may be received. A database entry may be generated that links the identified entity with the supplemental content. The selected automatically identified one or more entities and//or supplemental content associated therewith may be presented to an end user.

Claims

1. (canceled)

2. A computer-implemented method, comprising:

automatically identifying, with a first processor, an entity within a first digital content item;

receiving, at the first processor, a first supplemental content about the entity and a second supplemental content about the entity, the first supplemental content related to a first time reference in the first digital content item, the second supplemental content related to a second time reference in the first digital content item, the first supplemental content and the second supplemental content being different from a text of a sound produced by the entity;

storing, by the first processor and in a database, the first supplemental content cross referenced to both the entity and the first time reference, and the second supplemental content cross referenced to both the entity and the second time reference; and

causing, by a second processor and during a presentation of the first digital content item, the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference.

3. The computer-implemented method of claim 2, wherein the second processor is the first processor.

4. The computer-implemented method of claim 2, wherein the entity comprises at least one of visual component of the first digital content item or an audio component of the first digital content item.

5. The computer-implemented method of claim 2, wherein the first digital content item comprises at least one of a video digital content item or an audio digital content item.

6. The computer-implemented method of claim 2, further comprising receiving, at the second processor and at a time reference, a request for a supplemental content, wherein the causing is in response to the receiving the request.

7. The computer-implemented method of claim 2, wherein the first supplemental content is a location associated with the entity at the first time reference in the first digital content item, and wherein the causing further comprises causing the first supplemental content to be presented on a map.

8. The computer-implemented method of claim 2, further comprising causing, by the second processor and during a presentation of a second digital content item, at least one of the first supplemental content or the second supplemental content to be presented at a time reference in which the entity is present in the second digital content item.

9. The computer-implemented method of claim 8, further comprising receiving, at the second processor and at the time reference, a request for a supplemental content, wherein the causing the at least one of the first supplemental content or the second supplemental content to be presented at the time reference in which the entity is present in the second digital content item is in response to the receiving the request.

10. A system, comprising:

a database;

a first processor configured to;

automatically identify an entity within a first digital content item,

receive a first supplemental content about the entity and a second supplemental content about the entity, the first supplemental content related to a first time reference in the first digital content item, the second supplemental content related to a second time reference in the first digital content item, the first supplemental content and the second supplemental content being different from a text of a sound produced by the entity, and

store, in the database, the first supplemental content cross referenced to both the entity and the first time reference, and the second supplemental content cross referenced to both the entity and the second time reference; and

a second processor configured to cause, during a presentation of the first digital content item, the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference.

11. The system of claim 10, wherein the second processor is further configured to cause the presentation of the first digital content item.

12. The system of claim 10, wherein the second processor is the first processor.

13. The system of claim 10, wherein the entity comprises at least one of visual component of the first digital content item or an audio component of the first digital content item.

14. The system of claim 10, wherein the first digital content item comprises at least one of a video digital content item or an audio digital content item.

15. The system of claim 10, wherein the second processor is further configured to receive, at a time reference, a request for a supplemental content, wherein the second processor is configured to cause the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference in response to a receipt of the request.

16. The system of claim 10, wherein the first supplemental content is a location associated with the entity at the first time reference in the first digital content item, and wherein the second processor is configured to cause the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference by causing the first supplemental content to be presented on a map.

17. The system of claim 10, wherein the second processor is further configured to cause, during a presentation of a second digital content item, at least one of the first supplemental content or the second supplemental content to be presented at a time reference in which the entity is present in the second digital content item.

18. The system of claim 17, wherein the second processor is further configured to receive, at the time reference, a request for a supplemental content, and wherein the second processor is configured to cause the at least one of the first supplemental content or the second supplemental content to be presented at the time reference in which the entity is present in the second digital content item in response to a receipt of the request.

19. A computer device, comprising:

a processor configured to;

obtain a portion of a movie, automatically identify an entity within the portion of the movie using a technique selected from the group consisting of;

face recognition, voice recognition, object recognition, individual characteristic recognition, scene break recognition, object tracking, speech recognition, and audio recognition,

receive supplemental content from a first user about the identified entity within the movie, the first user being associated with a making of the movie, subsequent to receipt of the supplemental content,

receive an update to the supplemental content about the identified entity within the movie, wherein the update to the supplemental content modifies or replaces the supplemental content,

receive a request from a second user for information related to a location of the second user, the second user being a consumer of the movie, the location of the second user being determined from a view of the location of the second user captured by an electronic device of the second user, and,

responsive to the request, provide, to the second user, the information related to the location of the second user and at least one item of the supplemental content, from the update to the supplemental content, related to the location of the second user; and

a memory configured to store the movie, the supplemental content, the update to the supplemental content, and the information related to the location of the second user.

20. A computer device, comprising:

a processor configured to;

automatically identify an entity in a movie using a technique selected from the group consisting of;

face recognition, voice recognition, object recognition, individual characteristic recognition, scene break recognition, object tracking, speech recognition, and audio recognition,

obtain supplemental content for the entity identified in the movie,

subsequently, receive an update to the supplemental content for the identified entity in the movie, wherein the update to the supplemental content modifies or replaces the supplemental content,

provide the movie, receive, from a user, a query for information related to a location of the user, wherein the query is received by an input method during playback of the movie and the location of the user is determined from a view of the location of the user captured by an electronic device of the user,

retrieve, from a database, the information related to the location of the user and at least one item of the supplemental content, of the update to the supplemental content about the identified entity, related to the location of the user, wherein the database comprises a plurality of automatically identified entities for a plurality of movies and corresponding supplemental content, and

provide, to the user, a response to the query wherein the response includes the update to the supplemental content; and

a memory configured to store the movie, the supplemental content, the update to the supplemental content, and the information related to the location of the user.

21. A computer device, comprising:

a processor configured to;

receive supplemental content,

obtain content,

automatically identify an entity in the content using a technique selected from the group consisting of;

face recognition, voice recognition, object recognition, individual characteristic recognition, scene break recognition, object tracking, speech recognition, and audio recognition,

subsequent to receipt of the supplemental content, receive an update to the supplemental content about the identified entity within the content, wherein the update to the supplemental content modifies or replaces the supplemental content,

retrieve a portion of the update to the supplemental content based on the entity,

provide, to a user, a portion of the content, the portion of the content including the identified entity,

receive, from the user, a request for information related to a location of the user and based upon the portion of the content and the identified entity, the location of the user determined from a view of the location of the user captured by an electronic device of the user,

and, responsive to the request, provide, to the user, the information related to the location of the user and at least one item of the supplemental content, of the update to the supplemental content, related to the location of the user; and

a memory configured to store the content, the supplemental content, the update to the supplemental content, a database entry that links the identified entity with the portion of the update to the supplemental content while the entity is present in the content, and the information related to the location of the user.