Content annotation tool

• US 10,070,170 B2
• Filed: 09/02/2016
• Issued: 09/04/2018
• Est. Priority Date: 05/01/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Schneiderman, Henry Will, Sipe, Michael Andrew, Paglia, Marco, Koser, Mikkel Crone
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Hicks, Charles N
• Application Number:
  US15/256,249
• Publication Number:
  US 20160373796A1
• Time in Patent Office: 732 Days
• Field of Search: None
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content

Abstract

A content annotation tool is disclosed. In a configuration, a portion of a movie may be obtained from a database. Entities, such as an actor, background music, text, etc. may be automatically identified in the movie. A user, such as a content producer, may associate and/or provide supplemental content for an identified entity to the database. A selection of one or more automatically identified entities may be received. A database entry may be generated that links the identified entity with the supplemental content. The selected automatically identified one or more entities and//or supplemental content associated therewith may be presented to an end user.

Claims

1. A computer-implemented method, comprising:

automatically identifying, with a first processor, an actor within a first movie;

receiving, at the first processor, a first supplemental content about the actor and a second supplemental content about the actor, the first supplemental content related to a first time reference in the first movie, the second supplemental content related to a second time reference in the first movie digital content item, the first supplemental content and the second supplemental content being different from a text of a sound produced by the actor, each of the first supplemental content and the second supplemental content comprising at least one of a text, an audio entity, a visual entity, a uniform resource locator, a picture, an advertisement, or a location;

storing, by the first processor and in a database, the first supplemental content cross referenced to both the actor and the first time reference, and the second supplemental content cross referenced to both the actor and the second time reference;

causing, by a second processor and during a presentation of the first movie, the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference; and

causing, by the second processor and during a presentation of a second movie, at least one of the first supplemental content or the second supplemental content to be presented at a time reference in which the actor is present in the second movie, wherein the second movie item is different from the first movie.

2. The computer-implemented method of claim 1, wherein the second processor is the first processor.

3. The computer-implemented method of claim 1, further comprising:

receiving, at the second processor and at one of the first time reference or the second time reference, a request for supplemental content,

wherein causing one of the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference is in response to receiving the request.

4. The computer-implemented method of claim 1,

wherein the first supplemental content includes a location associated with the actor at the first time reference in the first movie, and

wherein the first supplemental content is presented on a map.

5. The computer-implemented method of claim 1, further comprising:

receiving, at the second processor and at the time reference in which the actor is present in the second movie, a request for supplemental content,

wherein causing the at least one of the first supplemental content or the second supplemental content to be presented at the time reference in which the actor is present in the second movie is in response to receiving the request.

6. A system, comprising:

a database;

a first processor configured to;

automatically identify an actor within a first movie,

receive a first supplemental content about the actor and a second supplemental content about the actor, the first supplemental content related to a first time reference in the first movie, the second supplemental content related to a second time reference in the first movie, the first supplemental content and the second supplemental content being different from a text of a sound produced by the actor, each of the first supplemental content and the second supplemental content comprising at least one of a text, an audio entity, a visual entity, a uniform resource locator, a picture, an advertisement, or a location; and

store, in the database, the first supplemental content cross referenced to both the actor and the first time reference, and the second supplemental content cross referenced to both the actor and the second time reference; and

a second processor configured to;

cause, during a presentation of the first movie, the first supplemental content to be presented at the first time reference and the second supplemental content to be presented at the second time reference; and

cause, during a presentation of a second movie, at least one of the first supplemental content or the second supplemental content to be presented at a time reference in which the actor is present in the second movie, wherein the second movie item is different from the first movie.

7. The system of claim 6, wherein the second processor is further configured to cause the presentation of the first movie.

8. The system of claim 6, wherein the second processor is the first processor.

9. The system of claim 6, wherein the second processor is further configured to:

receive, at one of the first time reference or the second time reference, a request for supplemental content,

wherein the second processor is configured to cause one of the first supplemental content to be presented at the first time reference or the second supplemental content to be presented at the second time reference in response to receiving the request.

10. The system of claim 6,

wherein the first supplemental content includes a location associated with the actor at the first time reference in the first movie, and

wherein the first supplemental content is presented on a map.

11. The system of claim 6, wherein the second processor is further configured to:

receive, at the time reference in which the actor is present in the second movie, a request for supplemental content, and

cause the at least one of the first supplemental content or the second supplemental content to be presented at the time reference in which the actor is present in the second digital content item in response to receiving the request.