Flick intel annotation methods and systems

• US 9,508,387 B2
• Filed: 12/22/2010
• Issued: 11/29/2016
• Est. Priority Date: 12/31/2009
• Status: Active Grant

• Current Assignee: FlickIntelligence, LLC (Ortiz & Lopez PLLC)
• Original Assignee: FlickIntelligence, LLC (Ortiz & Lopez PLLC)
• Inventors: Krukar, Richard, Ortiz, Luis, Lopez, Kermit
• Primary Examiner(s): Topgyal, Gelek W
• Application Number:
  US12/976,148
• Publication Number:
  US 20110158603A1
• Time in Patent Office: 2,169 Days
• Field of Search: 386/278, 725/105
• US Class Current: 1/1
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Video content is a time varying presentation of scenes or video frames. Each frame can contain a number of scene elements such as actors, foreground items, background items, or other items. A person enjoying video content can select a scene element by specifying a screen coordinate while the video content plays. Frame specification data identifies the specific frame or scene being displayed when the coordinate is selected. The coordinate in combination with the frame specification data is sufficient to identify the scene element that the person has chosen, information about the scene element can then be presented to the person. An annotation database can relate the scene elements to the frame specification data and coordinates.

Claims

1. A system comprising:

a display device that displays video content to a person wherein the video content comprises a plurality of frames;

a media device that provides the video content to the display device;

a pointing device that the person uses to choose a screen coordinate on the display device;

frame specification data that identifies the video content and which of the frames was displayed on the display device when the person chose the screen coordinate;

a query comprising the screen coordinate and the frame specification data; and

an element identifier provided by an annotation database in response to receiving the query wherein the annotation service comprises a human worker who determines the element identifier based upon the query.

2. The system of claim 1 wherein the video content is a movie, show, advertisement, or sporting event.

3. The system of claim 2 wherein the frame specification data comprises a timestamp and a media tag wherein the media tag uniquely identifies the video content to distinguish the video content from other prerecorded content, wherein the timestamp identifies a frame of the video content and wherein the frame was displayed to the user when the user chose the screen coordinate.

4. The system of claim 3 further comprising:

an additional data server that produces element data based on the element identifier; and

a data presentation that displays the element data to the person.

5. The system of claim 4 wherein the element identifier corresponds to an item for sale and the data presentation comprises an offer for the user to purchase the item.

6. The system of claim 4 wherein the element identifier corresponds to a person and the data presentation provides information about that person.

7. The system of claim 4 wherein the element identifier corresponds to a song and the data presentation comprises an offer for the user to purchase a copy of the song.

8. The system of claim 4 wherein the element identifier corresponds to a location and the data presentation comprises travel information for reaching the location.

9. The system of claim 1 further comprising:

an additional data server that produces element data based on the element identifier;

and a data presentation that displays the element data to the person.

10. A system comprising:

a display device that displays video content to a person wherein the video content comprises a plurality of frames;

a media device that provides the video content to the display device;

a pointing device that the person uses to choose a screen coordinate on the display device;

frame specification data that identifies the video content and which of the frames was displayed on the display device when the person chose the screen coordinate;

a query comprising the screen coordinate and the frame specification data; and

an element identifier provided by an annotation service in response to receiving the query wherein the annotation service is provided by a service provider wherein the annotation service comprises a human worker who determines the element identifier based upon the query.

11. The system of claim 10 wherein the annotation service comprises an annotation database running on a remote server and wherein the annotation database receives the query and provides the element identifier.

12. The system of claim 10 further comprising an annotation database wherein the human worker causes the frame specification data, the screen coordinate, and the element identifier to be entered into the annotation database.

13. The system of claim 10 further comprising an additional data server that produces element data based on the element identifier and wherein the human worker causes the element data to be provided to the person.

14. A method comprising:

receiving, by an annotation service, a query specifying a screen coordinate, video content and a frame of the video content, wherein the screen coordinate specifies a location within the frame, and wherein a person selected the screen coordinate within the frame; and

producing, by the annotation service, an element identifier corresponding to a scene element visible in the frame and located at the screen coordinate to thereby identify an on-screen item to the person wherein a human worker determines the element identifier based upon the query.

15. The method of claim 14 further comprising querying an annotation database to thereby obtain the element identifier.

16. The method of claim 15 wherein the element identifier specifies a purchasable item and wherein the element data comprises an offer for the user to buy the purchasable item.

17. The method of claim 15 wherein the scene element is a person.

18. The method of claim 14 further comprising:

locating element data relating to the element identifier; and

presenting the element data to the person.

19. The method of claim 18 wherein the element identifier specifies a purchasable item and wherein the element data comprises an offer for the user to buy the purchasable item.