SYSTEMS AND METHODS FOR PROCESSING VIDEO CONTENT TO IDENTIFY OBJECTS AND ASSOCIATE INFORMATION WITH IDENTIFIED OBJECTS

• US 20160110607A1
• Filed: 12/30/2015
• Published: 04/21/2016
• Est. Priority Date: 03/14/2013
• Status: Abandoned Application

• Current Assignee: Aperture Investments LLC
• Original Assignee: Aperture Investments LLC
• Inventors: FUZELL-CASEY, Jacquelyn
• Application Number:
  US14/984,788
• Publication Number:
  US 20160110607A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 33/10 Indicating arrangements; Warning arrangements G11B15/04, G11B19/04, G11B27/34, G11B27/36 take precedence
• CPC Class Codes: H04N 9/8715 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

Systems and methods for identifying objects, such as advertised items or other content, within video content, which may be sequitur or non-sequitur in nature. The identified objects may then be select from within video content by a user to access metadata associated with the objects. The identified objects may be identified to viewers by cues. Cues may be oral, visual or both oral and visual. One or more frames corresponding to a period of video depicting identified objects are displayed in separate object identifiers that may be viewed by the viewer and from within which the identified objects may be selected by the viewer.

Claims

1. A computer-implemented method for identifying objects depicted within a video, comprising:

utilizing a processor of a computer to access and process the video;

accepting as input to the processor one or more locations of one or more identified objects depicted in frames of the video, wherein such input is received from an object recognition system analyzing the video, and wherein each identified object is depicted in a set of one or more locations corresponding to two or more sections of each frame of the video;

for each identified object, associating with the processor the identified object with the set of one or more locations and a period during play of the video that the identified object would be depicted in the set of one or more locations; and

associating with the processor sequitur or non-sequitur information with each identified object, wherein the sequitur or non-sequitur information is not part of the video prior to object identification.

2. The method of claim 1, wherein the object recognition system tracks each identified object as the identified object is depicted in the video to determine the set of one or more locations.

3. The method of claim 1, wherein associating with the processor the identified object further includes associating the identified object with an object type.

4. The method of claim 1, wherein the sequitur or non-sequitur information includes one or more of an advertisement, object metadata, trivia, educational information, a link to another location, a game or a contest.

5. The method of claim 1, further comprising generating with the processor one or more cues for each identified object, wherein the one or more cues are provided to a viewer of the video to identify each identified object as a selectable object.

6. The method of claim 5, wherein the one or more cues have a predetermined minimum of perceptibility to the viewer.

7. The method of claim 6, wherein the one or more cues includes a first cue with a first predetermined minimum of perceptibility to the viewer and a second cue with a second predetermined minimum of perceptibility to the viewer, wherein the first predetermined minimum of perceptibility to the viewer is less than the second predetermined minimum of perceptibility to the viewer.

8. The method of claim 7, wherein the first cue is aural and the second cue is visual.

9. The method of claim 5, wherein the one or more cues include visible cues that are overlaid on the video as the video is played on a viewer screen, and wherein a position on the viewer screen of each of the one or more cues as the video is played to the viewer corresponds to the set of one or more locations for each identified object.

10. The method of claim 5, wherein the one or more cues include visible cues that are overlaid on the video as the video is played on a viewer screen, wherein a position on the viewer screen of each of the one or more cues as the video is played to the viewer corresponds to a portion of the set of one more locations for each identified object, and wherein the portion is based on one or more of a first period to time during which the identified object first appears in the video, a second period of time during prior to when the identified object disappears in the video, or a third period of time that intermittently corresponds to depiction of the identified object in the video.

11. The method of claim 5, further comprising generating with the processor one or more object identifiers on a viewer screen as the one or more cues are generated.

12. The method of claim 11, wherein the one or more object identifiers are displayed in a contiguous group and form a shape or pattern.

13. The method of claim 11, wherein the one or more object identifiers are not physically connected.

14. The method of claim 11, wherein each of the one or more object identifiers include one or more frames from the video depicting the identified object during the period.

15. The method of claim 14, wherein each of the one or more frames form a scene.

16. The method of claim 14, wherein the one or more cues include visible cues, and wherein each visible cue is transformed by the processor to an object identifier among the one or more object identifiers.

17. The method of claim 16, wherein transformation of a visible cue to the object identifier is animated.

18. The method of claim 14, further comprising:

displaying the one or more frames to the viewer on the viewer screen in response to an object identifier being selected by the viewer; and

providing the sequitur or non-sequitur information to the viewer in response to an identified object depicted in the one or more frames being selected by the viewer.

19. The method of claim 18, wherein the sequitur or non-sequitur information includes one or more of an advertisement, trivia, educational information, a link to another location, a game or a contest.

20. The method of claim 18, wherein providing the sequitur and non-sequitur information includes generating with the processor a visible cue corresponding to the identified object with the one or more frames.