Method and apparatus for providing a program guide having search parameter aware thumbnails

• US 8,782,709 B2
• Filed: 02/19/2009
• Issued: 07/15/2014
• Est. Priority Date: 02/19/2009
• Status: Active Grant

• Current Assignee: Hulu LLC (The Walt Disney Company)
• Original Assignee: Hulu LLC (The Walt Disney Company)
• Inventors: Wang, Zhibing, Yang, Ting-hao, Tang, Yizhe, Chang, Qian
• Primary Examiner(s): Ly, Cheyne D
• Application Number:
  US12/389,249
• Publication Number:
  US 20100211584A1
• Time in Patent Office: 1,972 Days
• Field of Search: 725/41, 725/53, 707/769, 707/915
• US Class Current: 725/53
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: Y10S 707/915 Image

Abstract

A method, apparatus, article of manufacture, and a memory structure for presenting a program guide for a video-on-demand system describing a plurality of media programs, each media program having a plurality of video frames. In one embodiment, the method comprises the steps of accepting a search request from a user, the search request comprising a search parameter having a search value; searching the media program database for the search value, the media program database having first metadata associated with a first individual video frame of the media program; and providing the program guide comprising a thumbnail depicting the first individual video frame of the media program associated with the first metadata to the user if the first metadata includes the search value.

Claims

1. A method of presenting a program guide, comprising:

(a) receiving a media program, the media program received from a media program source wherein the media program comprises a plurality of video frames, the media program one of a plurality of media programs of a media program database;

(b) searching the plurality of video frames of the received media program to identify a set of video frames that depict different performers in a plurality of performers;

(c) generating thumbnail metadata for the identified set of video frames, the thumbnail metadata relating information describing one of the plurality of performers to an identifier of the identified video frame that depicts the one of the plurality of performers;

(d) associating the thumbnail metadata with the received media program in the media program database;

(e) accepting a search request from a user, the search request comprising a search parameter having a search value associated with one of the plurality of performers;

(f) searching the media program database for the search value;

(g) determining when the search value corresponds to the information describing a performer in the plurality of performers;

(h) determining the identifier related to the information describing the performer in the thumbnail metadata; and

(i) providing a search result identifying the media program, wherein a thumbnail of a video frame that depicts the performer is determined using the determined identifier and used to identify the media program in the search result, and wherein different thumbnails of different video frames that depict different performers in the plurality of performers are used to identify the media program in search results corresponding to different search requests for different performers.

2. The method of claim 1, wherein:

the media program comprises a plurality of scenes;

the performer is depicted in a plurality of scenes; and

the thumbnail metadata further comprises an identifier of a video frame that depicts the performer in each of the plurality of scenes.

3. The method of claim 1, wherein the method further comprises receiving media program metadata comprising information identifying the performer depicted in the media program.

4. The method of claim 3, wherein receiving media program metadata comprising information identifying the performer depicted in the media program comprises:

webcrawling for the information identifying the performer depicted in the media program.

5. The method of claim 3, wherein receiving media program metadata comprising information identifying the performer depicted in the media program comprises receiving the information from a media provider.

6. The method of claim 3, wherein:

the media program depicts the plurality of performers;

the received media program metadata comprises information regarding the plurality of performers; and

the method further comprises repeating steps (b)-(d) for all of the plurality of performers identified by the information.

7. The method of claim 3, wherein:

the information identifying the performer depicted in the media program comprises performer information; and

wherein searching the plurality of video frames of the received media program to identify the set of video frames that depict the different performers comprises;

extracting the set of video frames of the media program, wherein each extracted video frame is separated from an adjacent extracted video frame by a fixed time interval;

performing facial recognition on the extracted video frames to identify a video frame that depicts a human face;

comparing the human face in the identified video frame with an image of the performer identified by the performer information; and

identifying the identified video frame as depicting the performer if the human face in the identified frame and the image match.

8. The method of claim 7, wherein the media program comprises a plurality of scenes and wherein:

(b) comprises searching the plurality of video frames of the media program to identify the set of video frames that depict different performers, the identified set of video frames including frames in the plurality of scenes; and

(c) comprises generating further thumbnail metadata for the set of video frames, the further metadata further relating the information describing the different performers to an associated identifier for each of the identified video frames that depict the different performers.

9. The method of claim 8, wherein:

the thumbnail metadata further comprises scene information describing each of the plurality of scenes in which a frame depicting the performer is disposed; and

the search request comprises a second search parameter having a second value describing a scene; and

providing a thumbnail of the at least one video frame that depicts the performer if the search value matches the information describing the performer comprises;

providing a thumbnail of the video frame that depicts the performer if the search value matches the information describing the performer and the second value matches the scene information associated with the video frame.

10. The method of claim 7, wherein:

comparing the human face in the identified frame with the image produces a plurality of matches, each match associated with a matching confidence; and

identifying the identified frame as depicting the performer if the human face in the identified frame and the image match comprises identifying the identified frame having the highest matching confidence as the frame depicting the performer.

11. An apparatus for presenting a program guide, comprising a processor communicatively coupled to a memory storing instructions:

means, performed by the processor according to the instructions stored in the memory, for receiving a media program in a video-on-demand system, the media program received from a media program source wherein the media program comprises a plurality of video frames, the media program one of a plurality of media programs of a media program database;

means, performed by the processor according to the instructions stored in the memory, for searching the plurality of video frames of the received media program to identify a set of video frames that depict different performers;

means, performed by the processor according to the instructions stored in the memory, for generating thumbnail metadata for the identified set of video frames, the thumbnail metadata relating information describing one of the plurality of performers to an identifier of the identified video frame that depicts the one of the plurality of performers;

means, performed by the processor according to the instructions stored in the memory, for associating the thumbnail metadata with the received media program in a the media program database;

means, performed by the processor according to the instructions stored in the memory, for accepting a search request from a user, the search request comprising a search parameter having a search value associated with one of the plurality of performers;

means, performed by the processor according to the instructions stored in the memory, for searching the media program database for the search value for the performer;

means, performed by the processor according to the instructions stored in the memory, for determining when the search value corresponds to the information describing a performer in the plurality of performers; and

means, performed by the processor according to the instructions stored in the memory, for determining the identifier related to the information describing the performer in the thumbnail metadata; and

means, performed by the processor according to the instructions stored in the memory, for providing a search result identifying the media program, wherein a thumbnail of a video frame that depicts the performer is determined using the determined identifier and used to identify the media program in the search result, and wherein different thumbnails of different video frames that depict different performers in the plurality of performers are used to identify the media program in search results corresponding to different search requests for different performers.

12. The apparatus of claim 11, wherein:

the media program comprises a plurality of scenes;

the performer is depicted in a plurality of scenes; and

the thumbnail metadata further comprises an identifier of a video frame that depicts the performer in each of the plurality of scenes.

13. The apparatus of claim 11, further comprising means, performed by the processor according to the instructions stored in the memory, for receiving media program metadata comprising information identifying the performer depicted in the media program.

14. The apparatus of claim 13, wherein the means for receiving media program metadata comprising information identifying performer depicted in the media program comprises:

means, performed by the processor according to the instructions stored in the memory, for webcrawling for the information identifying the performer depicted in the media program.

15. The apparatus of claim 13, wherein the means for receiving media program metadata comprising information identifying the performer depicted in the media program comprises means, performed by the processor according to the instructions stored in the memory, for receiving the information from a media provider.

16. The apparatus of claim 13, wherein:

the received media program metadata comprises information regarding the plurality of performers; and

the apparatus searches the plurality of video frames of the received media program to identify a video frame that depicts each of the performers, generates thumbnail metadata for the identified video frame depicting each of the performers, wherein the thumbnail metadata relates information describing each of the performers to an identifier of the identified video frame that depicts each of the performers, and associates the thumbnail metadata with the media program in a media program database.

17. The apparatus of claim 13, wherein:

the information identifying the performer depicted in the media program comprises performer information; and

wherein the means for searching the plurality of video frames of the received media program to identify the set of video frames that depict the different performers comprises;

means, performed by the processor according to the instructions stored in the memory, for extracting the set of video frames of the media program, wherein each extracted video frame is separated from an adjacent extracted video frame by a fixed time interval;

means, performed by the processor according to the instructions stored in the memory, for performing facial recognition on the extracted video frames to identify a video frame that depicts a human face;

means, performed by the processor according to the instructions stored in the memory, for comparing the human face in the identified video frame with an image of the performer identified by the performer information; and

means, performed by the processor according to the instructions stored in the memory, for identifying the identified video frame as depicting the performer if the human face in the identified frame and the image match.

18. The apparatus of claim 17, wherein the media program comprises a plurality of scenes and wherein:

the means for searching the plurality of video frames of the received media program to identify the set of video frames that depict a performer comprises means, performed by the processor according to the instructions stored in the memory, for searching the plurality of video frames of the media program to identify the set of video frames that depict different performers, the identified set of video frames including frames in the plurality of scenes; and

the means for generating thumbnail metadata for the identified video frame, the thumbnail metadata relating information describing the performer to an identifier of the identified video frame that depicts the performer comprises means, performed by the processor according to the instructions stored in the memory, for generating further thumbnail metadata for the set of video frames, the further metadata further relating the information describing the different performers to an associated identifier for each of the identified video frames that depict the different performers.

19. The apparatus of claim 18, wherein:

the thumbnail metadata further comprises scene information describing each of the plurality of scenes in which a frame depicting the performer is disposed; and

the search request comprises a second search parameter having a second value describing a scene; and

the means for providing a thumbnail of the video frame that depicts the performer if the search value matches the information describing the performer comprises;

means, performed by the processor according to the instructions stored in the memory, for providing a thumbnail of the video frame that depicts the performer if the search value matches the information describing the performer and the second value matches the scene information associated with the video frame.

20. The apparatus of claim 17, wherein:

the means for comparing the human face in the identified frame with the image produces a plurality of matches, each match associated with a matching confidence; and

the means for identifying the identified frame as depicting the performer if the human face in the identified frame and the image match comprises means, performed by the processor according to the instructions stored in the memory, for identifying the identified frame having the highest matching confidence as the frame depicting the performer.

21. A program storage device, readable by a computer, tangibly embodying at least one program of instructions executable by the computer to perform method steps of presenting a program guide, the method comprising:

(a) receiving a media program, the media program received from a media program source wherein the media program comprises a plurality of video frames, the media program one of a plurality of media programs of a media program database;

(b) searching the plurality of video frames of the received media program to identify a set of video frames that depict different performers in a plurality of performers;

(c) generating thumbnail metadata for the identified set of video frames, the thumbnail metadata relating information describing one of the plurality of performers to an identifier of the identified video frame that depicts the one of the plurality of performers;

(d) associating the thumbnail metadata with the received media program in the media program database;

(e) accepting a search request from a user, the search request comprising a search parameter having a search value associated with one of the plurality of performers;

(f) searching the media program database for the search value;

(g) determining when the search value corresponds to the information describing a performer in the plurality of performers;

(h) determining the identifier related to the information describing the performer in the thumbnail metadata; and

(i) providing a search result identifying the media program, wherein a thumbnail of a video frame that depicts the performer is determined using the determined identifier and used to identify the media program in the search result, and wherein different thumbnails of different video frames that depict different performers in the plurality of performers are used to identify the media program in search results corresponding to different search requests for different performers.

22. The program storage device of claim 21, wherein:

the media program comprises a plurality of scenes;

the performer is depicted in a plurality of scenes; and

the thumbnail metadata further comprises an identifier of a video frame that depicts the performer in each of the plurality of scenes.

23. The program storage device of claim 21, wherein the method further comprises receiving media program metadata comprising information identifying the performer depicted in the media program.

24. The program storage device of claim 23, wherein receiving media program metadata comprising information identifying performer depicted in the media program comprises:

webcrawling for the information identifying the performer depicted in the media program.

25. The program storage device of claim 23, wherein receiving media program metadata comprising information identifying the performer depicted in the media program comprises receiving the information from a media provider.

26. The program storage device of claim 23, wherein:

the received media program metadata comprises information regarding the plurality of performers; and

the method steps further comprises the step of repeating steps (b)-(d) for all of the plurality of performers identified by the information.

27. The program storage device of claim 23, wherein:

the information identifying the performer depicted in the media program comprises performer information; and

wherein searching the plurality of video frames of the received media program to identify the set of video frames that depict the different performers comprises;

extracting the set of video frames of the media program, wherein each extracted video frame is separated from an adjacent extracted video frame by a fixed time interval;

performing facial recognition on the extracted video frames to identify a video frame that depicts a human face;

comparing the human face in the identified video frame with an image of the performer identified by the performer information; and

identifying the identified video frame as depicting the performer if the human face in the identified frame and the image match.

28. The program storage device of claim 27, wherein the media program comprises a plurality of scenes and wherein:

(b) comprises searching the plurality of video frames of the media program to identify the set of video frames that depict different performers, the identified set of video frames including frames in the plurality of scenes; and

(c) comprises generating further thumbnail metadata for the set of video frames, the further metadata further relating the information describing the different performers to an associated identifier for each of the identified video frames that depict the different performers.

29. The program storage device of claim 28, wherein:

the thumbnail metadata further comprises scene information describing each of the plurality of scenes in which a frame depicting the performer is disposed; and

the search request comprises a second search parameter having a second value describing a scene; and

the method step of providing a thumbnail of the at least one video frame that depicts the performer if the search value matches the information describing the performer comprises the method step of;

providing a thumbnail of the video frame that depicts the performer if the search value matches the information describing the performer and the second value matches the scene information associated with the video frame.

30. The program storage device of claim 27, wherein:

the method step of comparing the human face in the identified frame with the image produces a plurality of matches, each match associated with a matching confidence; and

the method step of identifying the identified frame as depicting the performer if the human face in the identified frame and the image match comprises the method step of identifying the identified frame having the highest matching confidence as the frame depicting the performer.

31. A method of presenting a program guide, describing a plurality of media programs, each media program having a plurality of video frames, the method comprising:

accepting a search request from a user, the search request comprising a search parameter having a search value;

searching a media program database for the search value, the media program database having first metadata associated with a first individual video frame of the media program;

determining if the first metadata includes the search value for a performer, wherein the first metadata associated with the first individual video frame of the media program is generated by performing;

receiving the media program from a media program source;

searching the plurality of video frames of the media program to identify a video frame that depicts the performer; and

generating the first metadata associated with the video frame that depicts the performer, the first metadata relating information describing the performer to an identifier of the identified video frame that depicts the performer; and

providing the program guide comprising a thumbnail depicting the performer included in the first individual video frame of the media program associated with the first metadata to the user if the first metadata includes the search value, wherein the thumbnail is used to identify the media program in the program guide, and wherein different thumbnails of different video frames that depict different performers are used to identify the media program in the program guide for different search requests for different performers.

32. The method of claim 31, wherein the media program database further has second metadata associated with a second individual frame of the media program, and wherein the method further comprises:

providing a second thumbnail depicting the second individual frame of the media program if the second metadata includes the search parameter.

33. The method of claim 31, wherein:

the method further comprises receiving media program metadata comprising information identifying performers depicted in the media program; and

searching the plurality of video frames of the media program to identify a video frame that depicts the performer and generating the first metadata associated with the video frame that depicts the performer is performed for each of the identified performers.

34. The method of claim 31, wherein:

the information identifying the performer depicted in the media program comprises performer information; and

wherein searching the plurality of video frames of the received media program to identify a video frame that depicts the performer comprises;

extracting the plurality of video frames of the media program, wherein each extracted video frame is separated from an adjacent extracted video frame by a fixed time interval;

performing facial recognition on the extracted video frames to identify a video frame that depicts a human face;

comparing the human face in the identified video frame with an image of the performer identified by the performer information; and

identifying the identified video frame as depicting the performer if the human face in the identified frame and the image match.

35. An apparatus for presenting a program guide, describing a plurality of media programs, each media program having a plurality of video frames, the apparatus having a processor and a memory storing instructions and further comprising:

means, performed by the processor according to the instructions stored in the memory, for accepting a search request from a user, the search request comprising a search parameter having a search value;

means, performed by the processor according to the instructions stored in the memory, for searching a media program database for the search value, the media program database having first metadata associated with a first individual video frame of the media program;

means, performed by the processor according to the instructions stored in the memory, for determining if the first metadata includes the search value for a performer, wherein the first metadata associated with the first individual video frame of the media program is generated by;

means, performed by the processor according to the instructions stored in the memory, for receiving the media program from a media program source;

means, performed by the processor according to the instructions stored in the memory, for searching the plurality of video frames of the media program to identify a video frame that depicts the performer; and

means, performed by the processor according to the instructions stored in the memory, for generating the first metadata associated with the video frame that depicts the performer, the first metadata relating information describing the performer to an identifier of the identified video frame that depicts the performer; and

means, performed by the processor according to the instructions stored in the memory, for providing the program guide comprising a thumbnail depicting the performer included in the first individual video frame of the media program associated with the first metadata to the user, wherein the thumbnail is used to identify the media program in the program guide, and wherein different thumbnails of different video frames that depict different performers are used to identify the media program in the program guide for different search requests for different performers.

36. The apparatus of claim 35 wherein the media program database further has second metadata associated with a second individual frame of the media program;

and wherein the apparatus further comprises;

means, performed by the processor according to the instructions stored in the memory, for providing a second thumbnail depicting the second individual frame of the media program if the second metadata includes the search parameter.

37. The apparatus of claim 35, wherein:

the apparatus further comprises means, performed by the processor according to the instructions stored in the memory, for receiving media program metadata comprising information identifying performers depicted in the media program; and

the means for searching the plurality of video frames of the media program to identify a video frame that depicts the performer and for generating the first metadata associated with the video frame that depicts the performer searches the plurality of video frames of the media program to identify a video frame that depicts the performer and generates the first metadata associated with the video frame that depicts the performer for each of the identified performers.

38. The apparatus of claim 35, wherein:

the information identifying the performer depicted in the media program comprises performer information; and

wherein the means for searching the plurality of video frames of the received media program to identify a video frame that depicts the performer comprises;

means, performed by the processor according to the instructions stored in the memory, for extracting the plurality of video frames of the media program, wherein each extracted video frame is separated from an adjacent extracted video frame by a fixed time interval;

means, performed by the processor according to the instructions stored in the memory, for performing facial recognition on the extracted video frames to identify a video frame that depicts a human face;

means, performed by the processor according to the instructions stored in the memory, for comparing the human face in the identified video frame with an image of the performer identified by the performer information; and

means, performed by the processor according to the instructions stored in the memory, for identifying the identified video frame as depicting the performer if the human face in the identified frame and the image match.

39. A program storage device, readable by a computer, tangibly embodying at least one program of instructions executable by the computer to perform method steps of presenting a program guide for a video-on-demand system describing a plurality of media programs, each media program having a plurality of video frames, the method steps comprising:

accepting a search request from a user, the search request comprising a search parameter having a search value;

searching a media program database for the search value, the media program database having first metadata associated with a first individual video frame of the media program;

determining if the first metadata includes the search value for a performer, wherein the first metadata associated with the first individual video frame of the media program is generated by performing;

receiving the media program from a media program source;

searching the plurality of video frames of the media program to identify a video frame that depicts the performer; and

generating the first metadata associated with the video frame that depicts the performer, the first metadata relating information describing the performer to an identifier of the identified video frame that depicts the performer; and

providing the program guide comprising a thumbnail depicting the performer included in the first individual video frame of the media program associated with the first metadata to the user using the determined identifier, wherein the thumbnail is used to identify the media program in the program guide, and wherein different thumbnails of different video frames that depict different performers are used to identify the media program in the program guide for different search requests for different performers.

40. The program storage device of claim 39, wherein the media program database further has second metadata associated with a second individual frame of the media program;

and wherein the method further comprises;

providing a second thumbnail depicting the second individual frame of the media program if the second metadata includes the search parameter.

41. The program storage device of claim 39, wherein:

the method further comprises receiving media program metadata comprising information identifying performers depicted in the media program; and

searching the plurality of video frames of the media program to identify a video frame that depicts the performer and generating the first metadata associated with the video frame that depicts the performer is performed for each of the identified performers.

42. The program storage device of claim 39, wherein:

the information identifying the performer depicted in the media program comprises performer information; and

wherein searching the plurality of video frames of the received media program to identify a video frame that depicts the performer comprises;

extracting the plurality of video frames of the media program, wherein each extracted video frame is separated from an adjacent extracted video frame by a fixed time interval;

performing facial recognition on the extracted video frames to identify a video frame that depicts a human face;

comparing the human face in the identified video frame with an image of the performer identified by the performer information; and

identifying the identified video frame as depicting the performer if the human face in the identified frame and the image match.