System and method for automated network search and companion display of result relating to audio-video metadata

• US 10,587,833 B2
• Filed: 09/16/2009
• Issued: 03/10/2020
• Est. Priority Date: 09/16/2009
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Mendeloff, Todd Allen, Bartley, William Joseph, Kwan, Brian, Jessen, David, Acosta, Evan
• Primary Examiner(s): Alcon, Fernando
• Application Number:
  US12/561,193
• Publication Number:
  US 20110064387A1
• Time in Patent Office: 3,828 Days
• Field of Search: None
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Embodiments disclosed herein include systems and methods which allow consumers of audio-visual content (such as movies and television programs) to obtain dynamic additional content about programs and movies being watched, and customize that additional content to their personal preferences and behaviors.

Claims

1. An audio-visual entertainment system for use in conjunction with a display, the audio-visual entertainment system comprising:

a processor configured to;

obtain an audio-visual content having a plurality of video frames;

identify, after obtaining, the audio-visual content;

request a dataprint associated with the identified audio-visual content from a dataprint server over a network, wherein the dataprint includes a plurality of video frame numbers each corresponding to a different video frame of the plurality of video frames of the audio-visual content, wherein first video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of first cast members and first scene locations in one or more first video frames of the plurality of video frames of the audio-visual content, and second video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of second cast members and second scene locations in one or more second video frames of the plurality of video frames of the audio-visual content;

obtain, in response to the request for the dataprint, the dataprint associated with the identified audio-visual content from the dataprint server over the network;

start playing the audio-visual content on the display;

while playing the audio-visual content on the display, access the dataprint to generate first queries based on the first one or more of the cast members and the first scene locations associated with the first video frame numbers while the one or more first video frames of the plurality of video frames of the audio-visual content are being currently played on the display;

send the first queries over the network;

receive first data over the network in response to the first queries, wherein the first data relates to the one or more of the first cast members and the first scene locations associated with the first video frame numbers;

display the first data while playing the one or more first video frames of the plurality of video frames of the audio-visual content on the display;

while playing the audio-visual content on the display, access the dataprint to generate second queries based on the second one or more of the cast members and the second scene locations associated with the second video frame numbers while the one or more second video frames of the plurality of video frames of the audio-visual content are being currently played on the display;

send the second queries over the network;

receive second data over the network in response to the second queries, wherein the second data relates to the one or more of the second cast members and the second scene locations associated with the second video frame numbers; and

display the second data while playing the one or more second video frames of the plurality of video frames of the audio-visual content on the display.

2. The audio-visual entertainment system of claim 1, wherein the first data and the second data are displayed in a second display area of the display that comprises a picture within a first display area displaying the audio-visual content.

3. The audio-visual entertainment system of claim 1, wherein the audio-visual content comprises an audio file.

4. The audio-visual entertainment system of claim 1, wherein the audio-visual content comprises a video file.

5. The audio-visual entertainment system of claim 1, wherein the first data comprises a video stream, an audio stream, an image stream, and a text stream.

6. The audio-visual entertainment system of claim 1, wherein the first data and the second data are displayed on a different display.

7. The audio-visual entertainment system of claim 1, wherein the dataprint comprises audio-visual metadata and script data associated with the audio-visual content.

8. The audio-visual entertainment system of claim 7, wherein at least some of the audio-visual metadata and script data are associated with specified portions of the audio-visual content.

9. The audio-visual entertainment system of claim 1, wherein the processor is configured to obtain the dataprint separately from obtaining the audio-visual content.

10. The audio-visual entertainment system of claim 1, wherein the first queries comprise search engine queries.

11. The audio-visual entertainment system of claim 10, wherein the first queries further comprise queries of proprietary content related to the first video frame numbers of the audio-visual content.

12. The audio-visual entertainment system of claim 11, wherein the first queries further comprise queries of public content.

13. The audio-visual entertainment system of claim 1, wherein the first queries are also based on query usage guidelines associated with a particular user of the audio-visual entertainment system, wherein the query usage guidelines include user selected preferences.

14. The audio-visual entertainment system of claim 13, wherein the user selected preferences selected by the user comprise topical preferences and data-type preferences.

15. The audio-visual entertainment system of claim 1, wherein processor is further configured to display the most relevant query result if a plurality of query results are received.

16. The audio-visual entertainment system of claim 1, wherein the processor is further configured to refresh the first queries after a predetermined period of time.

31. The audio-visual entertainment system of claim 1, wherein the audio-visual content is a movie stored in a storage device, and wherein the processor is configured to obtain the movie from the storage device.

32. The audio-visual entertainment system of claim 31, wherein the storage device is a disc.

33. The audio-visual entertainment system of claim 1, wherein the audio-visual content is streamed to the audio-visual entertainment system and stored in a storage device, and wherein the processor is configured to obtain the audio-visual content from the storage device.

17. A method for use by an audio-visual entertainment system in conjunction with a display, the method comprising:

obtaining an audio-visual content having a plurality of video frames;

identifying, after the obtaining, the audio-visual content;

requesting a dataprint associated with the identified audio-visual content from a dataprint server over a network, wherein the dataprint includes a plurality of video frame numbers each corresponding to a different video frame of the plurality of video frames of the audio-visual content, wherein first video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of first cast members and first scene locations in one or more first video frames of the plurality of video frames of the audio-visual content, and second video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of second cast members and second scene locations in one or more second video frames of the plurality of video frames of the audio-visual content;

obtaining, in response to the requesting of the dataprint the dataprint associated with the identified audio-visual content from the dataprint server over the network;

starting to play the audio-visual content on the display;

while playing the audio-visual content on the display, accessing the dataprint to generate first queries based on the first one or more of the cast members and the first scene locations associated with the first video frame numbers while the one or more first video frames of the plurality of video frames of the audio-visual content are being currently played on the display;

sending the first queries over the network;

receiving first data over the network in response to the first queries, wherein the first data relates to the one or more of the first cast members and the first scene locations associated with the first video frame numbers; and

displaying the first data while playing the one or more first video frames of the plurality of video frames of the audio-visual content on the display;

while playing the audio-visual content on the display, accessing the dataprint to generate second queries based on the second one or more of the cast members and the second scene locations associated with the second video frame numbers while the one or more second video frames of the plurality of video frames of the audio-visual content are being currently played on the display;

sending the second queries over the network;

receiving second data over the network in response to the second queries, wherein the second data relates to the one or more of the second cast members and the second scene locations associated with the second video frame numbers; and

displaying the second data while playing the one or more second video frames of the plurality of video frames of the audio-visual content on the display.

18. The method of claim 17, wherein the audio-visual content comprises an audio file.

19. The method of claim 17, wherein audio-visual content comprises a video file.

20. The method of claim 17, wherein the first data is displayed in a second display area of the display that comprises a picture within a first display area displaying the audio-visual content.

21. The method of claim 17, wherein the first data comprises a video stream, an audio stream, an image stream, and a text stream.

22. The method of claim 17, wherein the first data is displayed on a different display.

23. The method of claim 17, wherein the dataprint comprises audio-visual metadata and script data associated with the audio-visual content.

24. The method of claim 17, wherein the obtaining of the dataprint is performed separately from the obtaining of the audio-visual content.

25. The method of claim 17, wherein the first queries comprise search engine queries.

26. The method of claim 17, wherein the first queries comprise queries of proprietary content related to the audio-visual content.

27. The method of claim 17, wherein the first queries are also based on query usage guidelines associated with a particular user of the audio-visual entertainment system, wherein the query usage guidelines include user-selected preferences.

28. The method of claim 27, wherein the user selected preferences comprise topical preferences and data-type preferences.

29. The method of claim 17, wherein displaying the first data in a second display area comprises displaying the most relevant query result if a plurality of query results are received.

30. The method claim 17 further comprises refreshing the first queries after a predetermined period of time.

34. The method of claim 17, wherein the audio-visual content is a movie stored in a storage device, and wherein the obtaining obtains the movie from the storage device.

35. The method of claim 34, wherein the storage device is a disc.

36. The method of claim 17, wherein prior to the obtaining, the method further comprising:

receiving a stream of the audio-visual content; and

storing the received audio-visual content in a storage device;

wherein the obtaining obtains the audio-visual content from the storage device.

37. An audio-visual entertainment system for use in conjunction with a display, the audio-visual entertainment system comprising:

a processor configured to;

obtain an audio-visual content having a plurality of video frames;

identify, after obtaining, the audio-visual content;

request a dataprint associated with the identified audio-visual content from a dataprint server over a network, wherein the dataprint includes a plurality of video frame numbers each corresponding to a different video frame of the plurality of video frames of the audio-visual content, wherein first video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of first cast members and first scene locations in one or more first video frames of the plurality of video frames of the audio-visual content;

obtain, in response to the request for the dataprint, the dataprint associated with the identified audio-visual content from the dataprint server over the network;

start playing the audio-visual content on the display;

while playing the audio-visual content on the display, access the dataprint to generate one or more first queries based on the first one or more of the cast members or the first scene locations associated with the first video frame numbers while the one or more first video frames of the plurality of video frames of the audio-visual content are being currently played on the display;

send the first queries over the network;

receive first data over the network in response to the one or more first queries, wherein the first data relates to the generated one of the one or more of the first cast members or the first scene locations associated with the first video frame numbers; and

display the first data while playing the one or more first video frames of the plurality of video frames of the audio-visual content on the display.

38. The audio-visual entertainment system of claim 37, wherein the first queries comprise search engine queries.

39. The audio-visual entertainment system of claim 37, wherein the audio-visual content is a movie stored in a storage device, and wherein the processor is configured to obtain the movie from the storage device.