SYSTEM AND METHOD FOR AUTOMATED NETWORK SEARCH AND COMPANION DISPLAY OF RESULTS RELATING TO AUDIO-VIDEO METADATA

• US 20110064387A1
• Filed: 09/16/2009
• Published: 03/17/2011
• Est. Priority Date: 09/16/2009
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Mendeloff, Todd Allen, Bartley, William Joseph
• Granted Patent: US 10,587,833 B2
• Time in Patent Office: Days
• US Class Current: 386/262
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Embodiments disclosed herein include systems and methods which allow consumers of audio-visual content (such as movies and television programs) to obtain dynamic additional content about programs and movies being watched, and customize that additional content to their personal preferences and behaviors.

Claims

1. A audio-visual entertainment system, comprising:

an audio-visual data reader configured to process audio-visual data from an audio-visual storage device;

audio and visual outputs configured to output the processed audio-visual data to a first display area of a first display device;

a dataprint request module configured to request identify the audio-visual data and download a dataprint associated with the identified audio-visual data from a dataprint server;

a query module configured to;

process the downloaded dataprint and generate queries based on at least the dataprint and query usage guidelines;

receive data in response to the queries; and

display the received data in a second display area.

2. The audio-visual entertainment system of claim 1, wherein the second display area comprises a picture within the first display area.

3. The audio-visual entertainment system of claim 1, wherein the processed audio-visual data comprises an audio song file.

4. The audio-visual entertainment system of claim 1, wherein the processed audio-visual data comprises a video file.

5. The audio-visual entertainment system of claim 1, wherein the second display area comprises a video stream, an audio stream, an image stream, and a text stream.

6. The audio-visual entertainment system of claim 1, wherein the second display area comprises a display on a second display device.

7. The audio-visual entertainment system of claim 1, wherein the dataprint comprises audio-visual metadata and script data associated with the processed audio-visual data.

8. The audio-visual entertainment system of claim 7, wherein at least some of the audio-visual metadata and script data are associated with specified portions of the processed audio-visual data.

9. The audio-visual entertainment system of claim 8, wherein the specified portions are selected frames.

10. The audio-visual entertainment system of claim 1, wherein the generated queries comprise search engine queries.

11. The audio-visual entertainment system of claim 10, wherein the generated queries further comprise queries of proprietary content related to the audio-visual data.

12. The audio-visual entertainment system of claim 11, wherein the generated queries further comprise queries of public content.

13. The audio-visual entertainment system of claim 1, wherein the query usage guidelines are associated with a particular user of the audio-visual entertainment system.

14. The audio-visual entertainment system of claim 13, wherein the query usage guidelines include user selected preferences.

15. The audio-visual entertainment system of claim 13, wherein the query module is further configured to track user behavior with respect to query results, and wherein query usage guidelines are based at least in part on behavior of the user with respect prior query results.

16. The audio-visual entertainment system of claim 14, wherein the user selected preferences selected by the user comprise topical preferences and data-type preferences.

17. The audio-visual entertainment system of claim 1, wherein the query module is further configured to display the most relevant query result if a plurality of query results are received.

18. The audio-visual entertainment system of claim 1, wherein the query module is further configured to refresh the generated queries after a predetermined period of time.

19. The audio-visual entertainment system of claim 18, wherein the query module is further configured to generate new queries by processing a portion of the dataprint associated with a current location of the audio-visual content and generating the new queries based on at least the processed portion of the dataprint and query usage guidelines.

20. A method of providing audio-visual content to a user, the method comprising:

receiving audio-visual content in a media player device;

identifying the audio-visual content;

requesting a dataprint associated with the audio-visual content, the dataprint being associated with specified portions of the audio-visual content;

storing the dataprint in a memory;

playing at least a portion of the audio-visual content in a first display area;

repeatedly generating queries based at least in part on the dataprint associated with the playing portion of the audio-visual content; and

displaying the query results in a second display area.

21. The method of claim 20, wherein the generated queries are further based on query usage guidelines.

22. The audio-visual entertainment system of claim 20, wherein the processed audio-visual data comprises an audio song file.

23. The audio-visual entertainment system of claim 20, wherein the processed audio-visual data comprises a video file.

24. The method of claim 21, wherein the query usage guidelines are associated with a user of the media player device.

25. The method of claim 20, wherein the second display area comprises a picture within the first display area.

26. The method of claim 20, wherein the second display area comprises a video stream, an audio stream, an image stream, and a text stream.

27. The method of claim 20, wherein the second display area comprises a display on a second display device.

28. The method of claim 20, wherein the dataprint comprises audio-visual metadata and script data associated with the audio-visual content.

29. The audio-visual entertainment system of claim 20, wherein the specified portions of the audio-visual content comprise specified frames of video.

30. The method of claim 20, wherein the generated queries comprise search engine queries.

31. The method of claim 20, wherein the generated queries comprise queries of proprietary content related to the audio-visual content.

32. The method of claim 24, wherein the query usage guidelines include user-selected preferences.

33. The method of claim 32, wherein the user selected preferences comprise topical preferences and data-type preferences.

34. The method of claim 24, further comprising tracking user behavior with respect to the received query results, and modifying the query usage guidelines based at least in part on behavior of the user with respect to the received query results.

35. The method of claim 20, wherein displaying the received data in a second display area comprises displaying the most relevant query result if a plurality of query results are received.

36. The method claim 20, wherein repeatedly generating queries comprises refreshing the generated queries after a predetermined period of time.

37. A computer-readable medium having computer-executable data stored thereon, the computer-executable data comprising instructions, which when executed by a computer device cause the computer device to perform a method of collecting a dataprint, the method comprising:

receiving data related to audio-visual content;

storing the received data in a memory; and

associating the stored data with one or more specified frames in the audio-visual content.

38. A dataprint, comprising:

a plurality of records stored on a computer-readable medium, wherein at least one of the records further comprises;

a first data element indicative of audio-visual content with which the dataprint record is associated;

a second data element indicative of a specific frame in the audio-visual content with which the dataprint record is associated;

a third data element indicative of content related to the specified frame of the audio-visual content.