Methods and systems of dynamic content analysis

• US 9,678,960 B2
• Filed: 05/28/2013
• Issued: 06/13/2017
• Est. Priority Date: 01/31/2013
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Robert, Arnaud, Drake, Edward, Arana, Mark
• Primary Examiner(s): VO, TRUONG V
• Application Number:
  US13/903,946
• Publication Number:
  US 20140214846A1
• Time in Patent Office: 1,477 Days
• Field of Search: 707706
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/44226 on social networks

Abstract

Methods and systems of dynamic content analysis for categorizing media contents are provided. Data regarding the media contents that a user is watching on one or more devices is obtained, and the environment in which the user is watching the media contents may be captured. Metadata categorizing the events and the media contents can be generated, and the metadata may be further associated with a corresponding event.

Claims

1. A computer-implemented method, comprising:

obtaining data on media contents that is being sent to a set of devices, wherein the data comprises media signals delivered to at least one of the set of devices, wherein the media contents comprises a live broadcast, an unscripted media, or a combination of both;

processing, in real-time, the data to recognize dynamically one or more events happening within the media contents as the data is being sent to the set of devices, the processing comprising one or more of color tracing, scene recognition, facial expression detection and recognition, or a combination thereof, the events comprising one or more objects, persons, sounds, scene characteristics, or a combination thereof within the data being sent to the set of devices;

generating real-time content metadata categorizing the media contents based on the recognized events happening within the media contents, the real-time content metadata comprising one or more newly created metadata tags not previously associated with the data and describing the recognized events happening within the media contents;

associating the data with the real-time content metadata; and

generating and transmitting a request for supplementary information related to the media contents by using the real-time content metadata.

2. The computer-implemented method of claim 1, further comprising receiving the supplementary information related to the media contents.

3. The computer-implemented method of claim 1, further comprising:

receiving an instruction on obtaining the supplementary information related to the media contents; and

processing the instruction to obtain the supplementary information related to the media contents.

4. The computer-implemented method of claim 1, wherein the supplementary information is related to a personal profile of the user, the method further comprising creating the personal profile associated with the user, the personal profile comprising a user'"'"'s historical activity or a user'"'"'s preference.

5. The computer-implemented method of claim 1, wherein the real-time content metadata further describe an event, the real-time content metadata comprising a standardized event description to a natural language event description.

6. The computer-implemented method of claim 1, wherein the supplementary information is further related to a concurrent activity of the user;

the method further comprising;

obtaining second data on the concurrent activity of the user; and

processing the second data to determine the concurrent activity of the user.

7. The computer-implemented method of claim 6, wherein the concurrent activity comprises a facial expression of the user, a body movement of the user, a voice of the user, or an internet activity of the user.

8. The computer-implemented method of claim 6, wherein the first user is a dominant user between the first user and a second user, the method further comprising:

obtaining second data on a second concurrent activity of a second user; and

transcoding module; and

processing the second data to recognize a dominant user between the first user and the second user.

9. The computer-implemented method of claim 1, wherein the step of processing the data comprises reading existing metadata encoded in a media signal and analyzing the existing metadata, and wherein the existing metadata comprises a closed caption, copy control information, or an operator watermark.

10. The computer-implemented method of claim 1, wherein the step of processing the data comprises detecting an image or a sound of the media contents and analyzing the image or the sound detected.

11. A computer-implemented method, comprising:

receiving obtained data on media contents that is being sent to a set of devices from at least one of the set of devices, wherein the data comprises media signals delivered to at least one of the set of devices, wherein the media contents comprises a live broadcast, an unscripted media, or a combination of both;

processing, in real-time, the data to recognize dynamically one or more events happening within the media contents, the processing comprising one or more of color tracing, scene recognition, facial expression detection and recognition, or a combination thereof, the events comprising one or more objects, persons, sounds, scene characteristics, or a combination thereof within the data being sent to the set of devices;

generating real-time content metadata categorizing the media contents based on the dynamically recognized events happening within the media contents, the real-time content metadata comprising one or more newly created metadata tags not previously associated with the data and describing the recognized events happening within the media contents;

associating the data with the real-time content metadata; and

generating and transmitting a request for supplementary information related to the media contents by using the real-time content metadata.

12. The computer-implemented method of claim 11, further comprising transmitting the supplementary information related to the media contents to the set of devices.

13. The computer-implemented method of claim 11, further comprising:

determining an instruction on obtaining the supplementary information related to the media contents; and

transmitting the instruction to the set of devices.

14. The computer-implemented method of claim 11, wherein the supplementary information is related to a personal profile of the user, the method further comprising creating the personal profile associated with the user, the personal profile comprising a user'"'"'s historical activity or a user'"'"'s preference.

15. The computer-implemented method of claim 11, wherein the real-time content metadata further describe an event, the real-time content metadata comprising a standardized event description or a natural language event description.

16. The computer-implemented method of claim 11, wherein the supplementary information is further related to a concurrent activity of the user;

the method further comprising;

obtaining second data on the concurrent activity of the user; and

processing the second data to determine the concurrent activity of the user.

17. The computer-implemented method of claim 16, wherein the concurrent activity comprises a facial expression of the user, a body movement of the user, a voice of the user, or an internet activity of the user.

18. The computer-implemented method of claim 16, wherein the first user is a dominant user between the first user and a second user, the method further comprising:

obtaining second data on a second concurrent activity of a second user; and

processing the second data to recognize a dominant user between the first user and the second user.

19. The computer-implemented method of claim 18, wherein the step of processing the data comprises reading existing metadata encoded in a media signal and analyzing the existing metadata, wherein the existing metadata comprises a closed caption, copy control information, or an operator watermark.

20. The computer-implemented method of claim 19, wherein the step of processing the data comprises detecting an image or a sound of the media contents and analyzing the image or the sound detected.

21. An apparatus, comprising:

non-transitory memory storing a set of instructions; and

a processor coupled to the non-transitory, wherein the set of instructions are configured to cause the processor to;

obtain data on media contents that is being sent to a set of devices, wherein the data comprise a signal delivered to a first device of the set of devices or a recording of the user and a video being played on a second device of the set of devices, wherein the media contents comprises a live broadcast, an unscripted media, or a combination of both;

process, in real-time, the data to recognize dynamically one or more events happening within the media contents, the processing comprising one or more of color tracing, scene recognition, facial expression detection and recognition, or a combination thereof, the events comprising one or more objects, persons, sounds, scene characteristics, or a combination thereof within the data being sent to the set of devices;

generate real-time content metadata categorizing the media contents based on the dynamically recognized events happening within the media contents, the real-time content metadata comprising one or more newly created metadata tags not previously associated with the data and describing the recognized events happening within the media contents;

associating the data with the real-time content metadata; and

generate and transmit a request for supplementary information related to the media contents by using the real-time content metadata.