Second screen content

• US 8,869,222 B2
• Filed: 09/13/2012
• Issued: 10/21/2014
• Est. Priority Date: 09/13/2012
• Status: Expired due to Fees

• Current Assignee: Verance Corporation
• Original Assignee: Verance Corporation
• Inventors: Winograd, Joseph M., Johnson, Peter Russell, Houle, William Carl
• Primary Examiner(s): Dubasky, Gigi L
• Application Number:
  US13/615,291
• Publication Number:
  US 20140071342A1
• Time in Patent Office: 768 Days
• Field of Search: 725 18- 20, 725 25- 32, 725/110
• US Class Current: 725/110
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/4396 by muting the audio signal
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

Methods, systems, devices and computer program products are provided to facilitate enhanced use and interaction with multimedia content using a variety of content identification techniques. After identifying a content that is being presented by a first device, the content identification information is used to retrieve and present a second content that would render at least a portion of the first content comprehensible to particular users or audience of the first content. The second content can be tailored to accommodate physical disabilities or special needs of a user or a group of users.

Claims

1. A method, comprising:

detecting, at a second device, an identification information that is embodied in a first content from at least one segment of the first content, the detecting carried out by capturing an acoustically propagated audio section of the first content using a microphone or a displayed video section of the first content using a camera while the first content is being presented by a first device, the detecting comprising processing the at least one segment from the captured audio section or video section using a processor to obtain the identification information, the identification information uniquely identifying the first content and providing an index to a location of a non-transitory storage medium where a second content resides; and

in response to the detection of the identification information, triggering presentation of the second content on the second device, wherein the second content is necessary for full comprehension of one or more portions of the first content, and the second content comprises a speech portion that provides a different level of vocabulary in same language as the language associated with audio section of the first content being presented by the first device.

2. The method of claim 1, wherein the identification information is detected from one or more watermarks that are embedded in the at least one segment of the first content.

3. The method of claim 2, wherein the one or more watermarks include a timecode.

4. The method of claim 1, wherein the identification information is detected by computing one or more fingerprints from the at least one segment of the first content, the one or more fingerprints representing an inherent characteristic of the at least one segment of the first content.

5. The method of claim 1, wherein the second content facilitates accessibility of the first content to people with disabilities or special needs.

6. The method of claim 1, wherein the second content is presented using a haptic interface.

7. The method of claim 1, wherein the second content is presented in a different audio-visual modality than the first content.

8. The method of claim 1, wherein the second content is selected from a group of contents consisting of:

a closed caption content,

an audio content designed for consumption of hearing impaired persons,

a video content designed for consumption of visually impaired persons,

a Braille content,

an audio content that includes a modified dialog portion,

a dialog-only audio content,

an audio description,

a video content with enhanced contrast, or

a video content with enhanced details.

9. The method of claim 1, wherein the second content comprises a speech portion that is presented in a different language than the corresponding speech portion of the first content being presented by the first device.

10. The method of claim 1, further comprising, in response to the detection of the identification information, muting an audio portion of the first content on the first device.

11. The method of claim 1, wherein the second content provides a particular level of parental control.

12. The method of claim 1, wherein the second content is presented in accordance with preferences associated with the second device.

13. The method of claim 1, wherein the second content enables comprehension of a cultural reference presented as part of the first content.

14. The method of claim 1, wherein the second content includes an explanation to clarify one of:

a particular dialect, a historical reference, and a geographical reference.

15. The method of claim 1, wherein the second content corresponds to an encyclopedia entry or a dictionary entry.

16. The method of claim 1, wherein the second content is presented in synchronization with the first content.

17. The method of claim 1, wherein presentation of the second content comprises:

presenting a plurality of choices for presentation of the second content,

receiving a response indicative of selection of a specific choice from the plurality of choices, and

retrieving the second content based on the response.

18. The method of claim 17, wherein receiving the response comprises receiving the response through one or more of:

a voice command,

a blow tube,

a brainwave transmission device, or

an eye movement detection device.

19. The method of claim 1, wherein:

the at least one segment of the first content is received at the second device;

detecting the identification information is carried out by the second device; and

the second content is retrieved by the second device from a secondary content database.

20. The method of claim 1, wherein the second content is presented as text in a language different from language of the first content that is being presented.

21. A method comprising:

detecting, at a second device, an identification information that is embodied in a first content from at least one segment of the first content, the detecting carried out while the first content is being presented by a first device, the detecting comprising processing the at least one segment using a processor to obtain the identification information which uniquely identifies the first content and an index to a location of a second content; and

in response to the detection of the identification information, triggering presentation of the second content on the second device, wherein the second content is necessary for full comprehension of one or more portions of the first content, wherein the second content comprises a speech portion that provides a different level of vocabulary than corresponding speech portion associated with the first content being presented by the first device, and wherein the different level of vocabulary is presented while the first content is being presented by the first device and the different level of vocabulary is in same language as the language of the corresponding speech portion associated with the first content that is being presented by the first device.

22. The method of claim 21, wherein the different level of vocabulary is adjustable so as to enable an increase or decrease of difficulty associated with the vocabulary level.

23. A device, comprising:

a processor; and

a memory comprising processor executable code, the processor executable code, when executed by the processor, configures the device to;

capture an acoustically propagated audio section of a first content using a microphone or a displayed video section of the first content using a camera while the first content is being presented by another device;

detect an identification information from at least one segment of the captured audio section or video section, the identification information uniquely identifying the first content and providing an index to a location of a non-transitory storage medium where a second content resides; and

in response to the detection of the identification information, trigger presentation of the second content by the device, wherein the second content is necessary for full comprehension of one or more portions of the first content, and the second content comprises a speech portion that provides a different level of vocabulary in same language as the language associated with the audio section of the first content being presented by the another device.

24. A computer program product, embodied on a non-transitory computer readable medium, comprising:

program code for detecting, at a second device, an identification information that is embodied in a first content from at least one segment of the first content, the detecting carried out by capturing an acoustically propagated audio section of the first content using a microphone or a displayed video section of the first content using a camera while the first content is being presented by a first device, the detecting comprising processing the at least one segment using a processor to obtain the identification information, the identification information uniquely identifying the first content and providing an index to a location of a non-transitory storage medium where a second content resides; and

program code for, in response to the detection of the identification information, triggering presentation of the second content by the second device, wherein the second content is necessary for full comprehension of one or more portions of the first content, and the second content comprises a speech portion that provides a different level of vocabulary in same language as the language associated with the audio section of the first content being presented by the first device.

25. A device, comprising:

an identification code detector configured to detect an identification information from at least one segment of a first content while the first content is being presented by another device, the identification information uniquely identifying the first content and providing an index to a location of a non-transitory storage medium where a second content resides, the at least one segment of the first content having been obtained from an acoustically propagated audio section of the first content that is captured by a microphone or a displayed video section of the first content that is captured by a camera; and

a trigger component configured to, in response to the detection of the identification information, trigger presentation of a second content by the device, wherein the second content is necessary for full comprehension of one or more portions of the first content, and the second content comprises a speech portion that provides a different level of vocabulary in same language as the language associated with the audio section of the first content being presented by the another device.

26. The device of claim 25, wherein the identification code detector is configured to extract one or more watermarks that are embedded in the at least one segment of the first content.

27. The device of claim 25, wherein the identification code detector is configured to compute one or more fingerprints from the at least one segment of the first content, the one or more fingerprints representing an inherent characteristic of the at least one segment of the first content.

28. The device of claim 25, wherein the second content facilitates accessibility of the first content to people with disabilities or special needs.

29. The device of claim 25, further comprising a haptic interface configured to present the second content.

30. The device of claim 25, further comprising a user interface configured to present the second content selected from a group of contents consisting of:

a closed caption content,

an audio content designed for consumption of hearing impaired persons,

a video content designed for consumption of visually impaired persons,

a Braille content,

an audio content that includes a modified dialog portion,

a dialog-only audio content

an audio description,

a video content with enhanced contrast, or

a video content with enhanced details.

31. The device of claim 25, further comprising a user interface configured to present the second content comprising a speech portion that is presented in a different language than the corresponding speech portion of the first content being presented by the first device.

32. The device of claim 25, further configured to, in response to the detection of the identification information, mute an audio portion of the first content on the first device.

33. The device of claim 25, further comprising a user interface configured to present the second content to enable comprehension of a cultural reference presented as part of the first content.

34. The device of claim 25, further comprising a user interface configured to present the second content that corresponds to an encyclopedia entry or a dictionary entry.

35. The device of claim 25, further configured to present the second content in synchronization with the first content.

36. The device of claim 25, further configured to:

present a plurality of choices for presentation of the second content;

receive a response indicative of selection of a specific choice from the plurality of choices; and

retrieve the second content based on the response.

37. The device of claim 36, configured to receive the response that provided through one or more of:

a voice command,

a blow tube,

a brainwave transmission device, or

an eye movement detection device.

38. The device of claim 25, further comprising a communication unit configured to communicate with a secondary content database to retrieve the second content.

39. The method of claim 25, the second content is presented as text in a language different from language of the first content that is being presented.

40. A device comprising:

an identification code detector configured to detect an identification information, from at least one segment of a first content, which uniquely identifies the first content and an index to a location of a second content while the first content is being presented by another device;

a trigger component configured to, in response to the detection of the identification information, trigger presentation of a second content by the device, wherein the second content is necessary for full comprehension of one or more portions of the first content; and

a user interface configured to present the second content comprising a speech portion that provides a different level of vocabulary than corresponding speech portion associated with the first content being presented by the another device, wherein the different level of vocabulary is presented while the first content is being presented by the another device and the different level of vocabulary is presented in same language as the language of the corresponding speech portion associated with the first content that is being presented by the another device.

41. The device of claim 40, wherein the different level of vocabulary is adjustable so as to enable an increase or decrease of difficulty associated with the vocabulary level.