Integration of control data into digital broadcast content for access to ancillary information

• US 10,313,740 B2
• Filed: 07/27/2012
• Issued: 06/04/2019
• Est. Priority Date: 05/28/2008
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Zalewski, Gary M.
• Primary Examiner(s): Shang, Annan Q
• Application Number:
  US13/560,213
• Publication Number:
  US 20120291065A1
• Time in Patent Office: 2,503 Days
• Field of Search: 725 32- 61, 709217-232
• CPC Class Codes: H04H 20/28 Arrangements for simultaneous broadcast of plural pieces of information
• CPC Class Codes: H04H 40/18 Arrangements characterised by circuits or components specially adapted for receiving
• CPC Class Codes: H04H 60/13 Arrangements for device control affected by the broadcast information
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Ancillary information associated with one or more images embedded in a digital broadcast data stream may be accessed by a digital broadcast receiving device. The device may include a receiver unit, a processor, and a memory. The processor may execute program instructions to access the ancillary information. Control data may be associated with one or more visual components of one or more video images. The control data and images may be combined into a digital broadcast data stream. The device may receive the images and control data. The images may be presented on a display device. The receiving device may use the control data to present or store a perceptible indication that ancillary information is associated with the visual components in conjunction with presenting the images. The device may use the control data to present or store the ancillary information in response to an input signal.

Claims

1. A method for accessing ancillary information associated with one or more images embedded in a digital broadcast data stream, the method comprising:

a) receiving a digital broadcast signal, wherein the digital broadcast signal includes data representing one or more video images and control data associated with one or more visual components of the one or more video images, wherein the control data includes different control data components for different corresponding visual components within the same video image, where control data components have text descriptors associated with said different corresponding visual components;

b) presenting the one or more video images on a video display device associated with the digital broadcast receiving device;

c) providing information guiding a percipient to ancillary information that is superposed to show said text descriptors over one or more visual components of the one or more video images; and

d) receiving selection of one of said text descriptors for one of said visual components presented on the video display device;

e) using a control data component including said text descriptor associated with said visual component as an input to a search engine coupled to the digital broadcast receiving device and/or video display device and conducting a search using said text descriptor with the search engine for obtaining ancillary information at a time of said selection of the text descriptor for said visual component presented on the video display device, wherein the ancillary information obtained for the visual component is filtered based on a current geographic location of the video display device so as to include ancillary information that is relevant to the current geographic location.

2. The method of claim 1, wherein the control data is associated with one or more objects depicted in one or more of the video images;

or wherein the control data is associated with a context associated with the one or more video images;

or wherein the input signal is a signal from a remote control associated with the digital broadcast receiving device;

or wherein the ancillary information includes one or more advertisements.

3. The method of claim 1 wherein c) includes displaying a perceptible indication with the display device while presenting the one or more video images;

or wherein c) includes highlighting the one or more visual components in a manner perceptible to the percipient, and associating one or more links to the ancillary information associated with the one or more highlighted visual components.

4. The method of claim 3 wherein the information guiding the percipient to the ancillary information includes one or more links to one or more resources accessible via an electronic communications network.

5. The method of claim 4 wherein e) includes accessing the one or more resources via the one or more links in response to the input signal.

6. The method of claim 1 wherein the information guiding the percipient to the ancillary information includes a video image identifying the one or more visual components, wherein the image includes one or more links, each link being associated with one or more of the visual components, wherein each link is configured to provide access to the ancillary information associated with the corresponding visual component.

7. The method of claim 1 wherein e) further includes storing the ancillary information in a memory associated with the digital broadcast receiving device and/or display device;

or wherein d) further includes presenting ancillary information associated with a particular visual component of the one or more visual components in response to a selection input.

8. A digital broadcast receiving device, comprising:

a receiver unit configured to receive programming and data over one or more digital broadcast channels;

a processor coupled to the receiver unit;

a memory coupled to the processor;

a set of processor readable instructions embodied in the memory for execution on the processor, the instructions being configured to implement a method for accessing control data associated with the one or more images embedded in a digital broadcast data stream, the method comprising;

a) receiving a digital broadcast signal, wherein the digital broadcast signal includes data representing one or more video images and control data associated with one or more visual components of the one or more video images, wherein the control data includes different control data components for different corresponding visual components within the same video image;

b) presenting the one or more video images on a video display device associated with the digital broadcast receiving device;

c) providing information guiding a percipient to the ancillary information that is at least partially superposed over one or more visual components of the one or more video images, the information guiding the percipient includes text descriptors that are associated with ones of said visual components; and

d) responsive to receiving a selection via touch input of one of said text descriptors associated with one or more visual components of one or more video images, using said selected text descriptor as an input to a search engine coupled to the digital broadcast receiving device and/or display device and causing a search to be conducted with the search engine for obtaining said ancillary information at a time that is responsive to said search associated to one or more corresponding visual components of one or more video images presented on the video display device of the receiver unit, wherein the ancillary information obtained for the visual component is filtered based on a current geographic location of the video display device so as to include ancillary information that is relevant to the current geographic location.

9. The device of claim 8, wherein the input is generated responsive to the touch input on a touch screen of the video display device.

10. The device of claim 8, further comprising a backchannel coupled to the processor wherein the backchannel comprises a network interface coupled to an electronic communications network.

11. The device of claim 8 wherein c) includes displaying at least one additional perceptible indication with the display device while presenting the one or more video images.

12. The device of claim 11 wherein the information guiding the percipient to the ancillary information additionally includes one or more links to one or more resources accessible via an electronic communications network.

13. The device of claim 12 wherein the one or more links are configured to access the one or more resources in response to the input.

14. The device of claim 11 wherein the information guiding the percipient to the ancillary information further includes a video image identifying the one or more visual components, wherein the image further includes one or more links, each hot link being associated with one or more of the visual components, wherein each hot link is configured to provide access to the ancillary information associated with the corresponding visual component.

15. The device of claim 11 wherein d) includes presenting the ancillary information associated with a particular visual component of the one or more visual components in response to a selection.

16. The device of claim 8 wherein d) includes storing the ancillary information in the memory of the receiver unit.