System for converting media content for interactive TV use

• US 6,496,981 B1
• Filed: 09/19/1997
• Issued: 12/17/2002
• Est. Priority Date: 09/19/1997
• Status: Expired due to Term

• Current Assignee: Intellectual Ventures Assets 6 LLC (Intellectual Ventures LLC)
• Original Assignee: Douglass A. Wistendahl, Leighton K. Chong
• Inventors: Wistendahl, Douglass A., Chong, Leighton K.
• Primary Examiner(s): Menta, Bhavesh
• Assistant Examiner(s): Srivastava, Vivek
• Application Number:
  US08/933,666
• Time in Patent Office: 1,915 Days
• Field of Search: H04/N.710, H04/N.704, 725/39, 725/40, 725/43, 725/44, 725/46, 725/47, 725/51, 725/52, 725/112, 725/113, 345/619, 345/723, 345/731, 345/738, 345/762, 345/763, 345/764
• US Class Current: 725/112
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 2220/2587 Laser Discs; Optical disc using analog recording
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/329 on a disc [VTOC]
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8166 involving executable data, e.g. software arrangements for executing specific programs G06F9/44; broadcasting computer programmes in broadcast systems H04H20/91; involving the movement of software or configuration parameters H04L67/34
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/8583 by creating hot-spots
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/088 the inserted signal being digital
• CPC Class Codes: H04N 7/16 Analogue secrecy systems; Analogue subscription systems

Abstract

A system for allowing media content to be used as an interactive media program comprises: (a) media content in the form of successive image display frames indexed in a time sequence; (b) object mapping data specifying the locations of objects appearing in the display of media content which are to be rendered interactive; (c) linkages provided through an associated interactive media program from the objects specified by the object mapping data to interactive functions to be performed upon selection of the objects in the display; and (d) a user system for operating the interactive media program in conjunction with the display of the media content by selecting an object appearing in an image display frame and performing the interactive function linked thereto. The invention includes an authoring system for generating the object mapping data for the media content. In a preferred interactive TV system, media content, in the form of movies, TV programs, advertising, and the like, can be presented as interactive media programs by transmitting the TV content with object mapping data (“hot spots”) to a set top box connected to a viewer'"'"'s TV. The TV set top box has a utility stored therein for performing the interactive functions linked to the defined hot spots in the TV content upon user selection. Interactive TV programs can also be presented using a conventional TV set top box and remote control in conjunction with the current analog video content. For example, the analog video content may be transmitted to the viewer on a channel provided by a cable TV company, with the object mapping data and program linkages for interactive functions transmitted in the video blanking intervals (VBI) interleaved with the video frames.

Claims

1. A system for allowing existing media content to be converted and used as an interactive media program comprising:

(a) existing media content in the form of media data representing a series of successive image display frames indexed in a time sequence which have objects appearing visually in one or more of the image display frames;

(b) object mapping data specifying display locations of the objects appearing in the image display frames of the existing media content which are to be rendered interactive;

(c) linkages provided through an associated object interactivity program for linking the objects specified by the object mapping data to respective interactive functions to be performed upon user selection of the objects by pointing to the display locations of the objects appearing in a display of the existing media content; and

(d) a user system for operating the object interactivity program in conjunction with the display of the existing media content, said user system including a display device for receiving the media data and displaying the series of image display frames represented by the media data, an object interactivity device for receiving the object mapping data and the object interactivity program and performing the respective interactivity functions when objects appearing in the display of image display frames are selected by the user, and a pointing device for enabling the user to point to the display locations of objects appearing in the display of the media content, the user thereby being enabled to interactively select an object appearing in one or more image display frames by using said object mapping data specifying its display location in the image display frames and performing the interactive function linked by the corresponding linkage of the object interactivity program thereto,

wherein the existing media content is an existing TV program transmitted to a viewer'"'"'s TV set top box, the object mapping data correspond to the display locations of interactive objects appearing in the TV program and are transmitted to the viewer'"'"'s set top box along with the object interactivity program and the viewer'"'"'s set-top box is coupled to a television display and to a set top box remote control which is adapted as a pointer device.

2. A system according to claim 1, wherein the TV program is existing video content enhanced with overlays of graphics to be displayed as objects appearing in the display in conjunction with the existing video content.

3. A system according to claim 1, wherein the TV program is existing video content transmitted as analog TV signals constituted by video frame signals in a time-indexed sequence, and the object mapping data and object interactivity program are transmitted in video blanking intervals interleaved with the video frame signals.

4. A system according to claim 1, wherein the remote control for the set top box is adapted for pointing to an object by toggling through and selecting an object from a plurality of interactive objects displayed on the viewer'"'"'s TV.

5. A system according to claim 4, wherein the set top box includes an interactive TV utility for generating markers at the display locations of interactive objects in the display of existing TV content as defined by the object mapping data and allowing the viewer to toggle through them.

6. A system according to claim 4, wherein the object mapping data are constituted by a display overlay of markers at display locations corresponding to interactive objects in the display of TV content, and the set top box includes an interactive TV utility for displaying the overlay of markers marking the interactive objects in conjunction with the display of TV content.

7. A system according to claim 4, wherein the set top box includes an interactive TV utility for generating highlights in succession at display locations corresponding to the interactive objects in the display of TV content as defined by the object mapping data, in response to the viewer'"'"'s toggling through the interactive objects displayed on the viewer'"'"'s TV.

8. A system according to claim 7, wherein the interactive TV utility includes a function for performing an object interactivity linkage function in response to the viewer'"'"'s selection of an object defined by the object mapping data, and storing the output of the performed functions with the set top box.

15. A method according to claim 1, wherein the set top box includes an interactive TV utility having a function for generating markers at the display locations of interactive objects in the display of existing TV content as defined by the object mapping data and allowing the viewer to toggle through them.

16. A method according to claim 1, wherein the object mapping data are constituted by a display overlay of markers at display locations corresponding to interactive objects in the display of TV content, and the set top box includes an interactive TV utility for displaying the overlay of markers marking the interactive objects in conjunction with the display of TV content.

9. An authoring system for allowing existing media content to be converted and used as an interactive media program comprising:

(a) an editing subsystem for editing existing media content in the form of media data representing a series of successive image display frames indexed in a time sequence which have objects appearing visually in one or more of the image display frames;

(b) an object mapping subsystem for generating object mapping data specifying display locations of the objects appearing in the image display frames of the existing media content which are to be rendered interactive;

(c) object interactivity program development tools including a hyperlinking tool for establishing linkages from the objects specified by the object mapping data to respective interactive functions to be performed upon user selection of the objects in conjunction with a display of the existing media content; and

(d) said object mapping subsystem having an object mapping tool for defining the display location of an object appearing in a display frame of the existing media content which is to be rendered interactive by marking the display location position of the object as it appears in an image display frame,

wherein said object mapping subsystem includes an object outlining tool for generating object mapping data specifying the display location of an object appearing in a display frame of the existing media content based upon an outline drawn around the object with a cursor or pointing device.

10. An authoring system according to claim 9, wherein said object mapping subsystem further includes an object motion tracking tool for detecting a path of an object as it appears in motion across a series of display frames and for generating object mapping data for the object for the series of display frames based upon an outline drawn around an object in one display frame by said object outlining tool and the path of motion of the object detected by said object motion tracking tool.

11. A method for allowing existing media content to be converted and used as an interactive media program comprising the steps of:

(a) providing existing media content in the form of media data representing a series of successive image display frames indexed in a time sequence which have objects appearing visually in one or more of the image display frames;

(b) defining object mapping data specifying display locations of the objects appearing in the image display frames of the existing media content which are to be rendered interactive;

(c) defining linkages provided through an associated object interactivity program for linking the objects specified by the object mapping data to respective interactive functions to be performed upon user selection of the objects by pointing to the display locations of the objects appearing in a display of the existing media content; and

(d) operating an interactive media program on a user system in conjunction with the display of the existing media content by receiving the media data and displaying the series of image display frames represented by the media data, receiving the object mapping data and the object interactivity program and performing the respective interactivity functions when objects appearing in the display of image display frames are selected by the user, and enabling the user to point to the display locations of objects appearing in the display of the media content in order to interactively select an object appearing in one or more image display frames using said object mapping data specifying its display location in the image display frames and performing the interactive function linked by the corresponding linkage of the object interactivity program thereto,

wherein the existing media content is an existing TV program transmitted to a viewer'"'"'s TV set top box, the object mapping data correspond to the display locations of interactive objects appearing in the TV program and are transmitted to the viewer'"'"'s set top box along with the object interactivity program, and the viewer'"'"'s set-top box is coupled to a television display and to a set top box remote control which is adapted as a pointer device.

12. A method according to claim 11, wherein the TV program is existing video content enhanced with overlays of graphics to be displayed as objects appearing in the display in conjunction with the existing video content.

13. A method according to claim 11, wherein the TV program is existing video content transmitted as analog TV signals constituted by video frame signals in a time-indexed sequence, and the object mapping data and object interactivity program are transmitted in video blanking intervals interleaved with the video frame signals.

14. A method according to claim 11, wherein the remote control for the set top box is adapted for pointing to an object by toggling through and selecting an object from a plurality of interactive objects displayed on the viewer'"'"'s TV.