System for mapping hot spots in media content for interactive digital media program

• US 5,708,845 A
• Filed: 09/29/1995
• Issued: 01/13/1998
• Est. Priority Date: 09/29/1995
• Status: Expired due to Term

• Current Assignee: Intellectual Ventures Assets 6 LLC (Intellectual Ventures LLC)
• Original Assignee: Douglass A. Wistendahl, Leighton K. Chong
• Inventors: Wistendahl, Douglass A., Chong, Leighton K.
• Primary Examiner(s): Feild, Joseph H.
• Assistant Examiner(s): HONG, STEPHEN S
• Application Number:
  US08/536,107
• Time in Patent Office: 837 Days
• Field of Search: 395/154, 395/152, 395/155, 395/160, 395/762, 395/806, 395/807, 395/173, 395/327, 395/328, 395/329, 345/121, 345/122, 345/158, 348/7, 348/10, 348/12, 348/20, 358/341, 358/342
• US Class Current: 715/202
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system for allowing media content to be used in an interactive digital media (IDM) program has Frame Data for the media content and object mapping data (N Data) representing the frame addresses and display location coordinates for objects appearing in the media content. The N Data are maintained separately from the Frame Data for the media content, so that the media content can be kept intact without embedded codes and can be played back on any system. The IDM program has established linkages connecting the objects mapped by the N Data to other functions to be performed in conjunction with display of the media content. Selection of an object appearing in the media content with a pointer results in initiation of the interactive function. A broad base of existing non-interactive media content, such as movies, videos, advertising, and television programming can be converted to interactive digital media use. An authoring system for creating IDM programs has an object outlining tool and a object motion tracking tool for facilitating the generation of N Data. In a data storage disk, the Frame Data and the N Data are stored on separate sectors. In a network system, the object mapping data and IDM program are downloaded to a subscriber terminal and used in conjunction with presentation of the media content.

Claims

1. A system for allowing media content to be used in an interactive digital media program comprising:

(a) first user means for receiving media content in the form of data representing a series of successive display frames having respective frame addresses ("Frame Data");

(b) second user means for receiving object mapping data ("N Data") separately from the media content, said N Data specifying display location coordinates of objects intended to be rendered interactive as they appear in the display frames of the media content, wherein said N Data for each mapped object comprise coordinate location data representing the display location coordinates of the object as it appears in a display frame of said media content and a frame address for the display frame in which the object appears, said object mapping N Data being maintained as logically and physically separate data from the media content data, such that the media content data remain uncorrupted by and unembedded with the N Data;

(c) media content display means operable in conjunction with said first user means and responsive to the media content data for providing a visual display of the display frames of said media content while tracking the frame addresses of the display frames being displayed;

(d) interactive digital media (IDM) program means operable in conjunction with said second user means and said media content display means and responsive to the N Data for providing program linkages for connecting objects, for which display location coordinates and frame addresses of the display frames of said media content are specified by the N Data, to respective other functions to be performed upon user selection of the objects in conjunction with display of the media content by said media content display means; and

(e) a user system, including said first and second user means and a pointing device for selecting an object when it appears in the visual display of said media content, for operating the IDM program by detecting when an object appearing within the display location coordinates of the N Data for said object in a displayed frame of said media content having a frame address corresponding to the frame address of the N Data for said object is selected by a user and by performing the function linked by the IDM program linkage thereto.

2. A system according to claim 1, wherein the N Data representing the display location coordinates and frame addresses of mapped objects are maintained separately from the Frame Data for the media content.

3. A system according to claim 1, wherein the media content is one selected from the group comprising a movie, music video, video advertising, cable or television programming, and reference works.

4. A system according to claim 1, wherein the linkages provided through an interactive digital media (IDM) program are maintained separately from the N Data for the mapped objects.

5. A system according to claim 1, wherein the user system is coupled to a network for transmitting media content and other data to a user location and includes a set-top box coupled to a television display as said media content display means at the user location.

6. A system according to claim 5, wherein the user system includes an optical pointer as said pointing device for pointing to a target area on the television display, and the set-top box includes a detector for detecting display location coordinates of a target area on the television display pointed to by said pointing device.

7. A system according to claim 1, further comprising:

(a) a network server connected to a plurality of subscriber terminals for providing interactive digital media program services to subscribers on the network system;

(b) the N Data for objects intended to be interactive in the media content being stored in a memory of the network server in association with the Frame Data for media content; and

(c) said user system being constituted by each subscriber terminal having a console connected to a display and to the network system via a transmission link.

8. A network system according to claim 7, wherein the media content is a movie, and Frame Data for the movie and N Data for designated objects appearing therein are transmitted from the network server to the subscriber terminal upon request.

9. A network system according to claim 7, wherein the IDM program is stored with the N Data and is also transmitted from the network server to the subscriber terminal upon request.

10. A network system according to claim 7, wherein the subscriber terminal includes a remote control having an optical pointer device and a pointer detection sensor for detecting the selection of an object by a subscriber using said pointer device.

11. A network system according to claim 7 in the form of a cable TV network, wherein the subscriber terminal console is a cable converter box, the media content is a cable TV program, and N Data for designated objects appearing therein are transmitted from the network server to the subscriber terminal on a cable channel received by the subscriber terminal console.

12. A network system according to claim 11, wherein the subscriber terminal console includes a keypad and means for generating a message to be transmitted back to the network server.

13. A network system according to claim 11, wherein the subscriber terminal console includes a stored IDM-like utility for performing an IDM program in conjunction with display of the media content.