Method and system for displaying multimedia data using pointing selection of related information

• US 6,151,017 A
• Filed: 09/12/1996
• Issued: 11/21/2000
• Est. Priority Date: 09/12/1995
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Kizu, Toshiki, Kawakura, Yasushi, Suzuoka, Takashi, Kakimoto, Mitsuru, Aikawa, Takeshi, Yokokawa, Takeshi
• Primary Examiner(s): Feild, Joseph H.
• Assistant Examiner(s): Kindred, Alford W.
• Application Number:
  US08/713,301
• Time in Patent Office: 1,531 Days
• Field of Search: 345/302, 345/116, 345/112, 345/418, 345/328, 345/348, 345/133, 345/469, 345/330, 345/157, 386/7, 386/2
• US Class Current: 715/201
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Abstract

A method and a system for displaying multimedia data including video data. A display of video data and related information are controlled according to a movement of a pointing selection marker, a type of related information, or a distribution of pointing selection possible regions over frames of video data. Linked related information can be displayed in synchronization with a progress of a display of the video data. Information indicating a presence/absence of pointing selection possible region for currently displayed video data can also be displayed. A useful information can be obtained by collecting a statistical information on the desired positions specified by the user'"'"'s pointing selection inputs. Each frame of video data can be partitioned and related information can be provided in correspondence to partitioned parts of each frame.

Claims

1. A method for displaying multimedia data including video data, in a system which displays video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system also displaying a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input, the method comprising the steps of:

displaying the video data at a prescribed video display region;

displaying a prescribed pointing selection marker at a position specified by a user; and

controlling a display of the video data so as to display the video data by a special display method when a display position of the pointing selection marker is moved from outside the video display region to inside the video display region and the related information is provided in correspondence to the video data currently displayed in the video display region, the special display method being different from a usual display method by which the video data are displayed when the display position of the pointing selection marker is located outside the video display region.

2. The method of claim 1, wherein the control step uses the special display method which displays a frame enclosing each pointing selection possible region.

3. The method of claim 1, wherein the control step uses the special display method which changes an image intensity and/or a color tone used for displaying each pointing selection possible region.

4. The method of claim 1, wherein the control step uses the special display method which pauses the display of the video data.

5. The method of claim 1, wherein the control step uses the special display method which lowers a display speed used for displaying the video data.

6. The method of claim 1, wherein the control step changes a display method used for displaying the video data from the special display method to the usual display method when the display position of the pointing selection marker is moved from inside the video display region to outside the video display region.

7. A method for displaying multimedia data including video data, in a system which displays video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system also displaying a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input, the method comprising the steps of:

displaying the video data at a prescribed video display region; and

displaying an information indicating a presence/absence of a pointing selection possible region set up with respect to the video data currently displayed in the video display region.

8. The method of claim 7, wherein said information also indicates a number of pointing selection possible regions set up with respect to the video data currently displayed in the video display region.

9. A method for displaying multimedia data including video data, in a system which displays video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the method comprising the steps of:

displaying the video data;

displaying one related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

controlling a display of the video data so as to display the video data by a special display method when said one related information is video information, while said one related information is displayed, the special display method being different from a usual display method by which the video data are normally displayed.

10. The method of claim 9, wherein the control step uses the special display method which pauses the display of the video data.

11. The method of claim 9, wherein the control step uses the special display method which lowers a display speed used for displaying the video data.

12. The method of claim 9, wherein the control step uses the special display method which raises a display speed used for displaying the video data.

13. A method for displaying multimedia data including video data, in a system which displays video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the method comprising the steps of:

displaying the video data;

displaying one related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

controlling a display of said one related information so as to display said one related information by a special display method when said one related information is video information, the special display method being different from a usual display method by which the related information is normally displayed.

14. The method of claim 13, wherein the control step uses the special display method which pauses the display of said one related information.

15. The method of claim 13, wherein the control step uses the special display method which lowers a display speed used for displaying said one related information.

16. The method of claim 13, wherein the control step uses the special display method which raises a display speed used for displaying said one related information.

17. A method for displaying multimedia data including video data, in a system which displays video data formed by a series of frames, the video data having a plurality of pointing selection possible regions set up in advance and being associated with a plurality of related information provided in correspondence to the pointing selection possible regions, said plurality of related information including more than one related information which are provided with respect to different frames of the video data and which are linked together, the system also displaying a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input, the method comprising the steps of:

displaying the video data, and

sequentially updating a content of a related information to be displayed among said more than one related information in synchronization with a progress of a display of the video data.

18. The method of claim 17, further comprising the step of:

displaying said more than-one related information sequentially in synchronization with a progress of a display of the video data.

19. The method of claim 17, further comprising the steps of:

iconizing a display screen for said more than one related information; and

displaying a sequentially updated content of a related information when an iconized display screen for said more than one related information is opened.

20. A method for displaying multimedia data including video data, in a system which displays video data formed by a series of frames, the video data having a plurality of pointing selection possible regions set up in advance with respect to a selected number of frames and being associated with a plurality of related information provided in correspondence to the pointing selection possible regions, the system also displaying a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input, the method comprising the steps of:

displaying the video data; and

controlling a display of the video data when a request for a transition to a mode for allowing a user'"'"'s pointing selection input is entered and a currently displayed frame has no pointing selection possible region, by playbacking the video data up to another frame which has a pointing selection possible region, and pausing/slowing down the playback of the video data at said another frame.

21. The method of claim 20, wherein at the controlling step, said another frame is a frame closest to the currently displayed frame among all frames which have pointing selection possible regions.

22. The method of claim 20, wherein at the controlling step, said another frame is a frame closest to the currently displayed frame among frames which have pointing selection possible regions and which belong to an identical scene as the currently displayed frame.

23. A method for obtaining an information useful in producing multimedia data including video data, for a system which displays video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system also displaying a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input, the method comprising the steps of:

displaying the video data;

receiving user'"'"'s pointing selection inputs specifying desired positions in the video data for obtaining the related information;

collecting a statistical information on the desired positions specified by the user'"'"'s pointing selection inputs; and

providing the statistical information as an information indicative of targets of user'"'"'s interests in the video data.

24. A method for displaying multimedia data including video data, in a system which displays video data formed by a series of frames, each frame being partitioned into partitioned parts by a prescribed partition scheme and being associated with a plurality of related information provided in correspondence to the partitioned parts, the method comprising the steps of:

displaying the video data;

receiving a user'"'"'s pointing selection input specifying a desired position in a currently displayed frame for obtaining the related information; and

displaying a related information provided in correspondence to one partitioned part which contains the desired position specified by the user'"'"'s pointing selection input, by identifying said one partitioned part according to an information on the prescribed partition scheme used in partitioning the currently displayed frame and an information on the desired position specified by the user'"'"'s pointing selection input.

25. A system for displaying multimedia data including video data, the video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system comprising:

a display device for displaying the video data at a prescribed video display region, a prescribed pointing selection marker at a position specified by a user, and a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

a control device for controlling a display of the video data by the display device so as to display the video data by a special display method when a display position of the pointing selection marker is moved from outside the video display region to inside the video display region and the related information is provided in correspondence to the video data currently displayed in the video display region, the special display method being different from a usual display method by which the video data are displayed when the display position of the pointing selection marker is located outside the video display region.

26. A system for displaying multimedia data including video data, the video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system comprising:

first display means for displaying the video data at a prescribed video display region, and a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

second display means for displaying an information indicating a presence/absence of pointing selection possible region set up with respect to the video data currently displayed in the video display region.

27. A system for displaying multimedia data including video data, the video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system comprising:

a display device for displaying the video data, and one related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

a control device for controlling a display of the video data by the display device so as to display the video data by a special display method when said one related information is video information, while said one related information is displayed, the special display method being different from a usual display method by which the video data are normally displayed.

28. A system for displaying multimedia data including video data, the video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, the system comprising:

a display device for displaying the video data, and one related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

a control device for controlling a display of said one related information so as to display said one related information by a special display method when said one related information is video information, the special display method being different from a usual display method by which the related information is normally displayed.

29. A system for displaying multimedia data including video data formed by a series of frames, the video data having a plurality of pointing selection possible regions set up in advance and being associated with a plurality of related information provided in correspondence to the pointing selection possible regions, said plurality of related information including more than one related information which are provided with respect to different frames of the video data and which are linked together, the system comprising:

a display device for displaying the video data, and a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

a control device for sequentially updating a content of a related information to be displayed by the display device among said more than one related information in synchronization with a progress of a display of the video data.

30. A system for displaying multimedia data including video data formed by a series of frames, the video data having a plurality of pointing selection possible regions set up in advance with respect to a selected number of frames and being associated with a plurality of related information provided in correspondence to the pointing selection possible regions, the system comprising:

a display device for displaying the video data, and a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input; and

a control device for controlling a display of the video data by the display device when a request for a transition to a mode for allowing a user'"'"'s pointing selection input is entered and a currently displayed frame has no pointing selection possible region, by playbacking the video data up to another frame which has a pointing selection possible region, and pausing/slowing down the playback of the video data at said another frame.

31. A system for obtaining an-information useful in producing multimedia data including video data, the video data having at least one pointing selection possible region set up in advance and being associated with at least one related information provided in correspondence to the pointing selection possible region, so as to be able to display a related information corresponding to a pointing selection possible region which contains a position specified by a user'"'"'s pointing selection input, the system comprising:

a display device for displaying the video data; and

a control device for receiving user'"'"'s pointing selection inputs specifying desired positions in the video data for obtaining the related information, collecting a statistical information on the desired positions specified by the user'"'"'s pointing selection inputs, and providing the statistical information as an information indicative of targets of user'"'"'s interests in the video data.

32. A system for displaying multimedia data including video data formed by a series of frames, each frame being partitioned into partitioned parts by a prescribed partition scheme and being associated with a plurality of related information provided in correspondence to the partitioned parts, the system comprising:

a display device for displaying the video data, and a related information; and

a control device for receiving a user'"'"'s pointing selection input specifying a desired position in a currently displayed frame for obtaining the related information, identifying said one partitioned part according to an information on the prescribed partition scheme used in partitioning the currently displayed frame and an information on the desired position specified by the user'"'"'s pointing selection input, and controlling the display device to display the related information provided in correspondence to said one partitioned part.