Video and multimedia browsing while switching between views

• US 6,907,570 B2
• Filed: 03/29/2001
• Issued: 06/14/2005
• Est. Priority Date: 03/29/2001
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Amir, Arnon, Ponceleon, Dulce Beatriz, Srinivasan, Savitha
• Primary Examiner(s): Cabeca, John
• Assistant Examiner(s): DETWILER, BRIAN J
• Application Number:
  US09/822,035
• Publication Number:
  US 20020140719A1
• Time in Patent Office: 1,538 Days
• Field of Search: 345717-721, 345/727, 345/748, 345/764, 345/972, 725/40, 725/51, 725/52, 725 59- 61
• US Class Current: 715/720
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

Preferred implementations of the invention permit a user to seamlessly switch from a first media stream to a second media stream in a synchronized way, such that the second media stream picks up where the first media stream left off. In this way, the user experiences events chronologically but without interruption. In a preferred implementation, a user watching a skim video switches to a full length video when, for example, the skim video reaches a frame that is of particular interest to the user. The full length video begins at a point corresponding to the frame in the skim video that is of interest to the user, without skipping over video segments, so that the user does not experience any time gaps in the story line.

Claims

1. A method of browsing, comprising:

accessing a first media stream;

allowing the first media stream to play up to some point in the first media stream; and

switching media streams by selecting a second media stream different from the first media stream, said selecting thereby starting the second media stream at a point corresponding to said point in the first media stream, wherein content in the first media stream is time compressed with respect to content in the second media stream, to reduce the time a user spends searching for media content of interest to the user.

2. The method of claim 1, wherein the second media stream has media content in common with the first media stream.

3. The method of claim 1, wherein the second media stream includes a full video.

4. The method of claim 1, wherein one of the media streams includes audio.

5. The method of claim 1, wherein one of the media streams includes closed caption text.

6. The method of claim 1, wherein one of the media streams is selected from the group consisting of skim video, moving storyboard, full video, audio, text, animation, and graphics.

7. The method of claim 1, said switching comprising clicking on a mouse or depressing a key on a keyboard.

8. The method of claim 1, wherein said point in the second media stream is selected from one of a plurality of points in the second media stream corresponding to the first media stream.

9. The method of claim 1, wherein said point in the second media stream corresponds in the chronological sense to said point in the first media stream.

10. The method of claim 9, wherein the first media stream includes a skim video and the second media stream includes a full video.

11. The method of claim 9, wherein one of the media streams is dedicated to audio.

12. The method of claim 9, wherein one of the media streams is sped-up audio.

13. The method of claim 9, wherein one of the media streams includes text.

14. The method of claim 9, wherein one of the media streams is dedicated to closed caption text.

15. The method of claim 9, wherein one of the media streams includes moving storyboard with fast or slow audio.

16. The method of claim 9, wherein one of the media streams includes both audio and video.

17. The method of claim 9, wherein one of the media streams includes video, and the rate at which the video is streamed out is controlled by a user.

18. The method of claim 9, wherein one of the media streams includes a low bandwidth video stream.

19. The method of claim 9, wherein said starting point in the second media steam is determined by accessing a look-up table.

20. The method of claim 9, wherein said starting point in the second media stream is determined from a mathematical formula.

21. The method of claim 9, wherein said starting point in the second media stream is computed from data that are streamed with the first media stream.

22. The method of claim 9, wherein said starting point in the second media stream compensates for user response time and thus is not precisely synchronized with said point in the first media stream.

23. The method of claim 9, wherein any synchronization mismatch between said first and second points is less than about 3 seconds of viewing time.

24. The method of claim 9, wherein said starting point in the second media stream corresponds to the beginning of a shot or a video scene.

25. The method of claim 9, wherein said starting point in the second media stream corresponds to the beginning of a sentence.

26. The method of claim 9, wherein one of the media streams includes more than one track.

27. The method of claim 1, further comprising searching the first media stream for media content of interest to the user.

28. The method of claim 1, wherein the first media stream includes at least one of moving storyboard and skim video.

29. A method of providing media streams to a browser user, comprising:

providing a first media stream;

receiving a request from the user to access a second media stream different from the first media stream, the request being generated at a point in the first media stream; and

providing as a result of said request, the second media stream starting at a point corresponding to said point in the first media stream, wherein content in the first media stream is time compressed with respect to content in the second media stream, to reduce the time the user spends searching for media content of interest to the user.

30. The method of claim 29, wherein the second media stream has media content in common with the first media stream.

31. The method of claim 29, wherein the second media stream includes a full video.

32. The method of claim 29, wherein one of the media streams includes audio.

33. The method of claim 29, wherein one of the media streams includes closed caption text.

34. The method of claim 29, wherein said point in the second media stream corresponds in the chronological sense to said point in the first media stream.

35. The method of claim 29, wherein the first media stream includes a skim video and the second media stream includes a full video.

36. The method of claim 34, wherein one of the media streams is dedicated to audio.

37. The method of claim 34, wherein one of the media streams includes text.

38. The method of claim 34, wherein one of the media streams includes both audio and video.

39. The method of claim 34, wherein said starting point in the second media stream compensates for user response time and thus is not precisely synchronized with said point in the first media stream.

40. The method of claim 34, wherein any mismatch between said first and second points is less than about 3 seconds of viewing time.

41. The method of claim 34, wherein said starting point in the second media stream corresponds to the beginning of a shot or a video scene.

42. The method of claim 34, wherein said starting point in the second media stream corresponds to the beginning of a sentence.

43. The method of claim 29, wherein said point in the second media stream is selected from one of a plurality of points in the second media stream corresponding to the first media stream.

44. The method of claim 29, wherein the second media stream is provided to the user after the user searches the first media stream for media content of interest to the user.

45. The method of claim 29, wherein the first media stream includes at least one of moving storyboard and skim video.

46. A computer program product comprising a computer readable medium having computer-executable program instructions thereon, comprising:

program instructions enabling a browser to access a first media stream; and

program instructions enabling the browser to switch media streams in response to a browser user selecting a second media stream different from the first media stream, after the user has allowed the first media stream to play up to some point in the first media stream, said selecting thereby starting the second media stream at a point corresponding to said point in the first media stream, wherein content in the first media stream is time compressed with respect to content in the second media stream, to reduce the time the user spends searching for media content of interest to the user.

47. The computer program product of claim 46, wherein said point in the second media stream corresponds in the chronological sense to said point in the first media stream.

48. A computer program product comprising a computer readable medium having computer-executable program instructions thereon, comprising:

program instructions for providing a first media stream to a browser user;

program instructions for receiving a request from the user to access a second media stream different from the first media stream, the request being generated at a point in the first media stream; and

program instructions for providing to the browser user, as a result of said request, the second media stream starting at a point corresponding to said point in the first media stream, wherein content in the first media stream is time compressed with respect to content in the second media stream, to reduce the time the user spends searching for media content of interest to the user.

49. The computer program product of claim 48, wherein said point in the second media stream corresponds in the chronological sense to said point in the first media stream.

50. A method of browsing, comprising:

accessing a first media stream;

allowing the first media stream to play up to some point in the first media stream; and

switching media streams by selecting a second media stream different from the first media stream, said selecting thereby starting the second media stream at a point corresponding in the chronological sense to said point in the first media stream, wherein said starting point in the second media stream compensates for user response time and thus is not precisely synchronized with said point in the first media stream.

51. The method of claim 50, wherein the second media stream has media content in common with the first media stream.

52. The method of claim 50, wherein the second media stream includes a full video.

53. The method of claim 50, wherein one of the media streams is selected from the group consisting of skim video, moving storyboard, full video, audio, text, animation, and graphics.

54. The method of claim 50, said switching comprising clicking on a mouse or depressing a key on a keyboard.

55. The method of claim 50, wherein the first media stream includes a skim video and the second media stream includes a full video.

56. The method of claim 50, wherein one of the media streams includes moving storyboard with first or slow audio.

57. The method of claim 50, wherein one of the media streams includes video, and the rate at which the video is streamed out is controlled by a user.

58. The method of claim 50, wherein one of the media streams includes a low bandwidth video stream.

59. The method of claim 50, wherein said starting point in the second media stream is determined by accessing a look-up table.

60. The method of claim 50, wherein said starting point in the second media stream is determined from a mathematical formula.

61. The method of claim 50, wherein said starting point in the second media stream is computed from data that are streamed with the first media stream.

62. The method of claim 50, wherein any synchronization mismatch between said first and second points is less than about 3 seconds of viewing time.

63. The method of claim 50, wherein said starting point in the second media stream corresponds to the beginning of a shot or a video scene.

64. The method of claim 50, wherein said starting point in the second media stream corresponds to the beginning of a sentence.

65. The method of claim 50, wherein one of the media streams includes more than one track.

66. A method of providing media streams to a browser user, comprising

providing a first media stream;

retrieving a request from the user to access a second media stream different from the first media stream, the request being generated at a point in the first media stream; and

providing, as a result of said request, the second media stream starting at a point corresponding in the chronological sense to said point in the first media stream, wherein said starting point in the second media stream compensates for user response time and thus is not precisely synchronized with said point in the first media stream.

67. The method of claim 66, wherein the second media stream has media content in common with the first media stream.

68. The method of claim 66, wherein the second media stream includes a full video.

69. The method of claim 66, wherein the first media stream includes a skim video and the second media stream includes a full video.

70. The method of claim 66, wherein any mismatch between said first and second points is less than about 3 seconds of viewing time.

71. The method of claim 66, wherein said starting point in the second media stream corresponds to the beginning of a shot or a video scene.

72. The method of claim 66, wherein said starting point in the second media stream corresponds to the beginning of a sentence.

73. A computer program product comprising a computer readable medium having computer-executable program instructions thereon, comprising:

program instructions enabling a browser to access a first media stream; and

program instructions enabling the browser to switch media streams in response to a browser user selecting a second media stream different from the first media stream, after the user has allowed the first media stream to play up to some point in the first media stream, said selecting thereby starting the second media stream at a point corresponding in the chronological sense to said point in the first media stream, wherein said starting point in the second media stream compensates for user response time and thus is not precisely synchronized with said point in the first media stream.

74. A computer program product comprising a computer readable medium having computer-executable program instructions thereon, comprising:

program instructions for providing a first media stream to a browser user;

program instructions for receiving a request from the user to access a second media stream different from the first media stream, the request being generated at a point in the first media stream; and

program instructions for providing to the browser user, as a result of said request, the second media stream starting at a point corresponding in the chronological sense to said point in the first media stream, wherein said starting point in the second media stream compensates for user response time and thus is not precisely synchronized with said point in the first media stream.