Timedependent hyperlink system in videocontent

• US 7,139,813 B1
• Filed: 11/01/1999
• Issued: 11/21/2006
• Est. Priority Date: 11/01/1999
• Status: Expired due to Fees

• Current Assignee: Nokia Networks (Nokia Corporation)
• Original Assignee: Nokia Networks (Nokia Corporation)
• Inventors: Wallenius, Jukka
• Primary Examiner(s): Cardone, Jason
• Assistant Examiner(s): Mirza, Adnan M.
• Application Number:
  US09/431,753
• Time in Patent Office: 2,577 Days
• Field of Search: 709/231, 709/227, 709/245, 709/228, 709/203, 709/219, 725/22, 725/215
• US Class Current: 709/219
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: H04N 21/2225 Local VOD servers
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2405 Monitoring of the internal components or processes of the server, e.g. server load allocation of resources in multiprogramming arrangements G06F9/50; performance measurement of computer activity G06F11/34
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
• CPC Class Codes: H04N 21/8583 by creating hot-spots

Abstract

A time-dependent hyperlink is associated with a video of a content server. The time dependent link is cross-referenced with coordinates and time that it appears in the video. A user may select the time-dependent hyperlink by selecting the hyperlink when is displayed by the video. The coordinates of the selection, including time, are used to determine the hyperlink that was selected. The browser being used can then be switched to a new session indicated by the hyperlink.

Claims

1. A procedure for using a time-dependent hyperlink in video, comprising the steps of:

(a) associating content reference for at least one hyperlink with an object in a video by associating the content reference with coordinates at which the hyperlink appears in the video, wherein one of the coordinates includes time, such that the hyperlink follows the area on the screen in which the object associated with the hyperlink appears during the video;

(b) transmitting the video from a first content server to a video browser of a user display;

(c) selecting by the user a selected hyperlink in the video by selecting coordinates corresponding to the area and time at which the selected hyperlink appears in the video, whereby the user selects the selected hyperlink in real time while the video is being displayed by the video browser;

(d) determining the content reference for a new session of the selected hyperlink based on the selected coordinates;

(e) initiating a connection of the browser to the new session of the selected hyperlink; and

(f) switching the connection of the browser from the first content server to the new session, wherein said steps (d) and (e) are performed prior to said step (c) of selecting such that said step of switching the connection is performed as a smooth switchover when the selected hyperlink is selected in said step (c).

2. The procedure of claim 1, wherein said step (b) further comprises transmitting a link stream to the browser in parallel to the video, the link stream including the content reference for the at least one hyperlink when the at least one hyperlink is displayed.

3. The procedure of claim 2, wherein said step (d) comprises determining, by the browser, the content reference based on the information received via the link stream and the coordinates selected in said step (c).

4. The procedure of claim 1, wherein said step (d) comprises looking up the content reference in a database in the current content server, the database including the content reference cross-referenced with the coordinates at which the at least one hyperlink for the content reference appears in the video.

5. The procedure of claim 1, further comprising the step of downloading a file from the current content server to the browser before performing said step (b), the file containing a database including the content reference cross-referenced with the coordinates at which the at least one hyperlink for the content reference appears in the video and said step (d) comprises looking up the content reference in the downloaded file.

6. The procedure of claim 1, wherein said step (e) further comprises initiating at a call processing server a connection to the new session of the selected hyperlink, the call processing server being arranged between the current content server and the browser.

7. The procedure of claim 1, wherein said steps (d), (e), and (f) are performed using a switchover application associated with the video in the current content server.

8. The procedure of claim 7, further comprising the step of downloading the switchover application containing information on the at least one hyperlink in the video being transmitted in said step (b).

9. The procedure of claim 8, wherein said step of downloading a switchover application is performed prior to said step (b), and said step (b) comprises establishing a multimedia session, by said switchover application, with the current content server and requesting transmission of a link stream including content reference for the at least one hyperlink.

10. The procedure of claim 8, wherein said step of downloading a switchover application is performed at a given time displacement from the start of the video in said step (b).

11. The procedure of claim 8, wherein said step of downloading a switchover application further comprises downloading a first switchover application and a second switchover application such that the first and second switchover applications are active simultaneously.

12. The procedure of claim 7, wherein the switchover application performs at least one of the following steps:

downloading given contents at given points in time;

playing contents at given points in time;

checking content server availability;

selecting from several content servers depending on server load status;

requesting the current content server to prepare a content for transmission;

requesting the current content server to start transmitting a prepared document;

requesting the current content server to start transmitting content from a given displacement;

requesting a downloading of a new switchover application for the content referred to by a link;

establishing a new session to new content at given points in time;

submitting received call processing language scripts to assist establishment of a new session;

determining round trip delay between the browser and the content server of the selected hyperlink and adjusting switchover times on the determination;

determining permanent terminal or terminal location specific implications to general session establishment time and adjusting switchover schedules based on the determination;

performing procedures needed to join a multicast session;

reserving network resources for a new session under establishment or a link or data stream being resumed;

freeing network resources for a new session being cleared or a link or data stream being paused;

performing video/audio content switchover at a given point in time;

comparing link descriptive information with user preference attributes and browser capabilities, in case of failure to satisfy the preference attributes; and

cancelling the visualization of the link to the user in case of failure.

13. The procedure of claim 12, wherein said step (f) comprises maintaining a session to the first content server and the switchover application performs the following steps:

establishing a new session toward the content of the selected hyperlink at a given point in time;

pausing the video/audio content stream of the original content at said step (f);

resuming the video/audio content stream of the original content at switchover back to the original content; and

releasing the new session toward the content of the selected hyperlink after switchover back to the original content.

14. The procedure of claim 13, wherein said step of resuming the video/audio content stream of the original content including resuming at the point in the original content at which the original content was paused.

15. The procedure of claim 13, wherein the switchover application caches a history of switchover applications.

16. The procedure of claim 3, wherein said steps (d), (e), and (f) are performed using a switchover application associated with the video in the first content server, said step of transmitting a link stream comprises transmitting a link stream including link selection and switchover preparation schedules, said switchover preparation schedules specified in ascii tag notation such that said switchover application performs the step of interpreting said ascii tag notation.

17. The procedure of claim 1, wherein said step (d) includes using an algorithm that determines the location of a hyperlink based on visual characteristics in the video.

18. The procedure of claim 1, wherein the browser performs at least one of the following steps:

downloading given contents at given points in time;

playing contents at given points in time;

checking content server availability;

selecting from several content servers depending on server load status;

requesting the current content server to prepare a content for transmission;

requesting the current content server to start transmitting a prepared document;

requesting the current content server to start transmitting content from a given displacement;

requesting a downloading of a new switchover application for the content referred to by a link;

establishing a new session to new content at given points in time;

submitting received call processing language scripts to assist establishment of a new session;

determining round trip delay between the browser and the content server of the selected hyperlink and adjusting switchover times on the determination;

determining permanent terminal or terminal location specific implications to general session establishment time and adjusting switchover schedules based on the determination;

performing procedures needed to join a multicast session;

reserving network resources for a new session under establishment or a link or data stream being resumed;

freeing network resources for a new session being cleared or a link or data stream being paused;

performing video/audio content switchover at a given point in time;

comparing link descriptive information with user preference attributes and browser capabilities, in case of failure to satisfy the preference attributes; and

cancelling the visualization of the link to the user in case of failure.

19. The procedure of claim 18, wherein said step (f) comprises maintaining a session to the first content server and the browser performs the following steps:

establishing a new session toward the link content at a given point in time;

pausing the video/audio content stream of the original content at said step (f);

resuming the video/audio content stream of the original content at switchover back to the original content; and

releasing the new session toward the content of the selected hyperlink after switchover back to the original content.

20. The procedure of claim 19, wherein said step of resuming the video/audio content stream of the original content including resuming at the point in the original content at which the original content was paused.

21. The procedure of claim 19, wherein the browser caches a history of switchover applications.

22. The procedure of claim 1, wherein said step (b) comprises transmitting the video from a current content server to a video browser of a user display via a media proxy controlled by a call processing server.

23. The procedure of claim 22, further comprising the step of downloading a switchover application to said call processing server or a service control means connected to said call processing server, said switchover application containing information on links in the video being transmitted in said step (b).

24. The procedure of claim 23, wherein said step of downloading a switchover application is performed prior to said step (b), and said step (b) comprises establishing a multimedia session, by said switchover application, with the current content server and requesting transmission of a link stream including content reference for the at least one hyperlink.

25. The procedure of claim 23, wherein said step of downloading a switchover application is performed at a given time displacement from the start of the video in said step (b).

26. The procedure of claim 23, wherein said step of downloading a switchover application further comprises downloading a first switchover application and a second switchover application such that the first and second switchover applications are active simultaneously.

27. The procedure of claim 22, wherein the call processing server performs at least one of the following steps:

downloading given contents at given points in time;

playing contents at given points in time;

checking content server availability;

selecting from several content servers depending on server load status;

requesting the current content server to prepare a content for transmission;

requesting the current content server to start transmitting a prepared document;

requesting the current content server to start transmitting content from a given displacement;

requesting a downloading of a new switchover application for the content referred to by a link;

establishing a new session to new content at given points in time;

submitting received call processing language scripts to assist establishment of a new session;

determining round trip delay between the browser and the content server of the selected hyperlink and adjusting switchover times on the determination;

determining permanent terminal or terminal location specific implications to general session establishment time and adjusting switchover schedules based on the determination;

performing procedures needed to join a multicast session;

reserving network resources for a new session under establishment or a link or data stream being resumed;

freeing network resources for a new session being cleared or a link or data stream being paused;

performing video/audio content switchover at a given point in time;

comparing link descriptive information with user preference attributes and browser capabilities, in case of failure to satisfy the preference attributes; and

cancelling the visualization of the link to the user in case of failure.

28. The procedure of claim 27, wherein said step (f) comprises maintaining a session to the first content server and the call processing server performs the following steps:

establishing a new session toward the content of the selected hyperlink at a given point in time;

pausing the video/audio content stream of the original content at said step (f);

resuming the video/audio content stream of the original content at switchover back to the original content; and

releasing the new session toward the content of the selected hyperlink after switchover back to the original content.

29. The procedure of claim 28, wherein said step of resuming the video/audio content stream of the original content including resuming at the point in the original content at which the original content was paused.

30. The procedure of claim 28, wherein the call processing server caches a history of switchover applications.

31. The procedure of claim 1, further comprising the step of performing said steps (d), (e), and (f) for a first new session and performing said steps (d), (e), and (f) for a second new session after said first new session reaches an end, in response to said selected hyperlink.

32. A system for processing a time-dependent hyperlink in a video, comprising:

a first content server comprising a video;

a user input/output device comprising a display for displaying the video and an input device for selecting a position on said display;

a browser arranged for connecting said user input/output device to said first content server;

at least one hyperlink and content reference cross-referenced with coordinates indicating where the object associated with the at least one hyperlink appears in the video stored in said first content server, said coordinates including display position and time during the video such that the at least one hyperlink follows the area on the screen in which the object associated with the hyperlink appears during the video, and said content reference indicating a second content server comprising an electronic document to which the hyperlink is linked;

means for determining when said hyperlink is selected by determining when coordinates at which the hyperlink appears in the video are selected while the video is being displayed on said display by said browser, wherein the selection of the hyperlink is in real time while the video is displayed; and

means for switching over a connection of said browser from said first content server to said second content server for user access to said electronic document in said second content server when said means for determining determines that said hyperlink has been selected, said means for switching over comprising means for performing a smooth switchover including means for initiating a connection of said browser to said second content server before said user selection of said at least one hyperlink.

33. The system of claim 32, further comprising means for transmitting a link stream containing said content reference of said at least one hyperlink from said first content server to said browser on a first communication channel and transmitting said video from said first content server to said browser in parallel to said link stream on a second communication channel.

34. The system of claim 32, wherein said content server comprises a switchover application for performing a smooth switchover and said means for performing a smooth switchover comprises a means for using said switchover application.

35. The system of claim 34, further comprising means for downloading said switchover application to said browser before said video is displayed, and said switchover application comprising means for establishing a multimedia session with said first content server and for requesting transmission of a link stream including content reference for said at least one hyperlink from said first content server.

36. The system of claim 34, further comprising means for downloading said switchover application to said browser while said video is displayed.

37. The system of claim 34, wherein said browser further comprises means for running more than one of said switchover applications simultaneously.

38. The system of claim 33, wherein said content server comprises a switchover application for performing a smooth switchover and said means for performing a smooth switchover comprises a means for using said switchover application, and said link stream comprises link selection and switchover preparation schedules specified in ascii tag notation which is interpretable by said switchover application.

39. The system of claim 34, wherein switchover application comprises means for performing at least one of the following steps:

downloading given contents of said first content server at given points in time;

playing contents of said first content server at given points in time;

checking availability of said second content server;

selecting from several content servers depending on server load status;

requesting said first content server to prepare a content for transmission;

requesting said first content server to start transmitting a prepared document;

requesting said first content server to start transmitting content from a given displacement;

requesting a downloading of a new switchover application for a content referred to by a link;

establishing a new session to new content at given points in time;

submitting received call processing language scripts to assist establishment of a new session;

determining round trip delay between the browser and the content server of the selected hyperlink and adjusting switchover times on the determination;

determining permanent terminal or terminal location specific implications to general session establishment time and adjusting switchover schedules based on the determination;

performing procedures needed to join a multicast session;

reserving network resources for a new session under establishment or a link or data stream being resumed;

freeing network resources for a new session being cleared or a link or data stream being paused;

performing video/audio content switchover at a given point in time;

comparing link descriptive information with user preference attributes and browser capabilities, in case of failure to satisfy the preference attributes; and

cancelling the visualization of a link.

40. The system of claim 39, wherein said switchover application comprises means for maintaining a session to the first content server and comprising means for performing the following steps:

establishing a new session toward the content of the selected hyperlink at a given point in time;

pausing the video/audio content stream of the original content when said new session is established;

resuming the video/audio content stream of the original content at switchover back to the original content; and

releasing the new session toward the content of the selected hyperlink after switchover back to the original content.

41. The system of claim 40, wherein means for resuming the video/audio content stream of the original content includes means for resuming at the point in the original content at which the original content was paused.

42. The system of claim 40, wherein said switchover application comprises means for caching a history of switchover applications.

43. The system of claim 32, wherein said content server further comprises a link database.

44. The system of claim 43, further comprising means for downloading said link database to said browser.

45. The system of claim 43, wherein said means for determining when said hyperlink is selected comprises means for querying said link database.

46. The system of claim 32, further comprising a call processing server arranged between said browser and said first content server, said call processing server comprising said means for switching over a connection of said user input/output device from said first content server to said second content server.

47. The system of claim 46, wherein said means for performing a smooth switchover comprises means for initiating a connection of said browser to said second content server before said user selection said at least one hyperlink.

48. The system of claim 47, wherein said content server comprises a switchover application for performing a smooth switchover and said means for performing a smooth switchover comprises a means for using said switchover application.

49. The system of claim 48, further comprising means for downloading said switchover application to said browser before said video is displayed, and said switchover application comprising means for establishing a multimedia session with said first content server and for requesting transmission of a link stream including content reference for said at least one hyperlink from said first content server.

50. The system of claim 48, further comprising means for downloading said switchover application to said browser while said video is displayed.

51. The system of claim 48, wherein said browser further comprises means or running more than one of said switchover applications simultaneously.

52. The system of claim 33, wherein said content server comprises a switchover application and said means for performing a smooth switchover comprises a means for using said switchover application, and further comprising a call processing server arranged between said browser and said first content server, said call processing server comprising said means for switching over a connection of said user input/output device from said first content server to said second content server, said link stream comprises link selection and switchover preparation schedules specified in ascii tag notation which is interpretable by said switchover application.

53. The system of claim 48, wherein said content server comprises means for performing at least one of the following steps:

downloading given contents of said first content server at given points in time;

playing contents of said first content server at given points in time;

checking availability of said second content server;

selecting from several content servers depending on server load status;

requesting said first content server to prepare a content for transmission;

requesting said first content server to start transmitting a prepared document;

requesting said first content server to start transmitting content from a given displacement;

requesting a downloading of a new switchover application for a content referred to by a link;

establishing a new session to new content at given points in time;

submitting received call processing language scripts to assist establishment of a new session;

determining round trip delay between the browser and the content server of the selected hyperlink and adjusting switchover times on the determination;

determining permanent terminal or terminal location specific implications to general session establishment time and adjusting switchover schedules based on the determination;

performing procedures needed to join a multicast session;

reserving network resources for a new session under establishment or a link or data stream being resumed;

freeing network resources for a new session being cleared or a link or data stream being paused;

performing video/audio content switchover at a given point in time;

comparing link descriptive information with user preference attributes and browser capabilities, in case of failure to satisfy the preference attributes; and

cancelling the visualization of a link.

54. The system of claim 53, wherein said content server further comprises means for maintaining a session to the first content server and means for performing the following steps:

establishing a new session toward the content of the selected hyperlink at a given point in time;

pausing the video/audio content stream of the original content when said new session is established;

resuming the video/audio content stream of the original content at switchover back to the original content; and

releasing the new session toward the content of the selected hyperlink after switchover back to the original content.

55. The procedure of claim 54, wherein means for resuming the video/audio content stream of the original content includes means for resuming at the point in the original content at which the original content was paused.

56. The system of claim 54, wherein said content server comprises means for caching a history of sessions.

57. The system of claim 48, further comprising a media proxy connected with said call processing server operative for conducting media transmission between said first content server and said browser.

58. The system of claim 32, wherein said means for determining when a hyperlink is selected comprises an algorithm operative for determining the location of a hyperlink based on visual characteristics of the video.

59. The system of claim 32, wherein said browser comprises means for performing at least one of the following steps:

downloading given contents of said first content server at given points in time;

playing contents of said first content server at given points in time;

checking availability of said second content server;

selecting from several content servers depending on server load status;

requesting said first content server to prepare a content for transmission;

requesting said first content server to start transmitting a prepared document;

requesting said first content server to start transmitting content from a given displacement;

establishing a new session to a new content at given points in time;

submitting received call processing language scripts to assist establishment of a new session;

determining round trip delay between the browser and the content server of the selected hyperlink and adjusting switchover times on the determination;

determining permanent terminal or terminal location specific implications to general session establishment time and adjusting switchover schedules based on the determination;

performing procedures needed to join a multicast session;

reserving network resources for a new session under establishment or a link or data stream being resumed;

freeing network resources for a new session being cleared or a link or data stream being paused;

performing video/audio content switchover at a given point in time;

comparing link descriptive information with user preference attributes and browser capabilities, in case of failure to satisfy the preference attributes; and

cancelling the visualization of a link.

60. The system of claim 59, wherein said browser further comprises means for maintaining a session to the first content server and comprising means for performing the following steps:

establishing a new session toward the content of the selected hyperlink at a given point in time;

pausing the video/audio content stream of the original content when said new session is established;

resuming the video/audio content stream of the original content at switchover back to the original content; and

releasing the new session toward the content of the selected hyperlink after switchover back to the original content.

61. The system of claim 60, wherein means for resuming the video/audio content stream of the original content includes means for resuming at the point in the original content at which the original content was paused.

62. The system of claim 60, wherein said content server comprises means for caching a history of sessions.

63. The system of claim 32, wherein a second content reference and a third content reference are both associated with said at least one hyperlink such that said means for switching over a connection further comprises means for switching over a connection of said browser from said second content reference to said third content reference of said at least one hyperlink after completion of said second content reference is completed.

64. A browser in a user input/output device comprising a display for displaying a video received from a first content server and an input device for selecting a position on the display, wherein at least one hyperlink and content reference cross-referenced with coordinates indicating where the object associated with the at least one hyperlink appears in the video stored in said first content server, said coordinates including display position and time during the video such that the at least one hyperlink follows the area on the screen in which the object associated with the hyperlink appears during the video, and said content reference indicating a second content server comprising an electronic document to which the hyperlink is linked, said browser comprising:

means for connecting the user input/output device to the first content server comprising the video;

means for initiating a connection of said browser to the second content server;

means for determining when the hyperlink is selected by determining when coordinates at which the hyperlink appears in the video are selected while the video is being displayed on said display, wherein the selection of the hyperlink is in real time while the video is displayed; and

means for switching over a connection of said browser from said first content server to said second content server for user access to said electronic document in said second content server when said means for determining determines that said hyperlink has been selected, wherein said means for initiating is performed before user selection of said at least one hyperlink so that said means for switching over effects a smooth switchover from the first content server to the second content server.