Method and system for conveying video messages

• US 6,748,421 B1
• Filed: 12/21/1999
• Issued: 06/08/2004
• Est. Priority Date: 12/23/1998
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Paris, Cecile, Brook, John Charles, Simpson-Young, William, Chung, Charles, Milosavljevic, Maria, Ozkan, Nadine, Yap, Sue-Ken
• Primary Examiner(s): Harrell, Robert B.
• Assistant Examiner(s): POLLACK, MELVIN H
• Application Number:
  US09/468,866
• Time in Patent Office: 1,631 Days
• Field of Search: 709/202, 709/206, 709/208, 709/213, 709/217, 709/219, 709/220, 709/231, 725/37, 725/41, 725/47, 725/87, 345/716, 345/724, 345/769, 345/854, 715/500.1, 715/515, 715/908, 358/402, 358/403
• US Class Current: 709/206
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A method and system (100) for conveying a video message is disclosed. Video data comprising at least image data and associated audio data is captured and a video message structure (401) is created. A link is established between the structure (401) and the video data to create a structured video message. The structured video message is characterized by a video message structure (401) that provides an originator (103), of the message, enhanced manipulation capabilities for the video data by manipulating the structure (401). The structured video message can be conveyed to a recipient for viewing and/or for providing the recipient substantially the same enhanced manipulation capabilities.

Claims

1. A method of conveying a video message from an originator of the video message to one or more remotely positioned recipients, said method comprising the steps of:

(i) creating a hierarchical video message structure including at least one node adapted to contain one or more links to one or more segments of video data for forming said video message;

(ii) establishing a link between at least one of said nodes of said structure and at least one of said segments of video data to create a structured video message, said structured video message comprising at least one linked node referencing at least said one segment of video data, whereby said structured video message is associated with said structure so as to provide said originator with enhanced capabilities for manipulation of said video data, said video data being manipulated by manipulating said structure, said manipulation capabilities including at least altering a position of a node within said structure so as to alter a temporal position of an associated segment of video data within said video message; and

(iii) conveying the structured video message to at least one of said remotely positioned recipients for viewing and/or for providing said at least one recipient with substantially the same enhanced manipulation capabilities.

2. A method according to claim 1, wherein establishing a link includes associating with each linked node a start time position and end time position of the video segment.

3. A method according to claim 1, wherein establishing a link includes associating a start time position and an end image data of the segment of video data with said node.

4. A method according to claim 1, further comprising the step of capturing said video data, wherein linking between said structure and said video data is performed during capture of the video data.

5. A method according to claim 1, wherein the enhanced manipulation capabilities includes one or more capabilities selected from a set consisting of:

Video message planning;

Video message capturing;

Video message labeling;

Video message navigating;

Video message editing; and

Video message annotating.

6. A method according to claim 1, wherein step (ii) includes the further sub-steps of:

providing a message template; and

executing said message template to generate said video message structure having a plurality of nodes, each said node being capable of representing a segment of video data of said video message.

7. A method according to claim 6, wherein said structured video message is an instantiation of the message template.

8. A method according to claim 7, wherein said instantiation of the message template provides a customized video message structure according to predetermined user preferences.

9. A method according to claim 8, wherein said customized message template can be saved as a new message template including the user preferences.

10. A method according to claim 8, wherein during execution said message template provides guidance to a user generating the video message structure.

11. A method according to claim 10, wherein the template prompts a user for user input information.

12. A method according to claim 6, wherein the message template further sets attributes for the video message.

13. A method according to claim 12, wherein the attributes include any one or more selected from a set consisting of:

a tone of the video message,

an intent of the video message; and

duration of the video message or part thereof.

14. A method according to claim 6, wherein conveying said structured video message includes transmitting over a network said structured video message.

15. A method according to claim 14, wherein said structured video message includes said video data and said message template.

16. A method according to claim 15, wherein transmitting said message template includes transmitting a reference address location for obtaining the message template.

17. A method according to claim 15, wherein transmitting said video data and said message template includes transmitting a reference address location for obtaining the video data and message template, respectively.

18. A method according to claim 1, further including the step of editing said structured video message.

19. A method according to claim 18, wherein said editing includes the further sub-steps of:

storing said video message in a memory;

displaying said video message structure; and

manipulating said nodes to place said video message in a desired format, wherein at least one node represents at least one segment of video data of said video message.

20. A method according to claim 18, wherein additional nodes representing further captured segments of video data are added to said video message.

21. A method according to claim 20, wherein any unwanted nodes are deleted from said structure so that only wanted information in retained.

22. A method according to claim 21, wherein a segment of said video message that is represented by a deleted node is retained in said memory.

23. A method according to claim 1, wherein said video message structure allows said originator to include at least one of a plurality of standard items in said video message.

24. A method according to claim 23, wherein said standard items include at least standard greetings, a business address and a company profile.

25. A method according to claim 1, wherein each node is labelled by a textual string.

26. A method according to claim 25, wherein said textual string relates to the content of said video segment.

27. A method according to claim 25, wherein said textual string capable of being edited.

28. A method according to claim 1, wherein said originator or a recipient of said video message can pause and restart said video message when viewing said video message.

29. A method according to claim 1, wherein said video message structure indicates a current position within said video message when viewed.

30. A method according to claim 29, wherein said current position is indicated by a karaoke-style ball displayed within said video message structure.

31. A method according to claim 29, wherein said current position is indicated by highlighting current text within said video message structure.

32. A method according to claim 29, wherein said current position is indicated by

displaying corresponding text of any video sequence at the base of a display upon which said video message is being viewed.

33. An apparatus for conveying a video message from an originator of the video message to one or more remotely positioned recipients, said apparatus comprising:

processing means for creating a hierarchical video message structure having at least one node adapted to contain one or more links to one or more segments of video data for forming said video message, said processing means being further configured for establishing a link between at least one of said nodes of said structure and at least one of said segments of said video data to create a structured video message, said structured video message comprising at least one linked node referencing at least said one segment of video data, whereby said structured video message is associated with said structure so as to provide said originator with enhanced capabilities for manipulation of said video data, said video data being manipulated by manipulating said structure, said manipulation capabilities including at least altering a position of a node within said structure so as to alter a temporal position of an associated segment of video data within said video message; and

means for conveying the structured video message to at least one of said remotely positioned recipients for viewing and/or for providing said at least one recipient with substantially the same enhanced manipulation capabilities.

34. An apparatus according to claim 33, wherein establishing a link includes associating with each linked node a start time position and end time position of the video segment.

35. An apparatus according to claim 33, wherein establishing a link includes associating a start time position and an end image data of the segment of video data with said node.

36. An apparatus according to claim 33, further comprising capturing means for capturing said video data, wherein linking between said structure and said video data is performed during capture of the video data.

37. An apparatus according to claim 33, wherein the enhanced manipulation capabilities includes one or more capabilities selected from a set consisting of:

Video message planning;

Video message capturing;

Video message labeling;

Video message navigating;

Video message editing; and

Video message annotating.

38. An apparatus according to claim 33, said apparatus further comprising:

means for providing a message template; and

means for executing said message template to generate said video message structure having a plurality of nodes, each said node being capable of representing to a segment of video data of said video message.

39. An apparatus according to claim 38, wherein said structured video message is an instantiation of the message template.

40. An apparatus according to claim 39, wherein said instantiation of the message template provides a customized video message structure according to predetermined user preferences.

41. An apparatus according to claim 40, wherein said customized message template can be saved as a new message template including the user preferences.

42. An apparatus according to claim 40, wherein during execution said message template provides guidance to a user generating the video message structure.

43. An apparatus according to claim 42, wherein the template prompts a user for user input information.

44. An apparatus according to claim 38, wherein the message template further sets attributes for the video message.

46. An apparatus according to claim 38, wherein conveying said structured video message includes transmitting over a network said structured video message.

47. An apparatus according to claim 46, wherein said structured video message includes said video data and said message template.

49. An apparatus according to claim 47, wherein transmitting said video data and said message template includes transmitting a reference address location for obtaining the video data and message template, respectively.

50. An apparatus according to claim 33, said apparatus further comprising editing means for editing said structured video message.

51. An apparatus according to claim 50, said editing means comprising:

storage means for storing said video message in a memory;

display for displaying said video message structure; and

a processor for manipulating said nodes to place said video message in a desired format, wherein at least one node represents at least one segment of video data of said video message.

52. An apparatus according to claim 50, wherein additional nodes representing further captured segments of video data are added to said video message.

53. An apparatus according to claim 52, wherein any unwanted nodes are deleted from said structure so that only wanted information in retained.

54. An apparatus according to claim 53, wherein a segment of said video message that is represented by a deleted node is retained in said memory.

55. An apparatus according to claim 33, wherein said video message structure allows said originator to include at least one of a plurality of standard items in said video message.

56. An apparatus according to claim 55, wherein said standard items include at least standard greetings, a business address and a company profile.

57. An apparatus according to claim 33, wherein each node is labelled by a textual string.

58. An apparatus according to claim 57, wherein said textual string relates to the content of said video segment.

59. An apparatus according to claim 57, wherein said textual string is capable of being edited.

60. An apparatus according to claim 33, wherein said originator or a recipient of said video message can pause and restart said video message when viewing said video message.

61. An apparatus according to claim 33, wherein said video message structure indicates a current position within said video message when viewed.

62. An apparatus according to claim 61, wherein said current position is indicated by a karaoke-style ball displayed within said video message structure.

63. An apparatus according to claim 61, wherein said current position is indicated by highlighting current text within said video message structure.

64. An apparatus according to claim 61, wherein said current position is indicated by displaying corresponding text of any video sequence at the base of a display upon which said video message is being viewed.

48. An apparatus according to claimed 47, wherein transmitting said message template includes transmitting a reference address location for obtaining the message template.

45. An apparatus according to claim 48, wherein the attributes include any one or more selected from a set consisting of:

a tone of the video message,

an intent of the video message; and

duration of the video message or part thereof.

65. A computer readable memory medium for storing a program for apparatus which processes data, said processing comprising a method of conveying a video message from an originator of the video messages to one or more remotely positioned recipients, said program comprising:

code for creating a hierarchical video message structure including at least one node adapted to contain one or more links to one or more segments of video data for forming said video message;

code for establishing a link between at least one of said nodes of said structure and at least one of said segments of said video data to create a structured video message, said structured video message comprising at least one linked node referencing at least said one segment of video data, whereby said structured video message is associated with said structure so as to provide said originator with enhanced manipulation capabilities for manipulation of said video data, said video data being manipulated by manipulating said structure, said manipulation capabilities including at least altering a position of a node within said structure so as to alter a temporal position of an associated segment of video data within said video messages; and

code for conveying the structured video message to at least one of said remotely positioned recipients for viewing and/or for providing said at least one recipient with substantially the same enhanced manipulation capabilities.

66. The computer readable memory medium according to claim 65, wherein said code for establishing a link includes code for associating with each linked node a start time position and end time position of the video segment.

67. The computer readable memory medium according to claim 65, wherein said code for establishing a link includes code for associating a start time position and an end image data of the segment of video data with said node.

68. The computer readable memory medium according to claim 65, further comprising code for capturing said video data, wherein linking between said structure and said video data is performed during capture of the video data.

69. The computer readable memory medium according to claim 65, wherein the enhanced manipulation capabilities includes one or more capabilities selected from a set consisting of:

Video message planning;

Video message capturing;

Video message labeling;

Video message navigating;

Video message editing; and

Video message annotating.

70. The computer readable memory medium according to claim 65, wherein code for creating a video message structure further includes:

code for providing a message template; and

code for executing said message template to generate said video message structure having a plurality of nodes, each said node being capable of representing to a segment of video data of said video message.

71. The computer readable memory medium according to claim 70, wherein said structured video message is an instantiation of the message template.

72. The computer readable memory medium according to claim 71, wherein said instantiation of the message template provides a customized video message structure according to predetermined user preferences.

73. The computer readable memory medium according to claim 72, wherein said customized message template can be saved as a new message template including the user preferences.

74. The computer readable memory medium according to claim 72, wherein during execution said message template provides guidance to a user generating the video message structure.

75. The computer readable memory medium according to claim 74, wherein the template prompts a user for user input information.

76. The computer readable memory medium according to claim 70, wherein the message template further sets attributes for the video message.

77. The computer readable memory medium according to claim 76, wherein the attributes include any one or more selected from a set consisting of:

a tone of the video message,

an intent of the video message; and

duration of the video message or part thereof.

78. The computer readable memory medium according to claim 70, wherein conveying said structured video message includes transmitting over a network said structured video message.

79. The computer readable memory medium according to claim 78, wherein said structured video message includes said video data and said message template.

80. The computer readable memory medium according to claim 79, wherein transmitting said message template includes transmitting a reference address location for obtaining the message template.

81. The computer readable memory medium according to claim 79, wherein code for transmitting said video data and said message template further includes code for transmitting a reference address location for obtaining the video data and message template, respectively.

82. The computer readable memory medium according to claim 65, further including code for editing said structured video message.

83. The computer readable memory medium according to claim 82, wherein said code for editing further includes:

code for storing said video message in a memory;

code for displaying said video message structure; and

code for manipulating said nodes to place said video message in a desired format, wherein at least one node represents at least one segment of video data of said video message.

84. The computer readable memory medium according to claim 82, wherein additional nodes representing further captured segments video data are added to said video message.

85. The computer readable memory medium according to claim 84, wherein any unwanted nodes are deleted from said structure so that only wanted information in retained.

86. The computer readable memory medium according to claim 85, wherein a segment of said video message that is represented by a deleted node is retained in said memory.

87. The computer readable memory medium according to claim 65, wherein said video message structure allows said originator to include at least one of a plurality of standard items in said video message.

88. The computer readable memory medium according to claim 87, wherein said standard items include at least standard greetings, a business address and a company profile.

89. The computer readable memory medium according to claim 65, wherein each node is labelled by a textual string.

90. The computer readable memory medium according to claim 89, wherein said textual string relates to the content of said video segment.

91. The computer readable memory medium according to claim 89, wherein said textual string is capable of being edited.

92. The computer readable memory medium according to claim 65, wherein said originator or a recipient of said video message can pause and restart said video message when viewing said video message.

93. The computer readable memory medium according to claim 65, wherein said video message structure indicates a current position within said video message when viewed.

94. The computer readable memory medium according to claim 93, wherein said current position is indicated by a karaoke-style ball displayed within said video message structure.

95. The computer readable memory medium according to claim 93, wherein said current position is indicated by highlighting current text within said video message structure.

96. The computer readable memory medium according to claim 93, wherein said current position is indicated by displaying corresponding text of any video sequence at the base of a display upon which said video message is being viewed.

97. A method of conveying a video message from an originator of the video message to one or more remotely positioned recipients, said method comprising the steps of:

providing a hierarchical tree video message structure including at least one node adapted to contain one or more links to one or more segments of video data for forming said video message;

establishing a link between at least one of said nodes of said structure and at least one of said segments of said video data to provide a structured video message, said structured video message comprising at least one linked node referencing at least said one segment of video data, whereby said structured video message is associated with said structure so as to provide said originator with enhanced capabilities for manipulation of said video data, said video data being manipulated by manipulating said structure; and

conveying the structured video message to at least one of said remotely positioned recipients for viewing and/or for providing said at least one recipient with substantially the same enhanced manipulation capabilities.

98. A method according to claim 97, wherein at least one node is labelled with a semantic label describing the topic of an associated video segment.

99. A method according to claim 97, wherein the enhanced manipulation capabilities includes one or more capabilities selected from a set consisting of:

Video message labeling;

Video message navigating;

Video message editing; and

Video message annotating.

100. A method according to claim 97, wherein conveying said structured video message includes conveying the video data and separately the associated video message structure.

101. A method according to claim 97, wherein conveying said structured video message includes conveying the video data and a reference address for locating the associated video message structure.

102. A method according to claim 97, wherein conveying includes transmitting over a network said structured video message.

103. A method of conveying a video message over a network, wherein said video message includes one or more segments of video image data and an associated audio message, said method including the steps of:

capturing said one or more segments of video data for forming said video message on a first apparatus;

processing said captured video message to provide a structured video message, wherein said structured video message is represented as a hierarchical tree structure including at least one node adapted to contain one or more links to one or more of said segments of video data for forming said video message, said structured video message comprising at least one linked node referencing at least one of said segments of said video data, said hierarchical tree structure allowing an originator labelling, navigation, editing and annotation capabilities; and

transmitting over said network the structured video message to at least one second apparatus;

receiving said structured video message at the at least one second apparatus;

processing and viewing said received structured video message by a recipient in accordance with said hierarchical tree structure.

104. A method according to claim 103, wherein said structure further allows the recipient labelling, navigation, editing and annotation capabilities.

105. A method according to claim 103, wherein said structure includes a plurality of nodes arranged in a hierarchical manner.

106. A method according to claim 103, wherein at least one node is labelled with a semantic label relating to the segment of the video message.

107. A method according to claim 103, wherein said structure allows the originator to include at least one of a plurality of standard items in said structured video message.

108. A method according to claims 107, wherein said standard items are selected from a set consisting of:

standard greetings;

a business address;

a company profile;

a uniform resource locator (URL);

date, time;

originator signature.

109. A method according to claim 103, wherein said structured video message is an instantiation of a video message template.

110. A system for conveying a video message, wherein said video message includes one or more segments of video image data and an associated audio message, said system including:

at least one first apparatus including;

capturing means for capturing said one or more segments of video data for forming said video message;

processing means for processing the captured video message to provide a structured video message, wherein said structured video message is represented as a hierarchical tree structure including at least one node adapted to contain one or more links to one or more of said segments of video data for forming said video message, said structured video message comprising at least one linked node referencing at least one of said segments of video data, said hierarchical tree structure allowing an originator of said video message labelling, navigation, editing and annotation capabilities; and

means for transmitting the structured video message to at least one second apparatus;

said second apparatus including;

means for receiving said structured video message;

means for processing and viewing by a recipient said received structured video message in accordance with said hierarchical tree structure.

111. A system according to claim 110, wherein said structure further allows the recipient labelling, navigation, editing and annotation capabilities.

112. A system according to claim 110, wherein said structure includes a plurality of nodes arranged in a hierarchical manner.

113. A system according to claim 110, wherein at least one node is labelled with a semantic label relating to the segment of the video message.

114. A system according to claim 110, wherein said structure allows the originator to include at least one of a plurality of standard items in said structured video message.

115. A system according to claims 114, wherein said standard items are selected from a set consisting of:

standard greetings;

a business address;

a company profile;

a uniform resource locator (URL);

date, time;

originator signature.

116. A system according to claim 110, wherein said structured video message is an instantiation of a video message template.

117. A computer readable medium for storing a program for apparatus which processes data, said processing comprising a method of conveying a video message over a network, wherein said video message includes one or more segments of video image data and an associated audio message, said program comprising:

code for capturing said one or more segments of video data for forming said video message on a first apparatus;

code for processing said captured video message to provide a structured video message, wherein said structured video message is represented as a hierarchical tree structure including at least one node adapted to contain one or more links to one or more of said segments of video data for forming said video message, said structured video message comprising at least one linked node referencing at least one of said segments of video data, said hierarchical tree structure allowing an originator labelling, navigation, editing and annotation capabilities;

code for transmitting the structured video message to at least one second apparatus;

code for receiving said structured video message at the at least one second apparatus; and

code for processing and viewing, by a recipient, said received structured video message in accordance with said hierarchical tree structure.

118. A computer readable medium according to claim 117, wherein said structure further allows the recipient labelling, navigation, editing and annotation capabilities.

119. A computer readable medium according to claim 117, wherein said structured video message is an instantiation of a video message template.

120. A method of conveying a video message including the steps of:

capturing video data on a first apparatus, wherein said video data includes one or more segments of image data and associated audio data;

processing said captured video data to provide a video message, wherein said video message includes said captured video data and a first video message hierarchical tree structure being a first instantiation of a message template, said first video message hierarchical tree structure including at least one node adapted to contain one or more links to one or more of said segments of video data for forming said video message;

transmitting said one or more segments of video data and said message template to at least one second apparatus;

receiving the video data and the message template at the second apparatus;

processing said video data to provide a corresponding video message, wherein said corresponding video message includes said video data and a second video message hierarchical tree structure being a second instantiation of said message template; and

viewing said corresponding video message in accordance with said second video message hierarchical tree structure.

121. A method according to claim 120, wherein transmitting said message template includes transmitting a reference address location for obtaining the message template.

122. A method according to claim 120, wherein transmitting said video data and said message template includes transmitting a reference address location for obtaining the video data and message template, respectively.

123. A method according to claim 120, wherein the first video message structure and the second video message structure are substantially identical.

124. A method according to claim 120, wherein instantiation of the message template provides a customized video message structure according to predetermined user preferences.

125. A method according to claim 124, wherein said customized video message structure can be saved as a new video message structure including the user preferences.

126. A method according to claim 120, wherein the message template prompts a user to provide the user preferences.

127. A method according to claim 120, wherein transmitting includes downloading data to be transmitted onto a removable storage medium and conveying said removable medium to an intended recipient.

128. A system for conveying a video message including:

at least one first apparatus including;

capturing means for capturing video, wherein said video data includes one or more segments of video image data and associated audio data;

processing means for processing said captured video data to provide a video message, wherein said video message includes said captured video data and a first video message hierarchical tree structure, said first structure being a first instantiation of a message template, said first structure including at least one node adapted to contain one or more links to one or more of said segments of video data for forming said video message;

means for transmitting the structured video message to at least one second apparatus;

said second apparatus including;

means for receiving the video data and the message template at the second apparatus;

means for processing said video data to provide a corresponding video message, wherein said corresponding video message includes said video data and a second video message hierarchical tree structure being a second instantiation of said message template; and

means for viewing said corresponding video message in accordance with said second video message hierarchical tree structure.

129. A system according to claim 128, wherein transmitting said message template includes transmitting a reference address location for obtaining the message template.

130. A system according to claim 128, wherein transmitting said video data and said message template includes transmitting a reference address location for obtaining the video data and message template respectively.

131. A system according to claim 128, wherein the first video message structure and the second video message structure are substantially identical.

132. A system according to claim 128, wherein instantiation of the message template provides a customised video message structure according to predetermined user preferences.

133. A system according to claim 132, wherein said customised video message structure can be saved as a new message structure including the user preferences.

134. A computer readable medium for storing a program for apparatus which processes data, said processing comprising a method of conveying a video message, said video message including video data comprising one or more segments of video image data and associated audio data, said program comprising:

code for capturing said one or more segments of video data on a first apparatus,

code for processing said captured video data to provide a video message, wherein said video message includes said captured video data and a first video message hierarchical tree structure being a first instantiation of a message template, said first hierarchical tree structure including at least one node adapted to contain one or more links to one or more of said segments of video data for forming said video message;

code for transmitting said video data and said message template to at least one second apparatus;

code for receiving the video data and the message template at the second apparatus;

code for processing said video data to provide a corresponding video message, wherein said corresponding video message includes said video data and a second video message hierarchical tree structure being a second instantiation of said message template; and

code for viewing said corresponding video message in accordance with said second video message hierarchical tree structure.

135. A computer readable medium according to claim 134, wherein transmitting said message template includes transmitting a reference address location for obtaining the message template.

136. A computer readable medium according to claim 134, wherein transmitting said video data and said message template includes transmitting a reference address location for obtaining the video data and message template, respectively.