Caching graphical interface for displaying video and ancillary data from a saved video

• US 20030007663A1
• Filed: 04/19/2002
• Published: 01/09/2003
• Est. Priority Date: 06/11/2001
• Status: Active Grant

• Current Assignee: Arrowsight Incorporated
• Original Assignee: Arrowsight Incorporated
• Inventors: Wixson, Lambert, Rafferty, Kate, Wayman, Mark, Roberts, Jeff, Gulyansky, Alex, Aronson, Adam, Shimshack, Julie, Chaudry, Kassim
• Granted Patent: US 7,540,011 B2
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system and a method for attaining a selectable image sequence are provided. The system includes a viewer display component configured to transmit a request from a user'"'"'s interface component for the selectable image sequence. The request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image. The viewer display component is also configured to receive the reply response and to render the selectable image sequence on a display screen of the user'"'"'s interface component.

Claims

1. A method of obtaining a selectable image sequence, comprising the steps of:

transmitting a request from a user'"'"'s interface component for the selectable image sequence, wherein the request obtains a handle which corresponds to the selectable image sequence, a display description, and a reply response containing the handle that corresponds to the selectable image sequence;

receiving the reply response; and

rendering the display description on a display screen of the user'"'"'s interface component in response to the reply response.

2. The method as recited in claim 1, wherein the display description comprises the handle.

3. The method as recited in claim 1, wherein the handle comprises a pointer to a memory location.

4. The method as recited in claim 1, wherein the step of rendering the display description renders the selectable image sequence.

5. The method as recited in claim 1, wherein the handle is a representation that contains data which permits a computer application to request the selectable image sequence from a server component.

6. The method as recited in claim 5, wherein the server component is a video server.

7. The method as recited in claim 5, wherein the server component is an interface server.

8. The method as recited in claim 5, wherein the server component is a video server and an interface server.

9. The method as recited in claim 5, further including the step of caching data in a data cache.

10. The method as recited in claim 9, wherein the data cache resides on the server component.

11. The method as recited in claim 9, wherein the data cache resides on a viewer display component.

12. The method as recited in claim 11, wherein the request invokes partial transmission of the data if a spatial or temporal portion of the data for the selectable image sequence was previously stored in the viewer display component.

13. The method as recited in claim 9, wherein the request invokes spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

14. The method as recited in claim 9, wherein the request invokes retrieval of a portion of the data for the selectable image sequence from the data cache if the user requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

16. The system as recited in claim 15, wherein the display description comprises the handle.

17. The system as recited in claim 15, wherein the handle comprises a pointer to a memory location

18. The system as recited in claim 15, wherein the display description renders the selectable image sequence.

19. The system as recited in claim 15, wherein the handle is a representation that contains data which permits a computer application to request the selectable image sequence from a server component.

20. The system as recited in claim 19, wherein the server component is a video server.

21. The system as recited in claim 19, wherein the server component is an interface server.

22. The system as recited in claim 19, wherein the server component is a video server and an interface server.

23. The system as recited in claim 19, wherein the system is configured to cache data in a data cache.

24. The system as recited in claim 23, wherein the data cache resides on the server component.

25. The system as recited in claim 23, wherein the data cache resides on a viewer display component.

26. The system as recited in claim 25, wherein the request invokes partial transmission of the data if a spatial or temporal portion of the data for the selectable image sequence was previously stored in the viewer display component.

27. The system as recited in claim 23, wherein the request invokes spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

28. The system as recited in claim 23, wherein the request invokes retrieval of a portion of the data for the selectable image sequence from the data cache if the user requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

30. The system as recited in claim 29, wherein the display description comprises the handle.

31. The system as recited in claim 29, wherein the handle comprises a pointer to a memory location.

32. The system as recited in claim 29, wherein the display description renders the selectable image sequence.

33. The system as recited in claim 29, wherein the handle is a representation that contains data which permits a computer application to request the selectable image sequence from the video server component.

34. The system as recited in claim 33, wherein the system is configured to cache data in a data cache.

35. The system as recited in claim 34, wherein the data cache resides on the server component.

36. The system as recited in claim 34, wherein the data cache resides on a viewer display component.

37. The system as recited in claim 36, wherein the system is configured to provide partial transmission of the data if a spatial or temporal portion of the data for the selectable image sequence was previously stored in the viewer display component.

38. The system as recited in claim 34, wherein the system is configured to perform spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

39. The system as recited in claim 34, wherein the system is configured to provide retrieval of a portion of the data for the selectable image sequence from the data cache if the user requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

40. The system as recited in claim 33, wherein the server component is a video server.

129. The system as recited in claim 33, wherein the server component system an interface server.

130. The system as recited in claim 33, wherein the server component system a video server and an interface server.

15. A system for obtaining a selectable image sequence, the system comprising:

a viewer display component configured to transmit a request from a user'"'"'s interface component for the selectable image sequence, wherein the request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image sequence;

the viewer display component configured to receive the reply response; and

the viewer display component configured to render the display description on a display screen of the user'"'"'s interface component.

29. A system for obtaining a selectable image sequence, the system comprising:

a viewer display component configured to transmit a request from a user'"'"'s interface component for the selectable image sequence;

the viewer display component configured to interact with an interface server, wherein the interface server is configured to receive the request for the selectable image sequence and obtain a handle which corresponds to the selectable image sequence;

the interface server component configured to interact with a video server component, wherein the video server component is configured to construct a reply message containing the handle that corresponds to the selectable image sequence;

the video display component configured to interact with an interface server, wherein the interface server is configured to obtain a display description in which the handle is embedded and send the display description with the embedded handles to the viewer display component;

the viewer display component configured to use the embedded handle to retrieve the selectable image sequence from the video server component; and

the viewer display component configured to render the display description on a display screen of the user'"'"'s interface component.

41. A system for obtaining a selectable image sequence, the system comprising:

transmitting means for transmitting a request from a user'"'"'s interface component for the selectable image sequence, wherein the request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image sequence;

receiving means for receiving the reply response; and

rendering means for rendering the display description on a display screen of the user'"'"'s interface component in response to the reply response.

42. The system as recited in claim 41, wherein the display description comprises the handle.

43. The system as recited in claim 41, wherein the handle comprises a pointer to a memory location.

44. The system as recited in claim 41, wherein the step of rendering the display description renders the selectable image sequence.

45. The system as recited in claim 41, wherein the handle comprises a representation that contains data which permits a computer application to request the selectable image sequence from a server component.

46. The system as recited in claim 45, wherein the server component comprises a video server.

47. The system as recited in claim 45, wherein the server component comprises an interface server.

48. The system as recited in claim 45, wherein the server component comprises a video server and an interface server.

49. The system as recited in claim 41, further comprising:

caching means for caching data in a data cache.

50. The system as recited in claim 49, wherein the data cache resides on the server component.

51. The system as recited in claim 49, wherein the data cache resides on a viewer display component.

52. The system as recited in claim 51, further comprising:

providing means for supporting partial transmission of the data if a spatial or temporal portion of the data for the selectable image sequence was previously stored in the viewer display component.

53. The system as recited in claim 49, further comprising:

providing means for supporting spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

54. The system recited in claim 49, further comprising:

providing means for supporting retrieval of a portion of the data for the selectable image sequence from the data cache if the user requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

131. The system as recited in claim 52, wherein the server component system a video server.

132. The system as recited in claim 52, wherein the server component system an interface server.

133. The system as recited in claim 52, wherein the server component system a video server and an interface server.

55. A method of obtaining a selectable image sequence, comprising the steps of:

receiving a request for the selectable image sequence;

obtaining a handle which corresponds to the selectable image sequence based upon the user'"'"'s request;

generating a display description in which the handle is embedded;

constructing a reply response containing the display description with the embedded handle that correspond to the selectable image sequence; and

sending the reply response containing the display description with the embedded handle in response to the request.

56. The method as recited in claim 55, wherein the display description comprises the handle.

57. The method as recited in claim 55, wherein the handle comprises a pointer to a memory location.

58. The method as recited in claim 55, wherein the handle comprises a representation that contains data which permits a computer application to request the selectable image sequence from a server component.

59. The method as recited in claim 58, wherein the server component comprises a video server.

60. The method as recited in claim 58, wherein the server component comprises an interface server.

61. The method as recited in claim 58, wherein the server component comprises a video server and an interface server.

62. The method as recited in claim 58, further including the step of caching data in a data cache.

63. The method as recited in claim 62, wherein the data cache resides on the server component.

64. The method as recited in claim 62, wherein the data cache resides on a viewer display component.

65. The method as recited in claim 62, wherein the step of constructing the reply response invokes spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

66. The method as recited in claim 62, wherein the step of constructing the reply response invokes retrieval of a portion of the data for the selectable image sequence from the data cache if the requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

67. The method as recited in claim 55, wherein the step of obtaining the handle comprises requesting the handle from a video server component.

68. The method as recited in claim 55, wherein the step of obtaining the handle comprises retrieving the handle from a handle data cache.

70. The system as recited in claim 69, wherein the display description comprises the handle.

71. The system as recited in claim 69, wherein the handle comprises a pointer to a memory location.

72. The system as recited in claim 69, wherein the handle comprises a representation that contains data which permits a computer application to request the selectable image sequence from a video server component.

73. The system as recited in claim 69, wherein the system is configured to cache data in a data cache.

74. The system as recited in claim 73, wherein the data cache resides on the server component.

75. The system as recited in claim 73, wherein the data cache resides on a viewer display component.

76. The system as recited in claim 73, wherein the system is configured to perform spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

77. The system as recited in claim 73, wherein the system is configured to provide retrieval of a portion of the data for the selectable image sequence from the data cache if the requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

79. The system as recited in claim 78, wherein the display description comprises the handle.

80. The system as recited in claim 78, wherein the handle comprises a pointer to a memory location.

81. The system as recited in claim 78, wherein the display description renders the selectable image sequence.

82. The system as recited in claim 78, wherein the handle comprises a representation that contains data which permits a computer application to request the selectable image sequence from a server component.

83. The system as recited in claim 82, wherein the server component comprises a video server.

84. The system as recited in claim 82, wherein the server component comprises an interface server.

85. The system as recited in claim 82, wherein the server component comprises a video server and an interface server.

86. The system as recited in claim 82, further comprising caching means for caching data in a data cache.

87. The system as recited in claim 86, wherein the data cache resides on the server component.

88. The system as recited in claim 86, wherein the data cache resides at the requestor.

89. The system as recited in claim 88, further comprising:

providing means for supporting partial transmission of the data if a spatial or temporal portion of the data for the selectable image sequence was previously stored by the requestor.

90. The system as recited in claim 86, further comprising:

providing means for supporting spatial or temporal reconstruction if signals of the selectable image sequence are sampled with different sampling rates and if a portion of the data for the selectable image sequence was previously stored in the data cache.

91. The system as recited in claim 86, further comprising:

providing means for supporting retrieval of a portion of the data for the selectable image sequence from the data cache if the user requests multiple selectable image sequences having overlapping time period and if a portion of the data for the selectable image sequence was previously stored in the data cache.

69. A system for obtaining a selectable image sequence, the system comprising:

a server component configured to receive a request for the selectable image sequence;

the server component configured to obtain a handle which corresponds to the selectable image sequence;

the server component configured to obtain a display description in which the handle is embedded;

the server component configured to construct a reply response containing the display description with the embedded handles that correspond to the selectable image sequence; and

the server component configured to send the reply response containing the display description with the embedded handles to a user'"'"'s interface component.

78. A system of obtaining a selectable image sequence, comprising:

receiving means for receiving a request for the selectable image sequence;

handle obtaining means for obtaining a handle which corresponds to the selectable image sequence;

display description generating means for generating a display description in which the handle is embedded;

reply response generating means for constructing a reply response containing the display description with the embedded handles that correspond to the selectable image sequence; and

sending means for sending the reply response containing the display description with the embedded handles to the requestor.

92. A method of obtaining selectable image sequences, comprising the steps of:

transmitting a business rule request from a user'"'"'s interface component for the selectable image sequences, wherein the business rules request requests a set of selectable image sequences, obtains a handle for each of the selectable images in the set of the selectable image sequences, and generates a reply response that corresponds to the selectable image sequences;

receiving the reply response including a display description in which the handle for each of the selectable image sequences is embedded; and

rendering the display description on a display screen of the user'"'"'s interface component in response to the reply response.

93. The method as recited in claim 92, wherein the display description comprises the handle.

94. The method as recited in claim 92, wherein the handle comprises a pointer to a memory location.

95. The method as recited in claim 92, wherein the step of rendering the display description renders the selectable image sequence.

96. The method as recited in claim 92, wherein the business rule request defines a set of video sources.

97. The method as recited in claim 92, wherein the business rule request defines a set of time intervals.

98. The method as recited in claim 92, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

99. A system for obtaining selectable image sequences, the system comprising:

a viewer display component configured to transmit a business rule request from a user'"'"'s interface component for the selectable image sequences, wherein the business rules request wherein the business rules request requests a set of selectable image sequences, obtains a handle for each of the selectable images in the set of the selectable image sequences, and generates a reply response that corresponds to the set of selectable image sequences;

the viewer display component configured to receive the reply response including a display description in which the handle for each of the selectable image sequences is embedded; and

the viewer display component configured to render the selectable image sequences on a display screen of the user'"'"'s interface component.

100. The system as recited in claim 99, wherein the display description renders the selectable image sequence.

101. The system as recited in claim 99, wherein the business rule request defines a set of video sources.

102. The system as recited in claim 99, wherein the business rule request defines a set of time intervals.

103. The system as recited in claim 99, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

104. A system for obtaining a set of selectable image sequences, the system comprising:

a viewer display component configured to transmit a business rule request from a user'"'"'s interface component requesting the set of selectable image sequences, wherein the business rule request requests the set of selectable image sequences;

the viewer display component configured to interact with an interface server, wherein the interface server is configured to receive the business rules request for the set of selectable image sequences and obtain handles for each selectable image sequences in the set of selectable image sequences;

the interface server component configured to interact with a video server component, wherein the video server component is configured to construct a reply message containing handles that correspond to the set of selectable image sequences;

the viewer display component configured to interact with the interface server component, wherein the interface server is configured to generate a display description in which the handles for each of the selectable image sequences are embedded and send the display description with the embedded handles to the viewer display component;

the viewer display component configured to receive a reply response in which the handles for each of the selectable images are embedded; and

the viewer display component configured to render the display description on a display screen of the user'"'"'s interface component.

105. The system as recited in claim 104, wherein the display description comprises a collection of handles.

106. The system as recited in claim 104, wherein the business rule request defines a set of video sources.

107. The system as recited in claim 104, wherein the business rule request defines a set of time intervals.

108. The system as recited in claim 104, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

109. A system for obtaining selectable image sequences, the system comprising:

transmitting means for transmitting a business rule request from a user'"'"'s interface component for the selectable image sequences, wherein the business rule request requests a set of selectable image sequences, obtains handles for each of the selectable image sequences in the set of the selectable image sequences, and generates a reply response that corresponds to the selectable image sequences;

receiving means for receiving the reply response including a display description in which the handles for each of the selectable image sequences are embedded; and

rendering means for rendering the display description on a display screen of the user'"'"'s interface component in response to the reply response.

110. The system as recited in claim 109, wherein the rendering display description renders the selectable image sequences.

111. The system as recited in claim 109, wherein the business rule request defines a set of video sources.

112. The system as recited in claim 109, wherein the business rule request defines a set of time intervals.

113. The system as recited in claim 109, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

115. The method as recited in claim 114, wherein the step of rendering the display description renders the selectable image sequences.

116. The method as recited in claim 114, wherein the business rule request defines a set of video sources.

117. The method as recited in claim 114, wherein the business rule request defines a set of time intervals.

118. The method as recited in claim 114, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

120. The system as recited in claim 119, wherein the step of rendering the display description renders the selectable image sequence.

121. The system as recited in claim 119, wherein the business rule request defines a set of video sources.

122. The system as recited in claim 119, wherein the business rule request defines a set of time intervals.

123. The system as recited in claim 119, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

125. The method as recited in claim 124, wherein the step of rendering the display description renders the selectable image sequence.

126. The method as recited in claim 124, wherein the business rule request defines a set of video sources.

127. The method as recited in claim 124, wherein the business rule request defines a set of time intervals.

128. The method as recited in claim 124, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

138. A method as recited in claim 137, wherein the server component is an interface server.

139. A method as recited in claim 137, wherein the server component is a video server.

140. A method as recited in claim 137, wherein the request criteria includes at least one of a specification of image sources, a time interval, a number of images to return as the reply, a length parameter specifying the length of each image sequence, at least one of time or number of images, a video content specification associated with the content of the video, a video activity specification associated with the activity of the video, and a telemetry data specification associated with the video.

141. A method as recited in claim 137, wherein the handle generation steps further comprises:

retrieving the selected image sequences from the database;

reassembling the selected image sequences into a new data format sequences,

storing the new data format sequences in a data cache located on the server component; and

generating a handle for each selected image sequence, wherein the handle causes the server component to retrieve each new format sequence.

142. A method as recited in claim 141, wherein the reassembling step further comprises:

transcoding the selected image sequences from a first compression format to another compression format.

143. A method as recited in claim 141, wherein the reassembling step further comprises:

writing the selected image sequences as separate files located outside of a video database.

144. A method as recited in claim 137, wherein the generating the set of handles step further comprises:

generating a hash code for each selected image sequence wherein the hash code causes the server component to retrieve selected image sequence.

145. A method as recited in claim 137, wherein the generating the set of handles step further comprises:

returning the memory address and range on the server component from which the selected image sequence may be retrieved.

146. A method as recited in claim 137, wherein the generating the set of handles step further comprises:

comparing the request for the set of handles with previously received handle set requests; and

retrieving a list of handles from the previously received handle set request, if an identical previous request is found.

148. A method as recited in claim 147, wherein the image sequence request further contains a specification that requests at least one of a subregion of the image sequence or a subrange of spatial or temporal frequencies that comprises the image sequence.

149. A method as recited in claim 148, wherein the retrieved image sequence is obtained by extracting at least one of the requested image sequence subregion or the spatial or temporal frequency subrange from the image sequence specified by the handle.

114. A method of obtaining selectable image sequences, comprising the steps of:

receiving a user'"'"'s business rule request from a user'"'"'s interface component for the selectable image sequences, wherein the business rule requests a set of selectable image sequences;

obtaining handles for each of the selectable image sequences in the set of selectable image sequences based upon the user'"'"'s business rule request;

generating a display description in which the handles for each of the selectable image sequences are embedded;

constructing a reply response containing the display description with the embedded handles that correspond to the selectable image sequences; and

sending the reply response containing the display description with the embedded handles in response to the user'"'"'s business rule request, wherein the reply response renders the display description on a display screen of the user'"'"'s interface component.

119. A system for obtaining selectable image sequences, the system comprising:

a server component configured to receive a business rule request from a user for the selectable image sequence, wherein the business rules request requests a set of selectable image sequences;

the server component configured to obtain handles for each of the selectable image sequences of the set of the selectable image sequences;

the server component configured to generate a display description in which the handles for each of the selectable image sequences in the set of selectable image sequences are embedded;

the server component configured to construct a reply response containing the display description with the embedded handles that correspond to the selectable image sequences; and

the server component configured to send the reply response containing the display description with the embedded handles.

124. A system of obtaining selectable image sequences, comprising:

receiving means for receiving a business rule request for the selectable image sequences, wherein the business rule requests a set of selectable image sequences;

handle obtaining means for obtaining handles for each of the selectable image sequences in the set of selectable image sequences based upon the user'"'"'s business rule request;

display description generating means for generating a display description in which the handles for each of the selectable image sequences are embedded;

reply response generating means for constructing a reply response containing the display description with the embedded handles that correspond to the selectable image sequences; and

sending means for sending the reply response containing the display description with the embedded handles.

134. A method of obtaining a selectable image sequence, comprising the steps of:

transmitting a request from a user'"'"'s interface component for the selectable image sequence, wherein the request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image sequence;

receiving the reply response;

rendering the display description on a display screen of the user'"'"'s interface component in response to the reply response; and

providing a drilldown module for specifying a time interval of the request transmitted from the user'"'"'s interface component.

135. A system for obtaining a selectable image sequence, the system comprising:

a viewer display component configured to transmit a request from a user'"'"'s interface component for the selectable image sequence, wherein the request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image sequence;

the viewer display component configured to receive the reply response;

the viewer display component configured to render the display description on a display screen of the user'"'"'s interface component; and

a drilldown module for specifying a time interval of the request transmitted from the viewer display component.

136. The system for obtaining a selectable image sequence, the system comprising:

transmitting means for transmitting a request from a user'"'"'s interface component for the selectable image sequence, wherein the request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image sequence;

receiving means for receiving the reply response;

rendering means for rendering the display description on a display screen of the user'"'"'s interface component in response to the reply response; and

drilldowning means for specifying a time interval of the request transmitted from the viewer display component.

137. A method for receiving a request at a server component, comprising:

receiving the request for a set of handles which corresponds to selectable image sequences, wherein the request specifies a set of request criteria;

accessing a database representing video and associated telemetry data in order to identify the initial image of the selectable image sequences which meet the request criteria;

generating the set of handles that may be used to retrieve each image sequence of the selectable image sequences; and

sending a reply response containing the set of handles.

147. A method for receiving a request at a server component, comprising:

receiving an image sequence request configured to contain a handle; and

retrieving the image sequence data identified by the handle.