Audio visual media encoding system

• US 20050122393A1
• Filed: 08/21/2003
• Published: 06/09/2005
• Est. Priority Date: 08/23/2002
• Status: Active Grant

• Current Assignee: Cisco Systems New Zealand Ltd. (Cisco Systems, Inc.)
• Original Assignee: University of Waikato
• Inventors: Cockerton, Craig George
• Granted Patent: US 7,619,645 B2
• Time in Patent Office: Days
• US Class Current: 348/14.120
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4333 Processing operations in response to a pause request
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8453 by locking or enabling a set of features, e.g. optional functionalities in an executable program
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

The present invention relates to a method, system and apparatus for encoding audio visual media signals sourced from preferably a video conference transmission. The technology provided is adapted to receive a video conference transmission from a computer network where this video conference transmission includes at least one audio visual signal and at least one protocol signal. One or more protocol signals are then read from the transmission received with the technology provided applying a selected encoding process to a received audio visual signal, wherein the encoding process selected depends on the contents of a read protocol signal.

Claims

1-36. -36. (canceled)

37. A method of encoding audio visual media signals characterised by the steps of:

(i) receiving a videoconference transmission from a computer network, said videoconference transmission including at least one audio visual signal and at least one protocol signal, and

(ii) reading one or more protocol signals, and

(iii) applying a selected encoding process to a received audio visual signal, said encoding process being selected depending on the contents of said at least one protocol signal read.

38. A method of encoding as claimed in claim 37 further characterised by additional subsequent step of:

(iv) producing encoded output for a software player application,

39. A method of encoding as claimed in claim 38 wherein the encoded output provided is adapted to be played to users not directly participating in the videoconference.

40. A method of encoding as claimed in claim 38 which is adapted to provide an encoded output file or files.

41. A method of encoding as claimed in claim 38 which is adapted to provide an encoded output transmission.

42. A method of encoding as claimed in claim 38 wherein the encoded output provided is adapted to be played using a computer system.

43. A method of encoding as claimed in claim 38 wherein the encoded output is distributed to users over a computer network.

44. A method of encoding as claimed in claim 38 wherein apparatus used to provide the encoded output forms a videoconference endpoint.

45. A method of encoding as claimed in claim 37 wherein a read protocol signal provides information regarding any combination of following parameters associated with an audio visual signal of a videoconference transmission;

(i) audio codec employed and/or

(ii) video codec employed and/or

(iii) the bit rate of audio information supplied and/or

(iv) the bit rate of video information supplied and/or

(v) the video information frame rate and/or

(vi) the video information resolution.

46. A method of encoding as claimed in claim 37 wherein the content of a read protocol signal is used to detect the time position of at least one keyframe present within an audio visual signal of the videoconference transmission.

47. A method of encoding as claimed in claim 46 wherein keyframes are encoded into the encoded output at the same time position as keyframes are detected in an audio visual signal of the videoconference transmission.

48. A method of encoding as claimed in claim 37 wherein the contents of said at least one read protocol signal indicates a content switch present within an audio visual signal of the videoconference transmission.

49. A method of encoding as claimed in claim 48, wherein a content switch is detected from a freeze picture signal extracted from a protocol signal.

50. A method of encoding as claimed in claim 48, wherein a content switch is detected from the removal of a freeze picture request signal extracted from a protocol signal.

51. A method of encoding as claimed in claim 48, wherein a content switch is detected from a document camera signal extraction from a protocol signal.

52. A method of encoding as claimed in claim 48, wherein a content switch is detected from the removal of a document camera signal extraction from a protocol signal.

53. A method of encoding as claimed in claim 48, wherein a content switch is detected from an image incorporation signal extracted from a protocol signal.

54. A method of encoding as claimed in claim 48, wherein a content switch is detected from the removal of an image incorporation signal extracted from a protocol signal.

55. A method of encoding as claimed in claim 48, wherein a content switch is detected from a camera movement signal extracted from a protocol signal.

56. A method of encoding as claimed in claim 48, wherein the detection of a content switch triggers the association of at least one index marker with the encoded output at the corresponding time position in the encoded output at which the content switch was detected.

57. A method of encoding as claimed in claim 56, wherein an index marker includes reference information indicating what content switch was detected.

58. A method of encoding as claimed in claim 56, wherein a protocol signal indicates the time position of at least one keyframe present within an audio visual signal of the videoconference transmission, and wherein keyframes encoded into the encoded output are positioned adjacent to or in the same position as index markers encoded into said output.

59. A method of encoding as claimed in claim 58, wherein keyframes encoded into the encoded output provided are positioned within a threshold time from an index marker.

60. A method of encoding as claimed in claim 58, wherein keyframes are encoded at the same time position as index markers.

61. A method of encoding as claimed in claim 38, wherein encoded output audio visual content is time compressed when a low content state is detected from a received protocol signal.

62. A method of encoding as claimed in claim 61, wherein a buffer is used to time compress the audio visual content of the encoded output.

63. A method of encoding audio visual media signals characterised by the steps of:

(i) receiving a videoconference transmission from a computer network, said videoconference transmission including at least one audio visual signal and at least one protocol signal, and

(ii) reading one or more protocol signals, and

(iii) determining the time position of a keyframe present within an audio visual signal received, and

(iv) encoding a keyframe into the encoded output at the same time position at which the keyframe was detected in the original received audio visual signal.

64. A method of encoding audio visual media signals, characterised by the steps of:

(i) receiving a videoconference transmission from a computer network, said videoconference transmission including at least one audio visual signal and at least one protocol signal, and

(ii) reading one or more protocol signals, and

(iii) detecting a content switch within the audio visual content of a received audio visual signal or signals, and

(iv) encoding an index marker at the time position at which the content switch was detected.

65. A method of encoding as claimed in claim 64 wherein index markers are encoded within a time threshold from the time position of a keyframe.

66. A method of encoding audio visual media signals characterised by the steps of:

(i) receiving a videoconference transmission, from a computer network, said videoconference transmission including at least one audio visual signal and at least one protocol signal, and

(ii) reading one or more protocol signals, and

(iii) detecting a content switch within the audio visual content of a received audio visual signal, and

(iv) encoding a keyframe and

(v) encoding an index marker at the same time position or adjacent to the time position of the keyframe encoded.

67. A method of encoding audio visual media signals characterised by the steps of:

(i) receiving a videoconference transmission from a computer network, said videoconference transmission including at least one audio visual signal and at least one protocol signal, and

(ii) reading one or more protocol signals, and

(iii) detecting the existence of a low content state present within a received audio visual signal or signals, and

(iv) time compressing the encoded output content during the time period in which said low content state is detected within the videoconference transmission received.

68. A method of encoding as claimed in claim 67 wherein a buffer is used to receive videoconference transmission signals whereby the rate at which the contents of the buffer is played out to an encoding process determines the degree of time compression applied to the original videoconference content when encoded.

69. A method of encoding audio visual media signals characterised by the steps of:

(i) receiving a videoconference transmission from a computer network, said videoconference transmission including at least one audio visual signal and at least one protocol signal, and

(ii) reading one or more protocol signals to determine the encoding characteristics of the received videoconference transmission,

(iii) receiving encoding preferences from at least one user, and

(iv) selecting from a set of encoding processes a subset of encoding processes which can be implemented using the user'"'"'s preferences and the encoding characteristics, and

(v) displaying the subset of encoding processes to a user.