Video/audio signal processing method and video/audio signal processing apparatus

• US 20080043848A1
• Filed: 08/30/2007
• Published: 02/21/2008
• Est. Priority Date: 11/29/1999
• Status: Abandoned Application

• Current Assignee: Peter Kuhn
• Original Assignee: Peter Kuhn
• Inventors: Kuhn, Peter
• Application Number:
  US11/897,303
• Publication Number:
  US 20080043848A1
• Time in Patent Office: Days
• US Class Current: 375/240.16
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06F 16/7864 using domain-transform features, e.g. DCT or wavelet transform coefficients
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/54 using feature points or meshes
• CPC Class Codes: H04N 19/547 Motion estimation performed in a transform domain
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 19/90 using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
• CPC Class Codes: H04N 23/6811 based on the image signal

Abstract

A metadata extraction unit has a feature point selection and motion estimation unit 62 for extracting at least one feature point representing characteristics of the video/audio signals in a compressed domain of the video/audio signals. Thus, reduction of time or cost for processing can be realized and it makes it possible to process effectively.

Claims

1-52. -52. (canceled)

53. A method for processing and browsing supplied video/audio signals, comprising the steps of:

building hierarchically a camera motion transition graph, wherein the graph building step includes the step of providing a graph layout having at least one main camera motion transition graph and having a plurality of nodes representing other camera motion with the transition paths illustrated for a video sequence;

browsing through the camera motion transition graph by depicting keyframes of a camera motion video sequence at the nodes; and

browsing through the camera motion transition graph by depicting a graph representation of the camera motion at the nodes.

54. An apparatus for processing and browsing supplied video/audio signals, comprising:

means for building hierarchically a camera motion transition graph, wherein the graph building means includes the step of providing a graph layout having at least one main camera motion transition graph and having a plurality of nodes representing other camera motion with the transition paths illustrated for a video sequence;

means for browsing through the camera motion transition graph by depicting keyframes of a camera motion video sequence at the nodes; and

means for browsing through the camera motion transition graph by depicting a graph representation of the camera motion at the nodes.

55. A method for extracting a hierarchical decomposition of a complex video selection for browsing, comprising the steps of:

identifying video;

collecting key frames from said video shots for representing each video segment;

classifying the collections of key frames according to camera motion or global motion information; and

building a graphical representation of the video, the graphical representation being based upon the results of said classifying step, temporal as well as camera motion information associated with each part of a video shot, wherein said graphical representation building step includes the step of representing each category of video shot by node.

56. An apparatus for extracting a hierarchical decomposition of a complex video selection for browsing, comprising:

means for identifying video;

means for collecting key frames from said video shots for representing each video segment;

means for classifying the collections of key frames according to camera motion or global motion information; and

means for building a graphical representation of the video, the graphical representation being based upon the results of said classifying step, temporal as well as camera motion information associated with each part of a video shot, wherein said graphical representation building step includes means for representing each category of video shot by node.

57-92. -92. (canceled)