Method and apparatus for the selection of data for use in VTR trick playback operation in a system using intra-coded video frames

• US 5,717,816 A
• Filed: 08/30/1994
• Issued: 02/10/1998
• Est. Priority Date: 01/13/1993
• Status: Expired due to Term

• Current Assignee: Hitachi America Limited (Hitachi, Ltd.)
• Original Assignee: Hitachi America Limited (Hitachi, Ltd.)
• Inventors: Boyce, Jill MacDonald, Lane, Frank Anton
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US08/298,524
• Time in Patent Office: 1,260 Days
• Field of Search: 358/335, 358/342, 358/310, 358/312, 360/32, 360/33.1, 360/10.3, 348/384, 386/109, 386/111, 386/112, 386/33, 386/27
• US Class Current: 386/205
• CPC Class Codes: G11B 15/125 conditioned by the operating function of the apparatus
• CPC Class Codes: G11B 15/1875 adaptations for special effects or editing signal processing or indexing therefor G11B27/00
• CPC Class Codes: G11B 15/4673 by controlling the speed of the tape while the head is rotating
• CPC Class Codes: G11B 5/0086 using cyclically driven heads providing segmented tracks
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/427 Display on the fly, e.g. simultaneous writing to and reading from decoding memory
• CPC Class Codes: H04N 19/428 Recompression, e.g. by spatial or temporal decimation
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 : characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/80 : Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/82 : involving filtering within a prediction loop
• CPC Class Codes: H04N 19/90 : using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
• CPC Class Codes: H04N 19/91 : Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• CPC Class Codes: H04N 21/4147 : PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4325 : by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/434 : Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/44004 : involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 5/78263 : for recording on tracks inclined relative to the direction of movement of the tape
• CPC Class Codes: H04N 5/783 : Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/8042 : involving data reduction
• CPC Class Codes: H04N 9/8227 : the additional signal being at least another television signal

Abstract

Method and apparatus for extracting intra-coded video frames from a video data stream including inter-coded video frames and intra-coded video frames to produce reduced resolution intra-coded video frames suitable for recording in trick play tape segments of a tape for later play back and display during video tape recorder trick play operation. A plurality of methods and apparatus for buffering and selecting received intra-coded video frames for recording in trick play tape segments to support a plurality of trick play modes of operation are disclosed. In addition, a plurality of different data reduction methods and apparatus are disclosed for generating reduced resolution intra-coded frames from the received full resolution intra-coded video frames.

Claims

1. An intra-coded video frame extraction circuit for generating a series of intra-coded video frames from a video data stream including digital video data representing a plurality of inter-coded and intra-coded frames, a single one out of every M+N of the digital video frames included in the digital video datastream being an intra-coded video frame, where M and N are integers greater than 0, the frame extraction circuit comprising:

an intra-coded data identification and selection circuit for receiving the digital video data included in the video data stream, for distinguishing between digital video data representing intra-coded video frames and digital video data representing inter-coded video frames and for outputting the digital video data representing each received intra-coded video frame;

a first storage device coupled to the intra-coded data identification and selection circuit, the first storage device receiving and storing the digital video data representing each received intra-coded video frame output by the intra-coded data identification and selection circuit; and

a video frame selection circuit coupled to the first storage device for receiving from the first storage device the data that represents the most recently stored intra-coded video frame, the video frame selection circuit outputting the video data representing the most recently stored intra-coded video frame once for every M video frames received by the intra-coded data identification and selection circuit, the video data representing at least one video frame being output multiple times.

2. The data extraction circuit of claim 1, further comprising:

a syntax parser having an input adapted for receiving the digital video data stream and an output coupled to the intra-coded data identification and selection circuit, the syntax parser arranging the digital video data representing each of the plurality of inter-coded and intra-coded frames into a separate set of MPEG coding elements including a plurality of macroblocks.

3. The data extraction circuit of claim 2,

wherein the syntax parser includes means for generating a video frame indicator signal in response to the receipt of video data representing each newly received video frame;

and

wherein the video frame selection circuit includes a video frame indicator signal input coupled to the syntax parser, the video frame selection circuit outputting the video data received from the first storage device as a function of the video frame indicator signal.

4. An intra-coded video frame extraction circuit for generating a series of intra-coded video frames from a video data stream including digital video data representing a plurality of inter-coded and intra-coded frames, the circuit comprising:

an intra-coded data identification circuit for identifying digital video data included in the video data stream representing intra-coded video frames;

a first data reduction circuit coupled to the intra-coded data identification circuit, the first data reduction circuit for performing a first data reduction operation on the intra-coded video data identified by the intra-coded data identification circuit;

a first storage device, coupled to the first data reduction circuit, for receiving and storing the intra-coded digital video data produced by the data reduction operation performed by the first data reduction circuit; and

a video frame selection circuit coupled to the first storage device for selecting stored intra-coded data, representing the intra-coded video frame most recently stored in the first data storage device, to be output once for every M video frames received by the intra-coded data identification circuit, wherein M is an integer greater than 1.

5. The data extraction circuit of claim 4, further comprising:

a second data reduction circuit coupled to the intra-coded data identification circuit, the second data reduction circuit for performing a second data reduction operation, the second data reduction operation being performed on the intra-coded video data identified by the intra-coded data identification circuit;

a second storage device, coupled to the second data reduction circuit, for receiving and storing the intra-coded digital video data produced by the data reduction operation performed by the second data reduction circuit; and

wherein the video frame selection circuit is further coupled to the output of the second storage device;

and wherein the video frame selection circuit selects the stored intra-coded data representing the intra-coded video frame most recently stored in the second storage device to be output once for every N video frames received by the intra-coded data identification circuit, wherein N is a positive number greater than M.

6. The data extraction circuit of claim 5, further comprising:

a third data reduction circuit coupled to the intra-coded data identification and selection circuit and to the input of a third storage device, the third data reduction circuit for performing a third data reduction operation, the third data reduction operation being performed on the intra-coded video data identified by the intra-coded data identification circuit;

the third storage device, coupled to the third data reduction circuit, for receiving and storing the intra-coded digital video data produced by the third data reduction operation; and

wherein the video frame selection circuit is further coupled to the output of the third storage device; and

wherein the video frame selection circuit selects the stored intra-coded data representing the intra-coded video frame most recently stored in the third storage device, to be output once for every P video frames received by the intra-coded data identification circuit, wherein P is a positive number greater than N.

7. An intra-coded video frame extraction circuit for generating a series of individual intra-coded video frames from a video data stream including digital video data representing a plurality of inter-coded and intra-coded video frames, the frame extraction circuit comprising:

an intra-coded data identification circuit for receiving the data in the video data stream, and for identifying and outputting the digital video data representing individual received intra-coded video frames in the order the digital video data is received;

a first storage device coupled to the intra-coded data identification and selection circuit, the first storage device receiving and storing the digital video data corresponding to each individual intra-coded video frame output by the intra-coded data identification circuit; and

a video frame selection circuit, the video frame selection circuit selecting the video data stored in the first storage device corresponding to the most recently stored intra-coded video frame to be output once for every M video frames received by the intra-coded data identification circuit such that the data representing some but not all of the stored intra-coded video frames are selected to be output.

8. A method of operating a digital video device to generate a series of intra-coded video frames from a full resolution video data stream including a plurality of inter-coded video frames and intra-coded video frames, comprising the steps of:

receiving the video frames included in the data stream;

identifying each intra-coded video frame in the video data stream as it is received;

upon identifying each intra-coded video frame, storing the identified intra-coded video frame in a first buffer, the first buffer thereby storing the most recently received intra-coded video frame;

upon the passage of every X frame times, wherein X is a positive number greater than 1 and a frame time is a predetermined amount of time used to display a frame in the full resolution video data stream, outputting from the first buffer the most recently stored intra-coded video frame, at least one of the stored intra-coded video frames being output multiple times.

9. A method of operating a digital video device to generate a series of intra-coded video frames from a full resolution video data stream including a plurality of inter-coded video frames and intra-coded video frames, comprising the steps of:

receiving the video frames included in the data stream;

identifying each intra-coded video frame in the video data stream in the order received;

performing a first data reduction operation on the identified intra-coded video frame to reduce the amount of data used to represent the intra-coded video frame;

storing the identified intra-coded video frame upon which the first data reduction operation was performed in a first buffer, the first buffer thereby storing the most recently received intra-coded video frame in a reduced data form;

upon the passage of every X frame times, wherein X is a positive number greater than 1 and a frame time is a predetermined amount of time used to display a frame included in the full resolution video data stream, outputting from the first buffer the most recently stored intra-coded video frame.

10. The method of claim 9, further comprising the steps of:

upon identifying an intra-coded video frame, storing the identified intra-coded video frame in a second buffer and upon identifying each subsequent intra-coded video frame storing the subsequent intra-coded video frame in the second buffer, the second buffer thereby storing the most recently received intra-coded video frame;

upon the passage of every Y frame times, wherein Y is a positive number greater than X outputting the intra-coded video frame that was most recently stored in the second buffer.

11. The method of claim 10, further comprising the steps of:

prior to storing the identified intra-coded video frame in the second buffer, performing a second data reduction operation, the second data reduction operation being performed on the identified intra-coded video frame to reduce the amount of data used to represent the identified intra-coded video frame, the amount of data reduction performed by the second data reduction operation being greater than the amount performed by the first data reduction operation.

12. The method of claim 11, further comprising the steps of:

upon identifying an intra-coded video frame, storing the identified intra-coded video frame in a third buffer and upon identifying each subsequent intra-coded video frame storing the subsequent intra-coded video frame in the third buffer, the third buffer thereby storing the most recently received intra-coded video frame;

upon the passage of every Z frame times, wherein Z is a positive number greater than Y, outputting the intra-coded video frame that was most recently stored in the third buffer.

13. The method of claim 12, further comprising the steps of:

prior to storing the identified intra-coded video frame in the third buffer, performing a third data reduction operation, the third data reduction operation being performed on the identified intra-coded video frame to reduce the amount of data used to represent the identified intra-coded video frame, the amount of data reduction performed by the third data reduction operation being greater than the amount performed by the second data reduction operation.

14. A method of operating a digital video device to extract a series of intra-coded video frames from a full resolution video data stream including a plurality of intra-coded video frames and inter-coded video frames, comprising the steps of:

receiving the video frames included in the data stream;

identifying every j^th intra-coded video frame in the video data stream as it is received, where j is an integer greater than one;

upon identifying a j^th intra-coded video frame, storing the identified j^th intra-coded video frame in a first buffer and upon identifying each subsequent j^th intra-coded video frame storing the subsequently identified j^th intra-coded video frame in the first buffer, the first buffer thereby storing the most recently received identified j^th intra-coded video frame;

upon the passage of every K frame times, wherein K is a positive number and wherein a frame time is a predetermined amount of time used to display a frame in the full resolution video data stream, outputting the intra-coded video frame most recently stored in the first buffer.

15. The method of claim 14, wherein j is equal to 3, K is equal to 4 and the digital video data stream includes at least three sequential sets of inter-coded and intra-coded video frames, each of the at least three sequential sets of inter-coded and intra-coded video frames consisting of one intra-coded video frame and 11 inter-coded video frames.

16. A method of operating a digital video device to generate a series of intra-coded video frames from a video data stream including a plurality of inter-coded video frames and intra-coded video frames, comprising the steps of:

receiving the video frames included in the data stream;

identifying each intra-coded video frame in the video data stream as it is received;

upon identifying each intra-coded video frame, storing the identified intra-coded video frame in a first buffer, the first buffer thereby storing the most recently received intra-coded video frame;

upon the passage of every X frame times, where a frame time is a predetermined amount of time used to display a frame in the full resolution video data stream, and where X is a positive number greater than 1 and is large enough that multiple intra-coded frames will have been received during X frame times, outputting from the first buffer the most recently stored intra-coded video frame.

17. An intra-coded video frame extraction method for generating a series of intra-coded video frames from a video data stream including digital video data representing a plurality of inter-coded and intra-coded frames, no more than one out of every M+N of the digital video frames included in the digital video data stream being an intra-coded video frame, where M and N are integers greater than 0, the method comprising:

receiving the digital video data included in the video data stream;

identifying the video data representing intra-coded video frames included in the video data stream;

storing identified video data representing intra-coded video frames; and

outputting the stored video data corresponding representing one of the identified video frames each time M video frames are received, where M is an integer, the stored data representing at least one of the identified intra-coded video frames being output multiple times.