Foveated video coding system and method
First Claim
1. A method for transcoding a frequency transform-encoded digital video signal representing a sequence of video frames to produce a compressed digital video signal for transmission over a limited bandwidth communication channel to a display, said method comprising the steps of:
- (a) providing a frequency transform-encoded digital video signal having encoded frequency coefficients representing a sequence of video frames, wherein the encoding removes temporal redundancies from the video signal and encodes the frequency coefficients as base layer frequency coefficients in a base layer and as residual frequency coefficients in an enhancement layer;
(b) identifying a gaze point of an observer on the display;
(c) partially decoding the encoded digital video signal to recover the frequency coefficients;
(d) adjusting the residual frequency coefficients to reduce the high frequency content of the video signal in regions away from the gaze point;
(e) recoding the frequency coefficients, including the adjusted residual frequency coefficients, to produce a foveated transcoded digital video signal; and
(f) displaying the foveated transcoded digital video signal to the observer.
1 Assignment
0 Petitions
Accused Products
Abstract
In transcoding a frequency transform-encoded digital video signal representing a sequence of video frames, a foveated, compressed digital video signal is produced and transmitted over a limited bandwidth communication channel to a display according to the following method: First, a frequency transform-encoded digital video signal having encoded frequency coefficients representing a sequence of video frames is provided, wherein the encoding removes temporal redundancies from the video signal and encodes the frequency coefficients as base layer frequency coefficients in a base layer and as residual frequency coefficients in an enhancement layer. Then, an observer'"'"'s gaze point is identified on the display. The encoded digital video signal is partially decoded to recover the frequency coefficients, and the residual frequency coefficients are adjusted to reduce the high frequency content of the video signal in regions away from the gaze point. The frequency coefficients, including the adjusted residual frequency coefficients, are then recoded to produce a foveated, transcoded digital video signal, and the foveated, transcoded digital video signal is displayed to the observer.
-
Citations
32 Claims
-
1. A method for transcoding a frequency transform-encoded digital video signal representing a sequence of video frames to produce a compressed digital video signal for transmission over a limited bandwidth communication channel to a display, said method comprising the steps of:
-
(a) providing a frequency transform-encoded digital video signal having encoded frequency coefficients representing a sequence of video frames, wherein the encoding removes temporal redundancies from the video signal and encodes the frequency coefficients as base layer frequency coefficients in a base layer and as residual frequency coefficients in an enhancement layer;
(b) identifying a gaze point of an observer on the display;
(c) partially decoding the encoded digital video signal to recover the frequency coefficients;
(d) adjusting the residual frequency coefficients to reduce the high frequency content of the video signal in regions away from the gaze point;
(e) recoding the frequency coefficients, including the adjusted residual frequency coefficients, to produce a foveated transcoded digital video signal; and
(f) displaying the foveated transcoded digital video signal to the observer. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A system for transcoding a frequency transform-encoded digital video signal representing a sequence of video frames to produce a compressed digital video signal for transmission over a limited bandwidth communication channel, said system comprising:
-
(a) a memory containing an encoded digital video signal representing a sequence of video frames, wherein the encoding removes temporal redundancies from the video sequence and encodes the frequency coefficients as base layer frequency coefficients in a base layer and as residual frequency coefficients in an enhancement layer;
(b) a display for displaying the video signal to an observer;
(c) a gaze tracking device for identifying the observer'"'"'s gaze point on the display;
(d) a decoding unit for partially decoding the encoded digital video signal to recover the frequency coefficients;
(e) a foveation processing unit for adjusting the residual frequency coefficients to reduce high frequency content of the video signal in regions away from the gaze point;
(f) a transcoding unit for recoding the frequency coefficients, including the adjusted residual frequency coefficients, to produce a foveated transcoded digital video signal; and
(g) means for transmitting and decoding the transcoded digital video signal and providing the decoded digital video signal to the display. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32)
-
Specification