SYSTEMS AND METHODS FOR GAME-GENERATED MOTION VECTORS

• US 20180310016A1
• Filed: 04/20/2018
• Published: 10/25/2018
• Est. Priority Date: 04/21/2017
• Status: Active Grant

• Current Assignee: Zenimax Media Incorporated. (Microsoft Corporation)
• Original Assignee: Zenimax Media Incorporated. (Microsoft Corporation)
• Inventors: Kopietz, Michael
• Granted Patent: US 10,567,788 B2
• Time in Patent Office: Days
• CPC Class Codes: E05B 77/54 Automatic securing or unlocking of bolts triggered by certain vehicle parameters, e.g. exceeding a speed threshold triggered by vehicle collision E05B77/12
• CPC Class Codes: E05B 79/20 using flexible connections, e.g. Bowden cables
• CPC Class Codes: E05B 81/16 operating on locking elements for locking or unlocking action
• CPC Class Codes: E05B 83/24 for car bonnets
• CPC Class Codes: E05B 85/243 with a bifurcated bolt
• CPC Class Codes: E05B 85/26 Cooperation between bolts and detents
• CPC Class Codes: F16H 59/10 comprising levers
• CPC Class Codes: F16H 63/36 Interlocking devices
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/517 by encoding
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/537 Motion estimation other than block-based
• CPC Class Codes: H04N 19/56 Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

Systems and methods for integrated graphics rendering are disclosed. In certain embodiments, the systems and methods utilize a graphics engine, a video encoding engine, and remote client coding engine to render graphics over a network. The systems and methods involve the generation of per-pixel motion vectors, which are converted to per-block motion vectors at the graphics engine. The graphics engine injects these per-block motion vectors into a video encoding engine, such that the video encoding engine may convert those vectors into encoded video data for transmission to the remote client coding engine.

Claims

1. A computer-implemented method for generating graphics, comprising the steps of:

generating one or more per-pixel motion vectors;

converting the one or more per-pixel motion vectors into one or more per-block motion vectors in a graphics engine; and

injecting the per-block motion vectors into a video encoding engine,

wherein the video encoding engine converts the one or more per-block motion vectors into encoded video data for transmission to a remote client coding engine.

2. The method of claim 1, wherein the one or more per-pixel motion vectors are stored in a velocity buffer prior to conversion.

3. The method of claim 1, wherein generation of the one or more per-pixel motion vectors comprises the steps of:

combining, at a compute shader, the one or more per-pixel motion vectors to a camera velocity to obtain a per-pixel result; and

storing the per-pixel result in a motion vector buffer.

4. The method of claim 1, wherein a graphics engine injects the per-block motion vector data into the video encoding engine in real-time, concurrently with one or more chroma sub sampled video frames.

5. The method of claim 1, wherein the encoded video data is decoded for playback on a remote client computer system.

6. The method of claim 1, wherein the video encoding engine performs motion compensation and residual transformation to convert the one or more per-block motion vectors into encoded video data.

7. The method of claim 1, wherein the video encoded data is prepared for transmission to the remote client coding engine by applying one or more inverse quantization algorithms, inverse transform and scale, and/or deblocking.

8. The method of claim 1, wherein the one or more per-pixel vectors are converted to one or more per-block motion vectors using a transformation method that applies an arithmetic mean.

12. The system of claim 8, wherein the graphics engine injects the per-block motion vector data into the video codec engine in real-time, concurrently with one or more chroma sub sampled video frames.

9. A computer-implemented graphics generation system comprised of one or more graphics engines and a video codec engine, wherein

the graphics engine generates one or more per-pixel motion vectors, converts said per-pixel motion vectors into one or more per-block motion vectors, and directly injects said per-block motion vectors into the video codec engine, wherein

the video codec engine converts the per-block motion vectors into encoded video data and transmits the encoded video data to a remote client coding engine running on a remote client computer system.

10. The system of claim 9, wherein the one or more per-pixel motion vectors are stored in a velocity buffer prior to conversion.

11. The system of claim 9, wherein the one or more per-pixel motion vectors are generated by adding, at a compute shader, the one or more per-pixel motion vectors to a camera velocity to obtain a per-pixel result, and storing the per-pixel result in a motion vector buffer.

13. The system of claim 9, wherein the video codec engine performs motion compensation and residual transformation to convert the one or more per-block motion vectors into encoded video data.

14. The system of claim 9, wherein the video encoded data is prepared for transmission to the remote client coding engine by applying one or more inverse quantization algorithms, inverse transform and scale, and/or deblocking.

15. The system of claim 9, wherein the encoded video data is configured to be decoded and played back on a display driven by a display controller.

16. The system of claim 9, wherein the graphics engine converts the one or more per-pixel vectors to one or more per-block motion vectors using a transformation method that applies an arithmetic mean.

17. A computer-implemented method for generating graphics, comprising the steps of:

converting the one or more per-pixel motion vectors into one or more per-block motion vectors in a graphics engine wherein the per-block motion vector data is transmitted to a codec engine upon receipt; and

receiving one or more chroma subsampled video frames at a graphics engine, wherein the chroma subsampled video frames are transmitted to the codec engine upon receipt,

wherein the codec engine combines the per-block motion vector data and the chroma sub sampled video frames to encode video data for transmission to a remote client computer system, and wherein motion estimation calculations are disabled during encoding of the video data.

18. The method of claim 17, wherein the combined per-block motion vector data and the chroma subsampled video frames form a residual image.

19. The method of claim 18, wherein the residual image is further processed by residual transformation and scaling, quantization, and/or scanning prior to encoding.

20. The method of claim 18, further comprising the steps of:

calculating an inverse quantization, inverse transform and scale; and

deblocking the residual image.