MULTI-SESSION LOW LATENCY ENCODING

• US 20200137134A1
• Filed: 10/31/2018
• Published: 04/30/2020
• Est. Priority Date: 10/31/2018
• Status: Active Application

• Current Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Original Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Inventors: HAROLD, Edward, ZHANG, Lei
• Application Number:
  US16/176,489
• Publication Number:
  US 20200137134A1
• Time in Patent Office: Days
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements

Abstract

An encoder of a multimedia system is configured to switch between encoding portions of frames at multiple encoding sessions based on configurable preemption requirements and stored context information. The encoder seamlessly encodes frames at multiple encoding sessions at low latency without introducing artifacts, such that the output bitstream is the same as if it were encoded at once as a single frame. Target bitrate and other encoder tunings also remain the same as if the entire frame were encoded at once.

Claims

1. A method comprising:

encoding a plurality of portions of a first frame and a second frame in multiple encoding sessions based on stored context information, the encoding comprising;

encoding a first portion of the first frame for a first session until a first configurable preemption requirement is met;

encoding a first portion of the second frame for a second session in response to the first preemption requirement being met until a second preemption requirement is met.

2. The method of claim 1, further comprising:

storing context information regarding the first portion of the first frame at a buffer in response to encoding the first portion of the first frame; and

accessing the stored context information regarding the first portion of the first frame in response to the second preemption requirement being met,

wherein encoding the second portion of the first frame for the first session is based on the stored context information regarding the first portion of the first frame.

3. The method of claim 2, wherein the context information comprises at least one of:

identification of a row of the first frame at which the first portion is located, identification of macroblocks comprising the first portion, pixel information associated with the first portion, and encoding settings used to encode the first portion.

4. The method of claim 1, wherein each portion of the plurality of portions comprises a predetermined number of macroblocks of the first frame and the second frame.

5. The method of claim 1, wherein the first preemption requirement comprises the encoded portion reaching a threshold size.

6. The method of claim 1, wherein the first preemption requirement comprises a threshold time limit being reached for encoding the first portion of the first frame.

7. The method of claim 1, further comprising:

encoding a second portion of the first frame for the first session in response to the second preemption requirement being met until a third preemption requirement is met; and

encoding a second portion of the second frame for the second session in response to the third preemption requirement being met.

8. A method, comprising:

switching, at an encoder, between encoding portions of first frame of a first session and encoding portions of a second frame of a second session based on stored context information in response to at least one preemption requirement being met; and

transmitting each encoded portion of the first frame and the second frame across a network in response to the encoder encoding each portion.

9. The method of claim 8, wherein switching comprises:

encoding a first portion of the first frame until a first preemption requirement is met;

encoding a first portion of the second frame in response to the first preemption requirement being met until a second preemption requirement is met;

encoding a second portion of the first frame in response to the second preemption requirement being met until a third preemption requirement is met; and

encoding a second portion of the second frame in response to the third preemption requirement being met.

10. The method of claim 9, further comprising:

storing context information regarding the first portion of the first frame at a buffer in response to encoding the first portion of the first frame; and

accessing the stored context information regarding the first portion of the first frame in response to the second preemption requirement being met,

wherein encoding the second portion of the first frame for the first session is based on the stored context information regarding the first portion of the first frame.

11. The method of claim 10, wherein the context information comprises at least one of:

identification of a row of the first frame at which the first portion is located, identification of macroblocks comprising the first portion, pixel information associated with the first portion, and encoding settings used to encode the first portion.

12. The method of claim 8, wherein each portion of the first frame comprises a predetermined number of macroblocks of the first frame and each portion of the second frame comprises a predetermined number of macroblocks of the second frame.

13. The method of claim 8, wherein at least one preemption requirement comprises the encoded portion reaching a threshold size.

14. The method of claim 8, wherein at least one preemption requirement comprises a threshold time limit being reached for encoding a portion of the first frame.

15. A device, comprising:

an encoder configured to switch between encoding portions of first frame of a first session for transmission across a network and encoding portions of a second frame of a second session based on stored context information for transmission across the network in response to at least one preemption requirement being met.

16. The device of claim 15, wherein the encoder is further configured to:

encode a first portion of the first frame until a first preemption requirement is met;

encode a first portion of the second frame in response to the first preemption requirement being met until a second preemption requirement is met;

encode a second portion of the first frame in response to the second preemption requirement being met until a third preemption requirement is met; and

encode a second portion of the second frame in response to the third preemption requirement being met.

17. The device of claim 16, further comprising:

a buffer,

wherein the encoder is further configured to;

store context information regarding the first portion of the first frame at the buffer in response to encoding the first portion of the first frame; and

access the stored context information regarding the first portion of the first frame in response to the second preemption requirement being met,

and wherein the encoder is configured to encode the second portion of the first frame for the first session based on the stored context information regarding the first portion of the first frame.

18. The device of claim 15, wherein each portion of the first frame comprises a predetermined number of macroblocks of the first frame and each portion of the second frame comprises a predetermined number of macroblocks of the second frame.

19. The device of claim 15, wherein at least one preemption requirement comprises the encoded portion reaching a threshold size.

20. The device of claim 15, wherein at least one preemption requirement comprises a threshold time limit being reached for encoding a portion of the first frame.