Timing synchronization between a content source and a display panel

• US 10,715,882 B2
• Filed: 06/29/2018
• Issued: 07/14/2020
• Est. Priority Date: 06/29/2018
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Ansari, Nausheen, Smith, Gary K., Kambhatla, Srikanth
• Primary Examiner(s): Mercedes, Dismery
• Application Number:
  US16/024,432
• Publication Number:
  US 20190045278A1
• Time in Patent Office: 746 Days
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G09G 2300/026 Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
• CPC Class Codes: G09G 2320/0252 Improving the response speed
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 3/2096 Details of the interface to the display terminal specific for a flat panel suitable for both CRT and flat panel G09G5/006; specific for a CRT G09G1/167
• CPC Class Codes: G09G 3/3618 with automatic refresh of the display panel using sense/write circuits
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Technology for a display device is described. The display device can include at least one display screen operable to show at least one display panel. The display device can include a controller. The controller can receive a content frame from a content source over a transport topology. The controller can receive a presentation timestamp (PTS) associated with the content frame, where the PTS indicates an earliest time at which the content frame is to be displayed at the display device. The controller can provide the content frame for display on the display panel at a subsequent panel refresh opportunity in accordance with the PTS.

Claims

1. A display device, comprising:

at least one display screen operable to show at least one display panel; and

a controller, comprising logic to;

receive a content frame from a content source over a transport topology;

receive a presentation timestamp (PTS) associated with the content frame, said PTS indicating an earliest time at which the content frame is to be displayed at the display device; and

provide the content frame for display on the display panel at a panel refresh opportunity subsequent to receipt of the content frame and PTS in accordance with the PTS;

wherein either;

the earliest time is defined in units of local time, wherein local time identifies a common time base between the content source and the display panel, wherein the local time is derived from an operating system time;

or

the controller further comprises logic to;

generate a synchronization timestamp (STS) based on units of local time for the content frame;

adjust a panel refresh rate of the display panel to align with the STS; and

provide the content frame for display on the display panel at the STS, wherein the STS is equal to the PTS associated with the content frame or the STS occurs at a subsequent panel refresh opportunity after the PTS.

2. The display device of claim 1, wherein the controller comprises logic to:

receive the content frame from the content source in accordance with a content refresh rate; and

provide the content frame for display on the display panel in accordance with a panel refresh rate,

wherein the content refresh rate and the panel refresh rate are expressed in Hertz (Hz).

3. The display device of claim 2, wherein:

the PTS serves to decouple the content refresh rate from the panel refresh rate, such that the content refresh rate is different from the panel refresh rate; and

the subsequent panel refresh opportunity occurs at the PTS or after the PTS.

4. The display device of claim 1, wherein the controller comprises logic to:

provide a last content frame from a local buffer for replay on the display panel at a following panel refresh opportunity when there is no new content frame received from the content source.

5. The display device of claim 1, wherein the controller comprises logic to:

generate the STS in response to a configuration received from the content source, wherein the controller generates the STS for every content frame until a reconfiguration is received from the content source to stop generating the STS.

6. The display device of claim 1, wherein the controller comprises logic to:

provide a last content frame from a local buffer for replay on the display panel at a next STS when there is no new content frame received from the content source.

7. The display device of claim 1, wherein the controller comprises logic to:

receive multiple video streams from the content source;

generate a synchronization timestamp (STS) that is applicable to each of the multiple video streams; and

provide the multiple video streams to multiple display panels of the display device, respectively, in accordance with the STS, wherein a same STS is used for each of the multiple video streams.

8. The display device of claim 1, wherein the display device is one in a group of display devices that receive video streams from the content source, wherein the display device receives a video stream over the transport topology that is independent of transport topologies for other display devices in the group of display devices.

9. The display device of claim 1, wherein the content source and the display panel operate in accordance with a Transport Agnostic Display (TAD) protocol that defines display stream transmissions between the content source and the display panel, wherein the TAD protocol enables managing inter-frame timings between the content source and the display panel.

10. The display device of claim 1, wherein the transport topology includes one of:

a legacy wired transport for video streaming, a legacy wireless transport or a non-traditional transport for video, wherein the legacy wired transport includes Universal Serial Bus (USB), the legacy wireless transport includes Institute of Electrical and Electronics Engineers (IEEE) 802.11, and the non-traditional transport includes Ethernet.

11. The display device of claim 1, wherein the display screen is a region based display screen that includes a plurality of display panel regions, wherein each display panel region refreshes at the PTS or at a synchronization timestamp (STS) or at a fixed delta time from the PTS or the STS, wherein each display panel region is associated with a set of coordinates.

12. The display device of claim 11, wherein the plurality of display panel regions include at least two display panel regions.

13. The display device of claim 11, wherein the plurality of display panel regions comprises a plurality of rectangular shapes.

14. The display device of claim 13, wherein the plurality of rectangular shapes have a long side disposed in a vertical orientation on the display panel region.

15. The display device of claim 13, wherein the plurality of rectangular shapes have a long side disposed in a horizontal orientation on the display panel region.

16. The display device of claim 11, wherein each display panel region refreshes at the PTS or at the STS or at the fixed delta time from the PTS or the STS in accordance with a timing order, wherein the timing order of a display panel region refresh is one of:

a top to bottom time order, a bottom to top time order, a left to right time order or a right to left time order.

17. A content display system, comprising:

a content source device;

a display device comprising at least one display screen operable to show at least one display panel; and

a controller, comprising logic to;

receive a content frame from the content source device over a transport topology;

receive a presentation timestamp (PTS) associated with the content frame, wherein the PTS indicates an earliest time at which the content frame is to be displayed at the display device; and

provide the content frame for display on the display panel at a panel refresh opportunity subsequent to receipt of the content frame and PTS in accordance with the PTS;

wherein either;

the earliest time is defined in units of local time, wherein local time identifies a common time base between the content source and the display panel, wherein the local time is derived from an operating system time;

or

the controller further comprising logic to;

generate a synchronization timestamp (STS) for the content frame, wherein the STS is based on units of local time;

adjust a panel refresh rate of the display panel to align with the STS; and

provide the content frame for display on the display panel at the STS, wherein the STS is equal to the PTS associated with the content frame or the STS occurs at a subsequent panel refresh opportunity after the PTS.

18. The content display system of claim 17, wherein the display device is one in a group of display devices that receive video streams from the content source device, wherein the display device receives a video stream over the transport topology that is independent of transport topologies for other display devices in the group of display devices.

19. The content display system of claim 17, wherein the content source device and the display panel operate in accordance with a Transport Agnostic Display (TAD) protocol that defines display stream transmissions between the content source device and the display panel, wherein the TAD protocol enables managing inter-frame timings between the content source device and the display panel.

20. The content display system of claim 17, wherein the display screen is a region based display screen that includes a plurality of display panel regions that include at least two display panel regions, wherein each display panel region refreshes at the PTS or at a synchronization timestamp (STS) or at a fixed delta time from the PTS or the STS, wherein each display panel region is associated with a set of coordinates.

21. The content display system of claim 17, wherein the display device comprising multiple display screens operable to each show multiple display panels.

22. A controller configured to control at least one display screen operable to show at least one display panel, the controller comprising logic to:

receive a content frame from a content source over a transport topology;

receive a presentation timestamp (PTS) associated with the content frame, wherein the PTS indicates an earliest time at which the content frame is to be displayed at the display screen; and

provide the content frame for display on the display panel at a panel refresh opportunity subsequent to receipt of the content frame and PTS in accordance with the PTS;

wherein either;

the earliest time is defined in units of local time, wherein local time identifies a common time base between the content source and the display panel, wherein the local time is derived from an operating system time;

or

the controller further comprising logic to;

generate a synchronization timestamp (STS) for the content frame, wherein the STS is based on units of local time;

adjust a panel refresh rate of the display panel to align with the STS; and

provide the content frame for display on the display panel at the STS, wherein the STS is equal to the PTS associated with the content frame or the STS occurs at a subsequent panel refresh opportunity after the PTS.

23. The controller of claim 22, further comprising logic to:

receive the content frame from the content source in accordance with a content refresh rate; and

provide the content frame for display on the display panel in accordance with a panel refresh rate,

wherein the content refresh rate and the panel refresh rate are expressed in Hertz (Hz).

24. The controller of claim 22, further comprising logic to provide a last content frame from a local buffer for replay on the display panel at a following panel refresh opportunity when there is no new content frame received from the content source.

25. The controller of claim 22, further comprising logic to generate the STS in response to a configuration received from the content source, wherein the controller generates the STS for every content frame until a reconfiguration is received from the content source to stop generating the STS.

26. The controller of claim 22, further comprising logic to provide a last content frame from a local buffer for replay on the display panel at a next STS when there is no new content frame received from the content source.

27. The controller of claim 22, further comprising logic to:

receive multiple video streams from the content source;

generate a synchronization timestamp (STS) that is applicable to each of the multiple video streams; and

provide the multiple video streams to multiple display panels of the display screen, respectively, in accordance with the STS, wherein a same STS is used for each of the multiple video streams.