Superresolution display using cascaded panels

• US 9,934,714 B2
• Filed: 03/17/2015
• Issued: 04/03/2018
• Est. Priority Date: 03/18/2014
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Heide, Felix, Lanman, Douglas, Reddy, Dikpal, Kautz, Jan, Pulli, Kari, Luebke, David
• Primary Examiner(s): Du, Haixia
• Application Number:
  US14/660,637
• Publication Number:
  US 20150310798A1
• Time in Patent Office: 1,113 Days
• CPC Class Codes: G09G 2300/023 Display panel composed of stacked panels
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: G09G 3/2025 the sub-frames having all the same time duration
• CPC Class Codes: G09G 3/36 using liquid crystals

Abstract

System and method of displaying images in temporal superresolution by multiplicative superposition of cascaded display layers integrated in a display device. Using an original video with a target temporal resolution as a priori, a factorization process is performed to derive respective image data for presentation on each display layer. The multiple layers are refreshed in staggered intervals to synthesize a video with an effective refresh rate exceeding that of each individual display layer, e.g., by a factor equal to the number of layers. Further optically averaging neighboring pixels can minimize artifacts.

Claims

1. A method of display videos on a display device, said method comprising:

accessing first frames representing a video content;

accessing second frames representing said video content;

displaying said video content on said display device, wherein said display device comprises a first display layer and a second display layer disposed in a cascaded manner, wherein said displaying comprises;

rendering said first frames for display on said first display layer in a first frame rate; and

rendering said second frames for display on said second display layer in a second frame rate,

wherein said rendering said first frames and said rendering said second frames comprises refreshing said first display layer and said second display layer in a temporally staggered manner,

wherein further an effective frame rate of said displaying said video content is greater than said first frame rate and said second frame rate.

2. The method of claim 1, wherein said temporally staggered manner comprises offsetting said rendering said second frames from said rendering said first frames by a half frame refresh period.

3. The method of claim 1 further comprising:

accessing original data representing said video content, wherein said original data is operable to be displayed in an original frame rate that is greater than said first frame rate and said second frame rate;

deriving said first frames and said second frames by factorizing said original data in according to an iteration method.

4. The method of claim 3, wherein said deriving further comprises incorporating an optical blurring in said first frames and said second frames.

5. The method of claim 1, wherein said first display layer and said second display layer are spatially aligned.

6. The method of claim 1, wherein said first display layer overlays and is offset from said second display layer with a lateral shift in two orthogonal directions by a fraction of a pixel of said first display layer.

7. The method of claim 1, wherein said original data represents a number of frames, and wherein said first frames and said second frames respectively comprise said number of frames.

8. The method of claim 1, wherein said display device comprises L display layers, wherein L is an integer greater than 1, and wherein further a frame refresh time of a respective display layer of said L display layers is temporally staggered from a frame refresh time of an adjacent display layer by 1/L of a frame refresh cycle.

9. A method of rendering real-time display, said method comprising:

accessing original data representing a video content in an original frame rate;

factorizing said original data to derive;

first frames representing said video content in a first frame rate; and

second frames representing said video content in a second frame rate;

rendering said first frames for display on a first display layer of a display device;

rendering said second frames for display on a second display layer of said display device, wherein said first display layer overlays said second display layer, and wherein further an effective frame rate of said display device for displaying said video content resulted from said renderings is greater than said first frame rate and said second frame rate, wherein said rendering said first frames and said rendering said second frame comprise refreshing said first display layer and said second display layer in a temporally staggered manner.

10. The method of claim 9, wherein said display device comprises L display layers, wherein L is an integer greater than 1, and wherein further a frame refresh time of a respective display layer of said L display layers is temporally staggered from a frame refresh time of an adjacent display layer by 1/L of a frame refresh cycle.

11. The method of claim 9, wherein pixels of said first display layer are spatially aligned with pixels of said second layer.

12. The method of claim 9, wherein pixels of said first display layer are spatially offset with pixels of said second layer by a fraction of pixel.

13. The method of claim 9, wherein said factorizing comprises performing a multiplicative update process.

14. A display system comprising:

a plurality of display layers disposed in a cascaded manner and comprising a first display layer and a second display layer;

frame buffers coupled to said plurality of display layers;

a processor coupled to said plurality of display layers;

memory coupled to said processor and comprising instructions that, when executed by said processor, implement a method of presenting a video content at an effective frame rate, said method comprising;

accessing first frames representing said video content;

accessing second frames representing said video content;

rendering said first frames for display on said first display layer in a first frame rate; and

rendering said second frames for display on said second display layer in a second frame rate,

wherein said rendering said first frames and said rendering said second frames comprise refreshing said first display layer and said second display layer in a temporally staggered manner, and

wherein further said effective frame rate of said displaying said video content is greater than said first frame rate and said second frame rate.

15. The display system of claim 14, wherein said first frames and said second frames are derived by factorizing original data that represents said video content in an original frame rate, wherein said effective frame rate is substantially equal to said original frame rate.

16. The display system of claim 14, wherein a frame refresh time of said first display layer deviates a frame refresh time of said second display layer by a half frame refresh period.

17. The display system of claim 14 further comprising a diffusing optical element disposed in front of said plurality of display layers.

18. The display system of claim 14, wherein corresponding pixels of said plurality of display layers are spatially aligned with respect to each other.

19. The display system of claim 14 further comprising color filter arrays coupled to said plurality of display layers, wherein said plurality of display layers comprise one of liquid crystal panels (LCDs) of a flat panel display, multiple types of display panels, and a liquid crystal on silicon (LCoS) panels of a digital projector.