METHOD FOR PROCESSING DISPLAY DATA

• US 20200133607A1
• Filed: 12/31/2019
• Published: 04/30/2020
• Est. Priority Date: 06/09/2017
• Status: Active Grant

• Current Assignee: Goertek Incorporated
• Original Assignee: Goertek Incorporated
• Inventors: DAI, Tianrong, ZHU, Yuge, ZHAO, Dachuan, CHEN, Xiang
• Granted Patent: US 11,106,422 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 2210/08 Bandwidth reduction
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G09G 2310/0232 Special driving of display border areas
• CPC Class Codes: G09G 2320/0686 with two or more screen areas displaying information with different brightness or colours
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 5/00 Details of television systems scanning details or combination thereof with generation of supply voltages H04N3/00

Abstract

A method for processing display data comprises: the host divides the display area into a central area and an edge area according to the field of view of a head-mounted display; segments each frame of the display data into first display data corresponding to the central area and second display data corresponding to the edge area; processes the first display data and the second display data according to a first transmission factor and a second transmission factor to obtain first transmission data and second transmission data and sends them to the head-mounted display; and the head-mounted display performs image reconstruction to the received first transmission data and second transmission data, to obtain the displayed image corresponding to the frame of display data, and outputs and display it.

Claims

1. A method for processing display data, applied to a host of a virtual reality device, wherein the method comprises the steps of:

dividing a display area of a head-mounted display into a central area and an edge area according to a field of view of the head-mounted display of the virtual reality device;

segmenting display data to be transmitted of each frame into first display data corresponding to the central area and second display data corresponding to the edge area, according to ranges of the central area and the edge area;

processing the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data, wherein a bandwidth occupied by the second transmission data is less than a bandwidth occupied by the first transmission data; and

sending the first transmission data and the second transmission data to the head-mounted display.

2. The method for processing display data according to claim 1, wherein the step of processing the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data comprises the steps of:

setting a first display resolution and a second display resolution according to a bandwidth of a data transmission channel, wherein the second display resolution is less than the first display resolution;

presetting the first transmission factor as the first display resolution, and presetting the second transmission factor as the second display resolution; and

setting a display resolution of the first display data corresponding to the central area to be the first display resolution, and setting a display resolution of the second display data corresponding to the edge area to be the second display resolution, to obtain the first transmission data and the second transmission data.

3. The method for processing display data according to claim 1, wherein the step of processing the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data comprises the steps of:

setting a first display refresh rate and a second display refresh rate according to a bandwidth of a data transmission channel, wherein the second display refresh rate is less than the first display refresh rate;

presetting the first transmission factor as the first display refresh rate, and presetting the second transmission factor as the second display refresh rate; and

setting a display refresh rate of the first display data corresponding to the central area to be the first display refresh rate, and setting a display refresh rate of the second display data corresponding to the edge area to be the second display refresh rate, to obtain the first transmission data and the second transmission data.

4. The method for processing display data according to claim 1, wherein the step of processing the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data comprises the steps of:

setting a first display resolution, a first display refresh rate, a second display resolution and a second display refresh rate according to a bandwidth of a data transmission channel, wherein the second display resolution is less than the first display resolution; and

the second display refresh rate is less than the first display refresh rate;

presetting the first transmission factor as the first display resolution and the first display refresh rate, and presetting the second transmission factor as the second display resolution and the second display refresh rate; and

setting a display resolution and a display refresh rate of the first display data corresponding to the central area respectively to be the first display resolution and the first display refresh rate, and setting a display resolution and a display refresh rate of the second display data corresponding to the edge area respectively to be the second display resolution and the second display refresh rate, to obtain the first transmission data and the second transmission data.

5. The method for processing display data according to claim 2, wherein the first display resolution remains to be an original display resolution of each frame of the display data;

and the second display resolution is less than the original display resolution.

6. The method for processing display data according to claim 3, wherein the first display refresh rate remains to be an original display refresh rate of the each frame of display data to be transmitted, and the first display refresh rate is an integer multiple of the second display refresh rate.

7. The method for processing display data according to claim 1, wherein the step of dividing a display area of a head-mounted display into the central area and the edge area according to a field of view of the head-mounted display comprises:

acquiring a horizontal field of view and a vertical field of view for dividing the display area; and

setting an area enclosed by the horizontal field of view and the vertical field of view to be the central area, and setting the remaining area of the display area to be the edge area.

8. A method for processing display data, applied to a head-mounted display of a virtual reality device, wherein the method comprises the steps of:

receiving first transmission data and second transmission data that are sent by a host of the virtual reality device, wherein a bandwidth occupied by the second transmission data is less than a bandwidth occupied by the first transmission data, and the first transmission data and the second transmission data are obtained by segmenting each frame of the display data according to ranges of a central area and an edge area to obtain first display data and second display data and then processing the first display data and the second display data by using a first transmission factor and a second transmission factor, wherein the central area and the edge area are obtained by dividing a display area of the head-mounted display according to a field of view of the head-mounted display;

performing image reconstruction to the received first transmission data and second transmission data, to obtain a displayed image corresponding to the frame of display data; and

outputting and displaying the displayed image.

9. The method for processing display data according to claim 8, wherein the step of performing image reconstruction to the received first transmission data and second transmission data comprises the steps of:

judging whether data content of the second transmission data is void, and if the data content of the second transmission data is void, reusing image data of the edge area corresponding to the last frame of displayed image, and performing splicing processing to the image data of the edge area and the image data corresponding to the first transmission data, to obtain a displayed image corresponding to the frame of display data;

if the data content of the second transmission data is not void, judging whether a display resolution of the second transmission data is less than a display resolution of the first transmission data,

if the display resolution of the second transmission data is less than the display resolution of the first transmission data, performing image reconstruction of the first display resolution to the second transmission data by difference value processing, and compositing the second transmission data after the image reconstruction and the first transmission data into one frame of displayed image to output and display; and

if the display resolution of the second transmission data is equal to the display resolution of the first transmission data, compositing the first transmission data and the second transmission data into one frame of displayed image to output and display.