Method and device for processing display data

• US 10,620,903 B2
• Filed: 11/17/2017
• Issued: 04/14/2020
• Est. Priority Date: 06/09/2017
• Status: Active Grant

• Current Assignee: Goertek Incorporated
• Original Assignee: Goertek Incorporated
• Inventors: Dai, Tianrong, Zhu, Yuge, Zhao, Dachuan, Chen, Xiang
• Primary Examiner(s): Beutel, William A
• Application Number:
  US15/761,174
• Publication Number:
  US 20190235817A1
• Time in Patent Office: 879 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 2210/08 Bandwidth reduction
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G09G 2310/0232 Special driving of display border areas
• CPC Class Codes: G09G 2320/0686 with two or more screen areas displaying information with different brightness or colours
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 5/00 Details of television systems scanning details or combination thereof with generation of supply voltages H04N3/00

Abstract

A method for processing display data and a virtual reality device. The method comprises: the host divides the display area into a central area and an edge area according to the field of view of a head-mounted display; segments each frame of the display data into first display data corresponding to the central area and second display data corresponding to the edge area; processes the first display data and the second display data according to a first transmission factor and a second transmission factor to obtain first transmission data and second transmission data and sends them to the head-mounted display; and the head-mounted display performs image reconstruction to the received first transmission data and second transmission data, to obtain the displayed image corresponding to the frame of display data, and outputs and display it. The virtual reality device comprises the above host and head-mounted display.

Claims

1. A virtual reality device, comprising a host and a head-mounted display, wherein

the host divides a display area of the head-mounted display into a central area and an edge area according to a field of view of the head-mounted display;

segments display data to be transmitted of each frame into first display data corresponding to the central area and second display data corresponding to the edge area, according to ranges of the central area and the edge area;

processes the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data, wherein a bandwidth occupied by the second transmission data is less than a bandwidth occupied by the first transmission data; and

sends the first transmission data and the second transmission data to the head-mounted display; and

the head-mounted display receives the first transmission data and the second transmission data sent by the host, performs image reconstruction to the received first transmission data and second transmission data, to obtain a displayed image corresponding to the frame of display data, and outputting and displaying the displayed image;

wherein that the head-mounted display performs image reconstruction to the received first transmission data and second transmission data comprises;

the head-mounted display judges whether data content of the second transmission data is void, and if the data content of the second transmission data is void, reuses image data of the edge area corresponding to a last frame of displayed image, and performs splicing processing to the image data of the edge area and the image data corresponding to the first transmission data, to obtain a displayed image corresponding to the frame of display data; and

if the data content of the second transmission data is not void, judges whether a second display resolution of the second transmission data is less than a first display resolution of the first transmission data, and if the second display resolution of the second transmission data is less than the first display resolution of the first transmission data, performs image reconstruction of the first display resolution to the second transmission data by difference value processing, and composites the second transmission data after the image reconstruction and the first transmission data into one frame of displayed image to output and display; and

if the second display resolution of the second transmission data is equal to the first display resolution of the first transmission data, composites the first transmission data and the second transmission data into one frame of displayed image to output and display.

2. The virtual reality device according to claim 1, wherein that the host processes the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data comprises:

the host sets the first display resolution and the second display resolution according to a bandwidth of a data transmission channel, wherein the second display resolution is less than the first display resolution; and

presets the first transmission factor as the first display resolution, and presets the second transmission factor as the second display resolution, and sets a display resolution of the first display data corresponding to the central area to be the first display resolution, and sets a display resolution of the second display data corresponding to the edge area to be the second display resolution, to obtain the first transmission data and the second transmission data.

3. The virtual reality device according to claim 1, wherein that the host processes the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data comprises:

the host sets a first display refresh rate and a second display refresh rate according to a bandwidth of a data transmission channel, wherein the second display refresh rate is less than the first display refresh rate;

presets the first transmission factor as the first display refresh rate, and presets the second transmission factor as the second display refresh rate; and

sets a display refresh rate of the first display data corresponding to the central area to be the first display refresh rate, and sets a display refresh rate of the second display data corresponding to the edge area to be the second display refresh rate, to obtain the first transmission data and the second transmission data.

4. The virtual reality device according to claim 1, wherein that the host processes the first display data and the second display data respectively according to a preset first transmission factor and a preset second transmission factor, to obtain first transmission data and second transmission data comprises:

the host sets a first display resolution, a first display refresh rate, a second display resolution and a second display refresh rate according to a bandwidth of a data transmission channel, wherein the second display resolution is less than the first display resolution, and the second display refresh rate is less than the first display refresh rate;

presets the first transmission factor as the first display resolution and the first display refresh rate, and presets the second transmission factor as the second display resolution and the second display refresh rate; and

sets a display resolution and a display refresh rate of the first display data corresponding to the central area respectively to be the first display resolution and the first display refresh rate, and sets a display resolution and a display refresh rate of the second display data corresponding to the edge area respectively to be the second display resolution and the second display refresh rate, to obtain the first transmission data and the second transmission data.

5. The virtual reality device according to claim 1, wherein that the host divides a display area of the head-mounted display into a central area and an edge area according to a field of view of the head-mounted display comprises:

the host acquires a horizontal field of view and a vertical field of view for dividing the display area, sets an area enclosed by the horizontal field of view and the vertical field of view to be the central area, and sets the remaining area of the display area to be the edge area.