Image display method, custom method of shaped cambered curtain, and head-mounted display device

• US 10,643,300 B2
• Filed: 07/30/2018
• Issued: 05/05/2020
• Est. Priority Date: 03/28/2016
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Yu, Zhixiong, Wang, Yao
• Primary Examiner(s): Robinson, Terrell M
• Application Number:
  US16/049,335
• Publication Number:
  US 20180365797A1
• Time in Patent Office: 645 Days
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually

Abstract

The present disclosure relates to an image display method performed by a head-mounted display device. The device establishes a rectangular projection plane model that shares a same aspect ratio with a picture shot by a lens and then transforms the rectangular projection plane model into a shaped projection plane model through anti-distortion processing. Next, the device defines a shaped cambered spherical model by intersecting the shaped projection plane model with a spherical model according to a horizontal field angle and a vertical field angle of the lens and then projects an original distorted image onto the shaped cambered spherical model to remove image distortion. Finally, the device displays the image rendered on the shaped cambered spherical model.

Claims

1. An image display method performed at a head-mounted device having one or more processors and memory storing a plurality of programs to be executed by the one or more processors, the method comprising:

obtaining an original distorted image;

establishing a rectangular projection plane model that shares a same aspect ratio with a picture shot by a lens;

transforming the rectangular projection plane model into a shaped projection plane model through anti-distortion processing;

establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively;

casting, from a spherical center of the spherical model, rays to four edges of the shaped projection plane model, wherein a spherical surface of the spherical model intercepted by the rays defines a shaped cambered spherical model;

projecting the original distorted image onto the shaped cambered spherical model to remove image distortion; and

displaying the image rendered on the shaped cambered spherical model.

2. The method according to claim 1, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the shaped projection plane model according to the horizontal field angle of the lens, so that a horizontal center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

3. The method according to claim 1, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the shaped projection plane model according to the vertical field angle of the lens, so that a vertical center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the vertical field angle.

4. The method according to claim 1, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the spherical model according to the horizontal field angle of the lens, so that a horizontal center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

5. The method according to claim 1, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the spherical model according to the vertical field angle of the lens, so that a vertical center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

6. The method according to claim 1, wherein the step of casting, from a spherical center of the spherical model, rays to four edges of the shaped projection plane model, wherein a spherical surface of the spherical model intercepted by the rays defines a shaped cambered spherical model comprises:

casting, from the spherical center of the spherical model, multiple rays to the four edges of the shaped projection plane model, to construct a rectangular pyramid; and

projecting the rectangular pyramid along a radial direction of the spherical model, to intersect with the spherical surface of the spherical model, intercepting a part of the spherical model, and using the intercepted part of the spherical model as the shaped cambered spherical model.

7. A head-mounted display device, comprising memory and one or more processors, the memory storing a plurality of computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform the following steps:

obtaining an original distorted image;

establishing a rectangular projection plane model that shares a same aspect ratio with a picture shot by a lens;

transforming the rectangular projection plane model into a shaped projection plane model through anti-distortion processing;

establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively;

casting, from a spherical center of the spherical model, rays to four edges of the shaped projection plane model, wherein a spherical surface of the spherical model intercepted by the rays defines a shaped cambered spherical model;

projecting the original distorted image onto the shaped cambered spherical model to remove image distortion; and

displaying the image rendered on the shaped cambered spherical model.

8. The head-mounted display device according to claim 7, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the shaped projection plane model according to the horizontal field angle of the lens, so that a horizontal center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

9. The head-mounted display device according to claim 7, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the shaped projection plane model according to the vertical field angle of the lens, so that a vertical center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the vertical field angle.

10. The head-mounted display device according to claim 7, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the spherical model according to the horizontal field angle of the lens, so that a horizontal center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

11. The head-mounted display device according to claim 7, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the spherical model according to the vertical field angle of the lens, so that a vertical center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

12. The head-mounted display device according to claim 7, wherein the step of casting, from a spherical center of the spherical model, rays to four edges of the shaped projection plane model, wherein a spherical surface of the spherical model intercepted by the rays defines a shaped cambered spherical model comprises:

casting, from the spherical center of the spherical model, multiple rays to the four edges of the shaped projection plane model, to construct a rectangular pyramid; and

projecting the rectangular pyramid along a radial direction of the spherical model, to intersect with the spherical surface of the spherical model, intercepting a part of the spherical model, and using the intercepted part of the spherical model as the shaped cambered spherical model.

13. A non-transitory computer readable storage medium storing a plurality of computer-readable instructions that, when executed by one or more processors of a head-mounted display device, cause the one or more processors to perform the following steps:

obtaining an original distorted image;

establishing a rectangular projection plane model that shares a same aspect ratio with a picture shot by a lens;

transforming the rectangular projection plane model into a shaped projection plane model through anti-distortion processing;

establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively;

casting, from a spherical center of the spherical model, rays to four edges of the shaped projection plane model, wherein a spherical surface of the spherical model intercepted by the rays defines a shaped cambered spherical model;

projecting the original distorted image onto the shaped cambered spherical model to remove image distortion; and

displaying the image rendered on the shaped cambered spherical model.

14. The non-transitory computer readable storage medium according to claim 13, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the shaped projection plane model according to the horizontal field angle of the lens, so that a horizontal center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

15. The non-transitory computer readable storage medium according to claim 13, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the shaped projection plane model according to the vertical field angle of the lens, so that a vertical center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the vertical field angle.

16. The non-transitory computer readable storage medium according to claim 13, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the spherical model according to the horizontal field angle of the lens, so that a horizontal center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

17. The non-transitory computer readable storage medium according to claim 13, wherein the establishing a spherical model according to a horizontal field angle and a vertical field angle of the lens, and inscribing the shaped projection plane model to the spherical model, spherical center angles of corresponding directions formed by intersections of the shaped projection plane model and the spherical model in a horizontal direction and a vertical direction corresponding to the horizontal field angle and the vertical field angle of the lens, respectively comprises:

establishing a spherical model, placing the shaped projection plane model to be perpendicular to a radial direction of the spherical model, and equally zooming the spherical model according to the vertical field angle of the lens, so that a vertical center line of the shaped projection plane model is a spherical center angle that corresponds to a chord and that is equal to the horizontal field angle.

18. The non-transitory computer readable storage medium according to claim 13, wherein the step of casting, from a spherical center of the spherical model, rays to four edges of the shaped projection plane model, wherein a spherical surface of the spherical model intercepted by the rays defines a shaped cambered spherical model comprises:

casting, from the spherical center of the spherical model, multiple rays to the four edges of the shaped projection plane model, to construct a rectangular pyramid; and

projecting the rectangular pyramid along a radial direction of the spherical model, to intersect with the spherical surface of the spherical model, intercepting a part of the spherical model, and using the intercepted part of the spherical model as the shaped cambered spherical model.