Method of vision correction in a virtual reality environment

• US 10,204,599 B2
• Filed: 11/30/2016
• Issued: 02/12/2019
• Est. Priority Date: 05/27/2016
• Status: Active Grant

• Current Assignee: Beijing Pico Technology Co., Ltd (Qingdao PICO Technology Company Limited)
• Original Assignee: Beijing Pico Technology Co., Ltd (Qingdao PICO Technology Company Limited)
• Inventors: Li, Wei
• Primary Examiner(s): Lam, Vinh T
• Application Number:
  US15/364,629
• Publication Number:
  US 20170345400A1
• Time in Patent Office: 804 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 2320/0606 Manual adjustment
• CPC Class Codes: G09G 2320/068 for control of viewing angle adjustment
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/38 with means for controlling the display position

Abstract

A method of vision correction in a virtual reality environment, comprising: judging if a user is for the first time entering the virtual reality environment, if yes, providing the user with an initial visual position; monitoring in real time action of the user, and judging if the user is in a stable state in the virtual reality environment; if the user is in a stable state, adjusting the visual position of the user according to change of sight lines of the user; and if the user is in an unstable state, renewedly providing the user with an initial visual position; and monitoring in real time change of a scene in the virtual reality environment, and if the scene is taking discontinuous switching, renewedly providing the user with an initial visual position according to a new scene. The present disclosure performs automatic vision correction according to the usage scenes and the cognition custom of the user, which reduces user operation and improves the user experience.

Claims

1. A method of vision correction in a virtual reality environment, comprises:

judging if a user is for the first time entering the virtual reality environment, and when the user is for the first time entering the virtual reality environment, providing the user with an initial visual position;

monitoring in real time action of the user, and judging if the user is in a stable state in the virtual reality environment;

when the user is in a stable state, adjusting the visual position of the user according to change of sight lines of the user; and

when the user is in an unstable state, renewedly providing the user with an initial visual position; and

monitoring in real time change of a scene in the virtual reality environment, and when the scene of the virtual reality environment is taking discontinuous switching, renewedly providing the user with an initial visual position according to a new scene.

2. The method of vision correction in a virtual reality environment according to claim 1, wherein the judging if a user is for the first time entering the virtual reality environment specifically comprises:

providing a distance/light sensor on a virtual reality head-mounted device or utilizing a distance/light sensor already provided on a virtual reality head-mounted device, to monitor in real time a distance between the virtual reality head-mounted device and head of the user; and

when the distance/light sensor monitors that at a certain time moment the distance between the virtual reality head-mounted device and the head of the user becomes less than a preset distance from greater than the preset distance, determining that the user is for the first time entering the virtual reality environment at the time moment.

3. The method of vision correction in a virtual reality environment according to claim 1, wherein the judging if a user is for the first time entering the virtual reality environment specifically comprises:

when a certain virtual reality application starts up, determining that the user is for the first time entering the virtual reality environment at the time moment when the virtual reality application starts up.

4. The method of vision correction in a virtual reality environment according to claim 2, wherein the monitoring in real time action of the user, and judging if the user is in a stable state in the virtual reality environment specifically comprises:

providing a geomagnetic sensor, a gyroscope and an accelerometer on a virtual reality head-mounted device or utilizing a geomagnetic sensor, a gyroscope and an accelerometer already provided on a virtual reality head-mounted device, to monitor in real time the action of the head of the user, and if amplitude or speed of the action exceeds a preset threshold, determining that the user is in an unstable state, or else determining that the user is in a stable state.

5. The method of vision correction in a virtual reality environment according to claim 1, wherein the method further comprises:

providing the user with an interface for manually performing vision correction, to enable the user to adjust the visual position by the interface according to his own needs.

6. The method of vision correction in a virtual reality environment according to claim 5, wherein the providing the user with an interface for manually performing vision correction specifically comprises:

connecting a joystick to a virtual reality head-mounted device, and setting a correspondence relation between instructions of the vision correction and keys of the joystick; and

when a certain key of the joystick is pressed down, sending a corresponding vision correction instruction to the virtual reality head-mounted device, to correspondingly adjust the current visual position of the user or renewedly provide the user with an initial visual position.

7. The method of vision correction in a virtual reality environment according to claim 5, wherein the providing the user with an interface for manually performing vision correction specifically comprises:

defining a unique hand gesture corresponding to each of the instructions of the vision correction;

when it is monitored that the user makes a certain predefined hand gesture, sending a corresponding vision correction instruction to the virtual reality head-mounted device, to correspondingly adjust the current visual position of the user or renewedly provide the user with an initial visual position.

8. The method of vision correction in a virtual reality environment according to claim 5, wherein the providing the user with an interface for manually performing vision correction specifically comprises:

defining a unique voice instruction corresponding to each of the instructions of the vision correction;

when it is monitored that the user makes a certain predefined voice instruction, sending a corresponding vision correction instruction to the virtual reality head-mounted device, to correspondingly adjust the current visual position of the user or renewedly provide the user with an initial visual position.

9. The method of vision correction in a virtual reality environment according to claim 5, wherein the providing the user with an interface for manually performing vision correction specifically comprises:

defining a unique eye action corresponding to each of the instructions of the vision correction;

when it is monitored that the user makes a predefined eye action, sending a corresponding vision correction instruction to the virtual reality head-mounted device, to correspondingly adjust the current visual position of the user or renewedly provide the user with an initial visual position.

10. The method of vision correction in a virtual reality environment according to claim 5, wherein the providing the user with an interface for manually performing vision correction specifically comprises:

displaying in the virtual reality environment a correction button corresponding to each of the instructions of the vision correction; and

when a certain correction button is pressed down by the user, sending a corresponding vision correction instruction to a virtual reality head-mounted device, to correspondingly adjust the current visual position of the user or renewedly provide the user with an initial visual position.

11. The method of vision correction in a virtual reality environment according to claim 3, wherein the monitoring in real time action of the user, and judging if the user is in a stable state in the virtual reality environment specifically comprises:

providing a geomagnetic sensor, a gyroscope and an accelerometer on a virtual reality head-mounted device or utilizing a geomagnetic sensor, a gyroscope and an accelerometer already provided on a virtual reality head-mounted device, to monitor in real time the action of the head of the user, and if amplitude or speed of the action exceeds a preset threshold, determining that the user is in an unstable state, or else determining that the user is in a stable state.