INFORMATION INPUT METHOD IN 3D IMMERSIVE ENVIRONMENT

• US 20170301138A1
• Filed: 10/13/2016
• Published: 10/19/2017
• Est. Priority Date: 04/15/2016
• Status: Active Grant

• Current Assignee: Beijing Pico Technology Co., Ltd (Qingdao PICO Technology Company Limited)
• Original Assignee: Beijing Pico Technology Co., Ltd (Qingdao PICO Technology Company Limited)
• Inventors: HAN, Jin
• Granted Patent: US 10,417,826 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04892 Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key arrangements for controlling cursor position based on coordinate signals G06F3/038
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

The present disclosure discloses an information input method in a 3D immersive environment, comprising: displaying a virtual keyboard in the 3D immersive environment; selecting a key position on the virtual keyboard and determining the selected key position; and sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box to thereby complete information input for one time. Displaying the virtual keyboard to the user in the 3D immersive environment and receiving the user'"'"'s selection and confirmation instruction of the key position on the virtual keyboard solves the problem that the user, wearing the virtual reality headset device, cannot see actual key positions of a keyboard in reality and cannot input information and enables the user to conveniently and quickly input information by typewriting in the virtual environment.

Claims

1. An information input method in a 3D immersive environment, wherein the method comprises:

displaying a virtual keyboard in the 3D immersive environment;

selecting a key position on the virtual keyboard and determining the selected key position; and

sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box to thereby complete information input for one time.

2. The information input method in a 3D immersive environment according to claim 1, wherein,

a system where the 3D immersive environment lies comprises a handle;

the selecting a key position on the virtual keyboard and determining the selected key position specifically comprises;

setting a certain key position of the virtual keyboard as an initial selected key position; and

sending a key position selection instruction via up, down, left or right direction key of the handle, and taking a key position adjacent to the currently-selected key position in a corresponding direction as a new selected key position.

3. The information input method in a 3D immersive environment according to claim 1, wherein,

a system where the 3D immersive environment lies comprises a handle having a gyroscope function;

the selecting a key position on the virtual keyboard and determining the selected key position specifically comprises;

displaying a virtual cursor in the immersive environment;

collecting spatial movement information of the handle via the gyroscope of the handle, and controlling movement of the virtual cursor in the immersive environment;

moving the handle to control the virtual cursor to move into a area of the virtual keyboard, and changing the virtual cursor into a selection box for selecting a key position; and

moving the handle to control the selection box to move to a certain key position of the virtual keyboard, and taking the key position where the selection box lies as the selected key position.

4. The information input method in a 3D immersive environment according to claim 2, wherein, the sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box specifically comprises:

binding the confirmation instruction to a certain key on the handle;

when the key is pressed, sending the confirmation instruction to the selected key position, and inputting information corresponding to the current selected key position into the information input box.

5. The information input method in a 3D immersive environment according to claim 1, wherein,

a system where the 3D immersive environment lies comprises a handle on which a touch panel is disposed;

or, a touch panel is disposed on a headset device of a system where the 3D immersive environment lies;

the selecting a key position on the virtual keyboard and determining the selected key position specifically comprises;

displaying a virtual cursor in the immersive environment;

sliding a finger up, down, to the left or to the right on a surface of the touch panel, controlling the virtual cursor to move into the area of the virtual keyboard, and changing the virtual cursor into a selection box for selecting a key position; and

sliding a finger up, down, to the left or to the right on a surface of the touch panel to control the selection box to move to a certain key position of the virtual keyboard, and taking the key position where the selection box lies as the selected key position.

6. The information input method in a 3D immersive environment according to claim 5, wherein the sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box specifically comprises:

binding the confirmation instruction to a certain key on the handle;

when the key is pressed, sending the confirmation instruction to the selected key position, and inputting information corresponding to the current selected key position into the information input box;

or, by clicking the touch panel one time, sending the confirmation instruction to the selected key position, and inputting information corresponding to the current selected key position into the information input box.

7. The information input method in a 3D immersive environment according to claim 1, wherein the selecting a key position on the virtual keyboard and determining the selected key position specifically comprises:

locking the virtual keyboard in the immersive environment so that the virtual keyboard does not change the position along with the user'"'"'s head motion;

displaying the virtual cursor straight ahead the user'"'"'s sight line in the immersive environment so that the virtual cursor moves along with the user'"'"'s head motion; and

controlling the virtual cursor to a certain key position of the virtual keyboard through the head motion and taking the key position where the virtual cursor lies as the selected key position.

8. The information input method in a 3D immersive environment according to claim 7, wherein the sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box specifically comprises:

when a time period for which the virtual cursor stays on the selected key position reaches a preset value, sending the confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into the information input box;

or, a system where the 3D immersive environment lies comprises a handle, binding the confirmation instruction to a certain key on the handle;

when the key is pressed, inputting information corresponding to the current selected key position into the information input box.

9. The information input method in a 3D immersive environment according to claim 3, wherein, the sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box specifically comprises:

binding the confirmation instruction to a certain key on the handle;

when the key is pressed, sending the confirmation instruction to the selected key position, and inputting information corresponding to the current selected key position into the information input box.