PERFORMING VIRTUAL REALITY INPUT

• US 20180113599A1
• Filed: 10/24/2017
• Published: 04/26/2018
• Est. Priority Date: 10/26/2016
• Status: Active Grant

• Current Assignee: Advanced New Technologies Company Limited (Ant Group Co., Ltd.)
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Yin, Huanmi
• Granted Patent: US 10,509,535 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images

Abstract

A virtual reality (VR) device presents a virtual element in a VR scenario of a VR application. An effective interaction region (EIR) of the virtual element is determined that the virtual element can effectively interact with. A trajectory of an operational focus of the VR application is determined based on a movement sensed by the VR device. The virtual element is selected if an interaction between the trajectory of the operational focus and the EIR satisfies one or more conditions for triggering a selection event of the virtual button.

Claims

1. A computer-implemented method, comprising:

presenting, by a virtual reality (VR) device, a virtual element in a VR scenario of a VR application;

determining an effective interaction region (EIR) of the virtual element that the virtual element can effectively interact with;

determining a trajectory of an operational focus of the VR application based on a movement sensed by the VR device; and

selecting the virtual element if an interaction between the trajectory of the operational focus and the EIR satisfies one or more conditions for triggering a selection event of the virtual button.

2. The computer-implemented method of claim 1, wherein the EIR overlaps at least a portion of an area of the virtual element.

3. The computer-implemented method of claim 1, wherein the movement sensed by the VR device includes at least one of a head movement or a hand movement.

4. The computer-implemented method of claim 1, wherein the virtual element is a virtual button or a virtual key that is presented for performing user input.

5. The computer-implemented method of claim 1, wherein the operational focus is a cursor presented in the virtual scenario and is determined based on a VR device user'"'"'s visual focus, head position, or hand position.

6. The computer-implemented method of claim 1, wherein the one or more conditions of the interaction include the trajectory intersects with one or more boundaries of the EIR for at least two times.

7. The computer-implemented method of claim 1, wherein the one or more conditions of the interaction include the trajectory of the operational focus forms an enclosure in the EIR.

8. The computer-implemented method of claim 7, wherein the area of the enclosure is greater than a predetermined percentage of an area of the EIR.

9. The computer-implemented method of claim 1, wherein the one or more conditions of the interaction include that the interaction is performed in a time period less than or equal to a predetermined time limit.

10. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

presenting, by a virtual reality (VR) device, a virtual element in a VR scenario of a VR application;

determining an effective interaction region (EIR) of the virtual element that the virtual element can effectively interact with;

determining a trajectory of an operational focus of the VR application based on a movement sensed by the VR device; and

selecting the virtual element if an interaction between the trajectory of the operational focus and the EIR satisfies one or more conditions for triggering a selection event of the virtual button.

11. The non-transitory, computer-readable medium of claim 10, wherein the EIR overlaps at least a portion of an area of the virtual element.

12. The non-transitory, computer-readable medium of claim 10, wherein the movement sensed by the VR device includes at least one of a head movement or a hand movement.

13. The non-transitory, computer-readable medium of claim 10, wherein the virtual element is a virtual button or a virtual key that is presented for performing user input.

14. The non-transitory, computer-readable medium of claim 10, wherein the operational focus is a cursor presented in the virtual scenario and is determined based on a VR device user'"'"'s visual focus, head position, or hand position.

15. The non-transitory, computer-readable medium of claim 10, wherein the one or more conditions of the interaction include the trajectory intersects with one or more boundaries of the EIR for at least two times.

16. The non-transitory, computer-readable medium of claim 10, wherein the one or more conditions of the interaction include the trajectory of the operational focus forms an enclosure in the EIR.

17. The non-transitory, computer-readable medium of claim 16, wherein the area of the enclosure is greater than a predetermined percentage of an area of the EIR.

18. The non-transitory, computer-readable medium of claim 10, wherein the one or more conditions of the interaction include that the interaction is performed in a time period less than or equal to a predetermined time limit.

19. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform operations comprising;

presenting, by a virtual reality (VR) device, a virtual element in a VR scenario of a VR application;

determining an effective interaction region (EIR) of the virtual element that the virtual element can effectively interact with;

determining a trajectory of an operational focus of the VR application based on a movement sensed by the VR device; and

selecting the virtual element if an interaction between the trajectory of the operational focus and the EIR satisfies one or more conditions for triggering a selection event of the virtual button.

20. The computer-implemented system of claim 19, wherein the virtual element is a virtual button or a virtual key that is presented for performing user input.