Gesture-based reorientation and navigation of a virtual reality (VR) interface

• US 9,886,086 B2
• Filed: 09/02/2015
• Issued: 02/06/2018
• Est. Priority Date: 08/21/2015
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Inventors: Diament, Layton R., Khalid, Mohammad Raheel
• Primary Examiner(s): Mazumder, Tapas
• Application Number:
  US14/843,362
• Publication Number:
  US 20170053443A1
• Time in Patent Office: 888 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0443 using a single layer of sensing electrodes
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images

Abstract

A virtual reality (VR) device presents a virtual environment and detects an input that relates to a contact by a user. The VR device identifies attributes of the input, and the attributes include, for example, a portion of the VR device associated with the contact, a duration of the contact, and a direction of motion of the contact. The VR device modifies the presented virtual environment based on the input attributes, such as presenting a default view of the virtual environment when a first type of input is detected; moving a virtual horizon when a second type of input is detected; enlarging a depicted virtual object when a third type of input is detected; presenting a menu of options when a fourth type of input is detected; and capturing and presenting an image or video of the user'"'"'s actual surroundings when a fifth type of input is detected.

Claims

1. A method comprising:

presenting, by a processor associated with a virtual reality (VR) device worn by a user, a virtual environment using first content received via a network from a network device;

detecting, by the processor, a first input by the user, wherein the first input relates to a first contact by the user with the VR device;

identifying, by the processor, attributes of the first input, wherein the attributes include at least one of a location on the VR device associated with the first contact or a direction of motion associated with the first contact;

determining, by the processor and based on the attributes of the first input, that the first input corresponds to a first swipe and a second swipe concurrently made by the user;

rendering, by the processor, a modified version of the presented virtual environment using second content received via the network from the network device based on the identified attributes of the first input, wherein rendering the modified version of the presented virtual environment includes;

moving, when both the first swipe and the second swipe are in an upward or a downward direction, a virtual horizon of the presented virtual environment in the upward or the downward direction, and

re-orienting the virtual horizon when the first and second swipes are in opposing directions;

detecting, by the processor, a second input by the user, wherein the second input relates to a second contact by the user with the VR device;

determining, by the processor, that a duration of the second contact exceeds a threshold amount of time;

capturing, by the processor, at least one of an image or a video of physical surroundings of the user; and

displaying, via a display associated with the VR device, the at least one of the image or the video during the second contact with the VR device.

2. The method of claim 1, wherein the VR device includes touch sensors, and wherein identifying the attributes of the first input includes:

identifying one or more of the touch sensors contacted by the user during the first input.

3. The method of claim 2, wherein the VR device includes a retaining device configured to retain a mobile communications device that includes a capacitive touch screen that displays the presented virtual environment,

wherein the touch sensors are electronically coupled to contact areas of the VR device that are positioned proximate to regions of the capacitive touch screen and can transfer a capacitance from the regions to the touch sensors via the coupling, and

wherein detecting the first input includes detecting, by the capacitive touch screen, a change in the capacitance of the identified one or more of the touch sensors associated with the first input, and wherein the attributes of the first input are identified based on the change in the capacitance.

4. The method of claim 1, further comprising:

detecting, by the processor, a third input by the user, wherein the third input relates to a third contact by the user with the VR device; and

determining, based on the attributes, that the third input corresponds to one or more taps by the user on the VR device,

wherein rendering the modified version of the presented virtual environment further includes;

presenting a default version of the modified version of the presented virtual environment when the third input corresponds to a single tap by the user, and

designating the modified version of the presented virtual environment as the default version when the third input corresponds to multiple taps by the user.

5. The method of claim 1, further comprising:

determining, based on the attributes, that the first swipe corresponds to a first vertical swipe by one of the user'"'"'s hands and the second swipe corresponds to a second vertical swipe by another one of the user'"'"'s hands,

wherein re-orienting the virtual horizon includes;

rotating the virtual horizon when the first vertical swipe is in the upward direction and the second vertical swipe is in the downward direction.

6. The method of claim 1, further comprising:

detecting, by the processor, a third input by the user, wherein the third input relates to a third contact by the user with the VR device; and

determining, based on the attributes, that the first third input corresponds to a horizontal swipe by the user,

wherein rendering the modified version of the presented virtual environment further includes;

presenting, based on the horizontal swipe, a menu that includes one or more user-selectable options for rendering the modified version of the presented virtual environment.

7. The method of claim 1, further comprising:

detecting, by the processor, a third input by the user, wherein the third input relates to a third contact by the user with the VR device; and

determining, based on the attributes, that the third input corresponds to a hand rotation by the user,

wherein rendering the modified version of the presented virtual environment further includes;

enlarging, based on the hand rotation, one or more virtual objects included in the modified version of the presented virtual environment.

8. The method of claim 1,

wherein displaying the image or the video comprises superimposing the at least one of the image or the video over the modified version of the presented virtual environment, and wherein the method further comprises:

ceasing the displaying of the at least one of the image or the video when the user ends the second contact with the VR device.

9. A virtual reality (VR) device comprising:

a memory configured to store instructions; and

a processor configured to execute one or more of the instructions to;

present a virtual environment using first content received via a network from a network device;

detect a first input by a user, wherein the first input relates to a contact by the user with the VR device;

identify attributes of the first input, wherein the attributes include at least one of a location on the VR device associated with the first contact or a direction of motion associated with the first contact;

determine, based on the attributes of the first input, that the first input corresponds to a first swipe and a second swipe concurrently made by the user;

render a modified version of the presented virtual environment using second content received via the network from the network device based on the identified attributes of the first input, wherein to render the modified version of the presented virtual environment the processor is further configured to;

move, when both the first swipe and the second swipe are in an upward or a downward direction, a virtual horizon of the presented virtual environment in the upward or the downward direction, and

re-orient the virtual horizon when the first and second swipes are in opposing directions;

detect a second input by the user, wherein the second input relates to a second contact by the user with the VR device;

determine that a duration of the second contact exceeds a threshold amount of time;

capture, based on the determination, at least one of an image or a video of physical surroundings of the user; and

display, via a display associated with the VR device, the at least one of the image or the video during the second contact with the VR device.

10. The VR device of claim 9, further comprising:

touch sensors,

wherein the processor, when identifying the attributes of the first input, is further configured to;

identify one or more of the touch sensors contacted by the user during the first input.

11. The VR device of claim 10, further comprising:

a retaining device configured to retain a mobile communications device that includes a capacitive touch screen that displays the presented virtual environment;

contact areas positioned proximate to regions of the capacitive touch screen to transfer a capacitance from the regions to the touch sensors; and

leads that communicate the capacitance from the contact areas to the touch sensors,

wherein the processor, when detecting the first input, is further configured to detect a change in the capacitance of the identified one or more of the touch sensors associated with the first input, and wherein the processor is further configured to identify the attributes of the first input based on the change in the capacitance.

12. The VR device of claim 9, further comprising:

a motion sensor configured to detect a first head rotation by the user in a first direction, wherein the first head rotation is associated with an angle of rotation, and

wherein the processor is further configured to;

determine whether the angle of rotation exceeds a threshold, and

present a user interface when the angle of rotation exceeds the threshold.

13. The VR device of claim 12, wherein the motion sensor is further configured to detect, after the first head rotation, a second head rotation by the user, wherein the second head rotation is in a second direction that differs from the first direction;

and

wherein the processor is further configured to cease presenting the user interface based on detecting the second head rotation.

14. The VR device of claim 12, wherein the user interface includes graphical option elements that identify options that are selectable by the user and a graphical selection element that identifies one of the graphical option elements being selected by the user,

wherein the motion sensor is further configured to detect, after the first head rotation, a second head rotation by the user, and

wherein the processor is further configured to move the graphical selection element among the graphical option elements based on the second head rotation.

15. The VR device of claim 9, wherein the processor, when displaying the image or the video, is further configured to superimpose the at least one of the image or the video over the modified version of the presented virtual environment, and

wherein the processor, when rendering the modified version of the presented virtual environment, is further configured to:

cease the display of the at least one of the image or the video when the user ends the second contact with the VR device.

16. A non-transitory computer-readable medium to store instructions, wherein the instructions comprise:

one or more instructions that, when executed by a processor associated with a virtual reality (VR) device worn by a user, cause the processor to;

present a virtual environment using first content received via a network from a network device;

detect a first input by the user, wherein the first input relates to a first contact by the user with the VR device;

identify attributes of the first input, wherein the attributes include at least one of a location on the VR device associated with the first contact or a direction of motion associated with the first contact;

determine, based on the attributes of the first input, that the first input corresponds to multiple vertical swipes concurrently made by the user;

render a modified version of the presented virtual environment using second content received via the network from the network device based on the identified attributes of the first input, wherein to render the modified version of the presented virtual environment the instructions further cause the processor to;

move, when both the first swipe and the second swipe are in an upward or a downward direction, a virtual horizon of the presented virtual environment in the upward or the downward direction, and

re-orient the virtual horizon when the first and second swipes are in opposing directions;

detect a second input by the user, wherein the second input relates to a second contact by the user with the VR device;

determine that a duration of the second contact exceeds a threshold amount of time;

capture, based on the determination, at least one of an image or a video of physical surroundings of the user; and

display, via a display associated with the VR device, the at least one of the image or the video during the second contact of the VR device.

17. The non-transitory computer-readable medium of claim 16, wherein the VR device further includes touch sensors, and wherein the one or more instructions cause the processor, when identifying the attributes of the first input, to:

identify one or more of the touch sensors contacted by the user during the first input.

18. The non-transitory computer-readable medium of claim 17, wherein the VR device further includes:

a retaining device configured to retain a capacitive touch screen that displays the presented virtual environment,

contact areas positioned proximate to regions of the capacitive touch screen to communicate a capacitance from the regions to the touch sensors, and

leads that communicate the capacitance from the contact areas to the touch sensors, and

wherein the one or more instructions cause the processor, when detecting the first input, to detect a change in the capacitance of the identified one or more of the touch sensors associated with the first input, and wherein the attributes of the first input are identified based on the change in the capacitance.

19. The non-transitory computer-readable medium of claim 16, wherein the one or more instructions further cause the processor to:

detect a third input by the user, wherein the third input relates to a third contact by the user with the VR device; and

determine, based on the attributes, that the further input corresponds to one or more taps by the user on the VR device,

wherein the one or more instructions further cause the processor, when rendering the modified version of the presented virtual environment, to;

present a default version of the presented virtual environment when the third input corresponds to a single tap by the user, and

designate the presented virtual environment as the default version when the first third input corresponds to multiple taps by the user.

20. The non-transitory computer-readable medium of claim 16, wherein the one or more instructions further cause the processor, when rendering the modified version of the presented virtual environment, to:

superimpose the image or the video over the modified version of the presented virtual environment.