Methods and apparatus to align components in virtual reality environments

• US 10,198,874 B2
• Filed: 05/12/2017
• Issued: 02/05/2019
• Est. Priority Date: 05/13/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Dearman, David, Li, Chun Yat Frank, Morse, Erica
• Primary Examiner(s): Davis, Tony
• Application Number:
  US15/594,186
• Publication Number:
  US 20170330387A1
• Time in Patent Office: 634 Days
• Field of Search: 345173, 345690, 345156
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts

Abstract

Systems, devices, methods, computer program products, and electronic apparatuses for aligning components in virtual reality environments are provided. An example method includes detecting a first input from a handheld controller of a virtual reality system, responsive to detecting the first input, instructing a user to orient a handheld controller in a designated direction, detecting a second input from the handheld controller; and responsive to detecting the second input, storing alignment data representative of an alignment of the handheld controller.

Claims

1. A method comprising:

detecting a first input from a handheld controller of a virtual reality system;

responsive to detecting the first input;

communicatively coupling the handheld controller to a head-mounted display of the virtual reality system; and

instructing a user to orient a handheld controller in a designated direction;

detecting a second input from the handheld controller; and

responsive to detecting the second input;

determining a controller orientation of the handheld controller;

determining a display orientation of the head-mounted display; and

storing alignment data representative of an alignment of the handheld controller, the alignment data including data representative of an offset between the determined controller orientation and the determined display orientation.

2. The method of claim 1, wherein communicatively coupling comprises establishing a connection via a short-range wireless signal.

3. The method of claim 1, further comprising aligning at least a portion of a virtual reality scene displayed by the head-mounted display based on the alignment data.

4. The method of claim 1, wherein storing alignment data representative of the alignment of the handheld controller comprises storing at least one of a forward/back position, an up/down position, a left/right position, a pitch, a roll, and a yaw.

5. The method of claim 1, wherein detecting the first input comprises detecting an actuation of an input device of the handheld controller.

6. The method of claim 5, wherein detecting the actuation of the input device comprises detecting a press of a button of the handheld controller.

7. The method of claim 5, wherein detecting the second input comprises detecting a release of an input device of the handheld controller.

8. The method of claim 7, wherein detecting the release of an input device comprised detecting the release of a button.

9. A computer program product comprising a non-transitory storage medium, the computer program product including code that, when executed by processing circuitry of a virtual reality system configured to produce a virtual reality environment, causes the processing circuitry to perform a method, the method comprising:

detecting a first input from a handheld controller of the virtual reality system;

responsive to detecting the first input;

communicatively coupling the handheld controller to a head-mounted display of the virtual reality system; and

instructing a user to orient a handheld controller in a designated direction;

detecting a second input from the handheld controller; and

responsive to detecting the second input;

determining a controller orientation of the handheld controller;

determining a display orientation of the head-mounted display; and

storing alignment data representative of an alignment of the handheld controller, the alignment data including data representative of an offset between the determined controller orientation and the determined display orientation.

10. The computer program product of claim 9, wherein communicatively coupling comprises establishing a connection via a short-range wireless signal.

11. The computer program product of claim 9, further comprising aligning at least a portion of a virtual reality scene displayed by the head-mounted display based on the alignment data.

12. The computer program product of claim 9, wherein instructing a user to orient a handheld controller in a designated direction comprises displaying instructions within a virtual reality scene displayed by the head-mounted display.

13. An electronic apparatus configured to produce a virtual reality environment, the electronic apparatus comprising:

a memory; and

controlling circuitry coupled to the memory, the controlling circuitry being configured to;

detect a first input from a handheld controller of the virtual reality system;

responsive to detecting the first input;

communicatively couple the handheld controller to a head-mounted display of the virtual reality system via a wireless signal; and

instruct a user to orient a handheld controller in a designated direction;

detect a second input from the handheld controller; and

responsive to detecting the second input;

determine a controller orientation of the handheld controller;

determine a display orientation of a head-mounted display; and

store alignment data representative of an alignment of the handheld controller, the alignment data including data representative of an offset between the determined controller orientation and the determined display orientation.

14. The electronic apparatus of claim 13, the controlling circuitry being further configured to coordinate movement of the handheld controller and the head-mounted display in a virtual reality scene based on the stored alignment data.