Virtual reality system, operating method for mobile device, and non-transitory computer readable storage medium

• US 10,282,909 B2
• Filed: 03/23/2017
• Issued: 05/07/2019
• Est. Priority Date: 03/23/2017
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Huang, Guei-Yu, Wang, Kang-Yu
• Primary Examiner(s): Gray, Ryan M
• Application Number:
  US15/466,884
• Publication Number:
  US 20180276893A1
• Time in Patent Office: 775 Days
• Field of Search: None
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

A virtual reality (VR) system includes a VR display device, a first VR controller, a mobile device, and a VR processing device. The VR display device is configured to display a VR environment corresponding to a position and rotating angles of the VR display device. The mobile device is attached to the first VR controller. The VR processing device is configured for acquiring a position and rotating angles of the first VR controller; and transmitting the position and the rotating angles of the first VR controller to the mobile device via a network, so as to allow the mobile device to operably display a VR object of the VR environment corresponding to the position and the rotating angles of the first VR controller.

Claims

1. A virtual reality (VR) system comprising:

a virtual reality display device configured to display a virtual reality environment having a first virtual reality object corresponding to a position and rotating angles of the virtual reality display device;

a first virtual reality controller;

a mobile device attached to a sensor, wherein there is a fixed shift on at least one axis between a position of the sensor and a position of the mobile device; and

a virtual reality processing device configured for;

acquiring the position and rotating angles of the sensor from the sensor through a connection between the sensor and the virtual reality processing device; and

transmitting the position and the rotating angles of the sensor to the mobile device via a network,

wherein the mobile device acquires the position of the mobile device according to the position of the sensor, and operably displays the first virtual reality object according to the position and rotating angles of the mobile device.

2. The virtual reality system as claimed in claim 1, wherein the mobile device is further configured for:

capturing real world images via a camera of the mobile device; and

operably displaying the first virtual reality object on the real world images.

3. The virtual reality system as claimed in claim 1, wherein the virtual reality processing device is further configured for:

transmitting a position and rotating angles of the first virtual reality controller to the mobile device via the network, so as to allow the mobile device to operably display a second virtual reality object corresponding to the position and the rotating angles of the first virtual reality controller according to the position and the rotating angles of the mobile device.

4. The virtual reality system as claimed in claim 3, wherein the virtual reality processing device is further configured for:

controlling the virtual reality display device to operably display the second virtual reality object corresponding to the position and the rotating angles of the first virtual reality controller.

5. The virtual reality system as claimed in claim 1, wherein the virtual reality processing device is further configured for:

acquiring a position and rotating angles of a second virtual reality controller; and

transmitting the position and the rotating angles of the second virtual reality controller to the mobile device via the network, so as to allow the mobile device to operably display a second virtual reality object corresponding to the position and the rotating angles of the second virtual reality controller.

6. The virtual reality system as claimed in claim 1, wherein the virtual reality processing device is further configured for:

receiving a real time image displayed on the mobile device; and

controlling the virtual reality display device to operably display the real time image displayed on the mobile device.

7. An operating method of a mobile device comprising:

receiving a position and rotating angles of a sensor attached to the mobile device from a virtual reality processing device via a network, wherein the virtual reality processing device communicates with a virtual reality display device, the virtual reality display device is configured to display a virtual reality environment having a first virtual reality object corresponding to a position and rotating angles of the virtual reality display device, wherein there is a fixed shift on at least one axis between the position of the sensor and a position of the mobile device;

receiving the position and the rotating angles of the virtual reality display device from the virtual reality processing device;

acquiring the position of the mobile device according to the position of the sensor;

operably displaying the first virtual reality object of the virtual reality environment according to the position and rotating angles of the mobile device.

8. The operating method as claimed in claim 7 further comprising:

capturing real world images via a camera of the mobile device; and

operably displaying the first virtual reality object on the real world images.

9. The operating method as claimed in claim 7 further comprising:

receiving a position and rotating angles of a virtual reality controller from the virtual reality processing device via the network; and

operably displaying a second virtual reality object corresponding to the position and the rotating angles of the virtual reality controller.

10. A non-transitory computer readable storage medium storing one or more programs comprising instructions, which when executed, causes one or more processing components to perform operations comprising:

receiving a position and rotating angles of a sensor attached to the mobile device from a virtual reality processing device via a network, wherein the virtual reality processing device communicates with a virtual reality display device, the virtual reality display device is configured to display a virtual reality environment having a first virtual reality object corresponding to a position and rotating angles of the virtual reality display device, wherein there is a fixed shift on at least one axis between the position of the sensor and a position of the mobile device;

receiving the position and the rotating angles of the virtual reality display device from the virtual reality processing device;

acquires the position of the mobile device according to the position of the sensor; and

operably displaying the first virtual reality object of the virtual reality environment according to the position and rotating angles of the mobile device.

11. The non-transitory computer readable storage medium as claimed in claim 10 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

capturing real world images via a camera of the mobile device; and

operably displaying the first virtual reality object on the real world images.

12. The non-transitory computer readable storage medium as claimed in claim 10 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

receiving a position and rotating angles of a virtual reality controller from the virtual reality processing device via the network; and

operably displaying a second virtual reality object corresponding to the position and the rotating angles of the sensor virtual reality controller.