VIRTUAL REALITY SYSTEM, OPERATING METHOD FOR MOBILE DEVICE, AND NON-TRANSITORY COMPUTER READABLE STORAGE MEDIUM

• US 20180276893A1
• Filed: 03/23/2017
• Published: 09/27/2018
• Est. Priority Date: 03/23/2017
• Status: Active Application

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: HUANG, Guei-Yu, WANG, Kang-Yu
• Granted Patent: US 10,282,909 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

A virtual reality (VR) system includes a VR display device, a first VR controller, a mobile device, and a VR processing device. The VR display device is configured to display a VR environment corresponding to a position and rotating angles of the VR display device. The mobile device is attached to the first VR controller. The VR processing device is configured for acquiring a position and rotating angles of the first VR controller; and transmitting the position and the rotating angles of the first VR controller to the mobile device via a network, so as to allow the mobile device to operably display a VR object of the VR environment corresponding to the position and the rotating angles of the first VR controller.

Claims

1. A virtual reality (VR) system comprising:

a virtual reality display device configured to display a virtual reality environment having a first virtual reality object corresponding to a position and rotating angles of the virtual reality display device;

a first virtual reality controller;

a mobile device attached to the first virtual reality controller; and

a virtual reality processing device configured for;

acquiring a position and rotating angles of the first virtual reality controller; and

transmitting the position and the rotating angles of the first virtual reality controller to the mobile device via a network, so as to allow the mobile device to operably display the first virtual reality object of the virtual reality environment corresponding to the position and the rotating angles of the first virtual reality controller.

2. The virtual reality system as claimed in claim 1, wherein the mobile device is further configured for:

capturing real world images via a camera of the mobile device; and

operably displaying the first virtual reality object on the real world images corresponding to the position and the rotating angles of the first virtual reality controller.

3. The virtual reality system as claimed in claim 1, wherein the mobile device is further configured for:

operably displaying the first virtual reality object with the VR environment corresponding to the position and the rotating angles of the first VR controller.

4. The virtual reality system as claimed in claim 1, wherein the virtual reality processing device is further configured for:

transmitting the position and the rotating angles of the virtual reality display device to the mobile device via the network, so as to allow the mobile device to operably display a second virtual reality object corresponding to the position and the rotating angles of the virtual reality display device and the position and the rotating angles of the first VR controller.

5. The virtual reality system as claimed in claim 4, wherein the virtual reality processing device is further configured for:

controlling the virtual reality display device to operably display the second virtual reality object corresponding to the position and the rotating angles of the virtual reality display device and the position and the rotating angles of the first VR controller.

6. The virtual reality system as claimed in claim 1, wherein the mobile device is further configured for:

acquiring a position of the mobile device corresponding to the position of the first virtual reality controller; and

operably displaying the first virtual reality object corresponding to the position of the mobile device.

7. The virtual reality system as claimed in claim 1, wherein the virtual reality processing device is further configured for:

acquiring a position and rotating angles of a second virtual reality controller; and

transmitting the position and the rotating angles of the second virtual reality controller to the mobile device via the network, so as to allow the mobile device to operably display a second virtual reality object corresponding to the position and the rotating angles of the second virtual reality controller.

8. The virtual reality system as claimed in claim 1, wherein the virtual reality processing device is further configured for:

receiving a real time image displayed on the mobile device; and

controlling the virtual reality display device to operably display the real time image displayed on the mobile device.

9. An operating method of a mobile device comprising:

receiving a position and rotating angles of a sensor attached to the mobile device from a virtual reality processing device via a network, wherein the virtual reality processing device communicates with a virtual reality display device, the virtual reality display device is configured to display a virtual reality environment having a first virtual reality object corresponding to a position and rotating angles of the virtual reality display device; and

operably displaying the first virtual reality object of the virtual reality environment corresponding to the position and the rotating angles of the sensor.

10. The operating method as claimed in claim 9 further comprising:

capturing real world images via a camera of the mobile device; and

operably displaying the first virtual reality object on the real world images corresponding to the position and the rotating angles of the sensor.

11. The operating method as claimed in claim 9 further comprising:

operably displaying the first virtual reality object with the virtual reality environment corresponding to the position and the rotating angles of the sensor.

12. The operating method as claimed in claim 9 further comprising:

receiving the position and the rotating angles of the virtual reality display device from virtual reality processing device via the network; and

operably displaying the first virtual reality object corresponding to the position and the rotating angles of the virtual reality display device and the position and the rotating angles of the sensor.

13. The operating method as claimed in claim 9 further comprising:

acquiring a position of the mobile device corresponding to the position of the sensor; and

operably displaying the first virtual reality object corresponding to the position of the mobile device.

14. The operating method as claimed in claim 9 further comprising:

receiving a position and rotating angles of a virtual reality controller from the virtual reality processing device via the network; and

operably displaying the first virtual reality object corresponding to the position and the rotating angles of the sensor.

15. A non-transitory computer readable storage medium storing one or more programs comprising instructions, which when executed, causes one or more processing components to perform operations comprising:

receiving a position and rotating angles of a sensor attached to the mobile device from a virtual reality processing device via a network, wherein the virtual reality processing device communicates with a virtual reality display device, the virtual reality display device is configured to display a virtual reality environment having a first virtual reality object corresponding to a position and rotating angles of the virtual reality display device; and

operably displaying the first virtual reality object of the virtual reality environment corresponding to the position and the rotating angles of the sensor.

16. The non-transitory computer readable storage medium as claimed in claim 15 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

capturing real world images via a camera of the mobile device; and

operably displaying the first virtual reality object on the real world images.

17. The non-transitory computer readable storage medium as claimed in claim 15 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

operably displaying the first virtual reality object with the virtual reality environment corresponding to the position and the rotating angles of the sensor.

18. The non-transitory computer readable storage medium as claimed in claim 15 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

receiving the position and the rotating angles of the virtual reality display device from virtual reality processing device via the network; and

operably displaying the first virtual reality object corresponding to the position and the rotating angles of the virtual reality display device and the position and the rotating angles of the sensor.

19. The non-transitory computer readable storage medium as claimed in claim 15 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

acquiring a position of the mobile device corresponding to the position of the sensor; and

operably displaying the first virtual reality object corresponding to the position of the mobile device.

20. The non-transitory computer readable storage medium as claimed in claim 15 comprising instructions, which when executed, causes one or more processing components to further perform operations comprising:

receiving a position and rotating angles of a virtual reality controller from the virtual reality processing device via the network; and

operably displaying the first virtual reality object corresponding to the position and the rotating angles of the sensor.

21. (canceled)