Controlling graphic field of view by operating head mounted display

• US 10,353,459 B2
• Filed: 01/11/2017
• Issued: 07/16/2019
• Est. Priority Date: 01/11/2017
• Status: Active Grant

• Current Assignee: Universal Entertainment Corporation
• Original Assignee: Universal Entertainment Corporation
• Inventors: Honda, Nobuyuki
• Primary Examiner(s): Khoo, Stacy
• Application Number:
  US15/404,165
• Publication Number:
  US 20180196504A1
• Time in Patent Office: 916 Days
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

An immersive head-mounted display (IHMD) system including an IHMD that includes at least one gyroscope and a hardware data transmission component operable to transmit data received from the at least one gyroscope. The system includes a control device communicatively that includes an input interface operable to accept an input from an external controller interface and a processing unit having one or more hardware processors. The processing unit operative to: generate a graphic field of view using at least a portion of the graphical data; generate, based on data received from the at least one gyroscope, a modified graphic field of view within the portion of the graphical data; identify a specific target from a plurality of potential targets within the modified graphic field of view; receive an input from the input interface, wherein the input is directed towards the specific target.

Claims

1. An immersive head-mounted display (IHMD) system comprising:

an IHMD comprising;

at least one gyroscope;

a hardware data transmission component operable to transmit data received from the at least one gyroscope;

a hardware data receiving component operable to receive display data; and

a display communicatively coupled to the hardware data receiving component and operable to output graphical data, using the received display data, to a user; and

a control device communicatively coupled to the IHMD and operative to generate graphical data to be transmitted to the hardware data receiving component on the IHMD, the control device comprising;

an input interface operable to accept an input from an external controller interface; and

a processing unit having one or more hardware processors, the processing unit operative to;

generate a graphic field of view using at least a portion of the graphical data;

generate, based on data received from the at least one gyroscope, a modified graphic field of view within the portion of the graphical data;

in response to determining that the IHMD is stationary for more than a predetermined amount of time, identify a specific target from a plurality of potential targets within the modified graphic field of view; and

receive an input from the input interface, wherein the input is directed towards the specific target.

2. The IHMD system as recited in claim 1, wherein the input interface is operable to be communicatively coupled to the processing unit, which is configured to detect spoken questions or commands.

3. The IHMD system as recited in claim 1, wherein the at least one gyroscope comprises a single three axis gyroscope chip.

4. The IHMD system as recited in claim 1, wherein the at least one gyroscope comprises a plurality of gyroscopic chips;

and further comprising a microphone operable to detect a spoken question or command, wherein the microphone is coupled to the control device.

5. The IHMD system as recited in claim 1, wherein the identification of the specific target, by the processing unit, includes determining if one or more interaction objects are located within the graphical field of view and selecting an identified one of the one or more interaction objects that takes up one of a central region or a majority of the graphical field of view, wherein the identified one of the one or more interactions objects becomes the specific target.

6. The IHMD system as recited in claim 5, wherein the one or more interaction objects are comprised of one or more images that resemble a person, a robot, an animal, a computer, or a kiosk.

7. The IHMD system as recited in claim 1, wherein the processing unit is further operable to generate response data, based on a spoken question or command into the input interface, wherein the response data is one of audio data or graphical textual data.

8. The IHMD system as recited in claim 7, wherein the response data is selected from predefined response data.

9. The IHMD system as recited in claim 7, wherein the response data generates new graphical data.

10. The IHMD system as recited in claim 1, wherein the processing unit is further operable to:

receive movement data from the at least one gyroscope;

generate, according to the movement data, changed graphic field of view data, so that the modified graphical field of view data generates a changed graphic field of view at a location different from the modified graphic field of view and within the graphical data.

11. The IHMD system as recited in claim 10, wherein the movement data indicates a head shake in a downward and upward direction.

12. The IHMD system as recited in claim 11, wherein the processing unit is operative to:

transmit a downward shifted graphic field of view and an upward shifted graphic field of view in response to a head shake in the downward and upward direction.

13. The IHMD system as recited in claim 12, further comprising an action that is affirmative in accordance with a question that was presented prior to receiving the head shake in a downward and upward direction.

14. The IHMD system as recited in claim 11, wherein the head shake begins by moving upward and then downward.

15. The IHMD system as recited in claim 10, wherein the movement data indicates a head shake in a left and right direction.

16. The IHMD system as recited in claim 15, wherein the processing unit is operative to:

transmit a leftward shifted graphic field of view and a rightward shifted graphic field of view in response to a head shake in the leftward and rightward direction.

17. The IHMD system as recited in claim 16, further comprising an action that is negative in response to a question that was presented prior to receiving the head shake in a leftward and rightward direction.

18. The IHMD system as recited in claim 15, wherein the head shake begins by moving rightward and then leftward.

19. The IHMD system as recited in claim 10, wherein the movement data indicates movement in a measured direction away from the graphic field of view such that varying graphic field of views are displayed until a designated target is displayed within one of the varying graphic field of views and displaying the one of the graphic field of views when the IHMD is stationary for more than the predetermined amount of time.

20. An immersive head-mounted display (IHMD) comprising:

at least one gyroscope;

a hardware data receiving component operable to receive display data;

a display communicatively coupled to the hardware data receiving component and operable to output graphical data, using the received display data, to a user; and

a processing unit having one or more hardware processors, the processing unit operative to;

generate a graphic field of view using at least a portion of the graphical data;

generate, based on data received from the at least one gyroscope, a modified graphic field of view within the portion of the graphical data;

in response to determining that the IHMD is stationary for more than a predetermined amount of time, identify a specific target from a plurality of potential targets within the modified graphic field of view; and

receive an input from an input interface, wherein the input is directed towards the specific target.