Method for presenting contents in virtual space, system for executing the method, and contents presenting apparatus

• US 10,332,316 B2
• Filed: 12/26/2017
• Issued: 06/25/2019
• Est. Priority Date: 12/27/2016
• Status: Active Grant

• Current Assignee: Colopl, Inc.
• Original Assignee: Colopl, Inc.
• Inventors: Saito, Kana
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US15/854,606
• Publication Number:
  US 20180253903A1
• Time in Patent Office: 546 Days
• Field of Search: 345419
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 : for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

A method includes defining a virtual space. The virtual space includes a plurality of first objects and a second object. The method further includes associating each situation of a plurality of situations with a corresponding first object. The method further includes moving the second object in accordance with a detected motion of a head-mounted display. The method further includes updating the virtual space to a virtual space corresponding to a situation of the plurality of situations corresponding to a selected first object. The method further includes displaying in the virtual space a plurality of words associated with the corresponding situation. The method further includes associating a selected at least one word with the selected situation and registering the associated at least one word in a word list.

Claims

1. A method, comprising:

defining a virtual space, wherein the virtual space comprises a plurality of first objects and a second object;

defining a plurality of situations to be developed in the virtual space;

associating each situation of the plurality of situations with a corresponding first object of the plurality of first objects;

detecting motion by a user associated with a head-mounted display (HMD);

moving the second object in accordance with the detected motion;

selecting a first object of the plurality of first objects using the second object;

updating the virtual space to a virtual space corresponding to a situation of the plurality of situations corresponding to the selected first object;

displaying in the virtual space a plurality of words associated with the corresponding situation;

selecting at least one word of the plurality of words based on the detected motion; and

associating the selected at least one word with the selected situation and registering the associated at least one word in a word list.

2. The method according to claim 1, further comprising displaying in the virtual space a word registered in the word list.

3. The method according to claim 1, further comprising:

identifying, from the plurality of situations, a situation associated with the at least one word registered in the word list;

updating the virtual space to the identified situation; and

presenting in the updated virtual space the word associated with the situation in the word list.

4. The method according to claim 1, further comprising:

associating each word of the plurality of words with a corresponding third object of a plurality of third objects in the virtual space;

selecting a third object of the plurality of third objects using the second object; and

selecting a word of the plurality of words corresponding to the selected third object.

5. The method according to claim 1, further comprising:

selecting a first object of the plurality of first objects based on a detected line of sight of the user; and

identifying a word of the plurality of words corresponding to the selected first object.

6. The method according to claim 1, further comprising:

receiving a command by a second user, the command comprising information for designating the plurality of words; and

presenting in the updated virtual space, among the plurality of words associated with the situation, the plurality of words designated in accordance with the command.

7. The method according to claim 1, wherein the plurality of words comprise at least one word that satisfies an answer criterion determined in advance and at least one word that fails to satisfy the answer criterion.

8. The method according to claim 1, further comprising:

displaying on the HMD an example sentence associated with the plurality of words;

displaying a first word of the plurality of words that satisfies the answer criterion for the example sentence;

displaying a second word of the plurality of words that fails to satisfy the answer criterion; and

displaying a hint for the example sentence.

9. The method according to claim 8, wherein the displaying of the hint comprises displaying the hint in accordance with an instruction from the user.

10. The method according to claim 8, wherein the displaying of the hint comprises displaying the hint in accordance with an operation by a second user.

11. The method according to claim 8, further comprising presenting the hint on the HMD in response to a failure to select the at least one word satisfying the answer criterion within a period of time selected in advance.

12. A system, comprising:

a head-mounted display (HMD);

a processor; and

a non-transitory computer readable medium connected to the processor, wherein the non-transitory computer readable medium is configured to store a program, and the processor is configured to execute the program for;

defining a virtual space, wherein the virtual space comprises a plurality of first objects and a second object;

receiving a plurality of situations to be developed in the virtual space;

associating each situation of the plurality of situations with a corresponding first object of the plurality of first objects;

detecting motion by a user associated with the HMD;

moving the second object in accordance with the detected motion;

selecting a first object of the plurality of first objects using the second object;

updating the virtual space to a virtual space corresponding to a situation of the plurality of situations corresponding to the selected first object;

instructing the HMD to display, in the virtual space, a plurality of words associated with the corresponding situation;

selecting at least one word of the plurality of words based on the detected motion; and

associating the selected at least one word with the selected situation and registering the associated at least one word in a word list.

13. The system according to claim 12, wherein the processor is further configured to instruct the HMD to display, in the virtual space, a word registered in the word list.

14. The system according to claim 12, wherein the processor is further configured to execute the program for:

identifying, from the plurality of situations, a situation associated with the at least one word registered in the word list;

updating the virtual space to the identified situation; and

instructing the HMD to display, in the updated virtual space, the word associated with the situation in the word list.

15. The system according to claim 12, wherein the processor is further configured to execute the program for:

associating each word of the plurality of words with a corresponding third object of a plurality of third objects in the virtual space;

selecting a third object of the plurality of third objects using the second object; and

selecting a word of the plurality of words corresponding to the selected third object.

16. The system according to claim 12, wherein the processor is further configured to execute the program for:

selecting a first object of the plurality of first objects based on a detected line of sight of the user; and

identifying a word of the plurality of words corresponding to the selected first object.

17. The system according to claim 12, wherein the processor is further configured to execute the program for:

receiving a command from a second user, the command comprising information for designating the plurality of words; and

instructing the HMD to display, in the updated virtual space, among the plurality of words associated with the situation, the plurality of words designated in accordance with the command.

18. The system according to claim 12, wherein the plurality of words comprise at least one word that satisfies an answer criterion determined in advance and at least one word that fails to satisfy the answer criterion.

19. The method according to claim 12, wherein the processor is further configured to execute the program for:

instructing the HMD to display an example sentence associated with the plurality of words;

instructing the HMD to display a first word of the plurality of words that satisfies the answer criterion for the example sentence;

instructing the HMD to display a second word of the plurality of words that fails to satisfy the answer criterion; and

instructing the HMD to display a hint for the example sentence.

20. The system according to claim 19, wherein the processor is further configured to execute the program for instructing the HMD to display the hint in response to a failure to select the at least one word satisfying the answer criterion within a period of time selected in advance.