Display device, control system, and control program

• US 9,799,141 B2
• Filed: 09/26/2013
• Issued: 10/24/2017
• Est. Priority Date: 09/27/2012
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Kyocera Corporation
• Inventors: Ueno, Yasuhiro, Tanabe, Shigeki
• Primary Examiner(s): Johnson, M Good
• Application Number:
  US14/431,228
• Publication Number:
  US 20150243081A1
• Time in Patent Office: 1,489 Days
• Field of Search: None
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 9/0612 Electronic puzzles
• CPC Class Codes: A63F 9/0826 Three-dimensional puzzles with slidable or rotatable elements or groups of elements, the main configuration remaining unchanged, e.g. Rubik's cube elements rotatable about just one axis, e.g. discs stacked as a cylinder A63F9/0811
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: H04N 13/366 using viewer tracking

Abstract

According to one of aspects, a display device includes: a display unit configured to stereoscopically display an aggregation configured from a plurality of regular hexahedrons arrayed along mutually perpendicular three directions, in a display space, by displaying images respectively corresponding to both eyes of a user by being worn; a detection unit configured to detect movement of a body in the display space; and a control unit configured to change positions of the regular hexahedrons of the aggregation according to a detection result of the detection unit. Each of six faces of the aggregation includes external faces of the regular hexahedrons as elements, and notations with which whether all of the elements on the same face of the aggregation belong to a same group is discriminative are provided to the respective elements.

Claims

1. A display device, comprising:

two displays which generate images respectively corresponding to both eyes of a user when the display device is being worn on the user, wherein said images stereoscopically display an aggregation having six faces in a display space, the aggregation configured from a plurality of regular hexahedrons arrayed along mutually perpendicular three directions;

a detector which detects movement of a body in the display space; and

a controller which changes positions of the regular hexahedrons of the aggregation according to a detection result of the detector, wherein

each of the six faces of the aggregation includes external faces of the regular hexahedrons as elements, and notations with which whether all of the elements on the same face of the aggregation belong to a same group is discriminative are provided to the respective elements,

the controller controls the regular hexahedrons to be pivoted such that,

of the six faces, in faces perpendicular to a first direction of the mutually perpendicular three directions, positional relationship among the elements that configure each of the faces is not changed, and

of the six faces, in a plurality of other faces perpendicular to a second or third direction of the mutually perpendicular three directions, part of the elements that configure each of the plurality of other faces are interchanged among the plurality of other faces,

based on the detection result of the detector, using the first direction as a rotation axis,

the controller calculates a moving speed of the body in the display space, and

in response to the calculated moving speed of the body being higher than a threshold, the controller resets an application of the aggregation to a start time.

2. The display device according to claim 1, wherein,

when the detector has detected that there is the body at a position where the body holds the aggregation, and the body has moved,

the controller controls the aggregation to be moved according to the movement of the body.

3. The display device according to claim 1, wherein,

when the detector has detected two pairs of bodies that hold the aggregation at two places, and movement that the two pairs of bodies are relatively rotated around a direction into which the two pairs of bodies face each other,

the controller determines the direction into which the two pairs of bodies face each other as the first direction, and controls the regular hexahedrons to be pivoted according to an amount of rotation of the relatively rotating movement.

4. The display device according to claim 1, wherein

the two displays stereoscopically display a plurality of aggregations in the display space, and

when the detector has detected, with respect to first aggregation of the plurality of aggregations, two pairs of bodies that hold the first aggregation at two places, and movement that the two pairs of bodies are relatively rotated around a direction into which the two pairs of bodies face each other,

the controller determines the direction into which the two pairs of bodies face each other as the first direction, and controls the regular hexahedrons that configure the first aggregation, and the regular hexahedrons that configure second aggregation of the plurality of aggregations to be pivoted in conjunction with each other, according to an amount of rotation of the relatively rotating movement with respect to the first aggregation.

5. The display device according to claim 4, wherein

the two displays stereoscopically display the aggregations in a state where the second aggregation is nested into the first aggregation, and

when the detector has detected that there is the body at a position where the body holds the second aggregation, and the body has moved,

the controller controls such that only the second aggregation is moved without moving the first aggregation, according to the movement of the body.

6. The display device according to claim 4, wherein

the two displays stereoscopically display the first aggregation and the second aggregation in the same display space, and

when the detector has detected that there is the body at a position where the body holds the second aggregation, and the body has moved,

the controller controls such that the second aggregation and the first aggregation are moved in conjunction with each other, according to the movement of the body with respect to the second aggregation.

7. The display device according to claim 1, wherein the detector includes a camera or a TOF sensor.

8. The display device according to claim 1, wherein the two displays display a time limit.

9. The display device according to claim 1, wherein the two displays display the number of pivoting by which the regular hexahedrons are pivoted.

10. The display device according to claim 1, wherein

in response to the calculated moving speed of the body being higher than the threshold and corresponding to throwing the aggregation, the controller deletes the aggregation.

11. A display device, comprising:

two displays which generate images respectively corresponding to both eyes of a user when the display device is being worn on the user, wherein said images stereoscopically display a polyhedron puzzle in a display space;

a detector which detects movement of a body in the display space; and

a controller which changes a position of a piece of the polyhedron puzzle according to a detection result of the detector, wherein

the controller calculates a moving speed of the body in the display space, and

in response to the calculated moving speed of the body being higher than a threshold, the controller resets an application of the polyhedron puzzle to a start time.

12. The display device according to claim 11, wherein the polyhedron puzzle is a regular polyhedron-type polyhedron puzzle.

13. The display device according to claim 12, wherein the regular polyhedron-type polyhedron puzzle includes a regular tetrahedron-type polyhedron puzzle, a regular hexahedron-type polyhedron puzzle, a regular octahedron-type polyhedron puzzle, a regular dodecahedron-type polyhedron puzzle, or a regular icosahedron-type polyhedron puzzle.

14. The display device according to claim 13, wherein the regular hexahedron-type polyhedron puzzle includes a 2×

2×

2 cube, a 3×

3×

3 cube, a 4×

4×

4 cube, or a 5×

5×

5 cube.

15. A control system, comprising:

a display device including

two displays which generate images respectively corresponding to both eyes of a user when the display device is being worn on the user, wherein said images stereoscopically display an aggregation having six faces in a display space, the aggregation configured from a plurality of regular hexahedrons arrayed along mutually perpendicular three directions, and

a detector which detects movement of a body in the display space; and

a control device including a controller which changes positions of the regular hexahedrons of the aggregation according to a detection result of the detector, wherein

each of the six faces of the aggregation includes external faces of the regular hexahedrons as elements, and notations with which whether all of the elements on the same face of the aggregation belong to a same group is discriminative are provided to the respective elements,

the controller controls the regular hexahedrons to be pivoted such that,

of the six faces, in faces perpendicular to a first direction of the mutually perpendicular three directions, positional relationship among the elements that configure the each of faces is not changed, and

of the six faces, in a plurality of other faces perpendicular to a second or third direction of the mutually perpendicular three directions, part of the elements that configure each of the plurality of other faces are interchanged among the plurality of other faces,

based on the detection result of the detector, using the first direction as a rotation axis,

the controller calculates a moving speed of the body in the display space, and

in response to the calculated moving speed of the body being higher than a threshold, the controller resets an application of the aggregation to a start time.

16. A non-transitory storage medium that stores a control program that causes, when executed by a display device including a detector and two displays which generate images respectively corresponding to both eyes of a user when the display device is being worn on the user, the display device to execute:

stereoscopically displaying, by the two displays, an aggregation having six faces in a display space, the aggregation configured from a plurality of regular hexahedrons arrayed along mutually perpendicular three directions, wherein each of the six faces of the aggregation includes external faces of the regular hexahedrons as elements, and notations with which whether all of the elements on the same face of the aggregation belong to a same group is discriminative are provided to the respective elements;

detecting, by the detector, movement of a body in the display space;

controlling the regular hexahedrons to be pivoted such that,

of the six faces, in faces perpendicular to a first direction of the mutually perpendicular three directions, positional relationship among the elements that configure the each of faces is not changed, and

of the six faces, in a plurality of other faces perpendicular to a second or third direction of the mutually perpendicular three directions, part of the elements that configure each of the plurality of other faces are interchanged among the plurality of other faces,

based on the detection result of the detector, using the first direction as a rotation axis;

calculating a moving speed of the body in the display space; and

in response to the calculated moving speed of the body being higher than a threshold, resetting an application of the aggregation to a start time.

17. A display device, comprising:

two displays which generate images respectively corresponding to both eyes of a user when the display device is being worn on the user, wherein said images stereoscopically display, in a display space, an aggregation configured from a plurality of regular polyhedrons arrayed along faces configured by connecting vertexes of a regular polyhedron with N faces (N=4, 6, 8, 12, or

     20);

a detector which detects movement of a body in the display space; and

a controller which changes positions of the regular polyhedrons of the aggregation according to a detection result of the detector, wherein

each of faces of the aggregation includes external faces of the regular polyhedrons as elements, and notations with which whether all of the elements on the same face of the aggregation belong to a same group is discriminative are provided to the respective elements,

the controller controls the regular polyhedrons to be pivoted such that

on a first face of the faces, and further on a second face parallel to the first face when there is the second face, positional relationship among the elements is not changed and,

on a plurality of other faces intersecting with the first face, or either on a plurality of other faces intersecting with the second face or on a plurality of other faces intersecting with the first face when there is the second face, part of the elements that configure the plurality of other faces are interchanged among the plurality of other faces,

based on the detection result of the detector, using a direction perpendicular to the first face as a rotation axis,

the controller calculates a moving speed of the body in the display space, and

in response to the calculated moving speed of the body being higher than a threshold, the controller resets an application of the aggregation to a start time.

18. A display device, comprising:

two displays which generate images respectively corresponding to both eyes of a user when the display device is being worn on the user, wherein said images stereoscopically display, in a display space, first and second aggregations each having six faces and configured from a plurality of regular hexahedrons arrayed along mutually perpendicular three directions;

a detector which detects movement of a body in the display space; and

a controller which changes positions of the regular hexahedrons of each of the first and second aggregations according to a detection result of the detector, wherein

each of the six faces of each of the first and second aggregations includes external faces of the regular hexahedrons as elements, and notations with which whether all of the elements on the same face of said each aggregation belong to a same group is discriminative are provided to the respective elements,

the controller controls the regular hexahedrons to be pivoted such that,

of the six faces, in faces perpendicular to a first direction of the mutually perpendicular three directions, positional relationship among the elements that configure each of the faces is not changed, and

of the six faces, in a plurality of other faces perpendicular to a second or third direction of the mutually perpendicular three directions, part of the elements that configure each of the plurality of other faces are interchanged among the plurality of other faces,

based on the detection result of the detector, using the first direction as a rotation axis, and

in a first mode, when the detector detects movement of the body acting on the first aggregation but not on the second aggregation, the controller changes

positions of the regular hexahedrons of the first aggregation according to the detected movement of the body acting on the first aggregation, and

positions of the regular hexahedrons of the second aggregation according to the changed positions of the corresponding regular hexahedrons of the first aggregation.

19. The display device according to claim 18, wherein

in a second mode, when the first aggregation is nested inside the second aggregation and the detector detects movement of the body acting on the first aggregation, the controller changes positions of the regular hexahedrons of the first aggregation according to the detected movement of the body acting on the first aggregation without changing positions of the regular hexahedrons of the second aggregation.