HEAD MOUNTED DISPLAY, MOTION DETECTOR, MOTION DETECTION METHOD, IMAGE PRESENTATION SYSTEM AND PROGRAM

• US 20140125579A1
• Filed: 10/08/2013
• Published: 05/08/2014
• Est. Priority Date: 11/06/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Yamamoto, Hirotsugu
• Granted Patent: US 9,448,405 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0308 comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Disclosed herein is a head mounted display including: an enclosure accommodating a presentation section adapted to present a three-dimensional image and located in front of the eyes of a viewer when worn on the head of the viewer; and an imaging element provided in the enclosure and adapted to turn light external to the enclosure into an image, in which the imaging element images light that is vertically downward relative to the enclosure and forward in the direction of line of sight of the viewer when the enclosure is worn on the head of the viewer.

Claims

1. A head mounted display comprising:

an enclosure accommodating a presentation section adapted to present a three-dimensional image and located in front of the eyes of a viewer when worn on the head of the viewer; and

an imaging element provided in the enclosure and adapted to turn light external to the enclosure into an image, wherein

the imaging element images light that is vertically downward relative to the enclosure and forward in the direction of line of sight of the viewer when the enclosure is worn on the head of the viewer.

2. The head mounted display of claim 1, wherein

of the sides making up the enclosure, at least part of the bottom side located vertically downward relative to the enclosure when the enclosure is worn on the head of the viewer has a sloped area that tilts vertically upward, and

the imaging element is provided on the sloped area.

3. The head mounted display of claim 1, wherein

the imaging element acquires light external to the enclosure via a fisheye lens and turns it into an image.

4. The head mounted display of claim 1, wherein

the imaging element turns light in the invisible range into an image.

5. The head mounted display of claim 4, wherein

the imaging element turns light emitted by a light-emitting element that moves along with the motion of the viewer'"'"'s hand into an image, the head mounted display further comprising:

a hand tracking block adapted to track the change in position of the light-emitting element by analyzing the image captured by the imaging element.

6. The head mounted display of claim 5, wherein

the light-emitting element that moves along with the motion of the viewer'"'"'s hand is attached to a grip section gripped by the viewer.

7. The head mounted display of claim 6, wherein

the hand tracking block comprises:

a bright spot detection unit adapted to detect a bright spot of light in the image captured by the imaging element;

a vector acquisition unit adapted to acquire a vector having, as an end point, the bright spot detected by the bright spot detection unit, and, as a start point, the center of the image captured by the imaging element;

a pitch acquisition unit adapted to acquire, as a pitch of the light-emitting element relative to the imaging element, the length of the vector acquired by the vector acquisition unit; and

a yaw acquisition unit adapted to acquire, as a yaw of the light-emitting element relative to the imaging element, the declination of the vector acquired by the vector acquisition unit.

8. The head mounted display of claim 1, wherein

the imaging element generates a visible light image by turning light in the visible range into an image, the head mounted display further comprising:

an image combining section adapted to combine the visible light image and a virtual image to be presented by the presentation section.

9. The head mounted display of claim 8 further comprising:

a gesture recognition unit adapted to recognize a gesture of the viewer captured by the imaging element.

10. A motion detector comprising:

an image acquisition section adapted to acquire an image captured by an imaging element attached to the head of a user by imaging infrared light radiated by a light-emitting element that moves along with the motion of the user'"'"'s hand;

a bright spot detection unit adapted to detect a bright spot of infrared light in the image captured by the imaging element;

a vector acquisition unit adapted to acquire a vector having, as an end point, the bright spot detected by the bright spot detection unit, and, as a start point, the center of the image captured by the imaging element;

a pitch acquisition unit adapted to acquire, as a pitch of the light-emitting element relative to the imaging element, the length of the vector acquired by the vector acquisition unit; and

a yaw acquisition unit adapted to acquire, as a yaw of the light-emitting element relative to the imaging element, the declination of the vector acquired by the vector acquisition unit.

11. A motion detection method causing a processor to:

acquire an image captured by an imaging element attached to the head of a user by imaging infrared light radiated by a light-emitting element that moves along with the motion of the user'"'"'s hand;

detect a bright spot of infrared light in the acquired image;

acquire a vector having, as an end point, the detected bright spot, and, as a start point, the center of the image captured by the imaging element;

acquire the length of the acquired vector; and

acquire the declination of the acquired vector.

12. A program causing a computer to implement the functions of:

acquiring an image captured by an imaging element attached to the head of a user by imaging infrared light radiated by a light-emitting element that moves along with the motion of the user'"'"'s hand;

detecting a bright spot of infrared light in the acquired image;

acquiring a vector having, as an end point, the detected bright spot, and, as a start point, the center of the image captured by the imaging element;

acquiring the length of the acquired vector; and

acquiring the declination of the acquired vector.

13. An image presentation system comprising:

a head mounted display; and

a light-emitting element attached to a grip section gripped by a viewer and adapted to radiate infrared light, wherein

the head mounted display includes;

an enclosure accommodating a presentation section adapted to present a three-dimensional image and located in front of the eyes of the viewer when worn on the head of the viewer;

an imaging element provided in the enclosure and adapted to image infrared light radiated by the light-emitting element that moves along with the motion of the grip section; and

a motion tracking section adapted to track the change in relative position of the light-emitting element with respect to the imaging element by analyzing the infrared light image captured by the imaging element.