Head mountable display system

• US 9,310,884 B2
• Filed: 05/03/2013
• Issued: 04/12/2016
• Est. Priority Date: 05/04/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Benson, Simon Mark, Bickerstaff, Ian Henry
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US13/886,872
• Publication Number:
  US 20130293688A1
• Time in Patent Office: 1,075 Days
• Field of Search: 345/8, 345/156, 345/419, 345/520, 345/633
• US Class Current: 1/1
• CPC Class Codes: G01S 13/04 Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: H04N 5/66 Transforming electric information into light information scanning details H04N3/00

Abstract

A head-mountable display system comprises a head mountable display having a frame to be mounted onto an observer'"'"'s head, the frame defining one or two eye display positions which, in use, are positioned for viewing by the observer. The frame comprises one or more shutters for obscuring the observer'"'"'s view of the surrounding real environment and a display element mounted with respect to each of the eye display positions. The display element provides a virtual image of a video display of a video signal from a video signal source to the observer. An object detector detects the presence of an object within a detection range of the observer'"'"'s head. And a controller controls operation of the head mountable display so as to allow the observer to view at least a portion of the surrounding real environment in response to detection of the presence of an object within the detection range.

Claims

1. A head-mountable display system comprising:

a games machine configured to generate a video signal representing a video game;

a head mountable display having a frame to be mounted onto an observer'"'"'s head, the frame defining one or two eye display positions which, in use, are positioned for viewing by the observer, the frame comprising one or more shutters for obscuring the observer'"'"'s view of the surrounding real environment and a display element mounted with respect to each of the eye display positions, the display element providing a virtual image of a video display of a video signal from the games machine to the observer;

an object detector configured to detect the presence of an object within a detection range of the observer'"'"'s head and, in response to a detection, configured to instruct the games machine to cause the observer'"'"'s in-game motion to be brought to a halt; and

a controller configured to control operation of the head mountable display so as to allow the observer to view at least a portion of the surrounding real environment in response to detection of the presence of an object within the detection range once the observer'"'"'s in-game motion has been brought to a halt.

2. A system according to claim 1, in which the object detector comprises:

a camera mounted so as to move with the frame; and

an image comparator operable to compare successive images captured by the camera so as to detect the presence, in a captured image, of an object that was not at that image position in a previously captured image.

3. A system according to claim 1, in which the object detector comprises a passive infra-red object detector.

4. A system according to claim 1, in which:

the object detector comprises an emitter and a receiver;

the receiver is operable to detect reflections of signals emitted by the emitter; and

the emitted signals comprise ultrasonic, optical or radio frequency signals.

5. A system according to claim 1, in which the object detector is part of the head mountable display.

6. A system according to claim 1, in which the object detector comprises a camera, separate to the head mountable display and positioned to capture images of the head mountable display.

7. A system according to claim 6, in which the camera is a depth camera configured to detect depth information associated with a captured image.

8. A system according to claim 7, in which the object detector is configured to detect the presence, in a captured image, of an object within a threshold image distance and depth distance of the observer'"'"'s head.

9. A system according to claim 1, the head mountable display comprising a camera for capturing a view of the surrounding real environment, and in which the controller is operable to cause the display element to display at least a portion of the captured view of the surrounding real environment in response to detection of the presence of an object within the detection range.

10. A system according to claim 1, in which the controller is operable to control the one or more shutters to change between a view-obscuring mode and a view-allowing mode in which the one or more shutters allow the observer to view at least a portion of the surrounding real environment.

11. A system according to claim 10, comprising an actuator for moving one or more shutters between a first position corresponding to the view-obscuring mode and a second position corresponding to the view-allowing mode.

12. A system according to claim 10, in which one or more shutters have an electrically alterable optical transmission, and the controller is operable to apply an electrical signal to alter the optical transmission of the one or more shutters.

13. A system according to claim 1, the head mountable display comprising a motion detector for detecting motion of the observer'"'"'s head;

in which the video signal source is operable to provide a video signal for display having an apparent viewpoint dependent upon the detected motion.

14. A system according to claim 13, in which:

the motion detector comprises an accelerometer; and

the controller is operable to allow the observer to view at least a portion of the surrounding real environment in response to detection of a predetermined characteristic motion of the observer'"'"'s head.

15. A system according to claim 13, in which the motion detector comprises:

a camera mounted so as to move with the frame of the head mountable display; and

an image comparator operable to compare successive images captured by the camera so as to detect inter-image motion.

16. A system according to claim 1, in which the head mountable display comprises a pair of earpieces positionable with respect to the observer'"'"'s ears so that, in use, the observer is inhibited from hearing sounds from the observer'"'"'s environment, the system comprising:

a microphone for generating a captured audio signal representing captured sounds from the observer'"'"'s environment;

a detector for detecting the presence of any of a set of one or more characteristic sounds in the captured audio signal; and

a second controller operable to transmit sounds from the observer'"'"'s environment to the observer in response to a detection that one or more of the set of characteristic sounds is present in the captured audio signal.

17. A system according to claim 1, in which the object detector is operable to detect an object approaching the head, and the controller is responsive to the detection of an object approaching the head.

18. A method of operation of a system comprising a head-mountable display having a frame to be mounted onto an observer'"'"'s head, the frame defining one or two eye display positions which, in use, are positioned for viewing by the observer, the frame comprising one or more shutters for obscuring the observer'"'"'s view of the surrounding real environment, and a display element mounted with respect to each of the eye display positions, the display element providing a virtual image of a video display of a video signal from a games machine to the observer;

the method comprising;

detecting the presence of an object within a detection range of the observer'"'"'s head;

in response to a detection, instructing the games machine to cause the observer'"'"'s in-game motion to be brought to a halt; and

controlling operation of the head mountable display so as to allow the observer to view at least a portion of the surrounding real environment in response to detection of the presence of an object within the detection range once the observer'"'"'s in-game motion has been brought to a halt.

19. A non-transitory computer-readable storage medium which stores computer software thereon, the instructions, when executed by a computer, causes the computer to carry out a method of operation of a system comprising a head-mountable display having a frame to be mounted onto an observer'"'"'s head, the frame defining one or two eye display positions which, in use, are positioned for viewing by the observer, the frame comprising one or more shutters for obscuring the observer'"'"'s view of the surrounding real environment, and a display element mounted with respect to each of the eye display positions, the display element providing a virtual image of a video display of a video signal from a games machine to the observer;

the method comprising;

detecting the presence of an object within a detection range of the observer'"'"'s head;

in response to a detection, instructing the games machine to cause the observer'"'"'s in-game motion to be brought to a halt; and

controlling operation of the head mountable display so as to allow the observer to view at least a portion of the surrounding real environment in response to detection of the presence of an object within the detection range once the observer'"'"'s in-game motion has been brought to a halt.