Method of controlling display of electronic device and electronic device

• US 9,946,393 B2
• Filed: 08/25/2015
• Issued: 04/17/2018
• Est. Priority Date: 08/25/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Jae-Birm, Cho, Chi-Hyun
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US14/835,157
• Publication Number:
  US 20160055680A1
• Time in Patent Office: 966 Days
• Field of Search: 345633
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A method of controlling a display of an electronic device and the electronic device thereof are provided. The method includes measuring an amount of movement of a user, when the movement of the user is detected while a Virtual Reality (VR) operation is provided to the user; comparing the amount of the movement with a threshold value corresponding to a type of content being used by the user; and changing the VR operation into a see-through operation, when the amount of the movement is greater than the threshold value corresponding to the type of the content.

Claims

1. A method of controlling a display of an electronic device, the method comprising:

displaying a Virtual Reality (VR) operation screen on a see-closed display of the electronic device;

measuring an amount of movement of a user wearing a head mounted electronic device, to which the electronic device is detachably mounted, when the movement of the user is detected while the VR operation screen is displayed on the see-closed display;

comparing the amount of the movement with a threshold value corresponding to a type of content being used in the VR operation among a plurality of threshold values that correspond to a plurality of type of content;

photographing a front view from the user by using a camera located in an opposite direction to a screen of the see-closed display, when the amount of the movement is greater than the threshold value;

displaying a preview screen according to the photographing on at least a portion of the screen of the see-closed display; and

when a position of the user changes by an amount greater than a specified value, the electronic device determines that a current situation is an emergency situation and automatically changes a current operation into a see-through operation.

2. The method of claim 1, wherein the threshold value corresponding to game content is specified greater than the threshold value corresponding to video content.

3. A method of controlling a display of an electronic device, the method comprising:

displaying a Virtual Reality (VR) operation screen on a see-closed display of the electronic device;

photographing a front view from a user wearing a head mounted electronic device, to which the electronic device is detachably mounted, by using a camera located in an opposite direction to a screen of the see-closed display, when it is detected that an object external to the head mounted electronic device approaches the user, while the VR operation screen is displayed on the see-closed display;

displaying a preview screen according to the photographing on at least a portion of the screen of the see-closed display;

measuring a direction in which the object approaches;

guiding the direction in which the object approaches the user; and

when a position of the user changes by an amount greater than a specified value, a current situation is determined to be an emergency situation and a current operation is changed into a see-through operation.

4. The method of claim 3, wherein guiding the direction in which the object approaches comprises displaying an image indicating the direction in which the object approaches on the see-closed display.

5. An electronic device comprising:

a see-closed display;

a camera located in an opposite direction to a screen of the see-closed display; and

a controller configured to;

display a Virtual Reality (VR) operation screen on the see-closed display;

measure an amount of movement of a user wearing a head mounted electronic device, to which the electronic device is detachably mounted, when the movement of the user is detected while the VR operation screen is displayed on the see-closed display;

compare the amount of the movement with a threshold value corresponding to a type of content being used in the VR operation among a plurality of threshold values that correspond to a plurality of type of content;

photograph a front view from the user by using the camera, when the amount of the movement is greater than the threshold value; and

display a preview screen according to the photographing on at least portion of the screen of the see-closed display,

wherein when a position of the user changes by an amount greater than a specified value, the electronic device determines that a current situation is an emergency situation and automatically changes a current operation into a see-through operation.

6. An electronic device comprising:

a see-closed display;

a camera located in an opposite direction to a screen of the see-closed display; and

a controller configured to;

display a Virtual Reality (VR) operation screen on the see-closed display;

photograph a front view from a user wearing a head mounted electronic device, to which the electronic device is detachably mounted, by using the camera, when it is detected that an object external to the head mounted electronic device approaches the user, while the VR operation screen is displayed on the see-closed display;

display a preview screen according to the photographing on at least portion of the screen of the see-closed display;

measure a direction in which the object approaches;

guide the direction in which the object approaches the user; and

when a position of the user changes by an amount greater than a specified value, determine that a current situation is an emergency situation and automatically change a current operation into a see-through operation.

7. The electronic device of claim 6, wherein the controller is further configured to guide the direction in which the object approaches by displaying an image indicating the direction in which the object approaches on the see-closed display.

8. A head mounted electronic device comprising:

a movement sensor;

a see-closed display;

a camera located in an opposite direction to a screen of the see-closed display; and

a controller configured to;

display a Virtual Reality (VR) operation screen on the see-closed display;

measure an amount of movement of a user wearing the head mounted electronic device, when the movement of the user is detected through the movement sensor while the VR operation screen is displayed on the see-closed display;

compare the amount of the movement with a threshold value corresponding to a type of content being used in the VR operation among a plurality of threshold values that correspond to a plurality of type of content;

photograph a front view from the user by using the camera, when the amount of the movement is greater than the threshold value; and

display a preview screen according to the photographing on at least portion of the screen of the see-closed display,

wherein when a position of the user changes by an amount greater than a specified value, a current situation is determined to be an emergency situation and a current operation is changed into a see-through operation.

9. The head mounted electronic device of claim 8, wherein the threshold value corresponding to game content is specified greater than the threshold value corresponding to video content.

10. A head mounted electronic device comprising:

an approaching sensor;

a see-closed display;

a camera located in an opposite direction to a screen of the see-closed display; and

a controller configured to;

display a Virtual Reality (VR) operation screen on the see-closed display;

photograph a front view from a user wearing the head mounted electronic device by using the camera, when it is detected that an object external to the head mounted electronic device approaches the user through the approaching sensor, while the VR operation screen is displayed on the see-closed display;

display a preview screen according to the photographing on at least portion of the screen of the see-closed display;

measure a direction in which the object approaches;

guide the direction in which the object approaches the user; and

when a position of the user changes by an amount greater than a specified value, a current situation is determined to be an emergency situation and a current operation is changed into a see-through operation.

11. The head mounted electronic device of claim 10, wherein the approaching sensor is at least one of a space recognition sensor and a wireless communication module.

12. The head mounted electronic device of 10, wherein the controller is further configured to display an image indicating the direction in which the object approaches on the see-closed display.