Wearable glasses and method of providing content using the same

• US 10,725,556 B2
• Filed: 10/15/2019
• Issued: 07/28/2020
• Est. Priority Date: 07/31/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Joo, Ga-hyun
• Primary Examiner(s): Amin, Jwalant
• Application Number:
  US16/601,898
• Publication Number:
  US 20200042098A1
• Time in Patent Office: 287 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A wearable glasses is provided. The wearable glasses includes a sensing circuit, a communication interface, a display, a memory and one or more processors. The sensing circuit senses movement information of a user wearing the wearable glasses. The communication interface receives notification message information. The display displays the notification message information within an angle of view of the user wearing the wearable glasses. The memory and one or more processors execute one or more programs including instructions to obtain environment information, determine a movement state of the user based on the sensed movement information of the user and the environment information, and control the display to display the received notification message information according to the movement state of the user.

Claims

1. A wearable glasses comprising:

a sensing circuit configured to sense movement information of a user wearing the wearable glasses;

a communication circuit configured to receive notification message information;

a display configured to display the notification message information within an angle of view of the user wearing the wearable glasses; and

at least one memory configured to store one or more programs; and

one or more processors configured to execute the one or more programs including instructions to;

obtain environment information including at least one of information about external sounds generated within a certain distance from the wearable glasses and information about an external image obtained by using an image sensor;

determine a movement state of the user based on the sensed movement information of the user and the environment information;

determine an output form for the received notification message as at least one of an audio signal or a video signal based on the obtained environment information; and

control the wearable glasses to output the received notification message information in the determined output form according to the movement state of the user.

2. The wearable glasses of claim 1, wherein the one or more processors are further configured to execute the one or more programs including instructions to determine whether the user is wearing the wearable glasses by using at least one sensor included in the sensing circuit, and control the sensing circuit to sense a movement of the user when it is determined that the user is wearing the wearable glasses.

3. The wearable glasses of claim 1, wherein the one or more processors are further configured to execute the one or more programs including instructions to determine the movement state of the user by using at least one of acceleration information, tilt information, biometric information, altitude information, atmospheric pressure information, eyeball tracking information, and position information measured by the sensing circuit.

4. The wearable glasses of claim 1, wherein the one or more processors are further configured to execute the one or more programs including instructions to determine the movement state of the user using movement information of the user received from an external device.

5. The wearable glasses of claim 1, wherein the one or more processors are further configured to execute the one or more programs including instructions to determine a time to display the notification message information based on the movement state of the user and control the display to display the notification message information at the determined time.

6. The wearable glasses of claim 5, wherein the one or more processors are further configured to execute the one or more programs including instructions to output the notification message information at a present time when a movement speed of the user is less than a threshold speed, and when the movement speed of the user is equal to or greater than the threshold speed, the one or more processors are further configured to execute the one or more programs including instructions to determine to output the notification message information at a different time than the present time.

7. The wearable glasses of claim 6, wherein the different time comprises at least one of a point of time when a user input for requesting to output the notification message information is received, a point of time when the movement state of the user is changed, and a point of time when a preset time has passed.

8. The wearable glasses of claim 1, wherein the one or more processors are further configured to execute the one or more programs including instructions to determine a display form for displaying the notification message information based on the movement state of the user and control the display to display the notification message information according to the determined display form.

9. The wearable glasses of claim 8, wherein when a movement speed of the user is equal to or greater than a threshold speed, the one or more processors are further configured to execute the one or more programs including instructions to display a portion of the notification message information, and when the movement speed of the user is less than the threshold speed, the one or more processors are further configured to execute the one or more programs including instructions to display an entirety of the notification message information.

10. The wearable glasses of claim 1, wherein the display is further configured to display the notification message information in a form of highlighting a keyword in the notification message information or setting a transparency of the notification message information.

11. The wearable glasses of claim 1, wherein the environment information includes the information about external sounds generated within a certain distance from the wearable glasses, and

in response to the external sounds being greater than or equal to a threshold, determine the output form as the video signal and control the display to display the received notification message information as the video signal, and in response to the external sounds being less than the threshold, determine the output form as the audio signal and control the wearable glasses to output the notification message as the audio signal.

12. The wearable glasses of claim 1, wherein the environment information includes the information about an external image obtained by using an image sensor, and

wherein in response to edges in the obtained external image being greater than a threshold number, determine the output form as the audio signal and control the wearable glasses to output the received notification message as the audio signal, and in response to the edges in the obtained external image being less than or equal to the threshold number, determine the output form as the video signal and control the wearable glasses to output the received notification message as the video signal to the display.

13. A method of providing information, wherein the method is performed by a wearable glasses and comprises:

receiving notification message information;

sensing movement information of a user wearing the wearable glasses and obtaining environment information including at least one of information about external sounds generated within a certain distance from the wearable glasses and information about an external image obtained by using an image sensor;

determining a movement state of the user based on the sensed movement information of the user and the environment information;

determining an output form for the received notification message as at least one of an audio signal or a video signal based on the obtained environment information; and

outputting the received notification message information in the determined output form according to the movement state of the user.

14. The method of claim 13, wherein the sensing of movement information of the user comprises:

determining whether the user is wearing the wearable glasses by using at least one sensor included in the wearable glasses; and

sensing the movement information of the user when it is determined that the user is wearing the wearable glasses.

15. The method of claim 13, wherein the displaying of the received notification message information comprises:

determining a time to display the notification message information; and

displaying the notification message information at the determined time.

16. The method of claim 15, wherein the determining the time to display the notification message information comprises determining to output the notification message information at a present time when a movement speed of the user is less than a threshold speed and to output the notification message information at a different time than the present time when the movement speed of the user is equal to or greater than the threshold speed.

17. The method of claim 13, wherein the displaying of the received notification message information comprises:

determining a display form for displaying the notification message information; and

displaying the notification message information according to the determined display form.

18. The method of claim 17, wherein the determining of the display form comprises:

determining to output a portion of the notification message information when a movement speed of the user is equal to or greater than a threshold speed and to output an entirety of the notification message information when the movement speed of the user is less than the threshold speed.

19. The method of claim 13, wherein the displaying the received notification message information according to the movement state of the user comprises:

displaying the notification message information in a form of highlighting a keyword in the notification message information or setting a transparency of the notification message information.