Display device and method of operating the same

• US 9,557,961 B2
• Filed: 02/21/2014
• Issued: 01/31/2017
• Est. Priority Date: 09/05/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Park, Jongseok, Lee, Sanghyuck
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): Chowdhury, Rayeez
• Application Number:
  US14/186,176
• Publication Number:
  US 20150067516A1
• Time in Patent Office: 1,075 Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces

Abstract

A wearable electronic device including a wireless communication unit configured to be wirelessly connected to a projector for projecting a stored presentation onto a screen of an external device; a main body configured to be worn by a user; a microphone integrally connected to the main body; a display unit configured to be attached to the main body; and a controller configured to match voice information input through the microphone with corresponding contents of the stored presentation, and display at least a following portion of content that follow the corresponding contents on the display unit.

Claims

1. A wearable electronic device, comprising:

a wireless communication unit configured to be wirelessly connected to a projector for projecting a stored presentation onto a screen of an external device;

a main body configured to be worn by a user;

a microphone integrally connected to the main body;

a sensing unit configured to detect a bio state of the user wearing the electronic device;

a display unit configured to be attached to the main body; and

a controller configured to;

match a voice information input through the microphone with a portion of the stored presentation, and

display a part of the stored presentation that follows the portion of the stored presentation matching the voice information input on the display unit, wherein the controller is further configured to change an output size of the part of the stored presentation that follows the portion of the stored presentation when the bio state indicates the user to be in a tense state.

2. The electronic device of claim 1, wherein the controller is further configured to:

convert the voice information into text, and

search the stored presentation for the converted text so as to match the voice information with the portion of the stored presentation.

3. The electronic device of claim 2, wherein the controller is further configured to:

display the converted text on the display unit with a different highlighting effect to distinguish the displayed converted text from the part of the stored presentation that follows the portion of the stored presentation.

4. The electronic device of claim 1, wherein the display unit includes first and second display regions for first and second eyes of the user.

5. The electronic device of claim 4, wherein the controller is further configured to:

display, on the first display region, the part of the stored presentation, and

display, on the second display region, at least a portion of a same image as an image of the presentation projected onto the screen.

6. The electronic device of claim 5, wherein the controller is further configured to display a progress indicator on the second display region indicating a progress state of the presentation based on the image projected onto the screen.

7. The electronic device of claim 5, wherein the presentation is stored in multiple pages of content, and

wherein the controller is further configured to:

display, on the second display region, the multiple pages of content as overlapping and with a page currently being projected on the screen of the external device being displayed first among the multiple pages.

8. The electronic device of claim 7, wherein the controller is further configured to display a page option on the display unit that can be touched or proximity touched to turn pages of the multiple pages.

9. The electronic device of claim 4, wherein the controller is further configured to:

display the portion of the stored presentation on the first display region,

search for additional information about the displayed portion of the stored presentation, and

display the additional information on the second display region.

10. The electronic device of claim 1, wherein the controller is further configured to:

convert the part of the stored presentation into a voice signal,

output the voice signal to an ear of the user, and

adjust an output speed of the voice signal to correspond to an input speed of the voice information.

11. The electronic device of claim 1, further comprising:

wherein the controller is further configured to highlight the part of the stored presentation when the detected bio state indicates the user is in the tense state.

12. The electronic device of claim 1, further comprising:

at least one camera on the main body and configured to detect a gesture input by the user.

13. The electronic device of claim 12, wherein the controller is further configured to project an image output to the display unit onto the screen of the external device, when the detected gesture input includes the user waving their hand between the main body and the screen when the main body and the screen face each other.

14. The electronic device of claim 12, wherein the controller is further configured to magnify the part of the stored presentation displayed on the display unit when the detected gesture input includes a rotating hand gesture in a first direction, and reduce the part of the stored presentation displayed on the display unit when the detected gesture input includes a rotating hand gesture in a second direction opposite to the first direction.

15. The electronic device of claim 12, wherein the controller is further configured to scroll through lines of the part of the stored presentation displayed on the display unit in a direction corresponding to a direction of a touch and drag applied to a region of the main body including a touch sensor.

16. The electronic device of claim 12, wherein the controller is further configured to forward page through pages of the part of the stored presentation based on a tapping touch input on a first region of the main body, and reverse page through pages of the part of the stored presentation based on a tapping touch input on a second region of the main body.

17. The electronic device of claim 4, further comprising:

at least one camera on the main body and configured to track an eye movement of the user,

wherein when the detected eye movement is fixed to a specific object output to the first display region, the controller is further configured to perform a search associated with the specific object and display results of the search on the second display region.

18. The electronic device of claim 1, wherein the controller the voice information input through the microphone with preset voice commands, and when the voice information matches a preset voice command, execute the preset voice command.

19. The electronic device of claim 1, wherein the wireless communication unit is further configured to receive a wireless signal corresponding to information relating to the presentation from an external apparatus, and

wherein the controller is further configured to convert the wireless signal into characters, and display the characters on a region of the display unit or store the characters in a document file format in which the characters are externally transmittable.

20. A method of controlling a wearable electronic device including a main body configured to be worn by a user, the method comprising:

wirelessly connecting, via a wireless communication unit, to a projector for projecting a stored presentation onto a screen of an external device;

matching, via a controller, a voice information input through a microphone integrally connected with the main body with a portion of the stored presentation; and

displaying, via a display unit, a part of the stored presentation that follows the portion of the stored presentation which matches the voice information input on the display unit,

wherein the method further comprises changing an output size of the part of the stored presentation that follows the portion of the stored presentation when the bio date indicates the user to be in a tense state.