Text Selection Using HMD Head-Tracker and Voice-Command

• US 20150138073A1
• Filed: 11/13/2014
• Published: 05/21/2015
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Hennelly, Sean
• Granted Patent: US 9,383,816 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G09G 5/10 Intensity circuits

Abstract

A joint head tracker and voice command in a headset computer enables hands-free user text selection. The method and system enables an end-user to select sections of text without requiring use of a mouse cursor control input device. Embodiments include a headset computer, including a processor, configured to display text in a screen view. The computer further configured to place a first point within the displayed text according to one or more of first head tracking information, first voice commands and first gestures, and place a second point within the displayed text according to second head tracking information, second voice commands and second gestures. The computer further configured to select a text section between the first point and the second point in response to one or more of third head tracking information, third voice commands and third gestures, and display the selected text section as a highlighted text section.

Claims

1. A computer-based method of selecting text, comprising:

with a headset computer, including a processor, the headset computer displaying text in a screen view;

placing a first point within the displayed text according to one or more of first head tracking information, first voice commands and first gestures;

placing a second point within the displayed text according to second head tracking information, second voice commands and second gestures;

selecting a text section between the first point and the second point in response to one or more of third head tracking information, third voice commands and third gestures; and

displaying the selected text section as a highlighted text section.

2. The method of claim 1, further including making the highlighted text section available for a common operation.

3. The method of claim 2, wherein the common operation includes one or more of copy, paste, cut, move, email and forward.

4. The method of claim 2, wherein the common operation is selectable by one or more of (i) a pop-up option window and (ii) a drop down menu.

5. The method of claim 1, wherein placing the first point or placing the second point further includes manipulating a pointer within the screen view until the pointer reaches a desired location, and using one or more of a particular voice command or a particular gesture to instantiate the first point or second point.

6. The method of claim 5, wherein the pointer includes an associated symbol that provides one or more of (i) a text magnifier and (ii) a text delineator.

7. The method of claim 1, wherein each of the first point and the second point is characterized by a symbol.

8. The method of claim 7, wherein the symbol is a bracket.

9. The method of claim 7, wherein the symbol periodically appears and disappears for a predetermined duration after being placed.

10. The method of claim 1, wherein the highlighted text section is characterized by a colored background.

11. A system for facilitating hands-free text selection, comprising:

a headset computer, including a processor, configured to;

display text in a screen view;

place a first point within the displayed text according to one or more of first head tracking information, first voice commands and first gestures;

place a second point within the displayed text according to second head tracking information, second voice commands and second gestures;

select a text section between the first point and the second point in response to one or more of third head tracking information, third voice commands and third gestures; and

display the selected text section as a highlighted text section.

12. The system of claim 11, wherein the headset computer is further configured to make the highlighted text section available for a common operation.

13. The system of claim 12, wherein the common operation includes one or more of copy, paste, cut, move, email and forward.

14. The system of claim 12, wherein the common operation is selectable by one or more of (i) a pop-up option window and (ii) a drop down menu.

15. The system of claim 11, wherein placing the first point or placing the second point further includes manipulating a pointer within the screen view until the pointer reaches a desired location, and using one or more of a particular voice command or a particular gesture to instantiate the first point or second point.

16. The system of claim 15, wherein the pointer includes an associated symbol that provides one or more of (i) a text magnifier and (ii) a text delineator.

17. The system of claim 11, wherein each of the first point and the second point is characterized by a symbol.

18. The system of claim 17, wherein the symbol is a bracket.

19. The system of claim 17, wherein the symbol periodically appears and disappears for a predetermined duration after being placed.

20. The system of claim 11, wherein the highlighted text section is characterized by a colored background.