Text selection using HMD head-tracker and voice-command

• US 9,383,816 B2
• Filed: 11/13/2014
• Issued: 07/05/2016
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Hennelly, Sean
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US14/540,905
• Publication Number:
  US 20150138073A1
• Time in Patent Office: 600 Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G09G 5/10 Intensity circuits

Abstract

A joint head tracker and voice command in a headset computer enables hands-free user text selection. The method and system enables an end-user to select sections of text without requiring use of a mouse cursor control input device. Embodiments include a headset computer, including a processor, configured to display text in a screen view. The computer further configured to place a first point within the displayed text according to one or more of first head tracking information, first voice commands and first gestures, and place a second point within the displayed text according to second head tracking information, second voice commands and second gestures. The computer further configured to select a text section between the first point and the second point in response to one or more of third head tracking information, third voice commands and third gestures, and display the selected text section as a highlighted text section.

Claims

1. A computer-based method of selecting text, comprising:

with a headset computer, including a processor, the headset computer displaying text in a screen view;

placing a first point, characterized by a first symbol, within the displayed text according to one or more of first head tracking information, first voice commands and first gestures, the first symbol periodically appearing and disappearing for a predetermined duration after being placed;

placing a second point, characterized by a second symbol, within the displayed text according to second head tracking information, second voice commands and second gestures, the second symbol periodically appearing and disappearing for a predetermined duration after being placed;

selecting a text section between the first point and the second point in response to one or more of third head tracking information, third voice commands and third gestures; and

displaying the selected text section as a highlighted text section.

2. The method of claim 1, further including making the highlighted text section available for a common operation.

3. The method of claim 2, wherein the common operation includes one or more of copy, paste, cut, move, email and forward.

4. The method of claim 2, wherein the common operation is selectable by one or more of (i) a pop-up option window and (ii) a drop down menu.

5. The method of claim 1, wherein placing the first point or placing the second point further includes manipulating a pointer within the screen view until the pointer reaches a desired location, and using one or more of a particular voice command or a particular gesture to instantiate the first point or second point.

6. The method of claim 5, wherein the pointer includes an associated symbol that provides one or more of (i) a text magnifier and (ii) a text delineator.

7. The method of claim 1, wherein the first symbol is a bracket and the second symbol is a bracket.

8. The method of claim 1, wherein the highlighted text section is characterized by a colored background.

9. A system for facilitating hands-free text selection, comprising:

a headset computer, including a processor, configured to;

display text in a screen view;

place a first point, characterized by a first symbol, within the displayed text according to one or more of first head tracking information, first voice commands and first gestures, the first symbol periodically appearing and disappearing for a predetermined duration after being placed;

place a second point, characterized by a second symbol, within the displayed text according to second head tracking information, second voice commands and second gestures, the second symbol periodically appearing and disappearing for a predetermined duration after being placed;

select a text section between the first point and the second point in response to one or more of third head tracking information, third voice commands and third gestures; and

display the selected text section as a highlighted text section.

10. The system of claim 9, wherein the headset computer is further configured to make the highlighted text section available for a common operation.

11. The system of claim 10, wherein the common operation includes one or more of copy, paste, cut, move, email and forward.

12. The system of claim 10, wherein the common operation is selectable by one or more of (i) a pop-up option window and (ii) a drop down menu.

13. The system of claim 9, wherein placing the first point or placing the second point further includes manipulating a pointer within the screen view until the pointer reaches a desired location, and using one or more of a particular voice command or a particular gesture to instantiate the first point or second point.

14. The system of claim 13, wherein the pointer includes an associated symbol that provides one or more of (i) a text magnifier and (ii) a text delineator.

15. The system of claim 9, wherein the first symbol is a bracket and the second symbol is a bracket.

16. The system of claim 9, wherein the highlighted text section is characterized by a colored background.