External user interface for head worn computing

• US 10,254,856 B2
• Filed: 05/19/2014
• Issued: 04/09/2019
• Est. Priority Date: 01/17/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Osterhout, Ralph F.
• Primary Examiner(s): Yang, Nan-Ying
• Application Number:
  US14/280,752
• Publication Number:
  US 20150205388A1
• Time in Patent Office: 1,786 Days
• CPC Class Codes: B43K 29/00 Combinations of writing implements with other articles
• CPC Class Codes: B43K 29/004 with more than one object
• CPC Class Codes: B43K 29/08 with measuring, computing or indicating devices
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC).

Claims

1. A method, comprising:

presenting a virtual line as digital content in a see-through display of a head-worn computer as a guide for alignment of pen strokes written by a wearer of the head-worn computer;

tracking a motion of a pen held by the wearer relative to the virtual line as the pen is moving along a surface when guided by the virtual line, wherein the tracking involves using a camera in the head-worn computer to capture images of a pen motion, and overlaying on the captured images of the motion the virtual line; and

interpreting the motion of the pen relative to the virtual line to determine a written pattern,

wherein the pen includes an IMU that detects pen movements, and wherein the pen movements detected by the IMU are used in connection with the motion of the pen relative to the virtual line to determine the written pattern.

2. The method of claim 1 wherein the virtual line is presented as a portion of a note.

3. The method of claim 1 wherein the virtual line is presented as a portion of a message template.

4. The method of claim 1 wherein the virtual line is presented as a portion of an email template.

5. The method of claim 1 wherein the virtual line is presented as a portion of a writing teaching platform.

6. The method of claim 1 wherein the virtual line is presented as a portion of a painting teaching platform.

7. The method of claim 1 wherein the virtual line is presented as a portion of a drawing teaching platform.

8. The method of claim 1, wherein the written pattern is presented in the see-through display relative to the virtual line.

9. The method of claim 8, wherein the presentation is in real time.