System and method for providing directional information

• US 10,113,877 B1
• Filed: 09/09/2016
• Issued: 10/30/2018
• Est. Priority Date: 09/11/2015
• Status: Active Grant

• Current Assignee: Vortant Technologies, LLC
• Original Assignee: Philip Raymond Schaefer
• Inventors: Schaefer, Philip Raymond
• Primary Examiner(s): Goldman, Richard A
• Application Number:
  US15/260,483
• Time in Patent Office: 781 Days
• Field of Search: 701532, 701533, 701516, 701421, 701411, 701301
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3415 Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents
• CPC Class Codes: G01C 21/3476 using point of interest [POI] information, e.g. a route passing visible POIs
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A system provides feedback to a user to guide the user to point a part of the body at a target of interest. An angle sensor senses the angle in which the part of the user'"'"'s body is pointing, such as the head or the hand. The system computes the angle to a target and compares to the angle in which the part of the user'"'"'s body is pointing and the feedback indicates to the user how to point more closely to the direction of the target. Additional sensors allow the system to update the angle to the target as the position of the user changes. A walking sensor is disclosed to accurately measure the position of the user.

Claims

1. A system for providing directional information to a user about a target of interest comprising

an angle sensor configured to sense information about the orientation of a part of the body of the user and to output a pointing angle;

a location sensor configured to obtain information about the location of the user and/or changes in the location of the user and to output a user location signal;

a target storage module coupled to the angle sensor and to the location sensor and configured to receive a target distance signal from the user, the pointing angle from the angle sensor, and the user location signal from the location sensor, to store a target data element, the target data element comprising information about the pointing angle, the location signal, and the target distance signal for later recall, and to output the target data element;

a target-angle module coupled to the angle sensor, the target storage module, and the location sensor, and configured to receive the pointing angle from the angle sensor, the target data element from the target storage module, and the user location signal from the location sensor, to compute a relative position of the user based on the user location signal and the target data element, to compute a target angle based on the target data element and the relative position of the user, and to output an error signal corresponding to the difference between the pointing angle and the target angle;

and a signal-output module coupled to the target-angle module and configured to receive the error signal from the target-angle module and, based on the error signal, to output a feedback signal that is detectable by the user;

wherein the angle sensor is configured to output an additional pointing angle, wherein the target-angle module is configured to output an additional error signal, and wherein the signal-output module is configured to output an additional feedback signal in response to a reorientation of the part of the body of the user.

2. The system of claim 1, wherein the feedback signal comprises a vibration, and wherein the signal-output module is further configured to vary at least one of:

the intensity of the vibration, the pulse width of the vibration, the frequency of the vibration, and the balance of vibration among a plurality of vibration sources, to correspond to the error signal.

3. The system of claim 1, wherein the feedback signal comprises an audio tone, and wherein the signal-output module is further configured to vary at least one of:

the volume of the audio tone, the frequency of the audio tone, the pulse width of the audio tone, the relative amplitude of the audio tone among a plurality of audio sources, and the apparent direction of the audio tone, to correspond to the error signal.

4. The system of claim 1, wherein the feedback signal comprises a speech output, the speech output comprising a set of words, and wherein the signal-output module is further configured to vary the set of words to correspond to the error signal.

5. The system of claim 1, further comprising a head-worn hardware unit, wherein the head-worn hardware unit contains the angle sensor, and wherein the angle sensor is configured to sense the direction in which the head of the user is pointing, whereby the user can be guided by the feedback signal to be able to look at the target of interest.

6. The system of claim 5, further comprising a head-motion predictor coupled to the angle sensor, the head-motion predictor configured to output a predicted future pointing angle based on the pointing angle received from the angle sensor and on the additional pointing angle, received from the angle sensor,

and wherein the target-angle module is additionally configured to cause the error signal to correspond to the difference between the predicted future pointing angle and the target angle,

whereby time delays in the system and in the user'"'"'s response to the feedback signal can be accommodated, so that the user may more quickly be able to look at a target.

7. The system of claim 1, wherein the target storage module is further configured to receive an approximate target distance from the user, the approximate target distance corresponding to a range of distances, and wherein the target data element comprises information about the approximate target distance, whereby the user can specify an approximate distance rather than an exact distance.

8. A method for providing directional information about a target of interest to a user comprising

measuring the orientation of a part of the body of the user and based on the measured orientation, producing a pointing angle;

receiving information about the location of the user and based on the information about the location of the user, producing a user-location signal;

receiving a target distance from the user and storing a target data element into a memory element, the target data element comprising information about the pointing angle, the user-location signal, and the target distance;

receiving the user-location signal, retrieving the target data element from the memory element, and producing a target angle based on the user-location signal and the retrieved target data element;

producing an error signal corresponding to the difference between the pointing angle and the target angle;

outputting a feedback signal configured to be detectable by the user and corresponding to the error signal;

producing an additional pointing angle based on measuring an additional orientation of the part of the body of the user;

producing an additional target angle to the target of interest corresponding to the additional pointing angle;

producing an additional error signal corresponding to the additional target angle; and

outputting an additional feedback signal corresponding to the additional error signal;

whereby the user can continue to orient the part of the body of the user toward the target of interest.

9. The method of claim 8, wherein the outputting a feedback signal comprises at least one of:

outputting a vibration signal, the vibration signal configured to correspond to the error signal;

outputting an audio tone, the audio tone configured to correspond to the error signal; and

outputting words of speech, the words of speech configured to correspond to the error signal.

10. The method of claim 8, wherein the measuring the orientation of a part of the body of the user comprises measuring the orientation of the head of the user, whereby the user can be guided by the feedback signal to be able to look at the target of interest.

11. The method of claim 10, further comprising producing a predicted future head pointing angle based on the pointing angle and on the additional pointing angle,

wherein the producing an error signal comprises comparing the target angle to the predicted future head pointing angle.

12. The method of claim 8, wherein the receiving a target distance from the user comprises receiving an approximate target distance, the approximate target distance corresponding to a range of distances.