Headset computer operation using vehicle sensor feedback for remote control vehicle

• US 9,442,290 B2
• Filed: 03/14/2013
• Issued: 09/13/2016
• Est. Priority Date: 05/10/2012
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Parkinson, Christopher, Pombo, Stephen A., Jacobsen, Jeffrey J., Hollick, David
• Primary Examiner(s): LI, TRACY Y
• Application Number:
  US13/830,931
• Publication Number:
  US 20130300649A1
• Time in Patent Office: 1,279 Days
• Field of Search: 348/158
• US Class Current: 1/1
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A system performs stable control of moving devices (such as a helicopter or robot) with attached camera(s), providing live imagery back to a head-mounted computer (HMC). The HMC controls the moving device. The HMC user specifies a desired path or location for the moving device. Camera images enable the user-specified instructions to be followed accurately and the device'"'"'s position to be maintained thereafter. A method of controlling a moving device with a headset computer includes analyzing, at the headset computer, at least one image received from the moving device to form an indication of change in position of the moving device. The method displays to a user of the headset computer the indication of change in position of the moving device. The method can additionally include enabling the user to control the moving device.

Claims

1. A method of controlling a moving device with a headset computer, the method comprising:

analyzing, at the headset computer, at least one image received from the moving device to form an indication of change in position of the moving device based on changes in position of one or more objects in the at least one image;

displaying to a user of the headset computer the indication of change in position of the moving device; and

enabling the user to control the moving device by analyzing user input, comparing the user input to a limit of the moving device, and reducing movement commands to the movement device to be within the limit.

2. The method of claim 1, further comprising enabling the user to control the moving device by user input, the user input being at least one of head movement, hand gesture, voice command, or digital command.

3. The method of claim 1, further comprising transmitting at least one directional or angular command to the moving device.

4. The method of claim 1, wherein analyzing the at least one image further includes transmitting the at least one image to a host computer to perform the analysis and receiving the analysis from the host computer.

5. The method of claim 4, further comprising coupling the headset computer and the host computer for communication over a wireless transport.

6. The method of claim 1, further comprising coupling the headset computer and the moving device for communication over a wireless transport.

7. The method of claim 1, further comprising, displaying, to the user, the at least one images from the moving device, and further overlaying the indication of change of the moving device on the at least one images.

8. The method of claim 1, wherein enabling the user to control the device further includes sending commands to an autopilot of the motion device.

9. A system for controlling a moving device with a headset computer, the system comprising:

an analysis module configured to analyze, at the headset computer, at least one image received from the moving device to form an indication of change in position of the moving device based on changes in position of an object in the at least one image;

a display configured to display to a user of the headset computer the indication of change in position of the moving device; and

a control module configured to enable the user to control the moving device by analyzing user input, comparing the user input to a limit of the moving device, and reducing movement commands to the movement device to be within the limit.

10. The system of claim 9, wherein the control module is further configured to enable the user to control the moving device by user input, the user input being at least one of head movement, hand gesture, voice command, or digital command.

11. The system of claim 9, further comprising transmitting at least one directional or angular command to the moving device.

12. The system of claim 9, wherein the analysis module is further configured to transmit the at least one image to a host computer to perform the analysis and receive the analysis from the host computer.

13. The system of claim 12, wherein the headset computer and the host computer are coupled for communication over a wireless transport.

14. The system of claim 9, wherein the headset computer and the moving device are coupled for communication over a wireless transport.

15. The system of claim 9, wherein the display module is further configured to display, to the user, the at least one images from the moving device, and further configured to overlay the indication of change of the moving device on the at least one images.

16. The system of claim 9, wherein the control module is further configured to send commands to an autopilot of the motion device.