First-Person Viewer for Unmanned Vehicles

• US 20150210387A1
• Filed: 01/26/2015
• Published: 07/30/2015
• Est. Priority Date: 01/24/2014
• Status: Active Grant

• Current Assignee: Maxlinear Incorporated
• Original Assignee: Maxlinear Incorporated
• Inventors: Ling, Curtis
• Granted Patent: US 10,077,109 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 10/14 with four distinct rotor axes, e.g. quadcopters
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 50/19 using electrically powered motors
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005

Abstract

A remote control unit of an unmanned vehicle comprises a first communications subsystem, a processor, and a graphics processor. The first communications subsystem may be operable to receive sensor data via a first communication link between the remote control unit and the unmanned vehicle. The processor may be operable to determine a position and orientation of the unmanned vehicle based on the sensor data. The first communication subsystem may be operable to receive, via a second communication link between the remote control unit and the unmanned vehicle, a live first-person view from a camera of the unmanned vehicle. The graphics processor may be operable to generate a virtual first-person view from apriori data based on the sensor data. The processor may be operable to determine whether to present said live first-person view or said virtual first-person view based on signal quality of said second communication link.

Claims

1. A system comprising:

a remote control unit of an unmanned vehicle, the remote control unit comprising;

a first communication subsystem operable to;

receive sensor data via a first communication link between said remote control unit and said unmanned vehicle; and

receive a live first-person view from a camera of said unmanned vehicle via a second communication link between said remote control unit and said unmanned vehicle;

a graphics processor operable to generate a virtual first-person view from apriori data based on said sensor data; and

a processor operable to;

determine a position and orientation of said unmanned vehicle based on said sensor data; and

determine whether to present said live first-person view or said virtual first-person view on a user interface of said control unit based on signal quality of said second communication link.

2. The system of claim 1, wherein:

said processor is operable to determine to present said virtual first-person view when said signal quality is below a determined threshold; and

said processor is operable to determine to present said live first-person view when said signal quality is above said determined threshold.

3. The system of claim 1, wherein said sensor data comprises data from one or both of:

data from a global navigation system satellite receiver onboard said unmanned vehicle, and data from a telemeter onboard said unmanned vehicle.

4. The system of claim 1, wherein:

said first communication link provides guaranteed data rate and latency; and

said second communication link provides best effort data rate and latency.

5. The system of claim 1, wherein said apriori data comprises topographical data.

6. The system of claim 1, wherein said apriori data comprises a photograph previously captured from said position.

7. The system of claim 1, wherein said communication subsystem is operable to adjust bandwidth of said second communication link based on a travel speed of said unmanned vehicle.

8. The system of claim 1, wherein said processor is operable to predict said position and orientation of said unmanned vehicle based on said sensor data.

9. The system of claim 1, comprising circuity of said unmanned vehicle operable to generate said virtual first-person view from said apriori data based on said sensor data.

10. The system of claim 9, wherein said circuitry of said unmanned vehicle is operable to determine differences between said virtual first-person view and said live first-person view.

11. The system of claim 10, wherein said circuitry of said unmanned vehicle is operable to:

encode said differences into a data block; and

transmit said data block via said second communication link.

12. The system of claim 1, comprising a second communication subsystem operable to retrieve said apriori data from a network database.

13. A method comprising:

in a remote control unit of an unmanned vehicle;

receiving sensor data via a first communication link between said remote control unit and said unmanned vehicle;

receiving a live first-person view from a camera of said unmanned vehicle via a second communication link between said remote control unit and said unmanned vehicle,

determining a position and orientation of said unmanned vehicle based on said sensor data;

generating a virtual first-person view from apriori data based on said sensor data; and

determining whether to present said live first-person view or said virtual first-person view on a user interface of said control unit based on signal quality of said second communication link.

14. The method of claim 13, comprising:

determining to present said virtual first-person view when said signal quality is below a determined threshold; and

determining to present said live first-person view when said signal quality is above said determined threshold.

15. The method of claim 13, wherein said sensor data comprises data from one or both of:

data from a global navigation system satellite receiver onboard said unmanned vehicle, and data from a telemeter onboard said unmanned vehicle.

16. The method of claim 13, wherein:

said first communication link provides guaranteed data rate and latency; and

said second communication link provides best effort data rate and latency.

17. The method of claim 13, wherein said apriori data comprises topographical data.

18. The method of claim 13, wherein said apriori data comprises photographs previously-captured from said position.

19. The method of claim 13, comprising adjusting bandwidth of said second communication link based on a travel speed of said unmanned vehicle.

20. The method of claim 13, comprising predicting a position and orientation of said unmanned vehicle based on said sensor data.