Remote vehicle control system

• US 20070072662A1
• Filed: 09/28/2006
• Published: 03/29/2007
• Est. Priority Date: 09/28/2005
• Status: Active Grant

• Current Assignee: United States Department Of Health And Human Services
• Original Assignee: United States Department Of Health And Human Services
• Inventors: Templeman, James
• Granted Patent: US 7,731,588 B2
• Time in Patent Office: Days
• US Class Current: 463/6
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/30 characterized by output arrangements for receiving control signals generated by the game device
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/8076 Shooting
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

An apparatus for remotely controlling the movements of a vehicle includes a user input means, such as a gamepad with a plurality of joystick-controlled and button-controlled outputs, a tracker, and optional sliding foot pedals; a processor for running a control mapping algorithm; and a remote vehicle controller. A control mapping algorithm maps the outputs to the remote-controlled vehicle'"'"'s course, heading, displacement, and camera view, with the joysticks mapped to provide open loop directional control over the vehicle'"'"'s course and heading, the tracker providing open loop control over the camera view, and the optional sliding foot pedals providing open loop control over the vehicle'"'"'s displacement. The remote vehicle controller sends commands to on-board controls to direct the vehicle'"'"'s movement. A video stream from an on-board camera is transmitted back to the operator station for viewing on a computer desktop display or a head mountable display.

Claims

1. An apparatus for controlling the movements of a vehicle having on-board controls for independently controlling the course and heading of the vehicle in response to a remote operator'"'"'s control and an on-board camera/video transmitter for recording and transmitting a video stream of the camera'"'"'s view of the physical environment within which the vehicle is operating, comprising:

a gamepad including a first joystick and a second joystick and having a plurality of outputs responsive to user-controlled movements of each joystick and user-controlled buttons;

a processor including a control mapping algorithm and a remote vehicle controller, wherein the control mapping algorithm maps the gamepad outputs to the remote-controlled vehicle course, heading, and displacement wherein the first joystick is mapped to provide an open loop directional control over steering of the vehicle and the second joystick is mapped to provide an open loop directional control over offset of the vehicle to thereby provide an open-loop control over the vehicle course and heading, and the remote vehicle controller sends commands to the on-board controls to direct the movement of the remote vehicle; and

a display for receiving the video stream and displaying the movement of the vehicle to the operator.

2. An apparatus as in claim 1, wherein the remote control vehicle includes a turret, the remote vehicle controller includes control over the rotation of the turret, and the processor further comprises control mapping the turret rotation of the remote vehicle as a directional open-loop heading control.

3. An apparatus as in claim 1, wherein the second joystick is mapped to provide a course-offset.

4. An apparatus as in claim 1, wherein the second joystick is mapped to provide a heading-offset.

5. An apparatus as in claim 1, further comprising a tracker attached to said gamepad to direct a head-pose of the remote vehicle as an open-loop control.

6. An apparatus as in claim 1, wherein the display is a head mountable display and further comprising a tracker attached thereto to direct a head-pose of the remote vehicle as an open-loop control.

7. An apparatus as in claim 5, wherein the vehicle moves in accordance to a computed situated-heading and the head-pose.

8. An apparatus as in claim 6, wherein the vehicle moves in accordance to a computed situated-heading and the head-pose.

9. An apparatus as in claim 1, wherein the display is a head-mountable display and further comprising a video rendering system for providing a mono or stereo video image to the head-mountable display.

10. An apparatus as in claim 1, wherein the display is a desk-top monitor display and further comprising a video rendering system for providing a mono or stereo video image to the desk-top monitor display.

11. An apparatus as in claim 1, further comprising a pair of sliding foot pedals having an output mapped to provide open-loop translational control of a displacement of the vehicle.

12. An apparatus as in claim 1, wherein the movements of the vehicle are displayed as three dimensional.

13. A control mapping system for mapping a plurality of a user-controlled dual joystick gamepad outputs to a movement of a vehicle in a physical environment, comprising:

a control mapping algorithm for mapping the user-controlled movements of a first joystick and a second joystick to a vehicle course, heading, and displacement wherein the first joystick is mapped to provide an open loop directional control over steering of the vehicle and the second joystick is mapped to provide an open loop directional control over offset of the vehicle to thereby provide an open-loop control over the vehicle'"'"'s course and heading.

14. A control mapping system as in claim 13, further comprising a processor for running a virtual environment software program displaying the vehicle in a physical environment in which the vehicle is programmed to move with a course, heading, and displacement.

15. A control mapping system as in claim 13, wherein the second joystick is mapped to provide a course-offset.

16. A control mapping system as in claim 13, wherein the second joystick is mapped to provide a heading-offset.

17. A control mapping system as in claim 13, wherein the vehicle moves in accordance to a computed situated-heading and the head-pose.

18. A method for controlling the movements of a vehicle using a gamepad including a first joystick and a second joystick and having a plurality of outputs responsive to user-controlled movements of each joystick and user-controlled buttons, comprising:

recording and transmitting a video stream of the vehicle'"'"'s camera view of the physical environment within which the vehicle is operating to a processor;

programming the processor with a control mapping algorithm for mapping the user-controlled movements of each joystick to a vehicle course, heading, and displacement wherein the first joystick is mapped to provide a steering control of the vehicle and the second joystick is mapped to provide an offset control of the vehicle to thereby provide an open-loop control over the vehicle;

transmitting a vehicle control signal to on-board vehicle controls; and

displaying the movement of the vehicle in the physical environment.

19. A method as in claim 18, wherein the vehicle includes a turret, the vehicle remote control includes control over the rotation of the turret, and the processor further comprises control mapping the turret rotation of the remote vehicle as a directional open-loop heading control.

20. A method as in claim 18, wherein the second joystick is mapped to provide a course-offset.

21. A method as in claim 18, wherein the second joystick is mapped to provide a heading-offset.

22. A method as in claim 18, further comprising mapping a head-pose of the vehicle to the movement of a tracker attached to the gamepad.

23. A method as in claim 22, wherein the vehicle moves in accordance to a computed situated-heading.

24. A method as in claim 18, further comprising mapping a head-pose of the vehicle to the movement of a tracker attached to a head-mountable display.

25. A method as in claim 24, wherein the vehicle moves in accordance to a computed situated-heading.

26. A method as in claim 18, further comprising providing a mono or stereo video image to a head-mountable display.

27. A method as in claim 18, further comprising providing a mono or stereo video image to a desk-top monitor display.

28. A method as in claim 18, further comprising control mapping an output of a pair of sliding foot pedals to provide open-loop control of a translational displacement of the vehicle.

29. A method as in claim 18, wherein the movements of the vehicle are displayed as three dimensional.

30. An apparatus for controlling the movements of a vehicle having on-board controls for independently controlling the course and heading of the vehicle in response to a remote operator'"'"'s control and an on-board camera/video transmitter for recording and transmitting a video stream of the camera'"'"'s view of the physical environment within which the vehicle is operating, comprising:

a pair of dual-axis directional input control devices having a plurality of outputs responsive to user-controlled operations of the directional control axes and user-controlled buttons;

a processor for running a remote vehicle control software program which sends commands to the vehicle'"'"'s on-board controls to direct the movement of the remote vehicle;

a control mapping algorithm for mapping the outputs of the directional input control devices to the vehicle'"'"'s course and heading, wherein the directional control axes are mapped to provide open loop directional control of the vehicle'"'"'s course and heading; and

a display for receiving the video stream and displaying the view from the vehicle'"'"'s cameras to the operator.

31. An apparatus as in claim 30, wherein the vehicle includes a turret, the remote vehicle controller includes control over the rotation of the turret, and the processor further comprises control mapping the turret rotation of the remote vehicle as a directional open-loop heading control.

32. An apparatus as in claim 30, wherein a first directional input control device is mapped to provide open loop directional control over steering the vehicle and a second directional input control device is mapped to provide open loop directional control over a heading offset.

33. An apparatus as in claim 30, wherein a first directional input control device is mapped to provide open loop directional control over steering the vehicle and a second directional input control device is mapped to provide open loop directional control over a course offset.

34. An apparatus as in claim 30, wherein a first directional input control device is mapped to provide open loop directional control over the vehicle'"'"'s heading and a second directional input control device is mapped to provide open loop directional control over the vehicle'"'"'s course.

35. An apparatus as in claim 30, further comprising a third directional input control device.

36. An apparatus as in claim 35, wherein the third directional input control device is mapped to provide a course or heading offset not directed by the second directional input control device.

37. An apparatus as in claim 35, wherein the third directional input control device is mapped to direct a head-pose of the vehicle as an open-loop control.

38. An apparatus as in claim 30, further comprising a tracker attached to said gamepad to direct a head-pose of the vehicle as an open-loop control.

39. An apparatus as in claim 30, wherein the display is a head mountable display and further comprising a tracker attached thereto to direct a head-pose of the vehicle as an open-loop control.