Removable vehicle operation instrument with remote control capability and related method

• US 9,505,383 B2
• Filed: 10/27/2014
• Issued: 11/29/2016
• Est. Priority Date: 10/29/2013
• Status: Active Grant

• Current Assignee: Medallion Instrumentation Systems LLC
• Original Assignee: Medallion Instrumentation Systems LLC
• Inventors: Peel, Ronald B., Bertalan, Richard P.
• Primary Examiner(s): Khatib, Rami
• Assistant Examiner(s): Foster, Gerrad A
• Application Number:
  US14/524,668
• Publication Number:
  US 20150120089A1
• Time in Patent Office: 764 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60T 7/02 for personal initiation
• CPC Class Codes: B60T 7/16 operated by remote control, i.e. initiating means not mounted on vehicle
• CPC Class Codes: B62D 1/00 Steering controls, i.e. means for initiating a change of direction of the vehicle
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246

Abstract

A system including an instrument and a vehicle control system is provided. The instrument can include a display and a vehicle controller in communication with the vehicle control system. The instrument can be docked in a docking station of the vehicle, for example in a driver space, and used as primary instrumentation for a driver to directly control the vehicle. The instrument can be undocked and removed physically from the vehicle and used to remotely control vehicle operations from a location distant from the vehicle. A method of using the system and instrument is also provided in which a user can directly or remotely operate a vehicle with the instrument in communication with the vehicle control system. A method of using the system and/or instrument to directly or remotely operate one or more vehicles is also provided.

Claims

1. A system for selective direct or remote operation of a vehicle, the system comprising:

a vehicle control system associated with a vehicle;

a handheld, selectively portable instrument comprising a communication element in communication with the vehicle control system, the instrument including a sensor that detects relative movement of the instrument by a user, and a display;

a vehicle dashboard including a docking station; and

an imaging device mounted on the vehicle, the imaging device in communication with the display of the handheld instrument,

wherein the handheld instrument is operable in a direct vehicle operation mode, a remote control mode, and a takeover mode,

wherein in the direct vehicle operation mode, the handheld instrument is removably mounted to the docking station and in communication with the vehicle control system;

wherein in the remote control mode, the handheld instrument is removed and distal from the docking station, and manually moveable about at least one axis, with the sensor detecting the relative movement of the instrument by the user about the at least one axis, and the instrument translating the relative movement into signals to control at least one of speed, acceleration, braking, gear selection, weapon activation and steering of the vehicle,

wherein at least one image captured by the imaging device is displayed on the display of the handheld instrument in the remote control mode,

wherein in the takeover mode, the at least one image displayed on the display of the handheld instrument includes a takeover asset shown in the at least one image,

wherein in the takeover mode, the handheld instrument is configured to allow a user to view and select the takeover asset shown in the at least one image, and thereby takeover, with the handheld instrument, the operation of the takeover asset.

2. The system of claim 1 wherein in the remote control mode, the sensor is operable to detect rotation of the handheld instrument and translate that rotation into steering the vehicle left or steering the vehicle right while the user is remote from the vehicle.

3. The system of claim 2,

wherein in the handheld instrument is configured to operate in the remote control mode to operate the takeover asset after the takeover mode is completed.

4. The system of claim 1 wherein the vehicle is a first vehicle,

wherein the takeover asset is a second vehicle,

wherein after the takeover mode, the handheld instrument is configured to control at least one of speed, acceleration, braking, gear selection, weapon activation and steering of the second vehicle, but does not control at least one of speed, acceleration, braking, gear selection, weapon activation and steering of the first vehicle.

5. The system of claim 1,

wherein the display is a touch screen, wherein in the takeover mode, the touch screen is configured to receive input from the user via the user at least one of touching the touch screen and coming in close proximity to the touchscreen with at least one of a digit and stylus,

wherein upon receiving the input from the user, the handheld instrument in the takeover mode displays a takeover icon on the display so that the user can confirm that takeover of the takeover asset is to commence.

6. The system of claim 5 wherein the display displays at least one of speedometer, tachometer, fuel level, electrical status, weapon status and oil pressure information while the handheld instrument is in the direct vehicle operation mode.

7. The system of claim 1 wherein the vehicle control system operates at least one servo that is operably coupled to at least one of brakes, a steering wheel, an accelerator, a gear selector and a weapon of the vehicle,

wherein the servo is mounted in the vehicle, and remains mounted, even when the user is in a driver space of the vehicle.

8. The system of claim 7 wherein the signals from the handheld instrument are sent to the vehicle control system which operates the servo in response thereto to control the vehicle when the handheld instrument is in the remote control mode.

9. The system of claim 1 wherein the handheld instrument is adapted to remotely operate the vehicle at a distance of at least 100 yards in the remote vehicle control mode.

10. The system of claim 9 wherein the vehicle is a wheeled or tracked military or law enforcement vehicle.

11. The system of claim 9 wherein the vehicle is a watercraft.

12. The system of claim 1 wherein the handheld instrument wirelessly communicates with the vehicle control system.

13. An instrument adapted for selective direct or remote operation of a vehicle, the instrument comprising:

a handheld, selectively portable instrument comprising a communication element adapted to communicate with a vehicle control system of a first vehicle, the instrument including at least one control input moveable by a user and a display, the instrument adapted for communication with an imaging device mounted on the first vehicle,

wherein the handheld instrument is operable in a direct vehicle operation mode, a first remote control mode, a takeover mode, and a second remote control mode,

wherein in the direct vehicle operation mode, the handheld instrument is removably mounted relative to a docking station in the first vehicle and in operative communication with the vehicle control system, the handheld instrument displaying via the display at least one of speedometer, tachometer, fuel level, electrical status, weapon status and oil pressure information while the handheld instrument is in the direct vehicle operation mode,

wherein in the first remote control mode, the handheld instrument is removed and distal from the docking station and the first vehicle, and the control input is manually operable by the user,

wherein the operation of the control input is translated into at least one of signals and commands to control at least one of speed, acceleration, braking, gear selection, weapon activation and steering of the first vehicle,

wherein at least one image captured by the imaging device is displayed on the display of the handheld instrument,

wherein in the takeover mode, the handheld instrument displays a second vehicle in the at least one image and the handheld instrument is configured to receive input from the user so that the handheld instrument can takeover operation of the second vehicle,

wherein in the second remote control mode, the control input is manually operable by the user and the operation of the control input is translated into at least one of signals and commands to control at least one of speed, acceleration, braking, gear selection, weapon activation and steering of the second vehicle.

14. A method for operating a vehicle comprising:

providing a first vehicle, the first vehicle comprising a first handheld, selectively portable instrument, the first instrument including a first sensor that detects relative movement of the first instrument by a user and a first display, the first handheld instrument docked in a first docking station of the first vehicle, the first handheld instrument including a first display;

providing a second vehicle, the second vehicle comprising a second handheld, selectively portable instrument, the second instrument including a second sensor that detects relative movement of the second instrument by a user and a second display, the second handheld instrument docked in a second docking station of the second vehicle, the second handheld instrument including a second display; and

removing the first handheld instrument from the first docking station of the first vehicle, the first handheld instrument displaying an image of the second vehicle on the first display;

providing input to the first handheld instrument to select the image of the second vehicle for operation of the second vehicle;

commencing takeover of a vehicle control system of the second vehicle with the first handheld instrument;

remotely operating at least one of speed, acceleration, braking, gear selection, steering and weapon operation of the second vehicle with the first handheld instrument after the vehicle control system of the second vehicle is taken over by the first instrument.

15. The method of claim 14 wherein the second vehicle includes an imaging device mounted on the second vehicle, the imaging device in communication with the first display of the first handheld instrument, comprising displaying a field of view to the user associated with the second vehicle while remotely controlling the second vehicle.

16. The method of claim 14 wherein the first display is a touchscreen, wherein the providing input step includes a user touching the touch screen with at least one of a digit and a stylus at a location where the second vehicle is displayed in the image.

17. The method of claim 14 comprising displaying a confirmation takeover icon on the first display before the commencing takeover step so that the user can confirm an intentional takeover of the second vehicle.

18. The method of claim 14 comprising transmitting with the first instrument at least one of a command and a signal to the second instrument for display in the form of notification on the second display of the second instrument.

19. The method of claim 18 comprising initializing an authorization protocol so that an occupant of the second vehicle, via the second instrument, can authorize or not authorize takeover of the second vehicle with the first instrument.

20. The method of claim 19 wherein the commencing takeover step occurs if the occupant of the second vehicle does not respond via the second instrument within a predetermined time period.