Performing remote vehicle commands using live camera supervision

• US 10,300,888 B1
• Filed: 03/06/2018
• Issued: 05/28/2019
• Est. Priority Date: 03/06/2018
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Gilbert-Eyres, Matthew E., Chim, Huong T., Patenaude, Russell A.
• Primary Examiner(s): Wu, Zhen Y
• Application Number:
  US15/913,442
• Time in Patent Office: 448 Days
• Field of Search: 34042614
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 25/245 where the antenna reception area plays a role
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A system and method for performing remote vehicle commands such as opening and closing doors and windows. The method is carried out by the system and includes the steps of: receiving a first signal at a vehicle from a remote application via a wireless communication device installed in the vehicle as a part of the vehicle electronics; in response to receiving the first signal, transmitting a camera feed from one or more vehicle cameras on the vehicle to the remote application; receiving a remote command signal at the vehicle from the remote application; in response to receiving the remote command signal, performing one or more vehicle commands at the vehicle while continuing to transmit the camera feed from the vehicle to the remote application; and ending the transmission of the camera feed from the vehicle to the remote application after completing the one or more remote vehicle commands.

Claims

1. A method for performing remote vehicle commands, the method comprising:

receiving a first signal at a vehicle from a remote application via a wireless communication device installed in the vehicle as a part of the vehicle electronics;

in response to receiving the first signal, transmitting a camera feed from one or more vehicle cameras on the vehicle to the remote application via cellular communication over a wireless carrier system or via short range wireless communication via a wireless network access point;

receiving a remote command signal at the vehicle from the remote application;

in response to receiving the remote command signal, performing one or more vehicle commands at the vehicle while continuing to transmit the camera feed from the vehicle to the remote application; and

ending the transmission of the camera feed from the vehicle to the remote application after completing the one or more remote vehicle commands;

wherein the performing step further comprises physically moving an internal or external vehicle component while transmitting a camera feed of the moving vehicle component to the remote application;

wherein the vehicle component is one of a door, trunk lid, liftgate, window, sunroof, moonroof, or convertible top of the vehicle; and

wherein the camera feed provides video showing the vehicle component as it moves.

2. The method of claim 1, wherein the performing step is carried out only during simultaneous bi-directional communication between the vehicle and the remote application that includes sending of the camera feed from the vehicle to the remote application and receiving a command signal from the remote application at the vehicle.

3. The method of claim 1, further comprising the step of emitting an audible warning, a visual warning, or both at the vehicle while conducting the one or more remote vehicle commands at the vehicle.

4. The method of claim 1, further comprising, prior to the transmitting step, the step of verifying that a quality of connection between the vehicle and the remote application is above a threshold.

5. The method of claim 1, further comprising the step of ceasing performance of one or more vehicle commands based on an input from a vehicle sensor.

6. The method of claim 1, further comprising the step of continuously receiving the remote vehicle command signal while the vehicle conducts the one or more remote vehicle commands.

7. The method of claim 6, further comprising the step of ceasing performance of one or more vehicle commands in response to an interruption or stoppage of receipt of the remote vehicle command.

8. A method for performing remote vehicle commands using a personal mobile device, the method comprising:

receiving from a user at a personal mobile device a selected remote vehicle command that involves physical movement of at least one vehicle component of a vehicle;

sending a first signal to the vehicle to activate one or more vehicle cameras on the vehicle;

receiving a camera feed from the vehicle cameras;

displaying the camera feed to the user on the personal mobile device;

during the display of the camera feed, receiving a further input from the user requesting that the selected remote vehicle command be carried out and sending a command signal to the vehicle to begin the selected remote vehicle command; and

continuing to display the camera feed to the user while the selected remote vehicle command is performed by the vehicle;

wherein the selected remote vehicle command comprises a command to move an internal or external vehicle component of the vehicle;

wherein the vehicle component is one of a door, trunk lid, liftgate, window, sunroof, moonroof, or convertible top of the vehicle; and

wherein the received camera feed provides video showing the vehicle component as it moves.

9. The method of claim 8, wherein the steps are carried out via a vehicle remote control application executing on the personal mobile device, wherein, prior to the sending step, the remote control application transmits user identification information to a remote facility that authorizes the user'"'"'s access to the vehicle to carry out the selected remote vehicle command.

10. The method of claim 8, wherein the camera feed is displayed on a touchscreen of the personal mobile device and wherein the method further comprises the step of displaying a button on the touchscreen while displaying the camera feed to the user.

11. The method of claim 10, wherein the step of sending the command signal to the vehicle is carried out only while the user presses the button on the touchscreen.

12. The method of claim 11, wherein the step of sending the command signal further comprises continuously sending the command signal only while the user presses the button on the touchscreen and the camera feed is being displayed on the touchscreen.

13. The method of claim 8 further comprising the step of monitoring a quality of connection of the camera feed.

14. The method of claim 13, wherein the method further comprises determining that the quality of connection of the camera feed has dropped below a threshold and in response thereto, either stopping transmission of the command signal or sending a stop command to the vehicle so as to cause the vehicle to cease conducting the selected remote vehicle command.

15. The method of claim 14, further comprising the step of providing a notification to the user via the personal mobile device that the quality of connection of the camera feed has dropped below the threshold.

16. The method of claim 8, further comprising the steps of receiving a completion signal at the personal mobile device after the vehicle has performed the selected remote vehicle command, and displaying a notification on the personal mobile device indicating that the selected remote vehicle command was completed.