Vehicle control system based on user input and method thereof

• US 10,303,957 B2
• Filed: 11/07/2016
• Issued: 05/28/2019
• Est. Priority Date: 05/26/2016
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: An, Jun Sik, Chang, Eu Gene, Lee, Joong Ryoul, Sung, Kap Je
• Primary Examiner(s): Yang, Wei Wen
• Application Number:
  US15/345,132
• Publication Number:
  US 20170344837A1
• Time in Patent Office: 932 Days
• Field of Search: None
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60R 1/22 for viewing an area outside the vehicle, e.g. the exterior of the vehicle
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators

Abstract

A vehicle control system based on a user input includes: a user information input device receiving a region of interest from a user; a vehicle movement information calculator calculating movement information of a vehicle; and a vehicle position relationship tracker performing a vehicle control based on the region of interest and the movement information of the vehicle.

Claims

1. A vehicle control system based on a user input, the vehicle control system comprising:

a sensor installed on a vehicle;

a camera different from the sensor and installed on the vehicle;

a user information input device including a screen displaying an image frame received from the camera, and receiving, by a touch of a user on the image frame displayed on the screen, a region of interest in the image frame, wherein the region of interest includes an image of an obstacle which is not sensed by the sensor and which is included in the image frame displayed on the screen;

an image coordinate converter converting an image coordinate of the region of interest in the image frame into a world coordinate of a space;

a vehicle movement information calculator calculating movement information of the vehicle; and

a vehicle position relationship tracker controlling the vehicle based on the movement information of the vehicle and the world coordinate of the space.

2. The vehicle control system according to claim 1, wherein the image coordinate converter calculates a world coordinate for a position of the vehicle and a world coordinate of the region of interest after the vehicle is moved by adding the movement information of the vehicle to the world coordinate for the position of the vehicle and the world coordinate of the region of interest.

3. The vehicle control system according to claim 2, wherein the vehicle position relationship tracker controls the vehicle by comparing a relative distance between the world coordinate for the position of the vehicle and the world coordinate of the region of interest after the vehicle is moved.

4. The vehicle control system according to claim 3, wherein the vehicle position relationship tracker performs a control to avoid a collision between the vehicle and the region of interest.

5. The vehicle control system according to claim 1, further comprising an image synthesizer synthesizing front, rear, and side images of the vehicle from the image frame of the camera.

6. The vehicle control system according to claim 5, wherein the user information input device displays the image frame synthesized by the image synthesizer on the screen.

12. The vehicle control system according to claim 1, wherein the sensor is one of an ultrasonic sensor or a radar sensor.

7. A vehicle control method based on a user input, the vehicle control method comprising:

displaying an image frame around a vehicle on a screen;

receiving a region of interest in the image frame, by a touch of a user on the image frame displayed on the screen, wherein the region of interest includes an obstacle which is not sensed by a sensor for sensing obstacles and which is included in the image frame displayed on the screen;

converting an image coordinate of the region of interest in the image frame into a world coordinate of a space;

calculating movement information of the vehicle; and

controlling the vehicle based on the movement information of the vehicle and the world coordinate of the space.

8. The vehicle control method according to claim 7, wherein in the displaying of the image frame on the screen, front, rear, and side image data of the vehicle are synthesized and are displayed.

9. The vehicle control method according to claim 7, wherein the performing of the vehicle control by applying the region of interest includes:

calculating movement information of the vehicle; and

performing the vehicle control according to a distance between the region of interest and the vehicle by considering the movement information of the vehicle.

10. The vehicle control method according to claim 9, wherein the performing of the vehicle control by applying the region of interest further includes warning a collision by comparing a distance between the region of interest and the vehicle.

11. The vehicle control method according to claim 7, wherein the sensor is one of an ultrasonic sensor or a radar sensor.