Electronic apparatus and control method thereof

• US 10,147,001 B2
• Filed: 03/30/2015
• Issued: 12/04/2018
• Est. Priority Date: 03/31/2014
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Corp.
• Original Assignee: Thinkware Corporation
• Inventors: Lee, Han Woo
• Primary Examiner(s): Duley, Janese
• Application Number:
  US14/673,298
• Publication Number:
  US 20150278614A1
• Time in Patent Office: 1,345 Days
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

An electronic apparatus according to an embodiment of the present invention includes a communication unit configured to receive image data including a driving image of a vehicle, a driving line information generation module configured to identify a line region from the image data, and generate driving line information, corresponding to a currently-driving lane of the vehicle in the driving image, from image data corresponding to the identified line region, and a controller configured to perform necessary processing according to the driving line information.

Claims

1. A method for controlling an electronic apparatus, the method comprising:

receiving image data including a driving image of a vehicle from a camera;

identifying line region image data from the image data;

generating driving line information from the identified line region image data,

wherein the driving line information corresponds to information on each line at both sides of a currently-driving lane of the vehicle in the driving image;

selecting a line departure warning from a plurality of line departure warnings in response to a type and a color of each line at both sides of the currently-driving lane of the vehicle, which is identified from the driving line information; and

outputting the selected line departure warning,

wherein the generating of the driving line information comprises;

determining whether the type of each line at both sides of the currently-driving lane of the vehicle is a dashed line or a solid line based on a line length of each line; and

verifying the determined type of each line according to whether or not each line is continuously formed with respect to time in a plurality of frames,

wherein the selecting of the line departure warning comprises;

selecting a first line departure warning from the plurality of line departure warnings if the vehicle moves out of a first line; and

selecting a second line departure warning from the plurality of line departure warnings if the vehicle moves out of a second line, and

wherein the first line and the second line are lines in which at least one of the type and the color are different, and the first line departure warning and the second line departure warning are different warning images or warning sounds.

2. The method of claim 1, wherein the generating of the driving line information further comprises:

performing binary coding for the identified line region image data; and

acquiring line type information from the binary-coded image data.

3. The method of claim 2, wherein the acquiring of the line type information comprises:

analyzing the binary-coded image data by using at least one of time continuity information and velocity information both related to each line, and

identifying whether or not a type of each line of the currently-driving lane of the vehicle is a dashed line or a solid line.

4. The method of claim 1, wherein the driving line information comprises line color information corresponding to each line located at both sides of the currently-driving lane of the vehicle.

5. The method of claim 1, further comprising:

identifying a position of the currently-driving lane of the vehicle from the driving image on the basis of the driving line information; and

outputting lane guide information on the basis of the position of the currently-driving lane.

6. The method of claim 1, further comprising:

identifying a position of the currently-driving lane of the vehicle from the driving image on the basis of the driving line information; and

outputting a lane change notification according to a navigating route of the vehicle and the position of the currently-driving lane.

16. A non-transitory storage medium having a program recorded therein, the program provided to execute in a computer a method disclosed in claim 1.

7. A method for controlling an augmented reality-based vehicle information notification apparatus, the method comprising:

receiving image data including a driving image of a vehicle from a camera;

identifying line region image data from the image data;

generating driving line information related to the vehicle from image data of the identified line region image data;

selecting a line departure warning from a plurality of line departure warnings in response to a type and a color of each line at both sides of the currently-driving lane of the vehicle, which is identified from the driving line information;

generating a line information interface overlaid on the augmented reality according to the selected line departure warning; and

outputting the generated line information interface through the augmented reality,

wherein the generating of the driving line information comprises;

determining whether the type of each line at both sides of the currently-driving lane of the vehicle is a dashed line or a solid line based on a line length of each line; and

verifying the determined type of each line according to whether or not each line is continuously formed with respect to time in a plurality of frames,

wherein the selecting of the line departure warning comprises;

selecting a first line departure warning from the plurality of line departure warning if the vehicle moves out of a first line; and

selecting a second line departure warning from the plurality of line departure warning if the vehicle moves out of a second line, and

wherein the first line and the second line are lines in which at least one of the type and the color is different, and the first line departure warning and the second line departure warning are different warning images or warning sounds.

8. The method of claim 7, further comprising performing a lane change notification using the line information interface according to the driving line information and navigating route information.

9. An electronic apparatus comprising:

a communication unit configured to receive image data including a driving image of a vehicle from a camera;

a driving line information generation module configured to identify line region image data from the image data, and to generate driving line information from the identified line region image data, wherein the driving line information corresponds to information on each line at both sides of a currently-driving lane of the vehicle in the driving image; and

a controller configured to select a line departure warning from a plurality of line departure warnings according to a type and a color of each line at both sides of the driving lane of the vehicle, which is identified from the driving line information,

wherein an output unit is configured to output the line departure warning,

wherein the driving line information generation module determines whether the type of each line at both sides of the currently-driving lane of the vehicle is a dashed line or a solid line based on a line length of each line, and verifies the determined type of each line according to whether or not each line is continuously formed with respect to time in a plurality of frames,

wherein the controller further configured to;

select a first line departure warning from the plurality of line departure warnings if the vehicle moves out of a first line; and

select a second line departure warning from the plurality of line departure warnings if the vehicle moves out of a second line, and

wherein the first line and the second line are lines in which at least one of the type and the color are different, and the first line departure warning and the second line departure warning are different warning images or warning sounds.

10. The apparatus of claim 9, wherein the driving line information comprises line type information corresponding to each line located at both sides of the currently-driving lane of the vehicle.

11. The apparatus of claim 9, wherein the driving line information generation module performs binary coding for the identified line region image data, and acquires line type information from the binary-coded image data.

12. The apparatus of claim 11, wherein the driving line information generation module analyzes the binary-coded image data by using at least one of time continuity information and velocity information both related to each line, and identifies whether or not a type of each line of the currently-driving lane of the vehicle is a dashed line or a solid line.

13. The apparatus of claim 9, wherein the driving line information comprises line color information corresponding to each line located at both sides of the currently-driving lane of the vehicle.

14. The apparatus of claim 9, wherein the controller identifies a position of the currently-driving lane of the vehicle in the driving image on the basis of the driving line information, and

wherein the apparatus further comprises an output unit configured to output lane guide information on the basis of the position of the currently-driving lane.

15. The apparatus of claim 9, wherein the controller identifies a position of the currently-driving lane of the vehicle in the driving image on the basis of the driving line information, and

wherein the apparatus further comprises an output unit configured to output a lane change notification according to a navigating route of the vehicle and the position of the currently-driving lane.