Mobile terminal for vehicular display system with gaze detection

• US 9,513,702 B2
• Filed: 05/16/2014
• Issued: 12/06/2016
• Est. Priority Date: 07/15/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Cho, Kyoungmin
• Primary Examiner(s): Lee, Gene W
• Application Number:
  US14/280,162
• Publication Number:
  US 20150015479A1
• Time in Patent Office: 935 Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60W 2050/0064 using a remote, e.g. cordless, transmitter or receiver unit, e.g. remote keypad or mobile phone
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2380/10 Automotive applications

Abstract

A mobile terminal including a terminal body; a display unit; a wireless communication unit configured to be wirelessly connected to an in-vehicle video display apparatus; and a controller configured to detect a directional change of a driver'"'"'s eyes from a first display to a second display included in the in-vehicle video display apparatus, and control the second display to display at least a portion of a first screen displayed on the first display, in response to the detected directional change of the driver'"'"'s eyes from the first display to the second display.

Claims

1. A mobile terminal comprising:

a terminal body;

a display unit;

a wireless communication unit configured to be wirelessly connected to an in-vehicle video display apparatus for a vehicle; and

a controller configured to;

detect a directional change of a driver'"'"'s eyes from a first display to a second display included in the in-vehicle video display apparatus, and

control the second display to display at least a portion of a first screen displayed on the first display, in response to the detected directional change of the driver'"'"'s eyes from the first display to the second display,

wherein the portion of the first screen displayed on the first display corresponds to a front visual field of the vehicle, and

wherein the second display displays the portion of the first screen overlapping with a second screen corresponding to a side visual field of the vehicle or a rear visual field of the vehicle.

2. The mobile terminal of claim 1, wherein the controller is further configured to detect the directional change of the driver'"'"'s eyes based on a plurality of cameras detachably disposed in a vehicle.

3. The mobile terminal of claim 1, wherein the controller is further configured to:

extract a partial image from the first screen to which the driver'"'"'s eyes were fixed, and

display the extracted partial screen in a region of the second display.

4. The mobile terminal of claim 1, wherein the controller is further configured to:

request transmission of the first screen displayed on the first display from the in-vehicle video display apparatus in real time, and

control the second display to display the first screen received according to the request in a region of the second display in real time.

5. The mobile terminal of claim 1, wherein the controller is further configured to:

detect movement of the driver'"'"'s eyes from the second display to the first display,

control the second display to stop displaying the first screen on the region of the second display, and

control the first display to display at least a portion of the second screen displayed on the second display on a region of the first display.

6. The mobile terminal of claim 1, wherein the controller is further configured to detect movement of the driver'"'"'s eyes from the first display to the display unit of the mobile terminal, and display on the display unit of the mobile terminal at least a portion of the first screen displayed on the first display, and

wherein the portion of the first screen displayed on the first display includes an image of a traffic light within the front visual field of the vehicle.

7. The mobile terminal of claim 1, wherein the controller is further configured to:

subsequent to detection of the directional change of the driver'"'"'s eyes from the first display to the second display, detect movement of the driver'"'"'s eyes from the second display to a third display,

control the second display to stop displaying the portion of the first screen, and

control the third display to display the portion of the first screen overlapping with a third screen corresponding to a side visual field of the vehicle or a rear visual field of the vehicle, and

wherein the third screen is different than the second screen displayed on the second diplay.

8. The mobile terminal of claim 1, wherein the controller is further configured to:

detect movement of the driver'"'"'s eyes from the first display to the display unit of the mobile terminal, and

display on the display unit of the mobile terminal at least a portion of the first screen displayed on the first display.

9. The mobile terminal of claim 8, wherein when an input applied to the first screen output on the display unit of the mobile terminal in a pre-set direction is sensed, the controller is further configured to change an output range of the first screen to correspond to the input.

10. The mobile terminal of claim 8, wherein when an input applied to the first screen output on the display unit of the mobile terminal in a pre-set direction is sensed, the controller is further configured to display a screen displayed on a different display of the connected in-vehicle video display apparatus together with the first screen.

11. The mobile terminal of claim 8, wherein when the driver'"'"'s eyes to the display unit are not sensed for a pre-set period of time, the controller is further configured to:

stop displaying the first screen on the display unit of the mobile terminal, and

display an indicator icon for re-displaying the first screen to a region of the display unit of the mobile terminal.

12. The mobile terminal of claim 8, wherein the controller is further configured to only display said at least the portion of the first screen to a region of the display unit when a vehicle running stop signal is received.

13. The mobile terminal of claim 12, wherein the vehicle running stop signal corresponds to a stop operating state of a traffic light included in an image obtained by a front camera within the vehicle.

14. The mobile terminal of claim 13, wherein when the stop operating state of the traffic light is changed to a go operating state, the controller is further configured to determine that a vehicle running resume signal has been input, and display a warning notification on the display unit of the mobile terminal.

15. The mobile terminal of claim 14, wherein the warning notification displayed on the display unit is an image of the traffic light.