Display apparatus, vehicle and display method

• US 10,310,600 B2
• Filed: 11/04/2015
• Issued: 06/04/2019
• Est. Priority Date: 03/23/2015
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Hong, Gi Beom, Min, Jungsang
• Primary Examiner(s): Soto Lopez, Jose R
• Application Number:
  US14/932,921
• Publication Number:
  US 20160282940A1
• Time in Patent Office: 1,308 Days
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/374 Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
• CPC Class Codes: A61B 5/378 Visual stimuli
• CPC Class Codes: B60K 2360/347 Optical elements for superposition of display information
• CPC Class Codes: B60K 28/00 Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions for electrically-propelled vehicles B60L3/00; road vehicle drive control systems for purposes not related to the control of a particular sub-unit B60W30/00; drive control systems specially adapted for autonomous road vehicles B60W60/00
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

A display apparatus, a vehicle, and a display method are disclosed, which recognize the user'"'"'s intention by recognizing the user'"'"'s eyes, and apply the recognized result to a device control process, thereby greatly increasing convenience of the input unit manipulation actions of the user. A display apparatus includes: a controller configured to insert a visual stimulus signal into basic visual information according to a predetermined frequency; a display unit configured to display the visual stimulus signal for generating an electroencephalogram (EEG) signal and the basic visual information; and an EEG analyzer configured to determine a frequency occupied by the generated EEG signal.

Claims

1. A display apparatus comprising:

a controller configured to interpose a visual stimulus signal having a predetermined frequency between immediately adjacent basic visual information frames which do not contain the visual stimulus signal;

a display unit configured to display the visual stimulus signal for generating an electroencephalogram (EEG) signal and the basic visual information frames; and

an electroencephalogram (EEG) analyzer configured to determine a frequency occupied by the generated EEG signal.

2. The display apparatus according to claim 1, wherein the EEG signal generated by the visual stimulus signal includes a steady-state visual evoked potential (SSVEP).

3. The display apparatus according to claim 1, wherein the display unit displays the basic visual information frames in a form of moving images or still images.

4. The display apparatus according to claim 1, further comprising:

a communication unit configured to receive the generated EEG signal from an electroencephalogram detector for detecting the EEG signal of a user.

5. The display apparatus according to claim 4, wherein the EEG analyzer recognizes the user'"'"'s eyes on the basis of the frequency occupied by the generated EEG signal.

6. The display apparatus according to claim 1, wherein the controller generates a control signal to activate a function corresponding to the frequency occupied by the generated EEG signal.

7. The display apparatus according to claim 1, wherein the controller divides a screen image of the display unit into a plurality of regions, and inserts visual stimulus signals having different frequencies into basic visual information frames displayed on the divided regions.

8. A vehicle comprising:

a controller configured to interpose a visual stimulus signal between immediately adjacent basic visual information frames which do not contain the visual stimulus signal;

a display unit configured to display the visual stimulus signal for generating an electroencephalogram (EEG) signal and the basic visual information frames;

a communication unit configured to receive an EEG signal from an EEG detector for detecting an EEG signal of a user; and

an electroencephalogram (EEG) analyzer configured to determine a frequency occupied by the EEG signal of the user, and determine a region gazed by the user on the basis of the determined frequency.

9. The vehicle according to claim 8, wherein the electroencephalogram (EEG) signal generated by the visual stimulus signal includes a steady-state visual evoked potential (SSVEP).

10. The vehicle according to claim 9, wherein the display unit includes a plurality of displays.

11. The vehicle according to claim 10, wherein the controller inserts visual stimulus signals having different frequencies into basic visual information frames respectively displayed on the plurality of displays.

12. The vehicle according to claim 11, wherein the controller controls a function related to the display gazed by the user from among the plurality of displays.

13. The vehicle according to claim 12, further comprising:

an input unit configured to receive a control command from the user,

wherein the controller controls a function related to the user-gazed display according to a control command received from the input unit manipulated by the user.

14. The vehicle according to claim 8, wherein the controller inserts different visual stimulus signals into different visual information displayed on different regions of the display unit.

15. The vehicle according to claim 14, wherein the controller, if the user gazes at one of the regions of the display unit, immediately executes a function corresponding to the one of the regions, such that the immediately executed function is determined to be a shortcut function.

16. The vehicle according to claim 15, wherein the controller determines the function frequently used by the user or the function frequently gazed by the user to be the shortcut function.

17. The vehicle according to claim 8, further comprising:

a speaker configured to output an acoustic or sound signal.

18. The vehicle according to claim 17, wherein the controller, if the user gazes at the display unit during a predetermined reference time or more, outputs a warning message through at least one of the display unit and the speaker.

19. The vehicle according to claim 17, wherein the controller, if the user does not gaze at traffic lights, outputs a warning message through at least one of the display unit and the speaker.

20. The vehicle according to claim 17, wherein the controller, if the user gazes at a red light from among traffic lights, and if the vehicle does not stop driving, outputs a warning message through at least one of the display unit and the speaker.

21. The vehicle according to claim 8, wherein the display unit enlarges a display size of a region corresponding to a function frequently used by the user or a display size of a region frequently gazed by the user.

22. The vehicle according to claim 8, wherein the display unit includes an Audio Video Navigation (AVN) display, a cluster display, and a head-up display.

23. A display apparatus comprising:

a controller configured to interpose a visual stimulus signal between immediately adjacent basic visual information frames which do not contain the visual stimulus signal; and

a display unit configured to display the visual stimulus signal for generating an electroencephalogram (EEG) signal and the basic visual information frames.

24. A display method comprising:

interposing a visual stimulus signal between immediately adjacent basic visual information frames which do not contain the visual stimulus signal;

receiving an electroencephalogram (EEG) signal of a user;

determining a region gazed by the user by analyzing the received EEG signal; and

performing a control function corresponding to the user-gazed region.

25. The display method according to claim 24, wherein the determining the user-gazed region includes:

determining a frequency occupied by the received EEG signal; and

determining whether the determined frequency is identical to the predetermined frequency of the visual stimulus signal.

26. The display method according to claim 24, further comprising:

mapping a region on which the visual stimulus signal is displayed to a control function corresponding to the region, and storing the mapped result.