INFOTAINMENT SYSTEM

• US 20150331487A1
• Filed: 12/19/2013
• Published: 11/19/2015
• Est. Priority Date: 12/21/2012
• Status: Active Grant

• Current Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Inventors: Roth, Hans, Marti, Stefan, Bergmann, Stephan, Preissner, Olaf, Reifenrath, Christoph, Wackernagel, Alexa, Reuss, Michael, Shen, Kelei
• Granted Patent: US 10,029,700 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/16 Type of output information
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/213 Virtual instruments
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 37/00 Dashboards as road-vehicle superstructure sub-units B62D25/14
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 11/0229 for displays, e.g. cathodic tubes
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06F 2203/04804 : Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 : based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G08G 1/00 : Traffic control systems for road vehicles arrangement of road signs or traffic signals E01F9/00 ; automatic vehicle control B62D
• CPC Class Codes: G08G 1/09623 : Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle G08G1/0967 takes precedence
• CPC Class Codes: H04M 1/6075 : adapted for handsfree use in a vehicle H04M1/6058 takes precedence; arrangements for holding telephones in a vehicle B60R11/0241
• CPC Class Codes: H04M 3/543 : Call deflection
• CPC Class Codes: H04N 13/243 : using three or more 2D image sensors
• CPC Class Codes: H04N 13/279 : the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/282 : for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 13/363 : using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 2101/00 : Still video cameras
• CPC Class Codes: H04N 9/31 : Projection devices for colour picture display , e.g. using electronic spatial light modulators [ESLM]
• CPC Class Codes: H04W 4/16 : Communication-related supplementary services, e.g. call-transfer or call-hold
• CPC Class Codes: H04W 4/40 : for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

Embodiments are disclosed for vehicle systems. An example system for a vehicle, includes

• a head-up display, and
• a central unit connected to the head-up display,
• wherein the head-up display is configured to project an image onto a front windshield of the vehicle or onto a separate combiner,
• wherein the central unit is configured to send image data to the connected head-up display to be displayed,
• to ascertain a position of the user'"'"'s eyes,
• to output a symbol within the image data,
• to ascertain a first virtual point and a second virtual point in a surrounding of the vehicle based on a recorded image of the surrounding and/or a current position of the vehicle, and
• to position the symbol such that a starting point of the symbol overlaps the first virtual point and an end point of the symbol overlaps the second virtual point in a view of the user.

Claims

1. A system for a vehicle, comprising:

a head-up display, and

a central unit connected to the head-up display,

wherein the head-up display is configured to project an image onto a front windshield of the vehicle or onto a separate combiner,

wherein the central unit is configured to send image data to the connected head-up display to be displayed,

wherein the central unit is configured to ascertain a position of the user'"'"'s eyes,

wherein the central unit is configured to output a symbol within the image data,

wherein the central unit is configured to ascertain a first virtual point and a second virtual point in a surrounding of the vehicle based on a recorded image of the surrounding and/or a current position of the vehicle, and

wherein the central unit is configured to position the symbol such that a starting point of the symbol overlaps the first virtual point and an end point of the symbol overlaps the second virtual point in a view of the user.

2. The system according to claim 1,

wherein the central unit is configured to calculate the alignment of the at least one point of the symbol based on geometrical optics and/or trigonometric functions.

3. The system according to claim 1,

having an internal camera recording an image of the user,

wherein the central unit is configured to recognize the user'"'"'s eyes or head,

wherein the central unit is configured to ascertain the position of the user'"'"'s eyes based on the recognized eyes or head within the recorded image of the user.

4. The system according to claim 3,

wherein the central unit is configured to track the position of the user'"'"'s eyes or the user'"'"'s head concurrently.

5. The system according to claim 3,

wherein the central unit is configured to align the position of the at least one point of the symbol to the virtual point concurrently based on at least one of a shift of the virtual point and a shift (Δ

xh) of the position of the user'"'"'s eyes or the user'"'"'s head.

6. The system according to claim 1,

having a capture device recording an image of the surrounding,

wherein the central unit is configured to ascertain a three dimensional space of the surrounding based on image data of the surrounding,

wherein the central unit is configured to recognize an object within the image of the surrounding, the recognized object having the virtual point in the three dimensional space,

wherein the central unit is configured to align the at least one point of the symbol to the virtual point of the recognized object based on the position of the virtual point of the recognized object and the position of the user'"'"'s eyes.

7. The system according to claim 1,

wherein the central unit is configured to ascertain a three dimensional space of the surrounding based on map data of the surrounding,

wherein the central unit is configured to recognize an object within the map data of the surrounding, the recognized object having the virtual point in the three dimensional space,

wherein the central unit is configured to align the at least one point of the symbol to the virtual point of the recognized object based on the position of the virtual point of the recognized object and the position of the user'"'"'s eyes.

8. The system according to claim 1,

wherein the central unit is configured to change a shape and/or a transparency and/or a colour of the symbol based on the position of the user'"'"'s eyes.

9. The system according to claim 1,

having adjustment means for adjusting the position of the projected image within the plane the front windshield,

wherein the central unit is configured to ascertain the position of the user'"'"'s eyes based on parameters of the adjustment of the projected image.

10. A method to control a displayed image on a front windshield or on a separate combiner of the vehicle, comprising:

projecting an image onto the front windshield of the vehicle or onto the separate combiner by means of a head-up display,

sending image data by means of a central unit to the connected head-up display to be displayed,

ascertaining a position of the user'"'"'s eyes by means of the central unit,

outputting a symbol within the image data by means of the central unit,

ascertaining a first virtual point (419) and a second virtual point in a surrounding of the vehicle based on a recorded image of the surrounding and/or a current position of the vehicle by means of the central unit, and

overlapping in the image a starting point of the symbol with the first virtual point and an end point of the symbol with the second virtual point in the view of the user.