Vehicle system and method for providing information regarding an external item a driver is focusing on

• US 9,421,866 B2
• Filed: 09/23/2011
• Issued: 08/23/2016
• Est. Priority Date: 09/23/2011
• Status: Active Grant

• Current Assignee: Visteon Global Technologies Incorporated (Visteon Corporation)
• Original Assignee: Visteon Global Technologies Incorporated (Visteon Corporation)
• Inventors: Madau, Dinu Petre, Mere, Shadi, Morris, Paul
• Primary Examiner(s): Pe, Geepy
• Application Number:
  US13/241,904
• Publication Number:
  US 20130076883A1
• Time in Patent Office: 1,796 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/1868 according to driving situations
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions

Abstract

A system and method for providing information to a driver of a vehicle includes: an image-capture device; a head or eye-gaze tracker; at least one processor; and an output device. The image-capture device captures an image of an environment external to a vehicle. The head or eye-gaze tracker determines an item a driver of the vehicle is viewing. The at least one processor processes the captured image. The at least one processor also translates language contained in the captured image of the item the driver is viewing to a second language, or determines point-of-interest information based on the captured image of the item the driver is viewing. The output device outputs information containing the second translated language of the captured image of the item the driver is viewing, or containing the determined point-of-interest information based on the captured image of the item the driver is viewing.

Claims

1. A system for providing information to a driver of a vehicle comprising:

a vehicle comprising an image-capture device, a head or eye-gaze tracker, at least one processor, and an output device;

the head or eye-gaze tracker to determine an area a driver of the vehicle is viewing;

the image-capture device to capture only the area the driver of the vehicle is viewing based on data from the head or eye-gaze tracker;

the at least one processor programmed to control the head or eye-gaze tracker and the image-capture device, to process the captured area, and at least one of;

(1) translate language contained in the captured area the driver is viewing to a second language;

or (2) determine point-of-interest information based on the captured area the driver is viewing; and

the output device to output information comprising at least one of;

(1) the second language comprising the translated language of the captured area the driver is viewing;

or (2) the determined point-of-interest information based on the captured area the driver is viewing.

2. The system of claim 1 wherein the at least one processor is programmed to process the captured area and to translate the language contained in the captured area the driver is viewing to the second language, and the output device is to output the second language comprising the translated language of the captured area the driver is viewing.

3. The system of claim 1 wherein the at least one processor is programmed to process the captured area and to determine the point-of-interest information based on the captured area the driver is viewing, and the output device is to output the determined point-of-interest information based on the captured area the driver is viewing.

4. The system of claim 3 wherein the point-of-interest information comprises at least one of a location of the point-of-interest, the name of the point-of-interest, a distance the vehicle is away from the point-of-interest, or a type of place, product, or service located at the point-of-interest.

5. The system of claim 1 wherein the vehicle further comprises a location determination unit to determine at least one of a location of the area or a location of the vehicle.

6. The system of claim 5 wherein the location determination unit comprises a Global-Positioning-System.

7. The system of claim 1 wherein the vehicle further comprises a pattern recognition unit to recognize the area the driver of the vehicle is viewing.

8. The system of claim 1 wherein the output device comprises a display to visually display the outputted information.

9. The system of claim 1 wherein the output device comprises an audio device to audio-output the outputted information.

10. The system of claim 1 wherein the vehicle further comprises a navigation system to assist the driver in navigating the vehicle.

21. The system of claim 1 wherein the vehicle further comprises a navigation system, wherein the at least one processor is programmed to process the captured area and to translate the language contained in the captured area the driver is viewing to the second language, the output device is to output the second language comprising the translated language of the captured area the driver is viewing, and the navigation system is to direct the driver to a location based on the second language comprising the translated language of the captured area.

22. The system of claim 3 wherein the point-of-interest information comprises a distance the vehicle is away from the point-of-interest.

23. The system of claim 3 wherein the point-of-interest information comprises directions for the vehicle to follow to arrive at the point-of-interest.

24. The system of claim 23 wherein the vehicle further comprises a navigation system, wherein the navigation system is to direct the driver to the point-of-interest using the directions.

11. A method for providing information to a driver of a vehicle comprising:

determining with a head or eye-gaze tracker of the vehicle an area a driver of the vehicle is viewing;

capturing only the area the driver is viewing with an image capture device of the vehicle;

processing the captured area with at least one processor of the vehicle and at least one of;

(1) translating language contained in the captured area the driver is viewing to a second language;

or (2) determining point-of-interest information based on the captured area the driver is viewing; and

outputting, with an output device of the vehicle, information comprising at least one of;

(1) the second language comprising the translated language of the captured area the driver is viewing;

or (2) the determined point-of-interest information based on the captured area the driver is viewing.

12. The method of claim 11 wherein the processing step comprises the at least one processor processing the captured area and translating the language contained in the captured area the driver is viewing to the second language, and the outputting step comprises the output device outputting the second language comprising the translated language of the captured area the driver is viewing.

13. The method of claim 11 wherein the processing step comprises the at least one processor processing the captured area and determining the point-of-interest information based on the captured area the driver is viewing, and the outputting step comprises the output device outputting the determined point-of-interest information based on the captured area the driver is viewing.

14. The method of claim 13 wherein the point-of-interest information comprises at least one of a location of the point-of-interest, the name of the point-of-interest, a distance the vehicle is away from the point-of-interest, or a type of place, product, or service located at the point-of-interest.

15. The method of claim 11 further comprising determining, using a location determination unit of the vehicle, at least one of a location of the area or a location of the vehicle.

16. The method of claim 15 wherein the location determination unit comprises a Global-Positioning-System.

17. The method of claim 11 further comprising recognizing the area the driver of the vehicle is viewing using a pattern recognition unit of the vehicle.

18. The method of claim 11 wherein the output device comprises a display, and the outputting comprises visually displaying the outputted information on the display.

19. The method of claim 11 wherein the output device comprises an audio device, and the outputting comprises audio-outputting the outputted information using the audio device.

20. The method of claim 11 further comprising using a navigation system of the vehicle to navigate the vehicle.

25. The method of claim 11 wherein the processing step comprises the at least one processor processing the captured area and translating the language contained in the captured area the driver is viewing to the second language, the outputting step comprises the output device outputting the second language comprising the translated language of the captured area the driver is viewing, and additionally including the step of a navigation system of the vehicle directing the driver to a location based on the second language comprising the translated language of the captured area.

26. The method of claim 13 wherein the point-of-interest information comprises a distance the vehicle is away from the point-of-interest.

27. The method of claim 13 wherein the point-of-interest information comprises directions for the vehicle to follow to arrive at the point-of-interest.

28. The method of claim 27 further comprising a navigation system of the vehicle directing the driver to the point-of-interest using the directions.