Image capture system for a vehicle using translation of different languages

• US 9,971,768 B2
• Filed: 02/19/2015
• Issued: 05/15/2018
• Est. Priority Date: 02/21/2014
• Status: Active Grant

• Current Assignee: Jaguar Land Rover Limited (TATA Motors Limited)
• Original Assignee: Jaguar Land Rover Limited (TATA Motors Limited)
• Inventors: Murthy, Niranjan, Wells, Andy
• Primary Examiner(s): Thomas-Homescu, Anne L
• Application Number:
  US15/114,663
• Publication Number:
  US 20160350286A1
• Time in Patent Office: 1,181 Days
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G08G 1/09623 Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle G08G1/0967 takes precedence
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096758 where no selection takes place on the transmitted or the received information
• CPC Class Codes: G08G 1/096775 where the origin of the information is a central station
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A system for use in a vehicle having a selected vehicle language, the system comprising image capture means for capturing an image scene external to the vehicle, wherein the image scene includes one or more information indicator including text in a country language other than the selected vehicle language. A means is provided for outputting a vehicle language signal representative of the selected vehicle language to an off-board server; and a means is provided for outputting a country language signal to the off-board server which is representative of the country language. A means is also provided for outputting the text to the off-board server for translation from the country language into the vehicle language; together with means for receiving a translated text output from the off-board server which is representative of the translated text. A means is provided for communicating the translated text output to the vehicle user. In an alternative arrangement the system carries a translator on-board the vehicle for translation of the text from the country language into the vehicle language, so that translation occurs on-board the vehicle and not off-board the vehicle.

Claims

1. A system for use in a vehicle having a selected vehicle language in which communications are to be carried out between a vehicle user and the system, the system comprising:

a camera system that captures an image scene external to the vehicle, wherein the image scene includes one or more information indicators including text in a country language other than the selected vehicle language; and

a computer system in communication with the camera system, wherein the computer system performs the following;

outputs a vehicle language signal representative of the selected vehicle language to an off-board server;

outputs a country language signal to the off-board server which is representative of the country language;

outputs the text to the off-board server for translation from the country language into the vehicle language;

receives a translated text output from the off-board server which is representative of the translated text; and

communicates the translated text output to the vehicle user;

wherein the camera system generates multiple information outputs from the image scene, wherein each of the multiple information outputs represents the translated text corresponding to an information indicator in a different region of the image scene; and

wherein the camera system communicates the multiple information outputs to the vehicle user so as to identify which information indicator corresponds to which region of the image scene in an order in which the vehicle passes a corresponding different region in the image scene.

3. The system of claim 1, wherein the information indicator also includes a symbol, and wherein the computer system derives a symbol meaning from the symbol and communicates the symbol meaning to the vehicle user.

4. The system of claim 1, wherein the information indicator is comprised in a road sign in the image scene.

5. The system of claim 1, wherein the information indicator is comprised in an advertisement board in the image scene.

6. The system of claim 1, further comprising a global position sensor that determines a geographical location of the vehicle, and wherein the computer system derives the country language signal from the global position sensor.

7. The system of claim 1, further comprising a display that allows user selection of a region of the image scene from which the information output is to be derived.

8. The system of claim 1, wherein the computer system communicates the translated text output to the vehicle user in a manner dependent on a position of the information indicator in the image scene.

9. The system of claim 8, further comprising an audio system having multiple speakers each in a different position in the vehicle, and wherein the translated text output to the vehicle user is communicated through a speaker according to the respective position of the speaker in the vehicle and the position of the information indicator in the image scene.

10. The system of claim 1, wherein the computer system comprises an audio system.

11. The system of claim 1, wherein the computer system comprises a visual display screen.

12. The system of claim 10, further comprising an interface that allows user selection of a type of communication.

15. A vehicle comprising the system of claim 1.

2. A system for use in a vehicle having a selected vehicle language in which communications are to be carried out between a vehicle user and the system, the system comprising:

a camera system that captures an image scene external to the vehicle, wherein the image scene includes one or more information indicators including text in a country language other than the selected vehicle language;

a processor that translates the text from the country language into the selected vehicle language, generates a translated text output representative of the translated text, and communicates the translated text output to the vehicle user;

wherein the camera system generates multiple information outputs from the image scene, wherein each of the multiple information outputs represents the translated text corresponding to an information indicator in a different region of the image scene and

wherein the camera system communicates the multiple information outputs to the vehicle user so as to identify which information indicator corresponds to which region of the image scene in an order in which the vehicle passes a corresponding different region in the image scene.

16. A vehicle comprising the system of claim 2.

13. A method for use in a vehicle having a selected vehicle language, the method comprising:

capturing an image scene external to the vehicle, wherein the image scene includes one or more information indicators including text in a country language other than the selected vehicle language;

outputting a vehicle language signal representative of the selected vehicle language to an off-board server;

outputting a country language signal to the off-board server which is representative of the country language;

outputting the text to the off-board server for translation from the country language into the vehicle language;

receiving a translated text output from the off-board server which is representative of the translated text;

generating multiple information outputs from the image scene, wherein each of the multiple information outputs represents the translated text corresponding to an information indicator in a different region of the image scene; and

communicating the multiple information outputs to the vehicle user so as to identify which information indicator corresponds to which region of the image scene in an order in which the vehicle passes a corresponding different region in the image scene so as to communicate the translated text output to a vehicle user.

14. A method for use in a vehicle having a selected vehicle language, the method comprising:

capturing an image scene external to the vehicle, wherein the image scene includes one or more information indicators including text in a country language other than the selected vehicle language;

translating the text from the country language into the selected vehicle language and generating a translated text output representative of the translated text;

generating multiple information outputs from the image scene, wherein each of the multiple information outputs represents the translated text corresponding to an information indicator in a different region of the image scene; and

communicating the multiple information outputs to the vehicle user so as to identify which information indicator corresponds to which region of the image scene in an order in which the vehicle passes a corresponding different region in the image scene so as to communicate the translated text output to a vehicle user.