IN-VEHICLE APPARATUS AND INFORMATION DISPLAY SYSTEM
First Claim
1. An in-vehicle apparatus receiving image data representative of a screen image from a portable terminal having a touch panel, and the apparatus displaying the screen image of the touch panel of the portable terminal based on the image data, the apparatus comprising:
- a vehicle communication unit receiving the image data from the portable terminal;
an extraction unit extracting a text code data from the image data received by the vehicle communication unit, the image data having the text code data that represents at least one of a text and a code in the screen image of the touch panel of the portable terminal;
a text-code display area identification unit identifying a text-code display area in the screen image;
a voice recognition unit recognizing a user-uttered voice command and converting a recognized voice command into a command text; and
a subject operation area set unit identifying a text-code display area as a subject operation area in the screen image of the portable terminal, whereinwhen the voice recognition unit acquires the command text, a determined text code data of the command text is determined based on the command text acquired from the voice recognition unit, the text code data extracted by the extraction unit, and information corresponding to the text code data on the text-code display area,the text-code display area is acquired based on the determined text code data,the subject operation area is identified as an area of the screen image of the touch panel corresponding to the text-code display area acquired by the subject operation area set unit, anda signal indicative of the subject operation area identified by the subject operation area set unit is transmitted to the portable terminal by the vehicle communication unit.
1 Assignment
0 Petitions
Accused Products
Abstract
An in-vehicle apparatus receives an image data representative of a screen image from a portable terminal with a touch panel. The apparatus extracts a text code data from the image data, and identifies a text-code display area in the screen image. The apparatus determines a command text based on a user-uttered voice command. The apparatus identifies a text-code display area as a subject operation area in the screen image of the portable terminal, based on the command text, the text code data extracted from image data, and information on the text-code display area corresponding to the text code data. An area of the screen image of the touch panel corresponding to the text-code display area is identified as the subject operation area, and a signal indicative of the subject operation area identified is transmitted to the portable terminal.
-
Citations
15 Claims
-
1. An in-vehicle apparatus receiving image data representative of a screen image from a portable terminal having a touch panel, and the apparatus displaying the screen image of the touch panel of the portable terminal based on the image data, the apparatus comprising:
-
a vehicle communication unit receiving the image data from the portable terminal; an extraction unit extracting a text code data from the image data received by the vehicle communication unit, the image data having the text code data that represents at least one of a text and a code in the screen image of the touch panel of the portable terminal; a text-code display area identification unit identifying a text-code display area in the screen image; a voice recognition unit recognizing a user-uttered voice command and converting a recognized voice command into a command text; and a subject operation area set unit identifying a text-code display area as a subject operation area in the screen image of the portable terminal, wherein when the voice recognition unit acquires the command text, a determined text code data of the command text is determined based on the command text acquired from the voice recognition unit, the text code data extracted by the extraction unit, and information corresponding to the text code data on the text-code display area, the text-code display area is acquired based on the determined text code data, the subject operation area is identified as an area of the screen image of the touch panel corresponding to the text-code display area acquired by the subject operation area set unit, and a signal indicative of the subject operation area identified by the subject operation area set unit is transmitted to the portable terminal by the vehicle communication unit. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. An information display system, comprising:
-
a portable terminal including a touch panel receiving an input from a user, a terminal communication unit communicating with other devices, and a display unit displaying a screen image according to an image data, the image data having a text code data that represents at least one of a text and a code in the screen image of the touch panel; and an in-vehicle apparatus including a vehicle communication unit communicating with the terminal communication unit of the portable terminal, wherein the vehicle communication unit receives the image data from the portable terminal via the terminal communication unit, an extraction unit extracting the text code data from the image data received by the vehicle communication unit, a text-code display area identification unit identifying a text-code display area in the screen image, a voice recognition unit recognizing a user-uttered voice command and converts a recognized voice command into a command text, and a subject operation area set unit identifying a text-code display area as a subject operation area in the screen image of the portable terminal, wherein when the voice recognition unit acquires the command text, a determined text code data of the command text is determined based on the command text acquired from the voice recognition unit, the text code data extracted by the extraction unit, and information corresponding to the text code data on the text-code display area, the text-code display area is acquired based on the determined text code data, an area of the screen image of the touch panel corresponding to the text-code display area acquired by the subject operation area set unit is identified as the subject operation area, and a signal indicative of the subject operation area identified by the subject operation area set unit is transmitted to the portable terminal by the vehicle communication unit, wherein when the portable terminal receives the signal indicative of the subject operation area from the in-vehicle apparatus, the signal is treated in a manner similar to an input operation of the identified subject operation area of the touch panel of the portable terminal.
-
-
15. An information display system comprising:
-
a voice recognition server recognizing a user-uttered voice command; a portable terminal including a touch panel to receive an input and a display unit to display a screen image according to an image data; and an in-vehicle apparatus including a display unit to display an image, wherein the in-vehicle apparatus receives an image data from a portable terminal having a touch panel and displays a screen image of the touch panel based on the image data received, the in-vehicle apparatus further including a vehicle communication unit receiving the image data of the screen image of the portable terminal, an extraction unit extracting text code data from the image data received by the vehicle communication unit, the image data includes the text code data that represents at least one of a text and a code in the screen image of the touch panel of the portable terminal, a text-code display area identification unit identifying a text-code display area in the screen image, a voice recognition server communication unit transmitting a user-uttered voice command to the voice recognition server and receives a command text from the voice recognition server based on the user-uttered voice command, and a subject operation area set unit identifying a text-code display area as a subject operation area in the screen image of the portable terminal, wherein, when the command text is acquired from the voice recognition server communication unit, a determined text code data of the command text is determined based on the command text acquired, the text code data extracted by the extraction unit, and information corresponding to the text code data on the text-code display area, and the determined text code data and the text-code display area is acquired based on the determined text code data, and an area of the screen image of the touch panel of the portable terminal corresponding to the text-code display area is determined as the subject operation area, and a signal indicative of the subject operation area identified by the subject operation area set unit is transmitted to the portable terminal by the vehicle communication unit.
-
Specification