CONTROL METHOD OF TRANSLATION DEVICE, TRANSLATION DEVICE, AND NON-TRANSITORY COMPUTER-READABLE RECORDING MEDIUM STORING A PROGRAM

• US 20180217985A1
• Filed: 03/29/2018
• Published: 08/02/2018
• Est. Priority Date: 11/11/2016
• Status: Abandoned Application

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: SAEKI, NATSUKI, MIURA, KOJI
• Application Number:
  US15/939,390
• Publication Number:
  US 20180217985A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/279 Recognition of textual entities
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A translation device includes a microphone, a sensor that detects an attitude of the translation device, and a display. In a control method of the translation device, audio signals indicating audio from a first user are generated by the microphone, and change in the attitude of the translation device, detected by the sensor, is detected, and second text, generated by translation processing performed on first text obtained by speech recognition of the audio signals generated until detection of change in attitude of the translation device, is displayed on the display.

Claims

1. A control method of a translation device that includes a microphone, a sensor that detects an attitude of the translation device, and a display, the control method comprising:

generating audio signals indicating audio from a first user by the microphone;

detecting change in the attitude of the translation device, detected by the sensor; and

displaying, on the display, second text generated by translation processing performed on first text obtained by speech recognition of the audio signals generated until detection of change in attitude of the translation device.

2. The control method according to claim 1,

wherein detection of change in attitude of the translation device includes detecting that a presentation direction, which is a direction parallel to a normal of the display and is a direction for the display to present images, has neared a direction set beforehand as a direction from the translation device toward a second user who receives speech by the first user, by a first predetermined angle.

3. The control method according to claim 2, further comprising:

starting to generate the audio signals by the microphone, upon detecting that the presentation direction has drawn closer to a direction set beforehand as a direction toward the first user from the translation device, by a second predetermined angle.

4. The control method according to claim 2, further comprising:

ending the generating of audio signals by the microphone, upon detecting that the presentation direction has been distanced from a direction set beforehand as a direction toward the first user from the translation device, by a third predetermined angle, the first text is obtained by performing speech recognition processing on the audio signals, and the obtained first text is displayed on the display.

5. The control method according to claim 4, further comprising:

generating new audio signals, upon detecting that, after displaying the first text on the display, the presentation direction has drawn closer to the direction set beforehand as the direction toward the first user from the translation device, by the first predetermined angle.

6. The control method according to claim 1, further comprising:

performing the speech recognition processing using a language indicated by language information correlated with the attitude of the translation device at the current point in time in correlation information, stored in the translation device, correlating the attitude of the translation device and language information indicating a language for performing speech recognition processing in the attitude.

7. The control method according to claim 6, further comprising:

performing the translation processing using a language indicated by language information correlated with the attitude of the translation device at the current point in time in the correlation information, as a translation source language.

8. The control method according to claim 1,

wherein an image is displayed on the display in accordance with the detected attitude of the translation device.

9. The control method according to claim 8,

wherein display of the image in accordance with the attitude of the translation device includes displaying the image in accordance with a difference in angle between a presentation direction that is a direction parallel to a normal of the display and is a direction for the display to present images, and a direction set beforehand as a direction toward a second user who receives speech by the first user or a direction set beforehand as a direction from the translation device toward the first user.

10. The control method according to claim 8,

wherein display of the image in accordance with the attitude of the translation device includes displaying the image in accordance with the presentation direction that is a direction parallel to a normal of the display and is a direction for the display to present images

having drawn close toward the direction set beforehand as the direction toward the second user who receives the speech by the first user, by a first predetermined angle, or

having drawn close toward the direction set beforehand as the direction toward the first user, by a second predetermined angle.

12. A non-transitory computer-readable recording medium storing thereon a computer program, which when executed by the processor, causes the processor to perform operations according to claim 1.

11. A translation device, comprising:

a microphone;

a sensor that detects an attitude of the translation device;

a processor; and

a memory storing thereon a computer program, which when executed by the processor, causes the processor to perform operations including

generating audio signals indicating audio from a first user by the microphone, and

upon detecting change in the attitude of the translation device detected by the sensor, displaying second text generated by translation processing performed on first text obtained by speech recognition of the audio signals, on a display.