Electronic device, information processing apparatus,and method for controlling the same

• US 9,257,114 B2
• Filed: 07/09/2013
• Issued: 02/09/2016
• Est. Priority Date: 07/12/2012
• Status: Active Grant

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Tanaka, Tomonori
• Primary Examiner(s): Neway, Samuel G
• Application Number:
  US13/937,357
• Publication Number:
  US 20140019136A1
• Time in Patent Office: 945 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

The present invention provides a technology for enabling a natural voice reproduction in which, depending on a gazed character position, a position of a voice output character follows but not excessively reacts with the gazed character position. Therefore, in an electronic device provided with a display unit for displaying text on a screen, a voice outputting unit for outputting the text as voice, and a sight-line detection unit for detecting a sight-line direction of a user, a control unit changes a starting position at which a voice outputting unit starts voice output if a distance between the position of the current output character and the position of the current gazed character is a preset threshold or more.

Claims

1. An electronic device comprising:

a display unit configured to display text on a screen;

a voice outputting unit configured to output the text as voice;

a sight-line detection unit configured to detect a sight-line direction of a user; and

a control unit configured, assuming that a position of a character that the voice outputting unit is currently outputting as voice is defined as a position of a current output character, and a position of a character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit is defined as a position of a current gazed character, to change a starting position at which the voice outputting unit starts voice output depending on a distance between the position of the current output character and the position of the current gazed character,

the control unit including;

a determination unit configured to determine whether or not the distance between the position of the current output character and the position of the current gazed character is equal to a preset threshold or more; and

a setting unit configured, if the determination unit determined that the distance is equal to the preset threshold or more, to set the position of the current gazed character to the starting position at which the voice outputting unit starts voice output.

2. The device according to claim 1,

wherein assuming that the preset threshold is defined as a first threshold, and a threshold that is less than the first threshold is defined as a second threshold,

the control unit is configured, if the distance is equal to the second threshold or more and less than the first threshold, to control the voice outputting unit to stop the voice output.

3. The device according to claim 1,

wherein the setting unit is configured, if a state in which the distance is equal to the preset threshold or more continues for a predetermined time duration or more, to set the position of the current gazed character to the starting position at which the voice outputting unit starts voice output.

4. The device according to claim 1,

wherein the setting unit is configured, on the further condition that a position of the gazed character present in the sight-line direction detected by the sight-line detection unit has shifted along the characters of the text in succession by a predetermined number of characters or more, to set the position of the current gazed character to the starting position at which the voice outputting unit starts voice output.

5. The device according to claim 1,

wherein the control unit further includes a velocity detection unit configured to detect a velocity at which the position of the gazed character present in the sight-line direction detected by the sight-line detection unit shifts, and

the setting unit is configured to set the position of the current gazed character to the starting position at which the voice outputting unit starts voice output, and to set a voice output velocity according to the velocity detected by the velocity detection unit.

6. The device according to claim 3,

wherein the control unit includes a time duration change unit configured to change the predetermined time duration if page transition or page scroll with respect to the text displayed on the screen is instructed.

7. The electronic device according to claim 1,

wherein the distance used for the determination by the determination unit is the number of characters in an arrangement of a character string in the text, between the position of the current output character and the position of the current gazed character.

8. The device according to claim 1,

wherein the distance used for the determination by the determination unit is a distance in a two-dimensional space on the screen between the position of the current output character and the position of the current gazed character.

9. A method for controlling an electronic device provided with a display unit configured to display text on a screen, a voice outputting unit configured to output the text as voice, and a sight-line detection unit configured to detect a sight-line direction of a user, the method comprising:

a controlling step of changing, assuming that a position of a character that the voice outputting unit is currently outputting as voice is defined as a position of a current output character, and a position of a character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit is defined as a position of a current gazed character, a starting position at which the voice outputting unit starts voice output depending on a distance between the position of the current output character and the position of the current gazed character,

the controlling step including;

a determination step of determining whether or not the distance between the position of the current output character and the position of the current gazed character is equal to a preset threshold or more; and

a setting step of setting the position of the current gazed character to the starting position at which the voice outputting unit starts voice output if it is determined in the determination step that the distance is equal to the preset threshold or more.

10. A non-transitory, computer-readable storage medium having stored therein a program for causing a computer, which comprises a display unit configured to display text on a screen, a voice outputting unit configured to output the text as voice, and a sight-line detection unit configured to detect a sight-line direction of a user, to execute the steps of:

a controlling step of changing, assuming that a position of a character that the voice outputting unit is currently outputting as voice is defined as a position of a current output character, and a position of a character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit is defined as a position of a current gazed character, a starting position at which the voice outputting unit starts voice output depending on a distance between the position of the current output character and the position of the current gazed character,

the controlling step including;

a determination step of determining whether or not the distance between the position of the current output character and the position of the current gazed character is equal to a preset threshold or more; and

a setting step of setting the position of the current gazed character to the starting position at which the voice outputting unit starts voice output if it is determined in the determination step that the distance is equal to the preset threshold or more.

11. An information processing apparatus comprising:

a voice outputting unit configured to output text displayed on a screen as voice;

a sight-line detection unit configured to detect a sight-line direction of a user;

a control unit configured to control a position at which the voice outputting unit performs voice output on the basis of a distance between a position of a character in the text at which the voice outputting unit is performing voice output and a position of a character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit; and

a setting unit configured to, if the distance is equal to or more than a preset threshold, set the position of the character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit to the starting position at which the voice outputting unit starts voice output.

12. The apparatus according to claim 11,

wherein the control unit includes:

a determination unit configured to determine whether or not the distance is equal to or more than the preset threshold,

wherein the setting unit is configured to, if the determination unit determined that the distance is equal to or more than the preset threshold, set the position of the character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit to the starting position at which the voice outputting unit starts voice output.

13. The apparatus according to claim 11,

wherein the setting unit is configured, if a state in which the distance is equal to or more than the preset threshold continues for a predetermined time duration or more, to set the position of the character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit to the starting position at which the voice outputting unit starts voice output.

14. The apparatus according to claim 12,

wherein the control unit further includes a velocity detection unit configured to detect a velocity at which the position of the character in the text that is present in the sight-line direction detected by the sight-line detection unit shifts;

and

the setting unit is configured to set the position of the character in the text that is present in the sight-line direction of the user detected by the sight-line detection unit to the starting position at which the voice outputting unit starts voice output, and to set a voice output velocity according to the velocity detected by the velocity detection unit.

15. The apparatus according to claim 12,

wherein the distance is the number of characters in an arrangement of a character string in the text.

16. The apparatus according to claim 12,

wherein the distance is a distance in a two-dimensional space on the screen.

17. A method for controlling an information processing apparatus provided with a voice outputting unit configured to output text displayed on a screen as voice, the method comprising:

a sight-line detection step of detecting a sight-line direction of a user;

a control step of controlling a position at which the voice outputting unit performs voice output on the basis of a distance between a position of a character in the text at which the voice outputting unit is performing voice output and a position of a character in the text that is present in the sight-line direction of the user detected in the sight-line detection step; and

a setting step of setting, if the distance is equal to or more than a preset threshold, the position of the character in the text that is present in the sight-line direction of the user detected in the sight-line detection step to the starting position at which the voice outputting unit starts voice output.

18. A non-transitory, computer-readable storage medium having stored therein a program for causing a computer, which comprises a voice outputting unit configured to output text displayed on a screen as voice, to execute the steps of:

a sight-line detection step of detecting a sight-line direction of a user;

a control step of controlling a position at which the voice outputting unit performs voice output on the basis of a distance between a position of a character in the text at which the voice outputting unit is performing voice output and a position of a character in the text that is present in the sight-line direction of the user detected in the sight-line detection step; and

a setting step of setting, if the distance is equal to or more than a preset threshold, the position of the character in the text that is present in the sight-line direction of the user detected in the sight-line detection step to the starting position at which the voice outputting unit starts voice output.