Information processing apparatus and information processing method

• US 9,377,853 B2
• Filed: 08/27/2014
• Issued: 06/28/2016
• Est. Priority Date: 09/11/2013
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Taguchi, Akinori
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Liang, Dong Hui
• Application Number:
  US14/469,693
• Publication Number:
  US 20150070268A1
• Time in Patent Office: 671 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

An information processing apparatus includes: a memory, and a processor coupled to the memory and configured to: identify an end position of a last line of a plurality of lines in an object for reading displayed on a display screen, the object being subjected to determination of whether the object has been finished reading by a user based on detecting movement of a gaze position of the user on a display screen, determine a display position at which movement of the gaze position that is greater than or equal to a given distance from the identified end position is detected, and display a display object at the determined display position on the display screen, the display object being destination of the gaze point after the object has been finished reading.

Claims

1. An information processing apparatus, comprising:

a memory, and

a processor coupled to the memory and configured to;

obtain data of a number of lines in an object for reading displayed on a display screen,

determine, based on movement of a gaze position of a user, whether a line break has occurred by comparing the movement of the gaze position to a first movement threshold,

determine whether a number of line breaks that have occurred is greater than or equal to a threshold number of line breaks, the threshold number of line breaks being the obtained number of lines,

when the number of line breaks is greater than or equal to the threshold number of line breaks, determine that a last line among the number of lines has been reached,

identify an end position of the last line,

determine a display position of a display component to be gazed by the user after the object has been finished reading, the display position being at a predetermined distance from the end position of the last line,

display the display component at the display position on the display screen,

set a second movement threshold based on an error regarding a gaze detection, the second movement threshold being used for determining whether the user gazes the display component and being shorter than the predetermined distance,

acquire a first gaze position and a second gaze position of the user by the gaze detection,

determine whether a distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold, and

determine that the display component is gazed by the user when the distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold.

2. The information processing apparatus according to claim 1,

wherein the display position is greater than or equal to the predetermined distance from the end position of the last line in a direction opposite to a direction in which the object is read.

3. The information processing apparatus according to claim 1,

wherein the display position is greater than or equal to the predetermined distance from the end position of the last line in a vertical direction with respect to a direction in which the object is read.

4. The information processing apparatus according to claim 1,

wherein the display position is greater than or equal to the predetermined distance in a direction identical to a direction in which the text is read.

5. The information processing apparatus according to claim 1,

wherein the processor is configured to identify each end position of each last line of each of a plurality of objects for reading displayed on the display screen,

wherein the processor is configured to calculate, for each of the plurality of objects, each of a plurality of ranges based on each end position and the predetermined distance, and

wherein the processor is configured to determine the display position based on an overlapped range with respect to the ranges.

6. The information processing apparatus according to claim 1,

wherein the second movement threshold is set based on at least one of a length corresponding to a range that is readable at one time, and a size of the display object.

7. The information processing apparatus according to claim 1,

wherein the processor is configured to determine the display position based on a distance obtained by correcting the predetermined distance in accordance with the error.

8. The information processing apparatus according to claim 1,

wherein the processor is configured to perform a determination of whether the distance from the first gaze position to the second gaze position is equal or larger than the second movement threshold, based on detecting movement indicating a newline.

9. The information processing apparatus according to claim 1,

wherein the object for reading includes text of a line configuration having the plurality of lines.

10. The information processing apparatus according to claim 1,

wherein the display component is to be operated by the user after the object has been finished reading.

11. The information processing apparatus according to claim 1,

wherein the display component includes a button for entering that the object has been finished reading.

12. The information processing apparatus according to claim 1, wherein the display component is a button and the button is only made clickable by the user when it is determined that the distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold.

13. The information processing apparatus according to claim 1, wherein the first movement threshold is different from the second movement threshold.

14. An information processing method, comprising:

obtaining data of a number of lines in an object for reading displayed on a display screen;

determining, based on movement of a gaze position of a user, whether a line break has occurred by comparing the movement of the gaze position to a first movement threshold;

determining whether a number of line breaks that have occurred is greater than or equal to a threshold number of line breaks, the threshold number of line breaks being the obtained number of lines;

when the number of line breaks is greater than or equal to the threshold number of line breaks, determining that a last line among the number of lines has been reached;

identifying an end position of the last line;

determining, by a processor, a display position of a display component to be gazed by the user after the object has been finished reading, the display position being at a predetermined distance from the end position of the last line;

displaying the display component at the display position on the display screen;

setting a second movement threshold based on an error regarding a gaze detection, the second movement threshold being used for determining whether the user gazes the display component and being shorter than the predetermined distance;

acquiring a first gaze position and a second gaze position of the user by the gaze detection;

determining whether a distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold; and

determining that the display component is gazed by the user when the distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold.

15. A non-transitory computer-readable recording medium storing a program that causes a computer to execute a procedure, the procedure comprising:

obtaining data of a number of lines in an object for reading displayed on a display screen;

determining, based on movement of a gaze position of a user, whether a line break has occurred by comparing the movement of the gaze position to a first movement threshold;

determining whether a number of line breaks that have occurred is greater than or equal to a threshold number of line breaks, the threshold number of line breaks being the obtained number of lines;

when the number of line breaks is greater than or equal to the threshold number of line breaks, determining that a last line among the number of lines has been reached;

identifying an end position of the last line;

determining a display position of a display component to be gazed by the user after the object has been finished reading, the display position being at a predetermined distance from the end position of the last line;

displaying the display component at the display position on the display screen;

setting a second movement threshold based on an error regarding a gaze detection, the second movement threshold being used for determining whether the user gazes the display component and being shorter than the predetermined distance;

acquiring a first gaze position and a second gaze position of the user by the gaze detection;

determining whether a distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold; and

determining that the display component is gazed by the user when the distance from the first gaze position to the second gaze position is equal to or larger than the second movement threshold.