Non-volatile storage medium storing a portable device control program, and method of controlling a portable device

• US 8,836,731 B2
• Filed: 01/26/2012
• Issued: 09/16/2014
• Est. Priority Date: 01/31/2011
• Status: Active Grant

• Current Assignee: Brother Kogyo Kabushiki Kaisha
• Original Assignee: Brother Kogyo Kabushiki Kaisha
• Inventors: Yanagawa, Ryo
• Primary Examiner(s): Chu, David H
• Application Number:
  US13/359,239
• Publication Number:
  US 20120194531A1
• Time in Patent Office: 964 Days
• US Class Current: 345/684
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: Y10T 74/12 Gyroscopes

Abstract

A non-volatile storage medium storing a control program readable by a computer of a portable device including a sensor to output detected information indicative of at least one of a movement and an attitude of the portable device, a data memory portion to store image data, and a display portion to display an image on the basis of the image data, wherein the control program enables the computer to function as: a partial area specifying portion to specify, as a partial image area, an area of a partial image that is a portion of the image represented by the image data, on the basis of at least one of the movement and attitude of the portable device indicated by the detected information; and a display control portion to display the partial image in the partial image area specified by the partial area specifying portion, on the display portion.

Claims

1. A non-transitory storage medium storing computer-readable instructions readable by a computer of a portable device including a sensor configured to output sensor information corresponding to a movement and an attitude of the portable device, a data memory portion configured to store image data, and a display portion configured to display an image on the basis of the image data, wherein, when executed by the computer of the portable device, the computer-readable instructions instruct the computer to function as:

a sensor-information obtaining portion configured to obtain the sensor information;

a partial area specifying portion configured to specify, as a partial image area, an area of a partial image that is a portion of the image represented by the image data, on the basis of the obtained sensor information;

a display control portion configured to command the display portion to display the partial image corresponding to the partial image area specified by the partial area specifying portion; and

a first state judging portion configured to judge whether the obtained sensor information indicates a state in which the portable device is kept inclined at a predetermined angle with respect to a horizontal plane,

wherein the partial area specifying portion is configured to specify, while the display portion displays a first partial image as the partial image, a second partial image area on the basis of the sensor information outputted in response to the movement of the portable device, the second partial image area corresponding to a portion of the image represented by the image data that is located at a position different from a position of a first partial image area corresponding to the first partial image,

wherein, when the first state judging portion judges that the obtained sensor information indicates the state in which the portable device is kept inclined at the predetermined angle with respect to the horizontal plane, the display control portion is configured to command the display portion to perform a scrolling processing such that the display portion displays a second partial image corresponding to the second partial image area specified by the partial area specifying portion on the basis of the sensor information outputted in response to the movement of the portable device,

wherein, when the first state judging portion judges that the obtained sensor information does not indicate the state in which the portable device is kept inclined at the predetermined angle with respect to the horizontal plane, the display control portion is configured not to command the display portion to perform the scrolling processing on the basis of the sensor information outputted in response to the movement of the portable device,

wherein the first state judging portion is further configured to judge whether the image data includes data representing characters, and

wherein, when the first state judging portion judges that the image data includes the data representing characters, the display control portion is configured to command the display portion to display the partial image corresponding to the partial image area, which is not an entire area of the image represented by the image data.

2. The non-transitory storage medium according to claim 1,

wherein said display portion is provided on a first surface that is one surface of a housing of the portable device, and

wherein, while the display portion displays the first partial image as the partial image, the partial area specifying portion is configured to specify the second partial image area on the basis of the outputted sensor information indicative of the movement of the portable device in a first direction parallel to the first surface.

3. The non-transitory storage medium according to claim 2, wherein the partial area specifying portion is configured to specify, as the second partial image area, the area of the partial image which is shifted from the position of the first partial image area in a positive direction, when the outputted sensor information indicates the movement of the portable device in one of opposite directions parallel to the first direction parallel to the first surface, and in a negative direction opposite to the positive direction, when the outputted sensor information indicates the movement of the portable device in the other of the opposite directions parallel to the first direction parallel to the first surface.

4. The non-transitory storage medium according to claim 2,

wherein the outputted sensor information includes a direction and a magnitude of acceleration of the portable device, and

wherein the partial area specifying portion is configured to calculate a velocity of the movement of the portable device on the basis of the direction and the magnitude of the acceleration, and to specify the second partial image area on the basis of the calculated velocity of the movement.

5. The non-transitory storage medium according to claim 1,

wherein the display portion is provided on a first surface that is one surface of a housing of the portable device,

wherein, while the display portion displays the first partial image as the partial image, the partial area specifying portion is configured to specify, as a third partial image area, an area of a partial image which is a portion of the image represented by the image data and which is enlarged or reduced with respect to the first partial image area, and to specify the second partial image area on the basis of the outputted sensor information indicative of the movement of the portable device in a direction of thickness of the housing perpendicular to the first surface of the housing, and

wherein the display control portion is configured to command, when the partial area specifying portion specifies the third partial image area, the display portion to display a third partial image corresponding to the third partial image area specified by the partial area specifying portion.

6. The non-transitory storage medium according to claim 5, wherein the partial area specifying portion is configured to specify, as the third partial image area, the area of the partial image enlarged with respect to the first partial image area, when the outputted sensor information indicates the movement of the portable device in one of opposite directions parallel to the direction of thickness of the housing, and the area of the partial image reduced with respect to the first partial image area, when the outputted sensor information indicates the movement of the portable device in the other of the opposite directions parallel to the direction of thickness of the housing.

7. The non-transitory storage medium according to claim 1,

wherein the display portion is provided on a first surface that is one of surfaces of a housing of the portable device,

wherein, while the display portion displays the first partial image as the partial image, the partial area specifying portion is configured to specify, the second partial image area on the basis of the outputted sensor information indicative of angles of inclination of the portable device with respect to a direction of an axis parallel to the first surface and another axis parallel to the first surface, and

wherein the display control portion is configured to command the display device to display the second partial image corresponding to the second partial image area specified by the partial area specifying portion.

8. The non-transitory storage medium according to claim 7, wherein, while the display portion displays the first partial image, the partial area specifying portion is configured to specify, as the second partial image area, an area of the partial image which is a portion of the image represented by the image data and which is enlarged or reduced with respect to the first partial image area, and to specify the second partial image area on the basis of the outputted sensor information indicative of the movement of the portable device in a direction of thickness of the housing perpendicular to the first surface of the housing, and

wherein the display control portion is configured to command the display device to display the second partial image corresponding to the second partial image area specified by the partial area specifying portion.

9. The non-transitory storage medium according to claim 1,

wherein the first state judging portion is further configured to judge whether a predetermined operation button of the portable device is kept touched, and

wherein the partial area specifying portion is configured to specify the second partial image area when the first state judging portion judges that the obtained sensor information indicates the state in which the portable device is kept inclined at the predetermined angle and that the predetermined operation button is kept touched.

10. The non-transitory storage medium according to claim 9,

wherein the display control portion is configured to command the display portion to display the second partial image corresponding to the second partial image area when the first state judging portion judges that the predetermined operation button is kept touched, and

wherein the display control portion is configured to command the display portion to not display the second partial image on the display portion when the first state judging portion judges that the predetermined operation button is not kept touched.

11. The non-transitory storage medium according to claim 1,

wherein, when executed by the computer of the portable device, the computer-readable instructions further instruct the computer to function as an input receiving portion configured to receive a manual operation of the portable device, and

wherein the partial area specifying portion is configured to specify the partial image area on the basis of the obtained sensor information when the input receiving portion is not currently receiving the manual operation, and

wherein the partial area specifying portion is configured to specify the partial image area on the basis of the manual operation while the input receiving portion receives the manual operation.

12. A method of controlling a portable device including a sensor configured to output sensor information corresponding to a movement and an attitude of the portable device, a data memory portion configured to store image data, and a display portion configured to display an image on the basis of the image data, the method comprising:

obtaining the sensor information;

performing a specifying processing to specify, as a partial image area, an area of a partial image that is a portion of the image represented by the image data, on the basis of the obtained sensor information;

performing a commanding processing to command the display portion to display the partial image corresponding to the partial image area; and

judging whether the obtained sensor information indicates a state in which the portable device is kept inclined at a predetermined angle with respect to a horizontal plane,

wherein the specifying processing includes specifying, while the display portion displays a first partial image as the partial image, a second partial image area on the basis of the sensor information outputted in response to the movement of the portable device, the second partial image area corresponding to a portion of the image represented by the image data that is located at a position different from a position of a first partial image area corresponding to the first partial image,

wherein, when it is judged that the obtained sensor information indicates the state in which the portable device is kept inclined at the predetermined angle with respect to the horizontal plane, the commanding processing includes commanding the display portion to perform a scrolling processing such that the display portion displays a second partial image corresponding to the second partial image area specified in the specifying processing on the basis of the sensor information outputted in response to the movement of the portable device,

wherein, when it is judged that the obtained sensor information does not indicate the state in which the portable device is kept inclined at the predetermined angle with respect to the horizontal plane, the commanding processing does not include commanding the display portion to perform the scrolling processing on the basis of the sensor information outputted in response to the movement of the portable device, and

wherein the method further comprises;

judging whether the image data includes data representing characters,

wherein, when it is judged that the image data includes the data representing characters, the commanding processing includes commanding the display portion to display the partial image corresponding to the partial image area, which is not an entire area of the image represented by the image data.

13. A portable device comprising:

a sensor configured to output sensor information corresponding to a movement and an attitude of the portable device;

a data memory portion configured to store image data;

a display portion configured to display an image on the basis of the image data;

a sensor-information obtaining portion configured to obtain the sensor information;

a partial area specifying portion configured to specify, as a partial image area, an area of a partial image that is a portion of the image represented by the image data, on the basis of the obtained sensor information;

a display control portion configured to command the display portion to display the partial image corresponding to the partial image area specified by the partial area specifying portion; and

a first state judging portion configured to judge whether the obtained sensor information indicates a state in which the portable device is kept inclined at a predetermined angle with respect to a horizontal plane,

wherein the partial area specifying portion is configured to specify, while the display portion displays a first partial image as the partial image, a second partial image area on the basis of the sensor information outputted in response to the movement of the portable device, the second image area corresponding to a portion of the image represented by the image data that is located at a position different from a position of a first partial image area corresponding to the first partial image,

wherein, when the first state judging portion judges that the obtained sensor information indicates the state in which the portable device is kept inclined at the predetermined angle with respect to the horizontal plane, the display control portion is configured to command the display portion to perform a scrolling processing such that the display portion displays a second partial image corresponding to the second partial image area specified by the partial area specifying portion on the basis of the sensor information outputted in response to the movement of the portable device,

wherein, when the first state judging portion judges that the obtained sensor information does not indicate the state in which the portable device is kept inclined at the predetermined angle with respect to the horizontal plane, the display control portion is configured not to command the display portion to perform the scrolling processing on the basis of the sensor information outputted in response to the movement of the portable device,

wherein the first state judging portion is further configured to judge whether the image data includes data representing characters, and

wherein, when the first state judging portion judges that the image data includes the data representing characters, the display control portion is configured to command the display portion to display the partial image corresponding to the partial image area, which is not an entire area of the image represented by the image data.

14. A non-transitory storage medium storing computer-readable instructions readable by a computer of a portable device including a sensor configured to output sensor information corresponding to at least one of a movement and an attitude of the portable device, a data memory portion configured to store image data, and a display portion configured to display an image on the basis of the image data, wherein, when executed by the computer of the portable device, the computer-readable instructions instruct the computer to function as:

a sensor-information obtaining portion configured to obtain the sensor information;

a partial area specifying portion configured to specify, as a partial image area, an area of a partial image that is a portion of the image represented by the image data, on the basis of the obtained sensor information;

a display control portion configured to command the display portion to display the partial image corresponding to the partial image area specified by the partial area specifying portion;

a first state judging portion configured to judge whether the image data includes data representing characters,

wherein, when the first state judging portion judges that the image data includes the data representing characters, the display control portion is configured to command the display portion to display the partial image area, which is not an entire area of the image represented by the image data, and

wherein, when the first state judging portion judges that the image data does not include the data representing characters, the display control portion is configured to command the display portion to display the partial image area, which is the entire area of the image represented by the image data.

15. The non-transitory storage medium according to claim 14, wherein the display control portion is configured to command the display portion to display the partial image, which is specified when the first state judging portion judges that the image data includes the data representing characters, such that a size of the characters included in the partial image displayed on the display portion is substantially equal to a size of the characters in the image printed on a recording medium.