Image forming apparatus with playback mode, display method for an operation screen, and computer program

• US 9,661,165 B2
• Filed: 11/25/2014
• Issued: 05/23/2017
• Est. Priority Date: 11/27/2013
• Status: Active Grant

• Current Assignee: Konica Minolta Inc.
• Original Assignee: Konica Minolta Inc.
• Inventors: Ichiyama, Shohei, Kawabata, Mie, Kurumasa, Yoichi, Motosugi, Toshihisa, Sugimoto, Hiroaki
• Primary Examiner(s): HON, MING Y
• Application Number:
  US14/552,640
• Publication Number:
  US 20150146226A1
• Time in Patent Office: 910 Days
• Field of Search: None
• CPC Class Codes: H04N 1/00381 Input by recognition or interpretation of visible user gestures manual input means, e.g. digitisers, writing tablets H04N1/00392; gesture input to computers G06F3/017; recognition algorithms G06V40/20
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00474 outputting a plurality of functional options, e.g. scan, copy or print
• CPC Class Codes: H04N 1/0049 providing a visual indication to the user, e.g. using a lamp H04N1/00408 takes precedence
• CPC Class Codes: H04N 1/00506 Customising to the data to be displayed
• CPC Class Codes: H04N 1/00949 Combining applications, e.g. to create workflows allocation of computer machine resources considering the execution order of a plurality of tasks G06F9/5038
• CPC Class Codes: H04N 1/00954 Scheduling operations or managing resources H04N1/0096 takes precedence; program initiating or switching G06F9/48; allocation of computer resources G06F9/50
• CPC Class Codes: H04N 2201/0094 Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception

Abstract

An image forming apparatus includes a display and a touch panel, and is provided with a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, and the image forming apparatus includes a controller configured to determine a gesture represented by a series of touch events, store gesture log data and touch event log data to a storage unit, and determine display control processing. In the normal mode, the display control processing is determined on the basis of the gesture or an object. In the play back mode, the display control processing is determined on the basis of the gesture log data or the touch event log data. The determined display control processing is executed.

Claims

1. An image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, the image forming apparatus comprising a controller configured to:

determine a gesture represented by a series of touch events every time the series of touch events is performed on a first area of the touch panel in the normal mode, the first area being defined as a first portion of the touch panel;

store gesture log data representing the gesture determined and touch event log data representing the series of touch events performed on a second area of the touch panel to a storage unit, the second area being defined as a second portion of the touch panel distinct from the first area;

determine display control processing for displaying an operation screen on the display,

wherein in the normal mode,

a) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture determined, and

b) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of an object at a position where the series of touch events is performed, and

wherein in the play back mode,

c) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture log data, and

d) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of the touch event log data; and

execute the determined display control processing.

2. The image forming apparatus according to claim 1, wherein the gesture log data further indicates a first time at which the gesture is performed, and the touch event log data further indicates a second time at which the series of touch events is performed, and

in the play back mode, the display control processing is performed on the basis of the first time and the second time.

3. The image forming apparatus according to claim 1, wherein the storage unit is a storage unit configured to store an operation log possessed by the image forming apparatus.

4. The image forming apparatus according to claim 1, wherein the storage unit is a portable storage medium.

5. The image forming apparatus according to claim 1, wherein the storage unit is a server.

6. An image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, the image forming apparatus comprising a controller configured to:

determine a gesture represented by a series of touch events every time the series of touch events is performed on the touch panel in the normal mode;

obtain gesture log data representing the gesture represented by the series of touch events performed on a second touch panel of another image forming apparatus;

determine display control processing for displaying an operation screen on the display, on the basis of the determined gesture log and the obtained gesture log data,

wherein

a) in the normal mode, the display control processing is determined on the basis of the determined gesture,

b) in the play back mode, the display control processing is determined on the basis of the obtained gesture log data; and

execute the determined display control processing.

7. The image forming apparatus according to claim 6, wherein the gesture log data are obtained from a portable storage medium.

8. The image forming apparatus according to claim 6, wherein the gesture log data are obtained from a server.

9. A non-transitory storage medium including a computer program that can be executed by an image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, the non-transitory storage medium causing the image forming apparatus to:

execute determination processing for determining, every time a series of touch events is performed on a first area of the touch panel in the normal mode, a gesture represented by the series of touch events, the first area being defined as a first portion of the touch panel;

execute storage processing for storing, to a storage unit, gesture log data representing the gesture determined and touch event log data representing the series of touch events performed on a second area of the touch panel, the second area being defined as a second portion of the touch panel distinct from the first area;

execute determination processing for determining display control processing for displaying an operation screen on the display,

wherein in the normal mode,

a) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture determined, and

b) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of an object at a position where the series of touch events is performed, and

wherein in the play back mode,

c) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture log data, and

d) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of the touch event log data; and

execute the display control processing determined in the determination processing.

10. A non-transitory recording medium storing a computer readable program used for an image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, the non-transitory recording medium storing a computer readable program causing the image forming apparatus to:

execute determination processing for determining, every time a series of touch events is performed on the touch panel in the normal mode, a gesture represented by the series of touch events;

execute obtaining processing for obtaining gesture log data representing the gesture represented by the series of touch events performed on a second touch panel of another image forming apparatus;

execute determination processing for determining display control processing for displaying an operation screen on the display,

wherein in the determination processing,

a) in the normal mode, the display control processing is determined on the basis of the determined gesture,

b) in the play back mode, the display control processing is determined on the basis of the obtained gesture log data; and

execute the display control processing determined in the determination processing.