Recording medium having stored image display control program, information processing system, and image display control method

• US 10,062,136 B2
• Filed: 11/20/2014
• Issued: 08/28/2018
• Est. Priority Date: 12/02/2013
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Katsumata, Akira
• Primary Examiner(s): Khan, Atta
• Application Number:
  US14/548,348
• Publication Number:
  US 20150156282A1
• Time in Patent Office: 1,377 Days
• Field of Search: 709203
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining

Abstract

The image display control program described below is stored on a recording medium. The program causes a client computer to execute a process including, detecting a stopping signal indicating that operations performed on an image have been stopped, performing control so as not to display images based on image data packets that are received after the detection, opening a second communication port that is different from a first communication port that communicates the image data packets, when the stopping signal is detected, transmitting, to a server via the first communication port, the stopping signal and port identification information of the second communication port, receiving, via the second communication port, a current still image corresponding to the stopping of the operations that the server transmits in response to the stopping signal, and displaying the current still image after an image that has been displayed immediately before the stopping of the operation.

Claims

1. A computer-readable, non-transitory medium having stored therein a control program for causing a client computer to execute a process, the process comprising:

obtaining a series of operation instructions directed to an object;

transmitting instruction information indicating the series of operation instructions to a server;

receiving a plurality of data packets transmitted from the server upon receipt of the instruction information, the plurality of data packets representing a plurality of images arranged in a time series to represent a series of actions of the object that depend on the series of operation instructions;

controlling a display device to display in a time series the plurality of images represented by the plurality of data packets;

determining whether the series of operation instructions have been stopped;

opening a second communication port that is different from a first communication port that communicates the plurality of data packets, between the server and the client computer, when it has been determined that the series of operation instructions have been stopped;

transmitting, to the server via the first communication port, port identification information of the second communication port and a stopping signal indicating that the series of operation instructions have been stopped;

receiving, via the second communication port, a final data packet that the server transmits in response to the stopping signal, the final data packet being one of the plurality of data packets that represents a final one of the plurality of images arranged in a time series; and

controlling the display device to halt displaying of images represented by individual packets, from among the plurality of data packets, that are received after it has been determined that the series of operation instructions have been stopped, and to display the final image represented by the final data packet subsequent to displaying of an image at a time at which it is determined that the series of operation instructions have been stopped.

2. The computer-readable, non-transitory medium stored therein the control program according to claim 1, wherein the client computer closes the second communication port after the controlling to display the final image.

3. A computer-readable, non-transitory medium having stored therein a control program for causing a server computer to execute a process, the process comprising:

receiving, from a client, instruction information indicating a series of operation instructions directed to an object;

transmitting a plurality of data packets to the client upon receipt of the instruction information, the plurality of data packets representing a plurality of images arranged in a time series to represent a series of actions of the object that depend on the series of operation instructions;

receiving, from the client, a stopping signal indicating that the series of operation instructions directed to the object have been stopped, and port identification information of a second communication port that the client opens between the server and the client when the client has determined that the series of operation instructions have been stopped, the second communication port being different from a first communication port that communicates the plurality of data packets; and

transmitting, upon receipt of the stopping signal, a final data packet, via the second communication port, the final data packet being one of the plurality of data packets that represents a final one of the plurality of images arranged in a time series.

4. An information processing system comprising:

a client that transmits, to a server via a network, a signal of an operation performed on an image, sequentially receives, via the network, image data packets that the server generates based on the signal of the operation, in response to acknowledgments, and displays images, the client including

a first processor configured to execute a first process, the first process comprising;

obtaining a series of operation instructions directed to an object;

transmitting instruction information indicating the series of operation instructions to a server;

receiving a plurality of data packets transmitted from the server upon receipt of the instruction information, the plurality of data packets representing a plurality of images arranged in a time series to represent a series of actions of the object that depend on the series of operation instructions;

controlling a display device to display in a time series the plurality of images represented by the plurality of data packets;

determining whether the series of operation instructions have been stopped,

opening, between the server and the client, a second communication port that is different from a first communication port that communicates the plurality of data packets, when it has been determined that the series of operation instructions have been stopped;

transmitting, to the server via the first communication port, port identification information of the second communication port and a stopping signal indicating that the series of operation instructions have been stopped;

receiving, via the second communication port, a final data packet that the server transmits in response to the stopping signal, the final data packet being one of the plurality of data packets that represents a final one of the plurality of images arranged in a time series; and

controlling the display device to halt displaying of images represented by individual packets, from among the plurality of data packets, that are received after it has been determined that the series of operation instructions have been stopped, and to display the final image represented by the final data packet subsequent to displaying of an image at a time at which it is determined that the series of operation instructions have been stopped; and

a server that receives the signal of the operation transmitted from the client via the network, generates image data packets based on the signal of the operation, and sequentially transmits the image data packets to the client via the network in response to acknowledgments from the client, the server including

a second processor configured to execute a second process, the second process comprising;

receiving, from the client, the stopping signal and the port identification information from the client, and

transmitting, via the second communication port, the current still image at the time of the receiving of the stopping signal.

5. An image display control method that is performed by a client computer, the image display control method comprising:

obtaining a series of operation instructions directed to an object;

transmitting instruction information indicating the series of operation instructions to a server;

receiving a plurality of data packets transmitted from the server upon receipt of the instruction information, the plurality of data packets representing a plurality of images arranged in a time series to represent a series of actions of the object that depend on the series of operation instructions;

controlling a display device to display in a time series the plurality of images represented by the plurality of data packets;

determining whether the series of operation instructions have been stopped;

opening, between the server and the client computer, a second communication port that is different from a first communication port that communicates the plurality of data packets, when it has been determined that the series of operation instructions have been stopped;

transmitting, to the server via the first communication port, port identification information of the second communication port and a stopping signal indicating that the series of operation instructions have been stopped;

receiving, via the second communication port, a final data packet that the server transmits in response to the stopping signal, the final data packet being one of the plurality of data packets that represents a final one of the plurality of images arranged in a time series; and

controlling the display device to halt displaying of images represented by individual packets, from among the plurality of data packets, that are received after it has been determined that the series of operation instructions have been stopped, and to display the final image represented by the final data packet subsequent to displaying of an image at a time at which it is determined that the series of operation instructions have been stopped.

6. An image display control method that is performed by a server computer, the image display control method comprising:

receiving, from a client, instruction information indicating a series of operation instructions directed to an object;

transmitting a plurality of data packets to the client upon receipt of the instruction information, the plurality of data packets representing a plurality of images arranged in a time series to represent a series of actions of the object that depend on the series of operation instructions;

receiving, from the client, a stopping signal indicating that the series of operation instructions directed to the object have been stopped and port identification information of a second communication port that the client opens between the server and the client when the client has determined that the series of operation instructions have been stopped, the second communication port being different from a first communication port that communicates the plurality of data packets; and

transmitting, upon receipt of the stopping signal, a final data packet, via the second communication port, the final data packet being one of the plurality of data packets that represents a final one of the plurality of images arranged in a time series.