Display screen duplication system and method

• US 5,990,852 A
• Filed: 10/31/1996
• Issued: 11/23/1999
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Szamrej, Mark
• Primary Examiner(s): BRIER, JEFFERY A
• Application Number:
  US08/741,807
• Time in Patent Office: 1,118 Days
• Field of Search: 345/2, 345/329-331, 348/420, 348/421
• US Class Current: 345/2.1
• CPC Class Codes: H04N 19/507 using conditional replenishment

Abstract

Duplicate copies of all or a portion of a display screen may be maintained at two or more computer systems with efficient use of memory, processor and bandwidth resources. The display screens are segmented into a two-dimensional matrix of blocks. A value, such as a CRC, is computed for each of the blocks and stored with a pointer to the corresponding block of the display screen. Changes in the display screen are detected by repeatedly calculating the values and comparing with previously stored values for the corresponding block. When the values are different, the pointers are temporarily stored until a predetermined period of time or all the blocks have been checked. When at least one of these criteria is met, adjacent blocks are transmitted as a group, preferably using compression.

Claims

1. A method of transmitting display data from a first display to a second display, comprising:

segmenting the first display into predefined blocks, each block containing a plurality of pixels;

calculating and storing first values, each representing all of the pixels in a corresponding block;

calculating second values, each representing all of the pixels in the corresponding block, after passage of time during which the pixels may have changed; and

transmitting changed blocks from the first display to the second display when the first and second values for the changed blocks are unequal.

2. A method as recited in claim 1, further comprising:

setting the first values of the changed blocks to the second values of the changed blocks after said transmitting; and

comparing the first and second values,

wherein said calculating of the second values and said comparing of the first and second values are performed repeatedly, and

wherein said transmitting of the changed blocks and said setting of the first values are performed when said comparing detects a difference between the first and second values.

3. A method as recited in claim 1, wherein said calculating produces a cyclic redundancy code for each of the first and second values.

4. A method as recited in claim 3, wherein the cyclic redundancy code has 32 bits.

5. A method as recited in claim 3, wherein the cyclic redundancy code uses 64 bits.

6. A method as recited in claim 1, wherein said method is performed by a data processing system controlled by a multithreaded operating system, and

wherein said calculating of the second values is performed by a first thread and said transmitting of the changed blocks is performed by a second thread separate from the first thread.

7. A method as recited in claim 6, wherein the data processing system has a first display memory to store the display data displayed by the first display, and said method further comprises:

storing identifiers of the changed blocks by the first thread when differences between the first and second values of the changed blocks is detected; and

reading the contents of the changed blocks from the display memory by the second thread based on the identifiers stored by the first thread to obtain the contents of the changed blocks for transmission.

8. A method as recited in claim 7, wherein said storing of the identifiers arranges the identifiers with a least recently detected changed block corresponding to a first identifier next accessed by the second thread.

9. A method as recited in claim 7, further comprising removing, by the second thread, transmitted block identifiers stored by the first thread when the changed blocks corresponding to the transmitted block identifiers are transmitted by the second thread.

10. A method as recited in claim 9, wherein said transmitting includes selecting by the second thread a plurality of adjacent changed blocks to be transmitted together.

11. A method as recited in claim 10,

wherein said selecting includes determining by the second thread a rectangle containing only the adjacent changed blocks and unchanged blocks adjacent to at least two of the changed blocks, and

wherein said transmitting by the second thread includes

encoding the contents of all of the blocks in the rectangle to obtain encoded data;

and

transmitting the encoded data.

12. A method as recited in claim 11, wherein said removing of the transmitted identifiers removes only the identifiers of the adjacent changed blocks and if any of the identifiers remain, the first identifier next accessed by the second thread corresponds to the least recently detected changed block of the identifiers remaining.

13. A method as recited in claim 7, wherein said transmitting includes selecting by the second thread a plurality of adjacent changed blocks to be transmitted together.

14. A method as recited in claim 13,

wherein said selecting includes determining by the second thread a rectangle containing only the adjacent changed blocks and unchanged blocks adjacent to at least two of the changed blocks, and

wherein said transmitting by the second thread includes

encoding the contents of all of the blocks in the rectangle to obtain encoded data;

and

transmitting the encoded data.

15. A method as recited in claim 7,

wherein said calculating of the second values by the first thread is performed repeatedly for the blocks, further comprising:

repeatedly comparing the first and second values by the first thread;

storing the identifiers of the changed blocks in a first location by the first thread;

storing the identifiers of the changed blocks in a first location by the first thread when said comparing determines that the first and second values are different;

moving the identifiers at the first location to a second location by the first thread, at a time decided by predetermined criteria; and

sending a signal from the first thread to the second thread informing the second thread that the identifiers were moved to the second location, and

wherein said reading of the contents of the changed blocks by the second thread is based on the identifiers stored in the second location.

16. A method as recited in claim 15, wherein the predetermined criteria include a period of time started when a first identifier of one of the changed blocks is stored in the first location without the identifiers of any previously detected changed blocks stored in the first location, and ended before said moving of the identifiers from the first location to the second location.

17. A method as recited in claim 16, wherein the predetermined criteria include performing said comparing for all of the blocks of the first display including said comparing resulting in the first identifier being stored in the first location, before said moving of the identifiers from the first location to the second location.

18. A method as recited in claim 15, wherein the predetermined criteria include performing said comparing for all of the blocks of the first display before said moving of the identifiers from the first location to the second location, starting with an initial changed block having a first identifier to be stored in the first location without the identifiers of any previously detected changed blocks stored in the first location.

19. A method as recited in claim 1, wherein said transmitting includes selecting a plurality of adjacent changed blocks to be transmitted together.

20. A method as recited in claim 19,

wherein said selecting includes determining a rectangle containing only the adjacent changed blocks and unchanged blocks adjacent to at least two of the changed blocks, and

wherein said transmitting includes

encoding the contents of all of the blocks in the rectangle to obtain encoded data;

and

transmitting the encoded data.

21. A method of maintaining a copy of a first display at a second display, comprising:

calculating and storing first values and identifiers in a grid list, each of the first values representing a plurality of pixels in one of a plurality of blocks into which the first display is segmented;

executing a first thread to repeatedly

calculate second values of the blocks having corresponding identifiers in the grid list, each of the second values representing a plurality of pixels in the one of the blocks after passage of time during which the pixels may have changed,

compare the second values with the first values stored in the grid list,

remove the identifiers of changed blocks from the grid list and store the identifiers and the second values of the changed blocks in a changed block list when differences between the first and second values of the changed blocks are detected, and

move the identifiers and the second values of the changed blocks from a return list to the grid list after data has been sent to the second display to update the copy of the first display to include the changed blocks; and

executing a second thread to repeatedly

remove the identifiers from the changed block list,

read the contents of the changed blocks from a display memory of the first display, based on the identifiers removed from the changed block list, to obtain the contents of the changed blocks for transmission,

transmit the data corresponding to the changed blocks to the second display, and

store the identifiers and the second values of the changed blocks in the return list after the data is transmitted to the second display.

22. A method as recited in claim 21, wherein the identifiers are removed from the grid list and stored in a wait list by the first thread as differences are detected between the first and second values of the changed blocks, and then the identifiers of the changed blocks are moved by the first thread from the wait list to the changed block list, with a timing based on predetermined criteria, with the identifiers stored in the changed block list arranged with a least recently detected changed block corresponding to a first identifier next removed by the second thread.

23. A method as recited in claim 21, wherein the predetermined criteria for moving the identifiers from the wait list to the changed block list include at least one of a period of time started when the identifier of one of the changed blocks is stored in the wait list without the identifiers of any previously detected changed blocks stored in the wait list and ended before the identifiers are moved from the wait list to the changed block list, and comparing all of the blocks of the first display before the identifiers are moved from the wait list to the grid list.

24. A method as recited in claim 21,

wherein said executing of the second thread further includes

determining a rectangle containing only adjacent changed blocks and unchanged blocks adjacent to at least two of the changed blocks, and

encoding the contents of all of the blocks in the rectangle to obtain the data to be transmitted to the second display, and

wherein only the identifiers of the adjacent changed blocks are removed from the changed block list after the contents of the blocks forming the rectangle are transmitted and if any of the identifiers remain in the changed block list, the first identifier next accessed by the second thread corresponds to the least recently detected changed block of the identifiers remaining.

25. A method as recited in claim 21, wherein each of the first and second values is a cyclic redundancy code.

26. A method as recited in claim 21,

wherein said executing of the second thread transmits the second values as part of the data corresponding to the changed blocks, and

wherein said method further comprises performing on a remote computer system

receiving and storing the data corresponding to the changed blocks,

displaying the changed blocks on the second display, and

maintaining a cache of the changed blocks for quick redisplay after a temporary change of the first display ends.

27. A system for maintaining a copy of a first display at a second display, comprising:

a storage unit to store first values and identifiers in a grid list, each of the first values representing a plurality of pixels in one of a plurality of blocks into which the first display is segmented;

a processor coupled to said storage unit and controlled by a multithreaded operating system to repeatedly

calculate by a first thread the first values and, after passage of time during which the pixels may have changed, second values of the blocks having corresponding identifiers in the grid list, each of the second values representing a plurality of pixels in the one of the blocks,

compare by the first thread the second values with the first values stored in the grid list,

remove by the first thread the identifiers of changed blocks from the grid list and store the identifiers and the second values of the changed blocks in a changed block list when differences between the first and second values of the changed blocks are detected,

move by the first thread the identifiers and the second values of the changed blocks from a return list to the grid list after data has been sent to the second display to update the copy of the first display to include the changed blocks,

remove by a second thread the identifiers from the changed block list,

read by the second thread the contents of the changed blocks from a display memory of the first display based on the identifiers removed from the changed block list to obtain the contents of the changed blocks for transmission, and

store by the second thread the identifiers and the second values of the changed blocks in the return list after the data is sent to the second display; and

a communication device, coupled to said processor, to transmit the data corresponding to the changed blocks to the second display.

28. A system for maintaining a copy of a first display screen on a second display screen, comprising:

a first display unit to display the first display screen;

a first display memory, coupled to said first display unit and segmented into blocks, to display contents of said first display memory as the first display screen;

a first storage unit to store first values, each representing a plurality of pixels in one of the blocks of the display memory;

a first processor, coupled to said first display memory and said first storage unit, to repeatedly calculate, after passage of time during which the pixels may have changed, second values, each representing a plurality of pixels in the one of the blocks of the display memory and to compare the first and second values;

a transmission line, coupled to said first processor, to transmit data representing changed blocks when the first and second values for the changed blocks are unequal;

a second display memory to store the contents of the blocks of said first display memory;

a second processor, coupled to said transmission line and said second display memory, to receive the data representing the changed blocks and to update the contents of the blocks of said first display memory based on the data received via said transmission line; and

a second display unit to display the second display screen based on contents of said second display memory.