Reducing information transfer in screen capture series

• US 7,447,997 B2
• Filed: 05/30/2002
• Issued: 11/04/2008
• Est. Priority Date: 05/30/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Colle, Olivier
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): TRAN, MYLINH T
• Application Number:
  US10/160,697
• Publication Number:
  US 20040222995A1
• Time in Patent Office: 2,350 Days
• Field of Search: 715/700, 715/781, 715/788, 715/802, 715/803, 715/704, 715/798, 715/804, 345/165
• US Class Current: 715/764
• CPC Class Codes: G09G 2360/127 Updating a frame memory using a transfer of data from a source area to a destination area
• CPC Class Codes: G09G 5/36 characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory

Abstract

A screen capture tool reduces information transfer when capturing a series of screen areas. For example, the screen capture tool reduces usage of Bit Block Transfer operations from a display card frame buffer to system memory. The screen capture tool scans pixel values in portions of a screen area to detect changes relative to a previously captured screen area, identifying portions to be updated by BitBlt operation. Or, the screen capture tool analyzes display driver commands to identify portions of a screen area to be updated by BitBlt operation. The screen capture tool then constructs a representation of the screen area. For example, the screen capture tool provides portions of the screen area that do not require a BitBlt operation (which may involve copying or other use of pixel information already in system memory) and then captures other portions of the screen area by BitBlt operation.

Claims

1. A computer-readable medium storing in storage computer-executable instructions for causing a computer system programmed thereby to perform a method of capturing a screen area in display by a visual display unit, the method comprising:

based upon analysis of one or more display driver commands, determining for each of one or more regions of the screen area whether to provide the region with or without bit block transfers from a display card frame buffer, that buffers the screen area for display by the visual display unit that displays the screen area wherein each of the one or more display driver commands is a drawing command sent from an operating system and received by one or more display drivers, and wherein the analysis includes for a new display driver command of the one or more display driver commands;

converting the new display driver command into a new screen capture operation;

comparing new screen capture operation to one or more previous screen capture operations in a list, wherein the comparing includes;

identifying a first portion of the screen area that is affected by the new screen capture operation;

identifying a second portion of the screen area that is affected by a selected one of the previous screen capture operations in the list;

identifying a relation between the first portion of the screen area and the second portion of the screen area; and

setting a first region of the one or more regions of the screen area based upon the relation between the first portion of the screen area and the second portion of the screen area; and

depending on results of the comparing, selectively adding the new screen capture operation into the list while simplifying the list by removing or replacing at least one redundant operation among the one or more previous screen capture operations in the list; and

constructing a representation of the screen area in system memory.

2. The computer-readable medium of claim 1 wherein the constructing includes capturing all of the screen area by bit block transfer from the display card frame buffer.

3. The computer-readable medium of claim 1 wherein the constructing includes providing all of the representation of the screen area without bit block transfers from the display card frame buffer for the screen area.

4. The computer-readable medium of claim 3 wherein the providing comprises using pre-determined screen feature pixel information.

5. The computer-readable medium of claim 3 wherein the providing comprises copying a previous screen area representation in the system memory.

6. The computer-readable medium of claim 1 wherein the constructing includes providing at least some of the representation of the screen area without bit block transfers from the display card frame buffer and capturing at least some of the screen area by bit block transfer from the display card frame buffer.

7. The computer-readable medium of claim 6 wherein the providing comprises copying a previous screen area representation in the system memory and moving one or more regions of the copied previous screen area representation.

8. The computer-readable medium of claim 1 wherein the method further comprises:

capturing a first screen area in a series by bit block transfer from the display card frame buffer; and

for each of at least one subsequent screen area in the series, performing the determining and the constructing.

9. The computer-readable medium of claim 1 wherein the new screen capture operation parameterizes cursor placement or shape for the screen area.

10. The computer-readable medium of claim 1 wherein the new screen capture operation parameterizes movement of previous screen area pixel information for the screen area.

11. The computer-readable medium of claim 1 wherein the screen area shows an entire screen, a window, or a user-specified area.

12. The computer-readable medium of claim 1 wherein the constructed representation comprises pixel values for pixel locations of the screen area.

13. The computer-readable medium of claim 12 wherein the method further comprises compressing the constructed representation into a reduced bit rate form.

14. The computer-readable medium of claim 13 wherein the compression includes lossy compression.

15. The computer-readable medium of claim 1 wherein the selectively updating is based upon one or more criteria that include reducing bit block transfers, reducing number of screen capture operations, and reducing memory page swapping.

16. The computer-readable medium of claim 1 wherein the new screen capture operation has one of plural types, the plural types including move commands, refresh commands, and cursor commands.

17. The computer-readable medium of claim 1 wherein a screen capture display driver receives the one or more display driver commands, and wherein the screen capture display driver is different than a primary display driver for the computer system that causes drawing upon the visual display unit.

18. The computer-readable medium of claim 1 wherein the drawing command for at least one of the one or more display driver commands is a simple line drawing command, a rectangular bitmap drawing command, a parameterized cursor drawing command, a parameterized shape drawing command, or a text drawing command.

19. The method of claim 1 wherein the comparing includes:

identifying a first portion of the screen area that is affected by the new screen capture operation;

identifying a second portion of the screen area that is affected by a selected one of the previous screen capture operations in the list;

identifying a relation between the first portion of the screen area and the second portion of the screen area; and

setting a first region of the one or more regions of the screen area based upon the relation between the first portion of the screen area and the second portion of the screen area.

20. The method of claim 1 wherein the relation indicates intersection between the first portion and the second portion, wherein the first region includes the first portion and the second portion, and wherein the selectively adding includes adding a replacement screen capture operation to represent the new screen capture operation and the selected previous screen capture operation.

21. The method of claim 1 wherein the relation indicates the first portion is included within the second portion, and wherein the selectively adding includes using the selected previous screen capture operation to represent the new screen capture operation and discarding the new screen capture operation.

22. The method of claim 1 wherein the relation indicates the first portion is adjacent the second portion, and wherein the selectively adding includes adding a replacement screen capture operation to represent the new screen capture operation and the selected previous screen capture operation.

23. The method of claim 1 wherein the relation indicates the second portion is included within the first portion, and wherein the selectively adding includes replacing the selected previous screen capture operation with the new screen capture operation in the list.

24. A computer-readable medium storing in storage computer-executable instructions for causing a computer system programmed thereby to perform a method of capturing a screen area in display by a visual display unit, the method comprising:

at each of one or more pixel locations of a screen area being buffered by a display card frame buffer for display by a visual display unit that displays the screen area, scanning for a pixel value change in order to reduce use of bit block transfers when constructing a representation of the screen area, wherein the bit block transfers are operations for transferring pixel values from the display card frame buffer to system memory, and wherein the scanning at the pixel location includes;

comparing a pixel value at the pixel location in the screen area to an expected value;

when no pixel value change is detected, designating a block of the screen area including the pixel location to be provided without bit block transfers when constructing the representation of the screen area in the system memory;

otherwise, designating the block of the screen area including the pixel location to be provided with bit block transfer when constructing the representation of the screen area in the system memory;

joining one or more blocks of the screen area designated to be provided without bit block transfers with plural blocks of the screen area designated to be provided with bit block transfer to improve bit block transfer efficiency, including;

setting a boundary rectangle in the screen area around the plural blocks of the screen area designated to be provided with bit block transfer;

identifying the one or more blocks of the screen area designated to be provided without bit block transfers as being within the boundary rectangle in the screen area; and

designating the boundary rectangle in the screen area to be provided with bit block transfer; and

constructing the representation of the screen area in system memory based at least in part upon the block designations.

25. The computer-readable medium of claim 24 wherein the constructing includes capturing all of the screen area by bit block transfer from the display card frame buffer.

26. The computer-readable medium of claim 24 wherein the constructing includes providing at least some of the representation of the screen area without bit block transfers from the display card frame buffer and capturing at least some of the screen area by bit block transfer from the display card frame buffer.

27. The computer-readable medium of claim 24 wherein the method further comprises:

capturing a first screen area in a series by bit block transfer from the display card frame buffer; and

for each of at least one subsequent screen area in the series, performing the comparing, the designating, and the constructing.

28. The computer-readable medium of claim 24 wherein the screen area shows an entire screen, a window, or a user-specified area.

29. In a screen capture tool, a method comprising:

based upon analysis of one or more display driver commands, identifying any regions of a screen area to capture by transfer of pixel information from a display card frame buffer, that buffers the screen area for display by a visual display unit that displays the screen area wherein each of the one or more display driver commands is a drawing command sent from an operating system and received by one or more display drivers, and wherein the analysis includes for a new display driver command of the one or more display driver commands;

converting the new display driver command into a new screen capture operation;

comparing the new screen capture operation to one or more previous screen capture operations in a list, wherein the comparing includes;

identifying a first portion of the screen area that is affected by the new screen capture operation;

identifying a second portion of the screen area that is affected by a selected one of the previous screen capture operations in the list;

identifying a relation between the first portion of the screen area and the second portion of the screen area; and

setting a first region of the regions of the screen area based upon the relation between the first portion of the screen area and the second portion of the screen area; and

depending on results of the comparing between the new screen capture operation and the one or more previous screen capture operations in the list, selectively updating the list to assimilate the new screen capture operation into the list; and

transferring the pixel information from the display card frame buffer to system memory for the identified regions.

30. The method of claim 29 wherein the selectively updating includes simplifying the list to reduce the number of screen capture operations while also reducing transfers from the display card frame buffer.

31. The method of claim 29 wherein the new screen capture operation parameterizes movement of pixel information of a base captured screen area in system memory for the captured screen area.

32. The method of claim 29 wherein the new screen capture operation parameterizes cursor position or cursor shape.

33. The method of claim 29 wherein the new screen capture operation parameterizes text display.

34. The method of claim 29 wherein the new screen capture operation specifies a bitmap to transfer from the display card frame buffer.

35. A computer-readable medium storing in storage computer-executable instructions for causing a computer system programmed thereby to perform the method of claim 29.

36. The method of claim 29 wherein a screen capture display driver receives the one or more display driver commands, and wherein the screen capture display driver is different than a primary display driver associated with the display card frame buffer.

37. The method of claim 29 wherein the drawing command for at least one of the one or more display driver commands is a simple line drawing command, a rectangular bitmap drawing command, a parameterized cursor drawing command, a parameterized shape drawing command, or a text drawing command.

38. In a screen capture tool, a method comprising:

scanning pixel values at pixel locations of a screen area in a display card frame buffer to identify pixel value changes in portions of the screen area and thereby reduce use of bit block transfers when constructing a representation of the screen area, wherein the display card frame buffer buffers the screen area for display by a visual display unit that displays the screen area, wherein the bit block transfers are operations for transferring pixel values from the display card frame buffer to system memory, and wherein for a given pixel location of the pixel locations the scanning includes;

comparing a pixel value at the given pixel location in the screen area to an expected value;

when no pixel value change is identified, designating a portion of the screen area including the given pixel location to be provided without bit block transfers when constructing the representation of the screen area in the system memory;

otherwise, designating the portion of the screen area including the given pixel location to be provided with bit block transfer when constructing the representation of the screen area in the system memory;

joining plural portions of the screen area in which pixel value changes are identified in the scanning with one or more portions of the screen area in which no pixel value change is identified in the scanning, thereby improving bit block transfer efficiency including;

setting a boundary rectangle in the screen area around the plural portions of the screen area in which pixel value changes are identified in the scanning;

identifying the one or more portions of the screen area in which no pixel value change is identified in the scanning as being within the boundary rectangle around the plural portions of the screen area in which pixel value changes are identified in the scanning; and

designating the boundary rectangle in the screen area to be provided with bit block transfer; and

transferring pixel information from the display card frame buffer to the system memory for the joined portions of the screen area within the boundary rectangle.

39. The method of claim 38 wherein one pixel value in each of the portions of the screen area is scanned.

40. The method of claim 38 further comprising adaptively changing configuration of the portions.

41. The method of claim 38 further comprising changing locations within the portions for the scanning.

42. A computer-readable medium storing in storage computer-executable instructions for causing a computer system programmed thereby to perform a method of claim 38.

43. A computer system comprising:

a display card;

a processor;

system memory; and

a screen capture tool for retrieving from the display card pixel information for screen areas based upon analysis of display driver commands, the screen areas being buffered by a display card frame buffer of the display card for display by a visual display unit wherein each of the analyzed display driver commands is a drawing command sent from an operating system and received by one or more display drivers, and wherein the analysis includes for a new display driver command of the one or more display driver commands;

converting the new display driver command into a new screen capture operation;

comparing the new screen capture operation to one or more previous screen capture operations in a list, wherein the comparing includes;

identifying a first portion of a screen area that is affected by the new screen capture operation;

identifying a second portion of the screen area that is affected by a selected one of the previous screen capture operations in the list;

identifying a relation between the first portion of the screen area and the second portion of the screen area; and

setting a first region of one or more regions of the screen area based upon the relation between the first portion of the screen area and the second portion of the screen area; and

depending on results of the comparing between the new screen capture operation and the one or more previous screen capture operations in the list, selectively updating the list to assimilate the new screen capture operation into the list.

44. The computer system of claim 43 wherein the screen capture tool simplifies the list to reduce bit block transfer usage in the selective updating of the list.

45. The computer system of claim 43 wherein the analysis indicates base screen area pixel information in the system memory for the screen capture tool to move for a current screen area.

46. The computer system of claim 43 wherein the analysis indicates cursor information for the screen capture tool to use in a current screen area.

47. The computer system of claim 43 wherein the screen capture tool assimilates the new display driver command into the list based upon one or more criteria that include reducing bit block transfers, reducing number of screen capture operations, and reducing memory page swapping.

48. The computer system of claim 43 wherein as part of the converting the screen capture tool categorizes the new display driver command as one of plural types, the plural types including move commands, refresh commands, and cursor commands.

49. The computer system of claim 43 wherein a screen capture display driver receives the display driver commands, and wherein the screen capture display driver is different tan a the primary display driver for the computer system.

50. The computer system of claim 43 wherein the drawing command is a simple line drawing command, a rectangular bitmap drawing command, a parameterized cursor drawing command, a parameterized shape drawing command, or a text drawing command.