Block based camera updates and asynchronous displays

• US 10,456,666 B2
• Filed: 04/17/2017
• Issued: 10/29/2019
• Est. Priority Date: 04/17/2017
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Hicks, Richmond, Ansari, Nausheen, Runyan, Arthur J., Biswal, Narayan
• Primary Examiner(s): Broome, Said
• Application Number:
  US15/488,583
• Publication Number:
  US 20180296912A1
• Time in Patent Office: 925 Days
• Field of Search: None
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

Systems, methods and computer readable mediums provide for displaying pixels asynchronously on a display, block-based camera updates, and event driven frame updates on an asynchronous display.

Claims

1. A system for asynchronous display of a frame, comprising:

a computing device to determine changes between a current frame and a previous frame; and

an asynchronous display coupled to the computing device to display an image;

wherein the computing device is to send frame updates asynchronously rather than at a fixed frame rate to the asynchronous display to only update areas of a currently displayed image that have changed.

2. The system of claim 1, wherein each area of a new frame that is different from a corresponding area in the displayed image is sent to the asynchronous display as a frame update along with corresponding pixel address(es) to identify location(s) of the area(s) that has changed.

3. The system of claim 1, wherein areas of the displayed image that maintain their status in the new frame are not updated or refreshed.

4. The system of claim 1, wherein the computing device to determine the frame updates by comparing a new frame to be rendered with the currently displayed image on the asynchronous display and if an area has changed, the computing device to send the changed area as a frame update along with a corresponding pixel address of the area to identify the location of the area in the currently displayed image that has changed.

5. A method for displaying pixels asynchronously, comprising:

determining, by a computing device, changes in a new frame to be rendered on an asynchronous display, wherein the changes comprise pixels of a currently displayed image on the asynchronous display that have changed in the new frame, wherein the changes represent updated pixels; and

sending asynchronously, by the computing device, the updated pixels along with corresponding pixel addresses representing the locations of the updated pixels to enable the asynchronous display to update the currently displayed image with the updated pixels based on the pixel addresses.

6. At least one non-transitory computer readable medium, comprising a set of instructions,

which when executed by a computing device cause the computing device to:

determine changes in a new frame to be rendered on an asynchronous display, wherein the changes comprise pixels of a currently displayed image on the asynchronous display that have changed in the new frame, wherein the changes represent updated pixels; and

send asynchronously the updated pixels along with corresponding pixel addresses representing the locations of the updated pixels to enable the asynchronous display to update the currently displayed image with the updated pixels based on the pixel addresses.

7. A system for block-based camera updates, comprising:

a camera to capture an image n and determine pixel-based blocks for the image n that are different from an image n−

1 previously captured by the camera;

a system on a chip (SOC) coupled to a memory device and to the camera, the SOC to;

receive the updated pixel-based blocks;

retrieve the image n−

1 from the memory device;

merge the updated pixel-based blocks with the image n−

1 to obtain a merged image; and

modify a format of the merged image to a display format.

8. The system of claim 7, further comprising a display coupled to the SOC, the display to receive the merged image and display the merged image.

9. A system for block-based camera updates, comprising:

a camera to capture an image n and determine pixel-based blocks and corresponding pixel addresses for the image n that are different from an image n−

1 previously captured by the camera;

a system on a chip (SOC) coupled to a memory device and to the camera, the SOC to;

receive the updated pixel-based blocks and corresponding pixel addresses;

modify a format of the updated pixel-based blocks to a display format.

10. The system of claim 9, further comprising a memory panel display coupled to the SOC, the memory panel display to:

receive the updated pixel-based blocks in display format and the corresponding pixel addresses from the SOC;

retrieve the image n−

1 from the memory panel display;

merge the updated pixel-based blocks in display format with the image n−

1 using the corresponding pixel addresses to obtain a merged image; and

display the merged image.

11. The system of claim 9, wherein the camera to determine pixel-based blocks for the image n is further to:

divide the image n into small regions;

determine a CRC for each small region;

compare the CRC for each region of image n with a corresponding CRC for each region of image n−

1;

if the CRC is different for a region, select that region as an updated region and tag the x,y coordinates for that region.

12. A method for block-based camera updates, comprising:

capturing, using a camera, an image n;

determining what regions of the image n changed from a previous image n−

1 based on a CRC (cyclic redundancy check) for the image n and the previous image n−

1;

merging the changed regions with the previous image n−

1 to obtain a new image n; and

displaying the new image n.

13. The method of claim 12, wherein determining what regions of the image n changed from the previous image n−

1 comprises;

dividing the image n into small regions;

determining the CRC for each small region;

comparing the CRC for each region of the image n with a corresponding CRC for each region of image n−

1;

if the CRC is different for a region, selecting that region as an updated region and tagging the x,y coordinates for that region.

14. The method of claim 13, wherein the x,y coordinates define the location placement of the updated region in image n−

1.

15. One or more non-transitory computer readable mediums, comprising a set of instructions, which when executed by one or more processors cause the processors to:

capture an image n;

determine what regions of the image n changed from a previous image n−

1 based on a CRC (cyclic redundancy check) for the image n and the previous image n−

1;

merge the changed regions with the previous image n−

1 to obtain a new image n; and

display the new image n.

24. The one or more non-transitory computer readable mediums of claim 15, wherein to determine what regions of the image n changed from the previous image n−

1 further comprises a set of instructions, which when executed by one or more processors cause the processors to;

divide the image n into small regions;

determine the CRC for each small region;

compare the CRC for each region of the image n with a corresponding CRC for each region of image n−

1;

if the CRC is different for a region, selecting that region as an updated region and tagging the x,y coordinates for that region.

25. The one or more non-transitory computer readable mediums of claim 24, wherein the x,y coordinates define the location placement of the updated region in image n−

1.

16. An asynchronous system for event driven updates, comprising:

a computing system;

a plurality of input devices communicatively coupled to the computing system; and

at least one output device;

wherein upon an event occurring, based at least in part on one input device, the one input device to cause the at least one output device to be asynchronously updated, wherein the update to only include changes that have occurred since the previous update and wherein the at least one output device to be updated at a time determined by the computing system includes at least one display, wherein a scoring table comprising relative weights for each input device is used by the computing system to determine when to render a new frame to the display.

17. The asynchronous system of claim 16, wherein the computing system comprises a gaming system and the plurality of inputs include event driven cameras and sensors to asynchronously drive the gaming system.

18. A method for event driven frame updates on a display, the method comprising:

waiting for an event or a timeout caused by one or more input devices to a computing system;

upon receiving the event or the timeout, adding a corresponding weight associated with the event or timeout to a score;

determining whether the score exceeds a pre-defined limit for the event;

if the score exceeds the pre-defined limit, updating a frame;

displaying the updated frame asynchronously;

clearing the score; and

returning to wait for the event or timeout;

if the score does not exceed the pre-defined limit, returning to wait for the event or timeout.

19. The method of claim 18, wherein the one or more input devices include one or more of event driven cameras and sensors to drive an asynchronous gaming system.

20. The method of claim 18, wherein a timeout periodically occurs when an event requires a score update.

21. The method of claim 18, wherein the pre-defined limit comprises a maximum limit based on the event.

22. At least one non-transitory computer readable medium, comprising a set of instructions, which when executed by a computing device cause the computing device to:

wait for an event or a timeout caused by one or more input devices to a computing system;

upon receipt of the event or the timeout, add a corresponding weight associated with the event or timeout to a score;

determine whether the score exceeds a pre-defined limit for the event;

if the score exceeds the pre-defined limit, updating a frame;

displaying the updated frame asynchronously;

clearing the score; and

returning to wait for the event or timeout;

if the score does not exceed the pre-defined limit, returning to wait for the event or timeout.

23. The at least one non-transitory computer readable medium of claim 22, wherein a timeout periodically occurs when an event requires a score update.