Systems and methods for operating an energy-efficient display

• US 9,891,595 B2
• Filed: 12/01/2015
• Issued: 02/13/2018
• Est. Priority Date: 12/01/2015
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Pitis, Andrei, Vlad, Iulian B., Deaconu, Ioan
• Primary Examiner(s): Tung, Kee M
• Assistant Examiner(s): Sheng, Xin
• Application Number:
  US14/955,934
• Publication Number:
  US 20170153606A1
• Time in Patent Office: 805 Days
• Field of Search: None
• CPC Class Codes: G04G 19/12 Arrangements for reducing power consumption during storage
• CPC Class Codes: G04G 9/0005 Transmission of control signals
• CPC Class Codes: G04G 9/0064 in which functions not related to time can be displayed digital output to display devices of digital computers G06F3/14
• CPC Class Codes: G04G 9/0082 by building-up characters using a combination of indicating elements and by selecting desired characters out of a number of characters or by selecting indicating elements the positions of which represents the time, i.e. combinations of G04G9/02 and G04G9/08
• CPC Class Codes: G04G 9/022 using multiplexing techniques
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2310/04 Partial updating of the display screen
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2360/08 Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
• CPC Class Codes: G09G 2360/121 using a cache memory
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: G09G 5/42 characterised by the display of patterns using a display memory without fixed position correspondence between the display memory contents and the display position on the screen

Abstract

Described systems and methods allow minimizing energy use and increasing battery life of a wearable device such as a smartwatch, by optimizing the way an image displayed to the user is updated in response to an event. In some embodiments, an image of each display object (e.g., clock hand, text, weather symbol, fitness icon) is individually stored in an image cache, such as a processor register or a separate section of memory. A new, updated on-screen image is computed dynamically, by combining cached images of the respective display objects. When the appearance of a current display object must change in response to the event, an updated image of the respective object is cached for future use.

Claims

1. A wearable computing device, comprising:

one or more processors;

a memory; and

a display with a display memory, an image buffer, and an image cache,

wherein the memory stores computer-executable instructions for causing the one or more processors to;

identify one or more display objects that will change responsive to an event;

determine a target region of the display that will change responsive to the changes in the one or more display objects;

subdivide the target region into a plurality of target tiles, each target tile having a corresponding pixel count that is less than or equal to a size of the image buffer; and

, for each target tile;

a) determine a subset of the one or more display objects, wherein each display object in the subset of the one or more display objects intersects with target tile,

b) retrieve, from the image cache and for each of the one or more display objects in the subset of the one or more display objects that intersects with that target tile, a subset of image data that intersects with that target tile and is associated with that display object,

c) determine composite image data for that target tile, the composite image data based at least on a combination of the subsets of image data for the one or more display objects in the subset of the one or more display objects that intersects with that target tile, and

d) write the composite image data for that target tile to the image buffer;

determine that the image buffer is full; and

write, based at least on the image buffer being full, the composite image data from the image buffer to the display memory.

2. The wearable computing device of claim 1, wherein:

the image cache stores image data for a plurality of images,

the image data includes first image data for a first image,

each image of the plurality of images comprises a rendering of one of the display objects,

the first image data comprises a first set of values,

each value of the first set of values is indicative of a state of a pixel of a first display object of the plurality of display objects, and

the memory further stores computer-executable instructions for causing the one or more processors to;

compute second image data for a second image, the second image data comprising a second set of values, each value of the second set of values indicative of a state of a pixel of a second display object of the plurality of display objects; and

store the second image in the image cache after computing the second image data, wherein for at least one of the target tiles;

the first display object and the second display object intersect with that target tile, and

the composite image data for that target tile is calculated by at least combining the subset of the first image data that intersects with that target tile with the subset of the second image data that intersects with that target tile by applying a pixel-wise logical operator to the first and second sets of values within the subsets of the first and second image data, respectively.

3. The wearable computing device of claim 2, wherein the second display object is an instance of the first display object after undergoing a change selected from the group consisting of:

a change of shape, a change of rotational orientation, a change in transparency, and a change in color.

4. The wearable computing device of claim 2, wherein the first display object is selected from a group of objects consisting of:

a clock hand, a weather symbol, a fitness symbol, and an alphanumeric character.

5. The wearable computing device of claim 1, wherein each target tile is a row of pixels.

6. The wearable computing device of claim 1, wherein the image cache comprises a register of the one or more processors.

7. The wearable computing device of claim 1, wherein the image cache comprises a section of the memory of the wearable computing device.

8. The wearable computing device of claim 1, wherein the event is selected from a group of events consisting of:

receiving a communication from another device distinct from the wearable computing device, an action of a user of the wearable computing device, and a fulfillment of a time condition.

9. The wearable computing device of claim 1, wherein the wearable computing device is a wristwatch.

10. A method comprising:

causing one or more processors of a wearable computing device to identify one or more display objects displayed on a display of the wearable computing device that will change responsive to an event;

causing the one or more processors of the wearable computing device to determine a target region of the display that will change responsive to the changes in the one or more display objects;

causing the one or more processors of the wearable computing device to subdivide the target region into a plurality of target tiles, each target tile having a corresponding pixel count that is less than or equal to a size of an image buffer of the wearable computing device; and

, for each target tile;

a) determine a subset of the one or more display objects, wherein each display object in the subset of the one or more display objects intersects with that target tile,

b) retrieve, from an image cache of the wearable computing device and for each of the one or more display objects in the subset of the one or more display objects that intersects with that target tile, a subset of image data that intersects with that target tile and is associated with that display object,

c) determine composite image data for that target tile, the composite image data based at least on a combination of the subsets of image data for the one or more display objects in the subset of the one or more display objects that intersects with that target tile, and

d) write the composite image data for that target tile to the image buffer;

causing the one or more processors of the wearable computing device to determine that the image buffer is full; and

causing the one or more processors of the wearable computing device to write, based at least on the image buffer being full, the composite image data from the image buffer to a display memory of the wearable computing device.

11. The method of claim 10, wherein the image cache stores image data for a plurality of images, the image data includes first image data for a first image, each image of the plurality of images comprises a rendering of one of the display objects, the first image data comprises a first set of values, and each value of the first set of values is indicative of a state of a pixel of a first display object of the plurality of display objects, the method further comprising causing, responsive to detecting the occurrence of the event, the one or more processors of the wearable computing device to:

compute second image data for a second image, the second image data comprising a second set of values, each value of the second set of values indicative of a state of a pixel of a second display object of the plurality of display objects;

calculate the composite image data for each target tile by

apply a pixel-wise logical operator to the first and second sets of values in the subsets of image data that intersect with each target tile; and

transmit the composite image to a display of the wearable computing device.

12. The method of claim 11, wherein the second display object is an instance of the first display object after undergoing a change selected from the group consisting of:

a change of shape, a change of rotational orientation, a change in transparency, and a change in color.

13. The method of claim 11, wherein the first display object is selected from a group of objects consisting of:

a clock hand, a weather symbol, a fitness symbol, and an alphanumeric symbol.

14. The method of claim 10, wherein each target tile is a row of pixels.

15. The method of claim 10;

wherein the image cache comprises a register of the one or more processors.

16. The method of claim 10, wherein the image cache comprises a section of a memory of the wearable computing device.

17. The method of claim 10, wherein the event is selected from a group of events consisting of:

receiving a communication from another device distinct from the wearable computing device, an action of a user of the wearable computing device, and a fulfillment of a time condition.

18. The method of claim 10, wherein the wearable computing device is a wristwatch.

19. A non-transitory computer readable medium storing instructions which, when executed by one or more processors of a wearable computing device, cause the one or more processors of the wearable computing device to:

identify one or more display objects displayed on a display of the wearable computing device that will change responsive to an event;

determine a target region of the display that will change responsive to the changes in the one or more display objects;

subdivide the target region into a plurality of target tiles, each target tile having a corresponding pixel count that is less than or equal to a size of an image buffer of the wearable computing device; and

, for each target tile;

a) determine a subset of the one or more display objects, wherein each display object in the subset of the one or more display objects intersects with that target tile,

b) retrieve, from an image cache of the wearable computing device and for each of the one or more display objects in the subset of the one or more display objects that intersects with that target tile, a subset of image data that intersects with that target tile and is associated with that display object,

c) determine composite image data for that target tile, the composite image data based at least on a combination of the subsets of image data for the one or more display objects in the subset of the one or more display objects that intersects with that target tile, and

d) write the composite image data for that target tile to the image buffer;

determine that the image buffer is full; and

write, based at least on the image buffer being full, the composite image data from the image buffer to a display memory of the wearable computing device.

20. The non-transitory computer readable medium of claim 19, storing further instructions which, when executed, cause the one or more processors of the wearable computing device to:

retrieve a first set of values from an image cache of the wearable computing device, wherein the image cache stores image data for a plurality of images, the image data includes first image data for a first image, each image of the plurality of images comprises a rendering of one of the display objects, the first image data comprises the first set of values, and each value of the first set of values is indicative of a state of a pixel of a first display object of the plurality of display objects,

compute image data for a second image, the second image data comprising a second set of values, each value of the second set of values indicative of a state of a pixel of a second display object of the plurality of display objects;

apply a pixel-wise logical operator to the first and second sets of values in the subsets of image data that intersect with each target tile; and

transmit the composite image to a display of the wearable computing device.