Facilitating environment-based lossy compression of data for efficient rendering of contents at computing devices

• US 9,906,816 B2
• Filed: 10/19/2016
• Issued: 02/27/2018
• Est. Priority Date: 06/12/2015
• Status: Active Grant

• Current Assignee: Tahoe Research Limited (f/k/a Learndale Limited) (Vector Capital Corporation)
• Original Assignee: Intel Corporation
• Inventors: Toth, Robert M., Nilsson, Jim K., Akenine-Moller, Tomas G., Clarberg, Franz P.
• Primary Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US15/297,912
• Publication Number:
  US 20170142447A1
• Time in Patent Office: 496 Days
• Field of Search: 382166, 382232, 382243, 382244, 345555, 370202
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

A mechanism is described for facilitating environment-based lossy compression of data for efficient rendering of contents at computing devices. A method of embodiments, as described herein, includes collecting, in real time, sensory input data relating to characteristics of at least one of a user and a surrounding environment. The method may further include evaluating the sensory input data to mark one or more data portions of data relating to contents, where the one or more data portions are determined to be suitable for compression based on the sensory input data. The method may further include dynamically performing, in real time, the compression of the one or more data portions, where the compression triggers loss of one or more content portions of the contents corresponding to the one or more data portions of the data. The method may further include rendering the contents to be displayed missing the one or more content portions, where the missing of the one or more content portions from the contents is not apparent to the user viewing the contents via a display device.

Claims

1. An apparatus comprising:

reception/detection logic to determine a distance between a user and a display screen;

a real-time data evaluation engine to evaluate the distance and determine a level of compression to be performed on content to be rendered on the display screen;

compression execution logic to dynamically perform compression of the content that is rendered on the display screen in accordance with the determined level of compression.

2. The apparatus of claim 1, further comprising a depth sensing camera to monitor how far a user is from the display screen and to provide a corresponding depth image to the reception/detection logic.

3. The apparatus of claim 2, wherein the reception/detection logic is further to collect, in real time sensor data relating to user characteristics comprising at least one of general human behavior, specific user behavior, user activities, user gaze points, user head locations, and user distance from the display device, and wherein the real time data evaluation engine includes user data evaluation logic receives the user characteristics determine a level of compression.

4. The apparatus of claim 1, wherein the real-time data evaluation engine reduces the compression as the user comes closer to the display screen.

5. The apparatus of claim 1, wherein the reception/detection logic is further to determine an angle of the display screen relative to the user and wherein the real-time data evaluation engine is further to increase the level of compression with reduced angle.

6. The apparatus of claim 1, further comprising an eye tracking component coupled to the reception/detection logic to detect gazing angles relating to movement of the user'"'"'s eyes and wherein the real-time data evaluation engine is further to increase the level of compression with increased gazing angle.

7. The apparatus of claim 6, wherein increasing the level of compression further comprises increasing the compression of chromatic information.

8. The apparatus of claim 7, further comprising quantizing the chromatic information before compressing the chromatic information.

9. The apparatus of claim 7, wherein the real-time data evaluation engine is further to increase the level of compression of any display screen tiles that are occluded by the display screen being touched.

10. The apparatus of claim 6, wherein increasing the level of compression further comprises increasing the compression of luminance information.

11. The apparatus of claim 1, further comprising a brightness component coupled to the reception/detection logic to detect ambient brightness and wherein the real-time data evaluation engine is further to increase the level of compression with increased ambient brightness.

12. The apparatus of claim 1, further comprising a touch sensor coupled to the reception/detection logic and wherein the real-time data evaluation engine is further to increase the level of compression of any display screen tiles that overlap with a display screen location being touched.

13. The apparatus of claim 1, wherein the display device comprises at least one of a high-resolution display, a high-dynamic range display, a multi-view display, and a head-mounted display (HMD) for at least one of virtual reality (VR) and augmented reality (AR).

14. A method comprising:

collecting, in real time, sensory input data relating to a distance between a user and a display screen of a device;

evaluating the distance;

determining a level of compression to performed on content to be rendered on the display screen; and

dynamically performing, in real time, the compression of the content that is rendered on the display screen in accordance with the determined level of compression; and

rendering the compressed content to the user on the display screen.

15. The method of claim 14, wherein the determining a level of compression comprises reducing the compression as the user comes closer to the display screen.

16. The method of claim 14, further comprising tracking a user eye gazing angle and wherein determining a level of compression comprises increasing the level of compression with increased gazing angle.

17. The method of claim 15, wherein increasing the level of compression further comprises increasing the compression of luminance information.

18. A non-transitory machine-readable medium comprising a plurality of instructions, executed on a computing device, to facilitate the computing device to perform operations comprising:

collecting, in real time, sensory input data relating to a distance between a user and a display screen of a device;

evaluating the distance;

determining a level of compression to performed on content to be rendered on the display screen; and

dynamically performing, in real time, the compression of the content that is rendered on the display screen in accordance with the determined level of compression; and

rendering the compressed content to the user on the display screen.

19. The medium of claim 18, the operations further comprising increasing a level of compression of any display screen tiles that overlap with a display screen location being touched through a touch screen sensor.

20. The medium of claim 19, wherein increasing the level of compression comprises increasing the level of compression of any display screen tiles that are occluded by the display screen being touched.

21. The medium of claim 19, the operations further comprising determining an angle of the display screen relative to the user and increasing the level of compression with reduced angle.