GENERATING A LOW-LATENCY TRANSPARENCY EFFECT

• US 20150194128A1
• Filed: 01/07/2014
• Published: 07/09/2015
• Est. Priority Date: 01/07/2014
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: HICOK, Gary D.
• Application Number:
  US14/149,648
• Publication Number:
  US 20150194128A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: G09G 5/36 characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

One embodiment of the present invention sets forth a technique for generating a transparency effect for a computing device. The technique includes transmitting, to a camera, a synchronization signal associated with a refresh rate of a display. The technique further includes determining a line of sight of a user relative to the display, acquiring a first image based on the synchronization signal, and processing the first image based on the line of sight of the user to generate a first processed image. Finally, the technique includes compositing first visual information and the first processed image to generate a first composited image, and displaying the first composited image on the display.

Claims

1. A computer-implemented method for generating a transparency effect for a computing device, the method comprising:

transmitting, to a camera, a synchronization signal associated with a refresh rate of a display;

determining a line of sight of a user relative to the display;

acquiring a first image based on the synchronization signal;

processing the first image based on the line of sight of the user to generate a first processed image;

compositing first visual information and the first processed image to generate a first composited image; and

displaying the first composited image on the display.

2. The method of claim 1, further comprising generator-locking the camera to the display based on the synchronization signal, wherein acquiring the first image, processing the first image, compositing the first visual information, and displaying the first composited image are performed within a period of time associated with refreshing a display frame on the display.

3. The method of claim 1, wherein processing the first image comprises projecting a line of sight of the user through a surface of the display to determine a first transform, and applying the first transform to the first image.

4. The method of claim 3, further comprising:

detecting a change in a position of the user relative to the display;

determining an updated line of sight of the user relative to the display;

acquiring a second image with the camera based on the synchronization signal;

applying a second transform to the second image to generate a second processed image, wherein the second transform is based on a projection of the updated line of sight of the user through the surface of the display;

compositing second visual information and the second processed image to generate a second composited image; and

displaying the second composited image on the display.

5. The method of claim 1, wherein processing the first image comprises clipping and scaling the first image.

6. The method of claim 1, further comprising:

detecting a change in a position of the user relative to the display;

determining an updated line of sight of the user relative to the display;

rotating, relative to the display, a lens associated with the camera based on the updated line of sight of the user;

after rotating the lens, acquiring a second image with the camera based on the synchronization signal;

compositing second visual information and the second image to generate a second composited image; and

displaying the second composited image on the display.

7. The method of claim 6, wherein rotating the lens comprises computing a motion vector based on the change in the position of the user.

8. The method of claim 1, further comprising:

detecting a change in a position of the display relative to a surrounding environment;

computing a motion vector based on the change in the position of the display;

adjusting an image acquisition resolution based on the motion vector;

acquiring a second image with the camera based on the image acquisition resolution;

compositing second visual information and the second image to generate a second composited image; and

displaying the second composited image on the display.

9. The method of claim 1, wherein the line of sight of a user relative to the display is determined by tracking an eye position of the user.

10. The method of claim 1, wherein the refresh rate comprises a horizontal refresh rate associated with the display.

11. The method of claim 10, wherein acquiring the first image with the camera comprises scanning out, based on the horizontal refresh rate, at least one line of the first image from the camera directly to a buffer memory associated with the display.

12. A computing device, comprising:

a processor configured to;

transmit, to a camera, a synchronization signal associated with a refresh rate of a display;

determine a line of sight of a user relative to the display;

process a first image based on the line of sight of the user to generate a first processed image; and

composite first visual information and the first processed image to generate a first composited image;

the camera, configured to acquire the first image based on the synchronization signal; and

the display, configured to display the first composited image.

13. The computing device of claim 12, wherein the camera is further configured to generator-lock to the display based on the synchronization signal, wherein acquiring the first image, processing the first image, compositing the first visual information, and displaying the first composited image are performed within a period of time associated with refreshing a display frame on the display.

14. The computing device of claim 12, wherein the processor is configured to process the first image by projecting a line of sight of the user through a surface of the display to determine a first transform, and applying the first transform to the first image.

15. The computing device of claim 14, wherein:

the processor is further configured to;

detect a change in a position of the user relative to the display;

determine an updated line of sight of the user relative to the display;

apply a second transform to a second image to generate a second processed image, wherein the second transform is based on a projection of the updated line of sight of the user through the surface of the display; and

composite second visual information and the second processed image to generate a second composited image;

the camera is further configured to acquire the second image with the camera based on the synchronization signal; and

the display is further configured to display the second composited image.

16. The computing device of claim 12, wherein processing the first image comprises clipping and scaling the first image.

17. The computing device of claim 12, wherein:

the processor is further configured to;

detect a change in a position of the user relative to the display;

determine an updated line of sight of the user relative to the display;

rotate, relative to the display, a lens associated with the camera based on the updated line of sight of the user; and

composite second visual information and a second image to generate a second composited image;

the camera is further configured to, after the processor rotates the lens, acquire the second image with the camera based on the synchronization signal; and

the display is further configured to display the second composited image.

18. The computing device of claim 17, wherein the processor is configured to rotate the lens by computing a motion vector based on the change in the position of the user.

19. The computing device of claim 12, wherein the refresh rate comprises a horizontal refresh rate associated with the display.

20. The computing device of claim 19, wherein the camera is configured to acquire the first image by scanning out, based on the horizontal refresh rate, at least one line of the first image from the camera directly to a buffer memory associated with the display.

21. A non-transitory computer-readable storage medium including instructions that, when executed by a processing unit, cause the processing unit to generate a transparency effect for a computing device, by performing the steps of:

transmitting, to a camera, a synchronization signal associated with a refresh rate of a display;

determining a line of sight of a user relative to the display;

acquiring a first image based on the synchronization signal;

processing the first image based on the line of sight of the user to generate a first processed image;

compositing first visual information and the first processed image to generate a first composited image; and

displaying the first composited image on the display.