Composition of a Digital Image for Display on a Transparent Screen

• US 20120038663A1
• Filed: 08/12/2010
• Published: 02/16/2012
• Est. Priority Date: 08/12/2010
• Status: Abandoned Application

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Gustafsson, Harald, Persson, Jan Patrik, Persson, Per, Yuan, Song
• Application Number:
  US12/855,063
• Publication Number:
  US 20120038663A1
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G09G 2340/0442 Handling or displaying different aspect ratios, or changing the aspect ratio
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2380/00 Specific applications
• CPC Class Codes: G09G 2380/02 Flexible displays
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

Teachings herein prepare a digital image for display on a substantially transparent screen. The teachings advantageously recognize that the perceptibility of the digital image on the screen will often depend on what is visible to a user through the screen, since that will effectively serve as the background of the screen. A method of preparing a digital image thus includes dynamically calculating which part of an environmental background is visible to a user through the screen and thereby serves as an effective background of the screen. This calculation may entail obtaining an image of the environmental background and identifying which part of that image serves as the effective background (e.g., based on the angle at which the user views the screen). The method further includes composing the digital image for perceptibility as viewed against that effective background and outputting the composed image as digital data for display on the screen.

Claims

1. A method of preparing a digital image for display on a substantially transparent screen, the method implemented by an image processor and comprising:

receiving environmental background data relating to an environmental background which is visible, at least in part, to a user through the screen;

dynamically calculating, based on the environmental background data, which part of the environmental background is visible to the user through the screen and thereby serves as an effective background of the screen;

composing the digital image for perceptibility as viewed against the effective background; and

outputting the composed digital image as digital data for display on the screen.

2. The method of claim 1, wherein receiving environmental background data comprises receiving a rear image of the environmental background and wherein said dynamically calculating comprises dynamically calculating which part of the rear image serves as the effective background of the screen.

3. The method of claim 2, wherein dynamically calculating which part of the rear image serves as the effective background of the screen comprises deriving an area around a point in the rear image as being the effective background, based on the dimensions of the screen, the dimensions of the rear image, the field of view of a rear camera capturing the rear image, and the distance between the user and the screen.

4. The method of claim 3, further comprising calibrating the center point of the rear image by displacing the center point horizontally, vertically, or both to compensate for offset of the rear camera from the center of the screen, and wherein said point in the rear image comprises the calibrated center point.

5. The method of claim 1, further comprising receiving viewing angle data relating to the viewing angle at which the user views the screen, and wherein said dynamically calculating comprises determining the viewing angle based on the viewing angle data and dynamically calculating the effective background based on that viewing angle.

6. The method of claim 5, wherein receiving viewing angle data comprises receiving a front image of the user, and wherein determining the viewing angle comprises:

detecting the location of the user'"'"'s face or eyes in the front image;

calculating an angle between a vertical or horizontal axis extending from a point in the front image and a line extending between said point and said location; and

adjusting the calculated angle as needed to derive the angle that would have been calculated had the front image been flipped about said vertical or horizontal axis prior to said detection.

7. The method of claim 6, further comprising calibrating the center point of the front image by displacing the center point horizontally, vertically, or both to compensate for offset of a front camera capturing the front image from the center of the screen, and wherein said point in the front image comprises the calibrated center point.

8. The method of claim 6, wherein receiving environmental background data comprises receiving a rear image of the environmental background, and wherein said dynamically calculating comprises determining the location in the rear image that would correspond to the location of the user'"'"'s face or eyes in a flipped version of the front image, as transposed across a point in the rear image at the viewing angle.

9. The method of claim 8, wherein said dynamically calculating comprises deriving an area around said location in the rear image as being the effective background, based on the dimensions of the screen, the dimensions of the rear image, the field of view of a rear camera capturing the rear image, and the distance between the user and the screen.

10. The method of claim 8, further comprising calibrating the center point of the rear image by displacing the center point horizontally, vertically, or both to compensate for offset of a rear camera capturing the rear image from the center of the screen, and wherein said point in the rear image comprises the calibrated center point.

11. The method of claim 1, wherein said composing the digital image comprises composing the image from one or more logical objects having a spatial arrangement or coloration determined in dependence on evaluation of the effective background.

22. The image processor of claim 1, wherein the image composer is configured to compose the image from one or more logical objects having a spatial arrangement or coloration determined in dependence on evaluation of the effective background.

12. An image processor configured to prepare a digital image for display on a substantially transparent screen, the image processor comprising:

a communications interface configured to receive environmental background data relating to an environmental background which is visible, at least in part, to a user through the screen;

an effective background calculator configured to dynamically calculate, based on the environmental background data, which part of the environmental background is visible to the user through the screen and thereby serves as an effective background of the screen; and

an image composer configured to compose the digital image for perceptibility as viewed against the effective background and to output the composed digital image as digital data for display on the screen.

13. The image processor of claim 12, wherein the communications interface is configured to receive environmental background data that comprises a rear image of the environmental background, and wherein the effective background calculator is configured to dynamically calculate which part of the rear image serves as the effective background of the screen.

14. The image processor of claim 13, wherein the effective background calculator is configured to derive an area around a point in the rear image as being the effective background, based on the dimensions of the screen, the dimensions of the rear image, the field of view of a rear camera capturing the rear image, and the distance between the user and the screen.

15. The image processor of claim 14, wherein the effective background calculator is configured to calibrate the center point of the rear image by displacing the center point horizontally, vertically, or both to compensate for offset of the rear camera from the center of the screen, and wherein said point in the rear image comprises the calibrated center point.

16. The image processor of claim 12, wherein the communications interface is configured to receive viewing angle data relating to the viewing angle at which the user views the screen, and wherein the effective background calculator is configured to determine the viewing angle based on the viewing angle data and to dynamically calculate the effective background based on that viewing angle.

17. The image processor of claim 16, wherein the communications interface is configured to receive viewing angle data that comprises a front image of the user, and wherein the effective background calculator is configured to determine the viewing angle by:

detecting the location of the user'"'"'s face or eyes in the flipped front image; and

calculating an angle between a vertical or horizontal axis extending from a point in the front image and a line extending between said point and said location; and

adjusting the calculated angle as needed to derive the angle that would have been calculated had the front image been flipped about said vertical or horizontal axis prior to said detection.

18. The image processor of claim 17, wherein the effective background calculator is configured to calibrate the center point of the front image by displacing the center point horizontally, vertically, or both to compensate for offset of a front camera capturing the front image from the center of the screen, and wherein said point in the front image comprises the calibrated center point.

19. The image processor of claim 17, wherein the communications interface is configured to receive environmental background data that comprises a rear image of the environmental background, and wherein the effective background calculator is configured to dynamically calculate the effective background based on the viewing angle by determining the location in the rear image that would correspond to the location of the user'"'"'s face or eyes in a flipped version of the front image, as transposed across a point in the rear image at the viewing angle.

20. The image processor of claim 19, wherein the effective background calculator is configured to derive an area around said location in the rear image as being the effective background, based on the dimensions of the screen, the dimensions of the rear image, the field of view of a rear camera capturing the rear image, and the distance between the user and the screen.

21. The image processor of claim 19, wherein the effective background calculator is configured to calibrate the center point of the rear image by displacing the center point horizontally, vertically, or both to compensate for offset of a rear camera capturing the rear image from the center of the screen, and wherein said point in the rear image comprises the calibrated center point.