System and method of modifying lighting in a display system
First Claim
1. A display system comprised of:
- a display including a display screen for operating in at least a transparent mode used to augment with graphical information content on the display screen an object manipulated behind the display screen by a user;
a lighting characteristic assessment component for determining the lighting characteristics, including lighting direction, of the content on the display screen and the lighting characteristics, including lighting direction, behind the display screen;
a viewpoint assessment sensor on the display positioned to capture a facial detail of the user and to determine a viewpoint of the user;
at least one object tracking sensor to sense the position of the object behind the display screen and the position of the content is dependent on the viewpoint of the user and the position of the object; and
an adaptive lighting control component to control an at least one lighting source to cast a pattern of a shadow that corresponds to the object to allow the lighting characteristics of the content on the display screen to match the lighting characteristics of the object behind the display screen to create a realistic natural looking scene that contains both virtual and real elements, wherein the at least one lighting source and the facial detail of the user are located on opposite sides of the display screen, and the adaptive lighting control component to modify the lighting characteristics of the at least one lighting source in response to a comparison of the lighting characteristics of the content on the display screen and the lighting characteristics behind the display screen.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention describes a display system. The display system includes a display, the display including a display screen capable of operating in a transparent mode; a lighting characteristic assessment component for determining the lighting characteristics of the content on the display screen and the lighting characteristics behind the display screen; and an adaptive lighting control component for controlling of an at least one lighting source and the lighting characteristics of the content on the display screen, wherein based on a comparison of the lighting characteristics of the content on the display screen and the lighting characteristics behind the display screen, modifying at least one of the lighting characteristics of the content on the display screen or the lighting characteristics of the at least one lighting source.
-
Citations
20 Claims
-
1. A display system comprised of:
-
a display including a display screen for operating in at least a transparent mode used to augment with graphical information content on the display screen an object manipulated behind the display screen by a user; a lighting characteristic assessment component for determining the lighting characteristics, including lighting direction, of the content on the display screen and the lighting characteristics, including lighting direction, behind the display screen; a viewpoint assessment sensor on the display positioned to capture a facial detail of the user and to determine a viewpoint of the user; at least one object tracking sensor to sense the position of the object behind the display screen and the position of the content is dependent on the viewpoint of the user and the position of the object; and an adaptive lighting control component to control an at least one lighting source to cast a pattern of a shadow that corresponds to the object to allow the lighting characteristics of the content on the display screen to match the lighting characteristics of the object behind the display screen to create a realistic natural looking scene that contains both virtual and real elements, wherein the at least one lighting source and the facial detail of the user are located on opposite sides of the display screen, and the adaptive lighting control component to modify the lighting characteristics of the at least one lighting source in response to a comparison of the lighting characteristics of the content on the display screen and the lighting characteristics behind the display screen. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A tangible non-transitory computer readable storage medium having computer readable program instructions stored thereon for causing a computer system to perform instructions, the instructions comprising the steps of:
-
augmenting with graphical information content on a display screen an object manipulated by a user behind the display screen wherein the object is on an opposite side of the display screen from which the user is to face; determining a viewpoint of the user using a viewpoint assessment component on the display positioned to capture a facial detail of the user; sensing the object behind the display screen with at least one object tracking component and positioning the content dependent on the viewpoint of the user; determining the lighting characteristics, including a first lighting direction, of the content displayed on a display screen; determining the lighting characteristics, including a second lighting direction, behind the display screen, wherein an at least one lighting source of the display system and the facial detail of the user are located on opposite sides of the display screen; comparing the lighting characteristics of the content displayed on the display screen to the lighting characteristics of a region behind the display screen; and modifying the at least one lighting source to cast a pattern of a shadow that corresponds to the object or the content on the display screen to match the lighting of the object behind the display screen with the lighting of the content that is on the display screen to create a realistic natural looking scene that contains both virtual and real elements, wherein the modifying is performed in response to the result of the comparison of the lighting characteristics of the content on the display screen and the lighting characteristics of the region behind the display screen. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A method of modifying lighting in a display system comprising the steps of:
-
augmenting with graphical information content on a display screen an object manipulated by a user behind the display screen wherein the object is on an opposite side of the display screen from which the user is to face; determining a viewpoint of the user using a viewpoint assessment component on the display positioned to capture a facial detail of the user; sensing the object behind the display screen with at least one object tracking component and positioning the content dependent on the viewpoint of the user; determining the lighting characteristics, including a first lighting direction, of the content displayed on a display screen; determining the lighting characteristics, including a second lighting direction, behind the display screen, wherein an at least one lighting source of the display system and the facial detail of the user are located on opposite sides of the display screen; comparing the lighting characteristics of the content displayed on the display screen to the lighting characteristics of a region behind the display screen; and modifying the at least one of lighting source to cast a pattern of a shadow that corresponds to the object or the content on the display screen to match the lighting of the object behind the display screen with the lighting of the content that is on the display screen to create a realistic natural looking scene that contains both virtual and real elements, wherein the modifying is performed in response to the result of the comparison of the lighting characteristics of the content on the display screen and the lighting characteristics of the region behind the display screen. - View Dependent Claims (18, 19, 20)
-
Specification