Optimization of a multi-view display

• US 9,225,975 B2
• Filed: 06/21/2010
• Issued: 12/29/2015
• Est. Priority Date: 06/21/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Bathiche, Steven, Lanier, Jaron Zepel
• Primary Examiner(s): Bailey, Frederick
• Assistant Examiner(s): Mahmud, Farhan
• Application Number:
  US12/819,239
• Publication Number:
  US 20110310233A1
• Time in Patent Office: 2,017 Days
• Field of Search: 348/51, 348/46, 348/59, 348/335, 349/15, 349/126
• US Class Current: 1/1
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/32 using arrays of controllable light sources; using moving apertures or moving light sources
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/368 for two or more viewers
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

Described herein is a multi-view display (based on spatial and/or temporal multiplexing) having an optimization mechanism that dynamically adjust views based upon detected state changes with respect to one or more views. The optimization mechanism determines viewing parameters (e.g., brightness and/or colors) for a view based upon a current position of the view, and/or on the multi-view display'"'"'s capabilities. The state change may correspond to the view (a viewer'"'"'s eye) moving towards another viewing zone, in which event new viewing parameters are determined, which may be in anticipation of entering the zone. Another state change corresponds to more views being needed than the display is capable of outputting, whereby one or more existing views are degraded, e.g., from 3D to 2D and/or from a personal video to a non-personal view. Conversely, a state change corresponding to excess capacity becoming available can result in enhancing a view to 3D and/or personal.

Claims

1. A system comprising:

a multi-view display device; and

logic configured to;

receive position data from at least one of an eye tracking component or a head tracking component, the position data indicating that a right eye view for a right eye of a first person that is located in a first viewing zone is moving toward a second viewing zone;

while the right eye view of the first person is in the first viewing zone and moving toward the second viewing zone;

determine right eye color or brightness parameters for the right eye view of the first person in the second viewing zone based at least in part upon the position data,

determine whether there is already a left eye view for a left eye of a second person in the second viewing zone,

and

in an instance when the left eye view of the second person is already in the second viewing zone, average, blend, or smooth the right eye color or brightness parameters for the right eye view of the first person with left eye color or brightness parameters for the left eye view of the second person to obtain output color or brightness parameters; and

control output of the multi-view display device using the output color or brightness parameters for the second viewing zone while the right eye view of the first person and the left eye view of the second person are concurrently in the second viewing zone.

2. The system of claim 1, wherein the logic is configured to control the output of the multi-view display device by controlling multiple light sources of the multi-view display device to transmit light having the output color or brightness parameters to the second viewing zone.

3. The system of claim 2, wherein the right eye color or brightness parameters, the left eye color or brightness parameters, and the output color or brightness parameters each comprise both brightness values and color values.

4. The system of claim 1, wherein the logic is configured to control the output of the multi-view display device to a plurality of other viewing zones while the right eye view of the first person and the left eye view of the second person are concurrently in the second viewing zone.

5. The system of claim 4, wherein the logic is configured to spatially multiplex a plurality of views to the plurality of viewing zones using vertical columns of pixels of the multi-view display device, the plurality of views including the right eye view of the first person and the left eye view of the second person.

6. The system of claim 5, wherein the logic is configured to temporally multiplex the plurality of views, including the right eye view of the first person and the left eye view of the second person, by selectively scheduling different light sources of the multi-view display device.

7. A system comprising:

a processing device; and

logic which, when executed by the processing device, causes the

processing device to;

receive position data indicating a position of a right eye view for a right eye of a first person that is in a first viewing zone and moving toward a second viewing zone, the right eye view of the first person having associated first brightness and color parameters for the right eye of the first person;

determine that there is a left eye view for a left eye of a second person that is already in the second viewing zone, the left eye view having associated second brightness and color parameters;

before the right eye view of the first person arrives in the second viewing zone with the left eye view of the second person, average, blend, or smooth the first brightness and color parameters with the second brightness and color parameters to obtain third brightness and color parameters;

wait until the right eye view of the first person enters the second viewing zone with the left eye view of the second person; and

upon detecting that the right eye view of the first person has entered the second viewing zone with the left eye view of the second person, using the third brightness and color parameters for both the right eye view of the first person and the left eye view of the second person.

8. The system of claim 7, wherein the logic further causes the processing device to:

generate a first three-dimensional view for the first person and a second three-dimensional view for the second person, the first three-dimensional view comprising the right eye view of the first person and a left eye view of the first person, the second three-dimensional view comprising the left eye view of the second person and a right eye view of the second person.

9. The system of claim 8, wherein the first three-dimensional view of the first person and the second three-dimensional view of the second person are different personal three-dimensional views.

10. The system of claim 9, wherein the logic further causes the processing device to:

detect one or more additional views of one or more additional people in the second viewing zone with the first three-dimensional view of the first person and the second three-dimensional view of the second person; and

change at least the first three-dimensional view of the first person to a non-personal three-dimensional view responsive to the one or more additional views of the one or more additional people being detected in the second viewing zone.

11. The system of claim 9, wherein the logic further causes the processing device to:

detect one or more additional views of one or more additional people in the second viewing zone with the first three-dimensional view of the first person and the second three-dimensional view of the second person; and

change at least the first three-dimensional view of the first person to a two-dimensional view responsive to the one or more additional views of the one or more additional people being detected in the second viewing zone.

12. The system of claim 8, wherein the logic further causes the processing device to:

select a view to degrade from the first three-dimensional view, the second three-dimensional view, and another view for another person, the selected view being selected for degrading based on gaze tracking of the first person, the second person, and the another person; and

degrade the selected view.

13. The system of claim 7, embodied as a display device, a gaming console, or a computing device that is not a display device and is not a gaming console.

14. A method of controlling a multi-view display device, the method comprising:

determining that a right eye view for a right eye of a first person is in a first viewing zone and moving toward a second viewing zone, the right eye view of the first person having associated first brightness or color parameters for the right eye of the first person;

determining that there is a left eye view that is already in the second viewing zone, the left eye view being for a left eye of a second person and having associated second brightness or color parameters;

before the right eye view of the first person arrives in the second viewing zone with the left eye view of the second person, averaging, blending, or smoothing the first brightness or color parameters with the second brightness or color parameters to obtain third brightness and color parameters;

detecting whether the right eye view of the first person has entered the second viewing zone with the left eye view of the second person; and

upon detecting that the right eye view of the first person has entered the second viewing zone with the left eye view of the second person, controlling the multi-view display device to use the third brightness or color parameters for the second viewing zone.

15. The method of claim 14, further comprising:

as the right eye view of the first person is moving toward the second viewing zone, computing transition brightness or color parameters for the right eye view of the first person and controlling the multi-view display device to use the transition brightness or color parameters while the right eye view of the first person is moving toward the second viewing zone.

16. The method of claim 15, further comprising using a Kalman filter to compute the transition brightness or color parameters.

17. The method of claim 14, wherein the third brightness or color parameters are obtained by averaging the first brightness or color parameters with the second brightness or color parameters.

18. The method of claim 14, wherein the third brightness or color parameters are obtained by blending the first brightness or color parameters with the second brightness or color parameters.

19. The method of claim 14, wherein the third brightness or color parameters are obtained by smoothing the first brightness or color parameters with the second brightness or color parameters.

20. The method of claim 14, performed by a processor of a computer system.