Integrated near-far light field display systems

• US 10,453,431 B2
• Filed: 04/27/2017
• Issued: 10/22/2019
• Est. Priority Date: 04/28/2016
• Status: Active Grant

• Current Assignee: Ostendo Technologies Inc.
• Original Assignee: Ostendo Technologies Inc.
• Inventors: El-Ghoroury, Hussein S.
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US15/499,603
• Publication Number:
  US 20170316762A1
• Time in Patent Office: 908 Days
• Field of Search: 345418
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 5/391 Resolution modifying circuits, e.g. variable screen formats

Abstract

Complementary near-field and far-field light field displays (LFDs) are provided. A distributed LFD system is disclosed in which the light field is cooperatively displayed by a direct view LFD and a near-eye LFD. The two display components of the system work together synchronously to display a high-fidelity 3D experience to one or multiple viewers.

Claims

1. An integrated light field display system comprising:

a first light field display element configured to display a near-field light field segment of a collective light field volume, the collective light field volume comprising a predetermined set of optical performance light field characteristics;

a second light field display element configured to display a far-field light field segment of the collective light field volume; and

a light field processor communicatively coupled to the first and second light field display elements and configured to;

determine, within the collective light field volume, a three-dimensional position of the first light field display element and a three-dimensional position of the second light field display element,

determine, based on which light field segment is focused on by a viewer, a modulation transfer function of the first light field display element and a modulation transfer function of the second light field display element; and

modulate at least one of the near-field and far-field light field segments based on at least one of the determined modulation transfer functions.

2. The integrated light field display system of claim 1 wherein the first light field display element comprises a near-eye wearable optical see-through glasses device.

3. The integrated light field display system of claim 1 wherein the first light field display element comprises a near-eye wearable optical see-through glasses device configured to operate as an augmented reality display.

4. The integrated light field display system of claim 1 wherein the first light field display element comprises at least one of a visual or location sensor configured to localize the viewer within the collective light field volume.

5. The integrated light field display system of claim 1 wherein the first light field display element is further configured to include a simultaneous localization and mapping capability that localizes the viewer within the collective light field volume.

6. The integrated light field display system of claim 1 wherein the first light field display element comprises at least one of a viewer eye-gaze tracking sensor, an interpupillary distance sensor and a head orientation sensor configured for determining a location of a viewer'"'"'s focus within the collective light field volume.

7. The integrated light field display system of claim 6 further comprising a gesture control device configured to enable the viewer to interact with the collective light field volume.

8. The integrated light field display system of claim 1 wherein the second display element is communicatively coupled to the first display element.

9. The integrated light field display system of claim 1 wherein the integrated light field display system is communicatively coupled to an external content source and is configured to receive from the external content source streaming of light field display content for display in the collective light field volume.

10. The integrated light field display system of claim 1 wherein the first light field display element is further configured to operate at a first light field display resolution, wherein the second display element is configured to operate at a second light field display resolution that is lower than the first light field display resolution, and wherein the first light field display resolution is complementary to the second light field display resolution.

11. The integrated light field display system of claim 1 wherein the first light field display element is further configured to operate at a first light field display resolution, wherein the second display element is configured to operate at a second light field display resolution that is higher than the first light field display resolution, and wherein the second light field display resolution is complementary to the first light field display resolution.

12. The integrated light field display system of claim 1 wherein a plurality of views of the collective light field volume being modulated by the second light field display element are dynamically adjusted to correspond to a number and a location of each of a plurality of viewers engaging the integrated light field display system.

13. The integrated light field display system of claim 1 wherein the collective light field volume is modulated at a first angular resolution by the second light field display element, and wherein in response to a viewer depth or a vergence being detected, an object in the collective light field volume is brought into a second angular resolution that is higher than the first angular resolution by the first light field display element.

14. The integrated light field display system of claim 1 wherein the collective light field volume is angularly partitioned.

15. The integrated light field display system of claim 1 wherein the collective light field volume is volumetrically partitioned.

16. The integrated light field display system of claim 1 wherein the first light field display element comprises a wearable near-eye augmented reality device and the second light field display element comprises a mobile phone device including a light field display.

17. The integrated light field display system of claim 16 further comprising a gesture control element configured to enable the viewer to interact with the collective light field volume.

18. The integrated light field display system of claim 17 wherein the gesture control element comprises a light field display element and is communicatively coupled with the first and second light field display elements and the light field processor.

19. The integrated light field display system of claim 18 wherein the light field processor is configured to determine and adjust a contribution of a color and a brightness of each of the first and second light field display elements and the light field display element of the gesture control element to a focus zone of the viewer.

20. The integrated light field display system of claim 1 wherein the second light field display element comprises a head-up light field display.

21. The integrated light field display system of claim 1 wherein the first light field display element is a wearable near-eye augmented reality device and the second light field display element is comprised of a multi-panel light field display.

22. A method for integrated light field display, the method comprising:

displaying a near-field light field segment of a collective light field volume, the collective light field volume comprising a predetermined set of optical performance light field characteristics;

displaying display a far-field light field segment of the collective light field volume;

determining, within the collective light field volume, a three-dimensional position of the first light field display element and a three-dimensional position of the second light field display element,

determining, based on which light field segment is focused on by a viewer, a modulation transfer function of the first light field display element and a modulation transfer function of the second light field display element; and

modulating at least one of the near-field and far-field light field segments based on at least one of the determined modulation transfer functions.

23. The method of claim 22 further comprising determining coordinates of a location of the viewer within the collective light field volume.

24. The method of claim 22 further comprising receiving at least one of viewer eye-gaze tracking information, interpupillary distance information and head orientation information for determining a location of a viewer'"'"'s focus within the collective light field volume.

25. The method of claim 22 further comprising receiving gesture control information to enable the viewer to interact with the collective light field volume.

26. The method of claim 22 further comprising receiving from an external content source streaming of light field display content for display in the collective light field volume.

27. The method of claim 22 wherein the near-field light field segment is displayed at a first light field display resolution, wherein the far-field light field segment is displayed at a second light field display resolution that is lower than the first light field display resolution, and wherein the first light field display resolution is complementary to the second light field display resolution.

28. The method of claim 22 wherein the near-field light field segment is displayed at a first light field display resolution, wherein the far-field light field segment is displayed at a second light field display resolution that is higher than the first light field display resolution, and wherein the second light field display resolution is complementary to the first light field display resolution.

29. The method of claim 22 wherein a plurality of views of the collective light field volume being modulated with respect to the far-field light field segment are dynamically adjusted to correspond to a number and a location of each of a plurality of viewers engaging with integrated light field display.

30. The method of claim 22 wherein the collective light field volume is modulated at a first angular resolution with respect to the far-field light segment, and wherein in response to a viewer depth or a vergence being detected, an object in the collective light field volume is brought into a second angular resolution that is higher than the first angular resolution with respect to the near-field light segment.

31. The method of claim 22 wherein the collective light field volume is angularly partitioned.

32. The method of claim 22 wherein the collective light field volume is volumetrically partitioned.

33. The method of claim 22 further comprising determining and adjusting a contribution of a color and a brightness of each of the near-field light field segment and the far-field light field segment to a focus zone of the viewer.

34. A non-transitory machine-readable medium having instructions stored thereon, which when executed by a processor, cause the processor to perform the following method for integrated light field display, the method comprising:

displaying a near-field light field segment of a collective light field volume, the collective light field volume comprising a predetermined set of optical performance light field characteristics;

displaying display a far-field light field segment of the collective light field volume;

determining, within the collective light field volume, a three-dimensional position of the first light field display element and a three-dimensional position of the second light field display element,

determining, based on which light field segment is focused on by a viewer, a modulation transfer function of the first light field display element and a modulation transfer function of the second light field display element; and

modulating at least one of the near-field and far-field light field segments based on at least one of the determined modulation transfer functions.

35. The non-transitory machine-readable medium of claim 34, wherein the method further comprises determining coordinates of a location of the viewer within the collective light field volume.

36. The non-transitory machine-readable medium of claim 34, wherein the method further comprises receiving at least one of viewer eye-gaze tracking information, interpupillary distance information and head orientation information for determining a location of a viewer'"'"'s focus within the collective light field volume.

37. The non-transitory machine-readable medium of claim 34, wherein the method further comprises receiving gesture control information to enable the viewer to interact with the collective light field volume.

38. The non-transitory machine-readable medium of claim 34, wherein the method further comprises receiving from an external content source streaming of light field display content for display in the collective light field volume.

39. The non-transitory machine-readable medium of claim 34, wherein the near-field light field segment is displayed at a first light field display resolution, wherein the far-field light field segment is displayed at a second light field display resolution that is lower than the first light field display resolution, and wherein the first light field display resolution is complementary to the second light field display resolution.

40. The non-transitory machine-readable medium of claim 34, wherein the near-field light field segment is displayed at a first light field display resolution, wherein the far-field light field segment is displayed at a second light field display resolution that is higher than the first light field display resolution, and wherein the second light field display resolution is complementary to the first light field display resolution.

41. The non-transitory machine-readable medium of claim 34, wherein a plurality of views of the collective light field volume being modulated with respect to the far-field light field segment are dynamically adjusted to correspond to a number and a location of each of a plurality of viewers engaging with integrated light field display.

42. The non-transitory machine-readable medium of claim 34, wherein the collective light field volume is modulated at a first angular resolution with respect to the far-field light segment, and wherein in response to a viewer depth or a vergence being detected, an object in the collective light field volume is brought into a second angular resolution that is higher than the first angular resolution with respect to the near-field light segment.

43. The non-transitory machine-readable medium of claim 34, wherein the collective light field volume is angularly partitioned.

44. The non-transitory machine-readable medium of claim 34, wherein the collective light field volume is volumetrically partitioned.

45. The non-transitory machine-readable medium of claim 34, wherein the method further comprises determining and adjusting a contribution of a color and a brightness of each of the near-field light field segment and the far-field light field segment to a focus zone of the viewer.