A SYSTEM AND METHOD FOR CORRECTING A ROLLING DISPLAY EFFECT

• US 20200133000A1
• Filed: 07/08/2018
• Published: 04/30/2020
• Est. Priority Date: 07/11/2017
• Status: Active Grant

• Current Assignee: Elbit Systems Limited
• Original Assignee: Elbit Systems Limited
• Inventors: AMATI, Johai, NEIMARK, Vadim, KEDEM, Sharon
• Granted Patent: US 10,775,629 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 23/125 head-mounted
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0189 Sight systems
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT

Abstract

A system for generating a frame for display on a see-through display, while correcting, at least partially, a rolling display effect.

Claims

1. A system for generating a frame for display on a see-through display, the frame comprising a plurality of pixels arranged in a plurality of pixel rows, wherein at least a first group of the pixels represents a first element displayed relative to a first coordinate system and a second group of the pixels represents a second element displayed relative to a second coordinate system other than the first coordinate system, wherein a time difference exists between a first time of displaying a reference pixel row of the pixel rows and a second time of displaying a given pixel row of the pixel rows, wherein the given pixel row is any pixel row of the pixel rows subsequent to the reference pixel row, and wherein a first pose of the see-through display at the first time is different than a second pose of said see-through display at the second time, thereby causing a rolling display effect, the system comprising a processor configured to:

determine, using first information of the first pose and second information of the second pose, a first relative spatial movement of the see-through display with respect to the first coordinate system and a second relative spatial movement of the see-through display with respect to the second coordinate system;

generate the frame by adjusting a first position of the pixels in the first group displayed at the first time to at least partially compensate for the first relative spatial movement and adjusting a second position of the pixels in the second group displayed at the second time to at least partially compensate for the second relative spatial movement, thereby at least reducing the rolling display effect; and

display the frame on the see-through display.

2. The system of claim 1, wherein the first relative spatial movement of the see-through display with respect to the first coordinate system and the second relative spatial movement of the see-through display with respect to the second coordinate system are not identical and therefore the adjusting of the first position and the adjusting of the second position are not identical.

3. The system of claim 1, wherein the first group of the pixels is arranged in a plurality of first pixel rows of the pixel rows and the second group of the pixels is arranged in a plurality of second pixel rows of the pixel rows, other than the first pixel rows and wherein the determine and the adjusting are performed for each succeeding pixel row of the pixel rows, succeeding the reference pixel row, wherein the second pose for each succeeding pixel row is determined based on the time difference between displaying the reference pixel row and displaying the corresponding succeeding pixel row.

4. The system of claim 1, wherein the first group of the pixels is arranged in a plurality of first pixel rows of the pixel rows and the second group of the pixels is arranged in a plurality of second pixel rows of the pixel rows, other than the first pixel rows and wherein the determine and the adjusting are performed for a plurality of groups of succeeding pixel rows of the pixel rows, succeeding the reference pixel row, wherein the second pose for each succeeding groups of succeeding pixel rows is determined based on the time difference between displaying the reference pixel row and displaying the corresponding succeeding group of succeeding pixel rows.

5. The system of claim 1, further comprising at least (a) a first buffer containing the first group of the pixels and (b) a second buffer containing the second group of the pixels, and wherein the adjusting is performed on the first group of the pixels within the first buffer and on the second group of the pixels within the second buffer and wherein the generate includes applying a first correction on the first group of the pixels in the first buffer and a second correction on the second group of the pixels in the second buffer.

6. The system of claim 1, wherein the adjusting is performed when the first relative spatial movement or the second relative spatial movement exceeds a threshold.

10. The system of claim 1, further comprising one or more pose sensors configured to obtain information enabling determination of the second pose of the see-through display by tracking the see-through display'"'"'s pose relative to a fixed coordinate system established in space, and wherein the second pose is determined based on the information.

18. The system of claim 1, wherein the see-through display is a visor of a helmet worn by a user.

21. The system of claim 1, wherein the first coordinate system is a coordinate system of a moving platform and the second coordinate system is earth coordinate system.

22. The system of claim 1, wherein the system is a head-worn system.

23. The system of claim 1, wherein the second time is a future time and the second pose is a predicted pose of said see-through display at the future time.

7-9. -9. (canceled)

11-17. -17. (canceled)

19-20. -20. (canceled)

24. A method for generating a frame for display on a see-through display, the frame comprising a plurality of pixels arranged in a plurality of pixel rows, wherein at least a first group of the pixels represents a first element displayed relative to a first coordinate system and a second group of the pixels represents a second element displayed relative to a second coordinate system other than the first coordinate system, wherein a time difference exists between a first time of displaying a reference pixel row of the pixel rows and a second time of displaying a given pixel row of the pixel rows, wherein the given pixel row is any pixel row of the pixel rows subsequent to the reference pixel row, and wherein a first pose of the see-through display at the first time is different than a second pose of said see-through display at the second time, thereby causing a rolling display effect, the method comprising:

determining, by a processing resource, using first information of the first pose and second information of the second pose, a first relative spatial movement of the see-through display with respect to the first coordinate system and a second relative spatial movement of the see-through display with respect to the second coordinate system;

generating, by the processing unit, the frame by adjusting a first position of the pixels in the first group displayed at the first time to at least partially compensate for the first relative spatial movement and adjusting a second position of the pixels in the second group displayed at the second time to at least partially compensate for the second relative spatial movement, thereby at least reducing the rolling display effect; and

displaying the frame on the see-through display.

25. The method of claim 24, wherein the first relative spatial movement of the see-through display with respect to the first coordinate system and the second relative spatial movement of the see-through display with respect to the second coordinate system are not identical and therefore the adjusting of the first position and the adjusting of the second position are not identical.

26. The method of claim 24, wherein the first group of the pixels is arranged in a plurality of first pixel rows of the pixel rows and the second group of the pixels is arranged in a plurality of second pixel rows of the pixel rows, other than the first pixel rows and wherein the determine and the adjusting are performed for each succeeding pixel row of the pixel rows, succeeding the reference pixel row, wherein the second pose for each succeeding pixel row is determined based on the time difference between displaying the reference pixel row and displaying the corresponding succeeding pixel row.

27. The method of claim 24, wherein the first group of the pixels is arranged in a plurality of first pixel rows of the pixel rows and the second group of the pixels is arranged in a plurality of second pixel rows of the pixel rows, other than the first pixel rows and wherein the determining and the adjusting are performed for a plurality of groups of succeeding pixel rows of the pixel rows, succeeding the reference pixel row, wherein the second pose for each succeeding groups of succeeding pixel rows is determined based on the time difference between displaying the reference pixel row and displaying the corresponding succeeding group of succeeding pixel rows.

28. The method of claim 24, wherein the adjusting is performed (a) on the first group of the pixels within a first buffer containing the first group of the pixels and (b) on the second group of the pixels within a second buffer containing the second group of the pixels;

and wherein the generating includes applying a first correction on the first group of the pixels in the first buffer and a second correction on the second group of the pixels in the second buffer.

29. The method of claim 24, wherein the adjusting is performed when the first relative spatial movement or the second relative spatial movement exceeds a threshold.

33. The method of claim 24, wherein the second pose is determined based on information obtained by one or more pose sensors configured to obtain the information by tracking the see-through display'"'"'s pose relative to a fixed coordinate system established in space.

44. The method of claim 24, wherein the first coordinate system is a coordinate system of a moving platform and the second coordinate system is earth coordinate system.

45. The method of claim 24, wherein the method is performed on a head-worn system.

46. The method of claim 24, wherein the second time is a future time and the second pose is a predicted pose of said see-through display at the future time.

30-32. -32. (canceled)

34-43. -43. (canceled)

47. A non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code, executable by at least one processor to perform a method for

generating a frame for display on a see-through display, the frame comprising a plurality of pixels arranged in a plurality of pixel rows, wherein at least a first group of the pixels represents a first element displayed relative to a first coordinate system and a second group of the pixels represents a second element displayed relative to a second coordinate system other than the first coordinate system, wherein a time difference exists between a first time of displaying a reference pixel row of the pixel rows and a second time of displaying a given pixel row of the pixel rows, wherein the given pixel row is any pixel row of the pixel rows subsequent to the reference pixel row, and wherein a first pose of the see-through display at the first time is different than a second pose of said see-through display at the second time, thereby causing a rolling display effect, the method comprising:

determining, by a processing resource, using first information of the first pose and second information of the second pose, a first relative spatial movement of the see-through display with respect to the first coordinate system and a second relative spatial movement of the see-through display with respect to the second coordinate system;

generating, by the processing unit, the frame by adjusting a first position of the pixels in the first group displayed at the first time to at least partially compensate for the first relative spatial movement and, adjusting a second position of the pixels in the second group displayed at the second time to at least partially compensate for the second relative spatial movement, thereby at least reducing the rolling display effect; and

displaying the frame on the see-through display.