Yaw user interface

• US 10,104,282 B2
• Filed: 01/29/2016
• Issued: 10/16/2018
• Est. Priority Date: 09/30/2015
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Van Olst, Daniel G
• Primary Examiner(s): Le, Peter D
• Application Number:
  US15/010,647
• Publication Number:
  US 20170094161A1
• Time in Patent Office: 991 Days
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/243 by compensating for image skew or non-uniform image deformations
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/6815 by distinguishing pan or tilt from motion
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A system and method that calculates a yaw error in an image and provides a user interface to a user for correcting the yaw error. The method includes receiving an image, performing line detection in the image, computing a line parameterization for lines in the image, computing a yaw angle for the image and providing the yaw data calculated in the image.

Claims

1. A method comprising:

receiving, using one or more computing devices, a first preview image of an object including yaw data;

computing, using the one or more computing devices, a yaw angle for the first preview image based on the yaw data;

determining, using the one or more computing devices, a yaw indicator based on the computed yaw angle, the yaw indicator visually represented as a vertical eyelid indicator covering a portion of one of a left side and a right side of a concentric circle in a user interface; and

presenting, using the one or more computing devices, the user interface with the yaw indicator positioned for display over the first preview image on a portion of a display device.

2. The method of claim 1, wherein the yaw angle is computed by:

performing, using the one or more computing devices, line detection in the first preview image;

computing, using the one or more computing devices, a line parametrization for two lines detected in the first preview image; and

computing, using the one or more computing devices, the yaw angle for the preview image using the line parametrization for the two lines.

3. The method of claim 1, further comprising:

receiving, using the one or more computing devices, a second preview image of the object;

computing, using the one or more computing devices, an updated yaw angle using the second preview image;

updating, using the one or more computing devices, the yaw indicator based on the updated yaw angle; and

presenting, using the one or more computing devices, the updated yaw indicator over the second preview image on the portion of the display device.

4. The method of claim 1, wherein the concentric circle is a smaller concentric circle centered inside of a larger concentric circle on the display device and the vertical eyelid indicator covers a portion of an area inside of the smaller concentric circle.

5. The method of claim 4, further comprising:

computing, using the one or more computing devices, a pitch angle and a roll angle for the first preview image;

determining, using the one or more computing devices, a horizontal eyelid indicator based on the pitch angle;

determining, using the one or more computing devices, a ball indicator based on the roll angle;

presenting, using the one or more computing devices, the horizontal eyelid indicator over a portion of the area inside of the larger concentric circle on the display device; and

presenting, using the one or more computing devices, the ball indicator along an outside edge of the larger concentric circle on the display device.

6. The method of claim 1, wherein the vertical eyelid indicator covering the portion of one of the left side and the right side of the concentric circle includes determining, using the one or more computing devices, a percentage of a shaded portion of the concentric circle representing the vertical eyelid indicator corresponding to a percentage of the yaw angle present in the first preview image.

7. The method of claim 1, further comprising:

indicating, using the one or more computing devices, to a user that the yaw angle does not satisfy a pre-defined threshold.

8. The method of claim 7, wherein indicating to a user that the yaw angle does not satisfy a pre-defined threshold is done by providing haptic feedback.

9. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

receive a first preview image of an object including yaw data;

compute a yaw angle for the first preview image based on the yaw data;

determining a yaw indicator based on the computed yaw angle, the yaw indicator visually represented as a vertical eyelid indicator covering a portion of one of a left side and a right side of a concentric circle in a user interface; and

present the user interface with the yaw indicator positioned for display over the first preview image on a portion of a display device.

10. The system of claim 9, wherein the instructions to compute the yaw angle further cause the system to:

perform line detection in the first preview image;

compute a line parametrization for two lines detected in the first preview image; and

compute the yaw angle for the preview image using the line parametrization for the two lines.

11. The system of claim 9, wherein the instructions further comprise:

receive a second preview image of the object;

compute an updated yaw angle using the second preview image;

update the yaw indicator based on the updated yaw angle; and

present the updated yaw indicator over the second preview image on the portion of the display device.

12. The system of claim 9, wherein the concentric circle is a smaller concentric circle centered inside of a larger concentric circle on the display device and the vertical eyelid indicator covers a portion of an area inside of the smaller concentric circle.

13. The system of claim 12, wherein the instructions further comprise:

compute a pitch angle and a roll angle for the first preview image;

determine a horizontal eyelid indicator based on the pitch angle;

determine a ball indicator based on the roll angle;

present the horizontal eyelid indicator over a portion of the area inside of the larger concentric circle on the display device; and

present the ball indicator along an outside edge of the larger concentric circle on the display device.

14. The system of claim 9, wherein the instructions further comprise:

indicate to a user that the yaw angle does not satisfy a pre-defined threshold by providing haptic feedback.

15. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

receive a first preview image of an object including yaw data;

compute a yaw angle for the first preview image based on the yaw data;

determine a yaw indicator based on the computed yaw angle, the yaw indicator visually represented as a vertical eyelid indicator covering a portion of one of a left side and a right side of a concentric circle in a user interface; and

present the user interface with the yaw indicator positioned for display over the first preview image on a portion of a display device.

16. The computer program product of claim 15, wherein causing the computer to compute the yaw angle further causes the computer to:

perform line detection in the first preview image;

compute a line parametrization for two lines detected in the first preview image; and

compute the yaw angle for the preview image using the line parametrization for the two lines.

17. The computer program product of claim 15, wherein the computer readable program when executed on a computer further causes the computer to:

receive a second preview image of the object;

compute an updated yaw angle using the second preview image;

update the yaw indicator based on the updated yaw angle; and

present the updated yaw indicator over the second preview image on the portion of the display device.

18. The computer program product of claim 16, wherein the concentric circle is a smaller concentric circle centered inside of a larger concentric circle on the display device and the vertical eyelid indicator covers a portion of an area inside of the smaller concentric circle.

19. The computer program product of claim 18, wherein the computer readable program when executed on a computer further causes the computer to:

compute a pitch angle and a roll angle for the first preview image;

determine a horizontal eyelid indicator based on the pitch angle;

determine a ball indicator based on the roll angle;

present the horizontal eyelid indicator over a portion of the area inside of the larger concentric circle on the display device; and

present the ball indicator along an outside edge of the larger concentric circle on the display device.

20. The computer program product of claim 15, wherein the computer readable program when executed on a computer further causes the computer to:

indicate to a user that the yaw angle does not satisfy a pre-defined threshold by providing haptic feedback.