GROUND PLANE DETECTION FOR PLACEMENT OF AUGMENTED REALITY OBJECTS

• US 20200151932A1
• Filed: 01/14/2020
• Published: 05/14/2020
• Est. Priority Date: 12/21/2017
• Status: Active Grant

• Current Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Original Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Inventors: DAGLEY, Geoffrey, HOOVER, Jason, TANG, Qiaochu, WYLIE, Stephen, VASISHT, Sunil, PRICE, Micah
• Granted Patent: US 10,643,364 B1
• Time in Patent Office: Days
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2210/12 Bounding box
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

In some implementations, a system may include a camera, a display, one or more memories, and one or more processors communicatively coupled to the one or more memories. The system may identify a horizontal plane in an image being captured by the camera and presented on the display, may determine a size of the horizontal plane, and may determine that the size of the horizontal plane satisfies a threshold. The system may designate the horizontal plane as a ground plane based on determining that the size of the horizontal plane satisfies the threshold. The system may output an indication that the horizontal plane has been designated as the ground plane.

Claims

1. A method, comprising:

detecting, by a device and based on feature points in an image, multiple horizontal planes in the image;

estimating, by the device, a vertical distance between the device and a first horizontal plane of the multiple horizontal planes;

eliminating, by the device, the first horizontal plane from consideration as a ground plane based on the vertical distance not satisfying a threshold;

designating, by the device and based on eliminating the first horizontal plane from consideration as the ground plane, a second horizontal plane, of the multiple horizontal planes, as the ground plane; and

providing, by the device and for display, an indication responsive to the second horizontal plane being designated as the ground plane.

2. The method of claim 1, wherein the vertical distance is a first vertical distance;

wherein the method further comprises;

estimating a second vertical distance between the device and the second horizontal plane; and

wherein designating the second horizontal plane as the ground plane comprises;

designating, based on estimating the second vertical distance, the second horizontal plane as the ground plane.

3. The method of claim 2, wherein designating the second horizontal plane as the ground plane further comprises:

designating, based on the second vertical distance satisfying the threshold, the second horizontal plane as the ground plane.

4. The method of claim 1, wherein the threshold is configurable based on detecting whether a user of the device is standing or sitting.

5. The method of claim 1, further comprising:

detecting whether a user of the device is standing or sitting based on at least one of;

a movement of the device,

an acceleration of the device, or

gait detection; and

configuring the threshold based on detecting whether the user is standing or sitting.

6. The method of claim 1, further comprising:

determining an area value of a perimeter of the second horizontal plane; and

wherein designating the second horizontal plane as the ground plane comprises;

designating, based on determining the area value of the perimeter, the second horizontal plane as the ground plane.

7. The method of claim 1, further comprising:

determining a size of a perimeter of the second horizontal plane; and

wherein designating the second horizontal plane as the ground plane comprises;

designating, based on determining the size of the perimeter, the second horizontal plane as the ground plane.

8. A device, comprising:

one or more memories; and

one or more processors communicatively coupled to the one or more memories, configured to;

detect, based on feature points in an image, multiple horizontal planes in the image;

estimate a vertical distance between the device and a first horizontal plane of the multiple horizontal planes;

eliminate the first horizontal plane from consideration as a ground plane based on the vertical distance not satisfying a threshold;

designate, based on eliminating the first horizontal plane from consideration as the ground plane, a second horizontal plane, of the multiple horizontal planes, as the ground plane; and

provide, for display, an indication responsive to the second horizontal plane being designated as the ground plane.

9. The device of claim 8, wherein the vertical distance is a first vertical distance;

wherein the one or more processors are further configured to;

estimate a second vertical distance between the device and the second horizontal plane; and

wherein the one or more processors, when designating the second horizontal plane as the ground plane, are configured to;

designate, based on estimating the second vertical distance, the second horizontal plane as the ground plane.

10. The device of claim 9, wherein the one or more processors, when designating the second horizontal plane as the ground plane, are further configured to:

designate, based on the second vertical distance satisfying the threshold, the second horizontal plane as the ground plane.

11. The device of claim 8, wherein the threshold is configurable based on detecting whether a user of the device is standing or sitting.

12. The device of claim 8, wherein the one or more processors are further configured to:

detect whether a user of the device is standing or sitting based on at least one of;

a movement of the device,

an acceleration of the device, or

gait detection; and

configure the threshold based on detecting whether the user is standing or sitting.

13. The device of claim 8, wherein the one or more processors are further configured to:

determine an area value of a perimeter of the second horizontal plane; and

wherein the one or more processors, when designating the second horizontal plane as the ground plane, are configured to;

designate, based on determining the area value of the perimeter, the second horizontal plane as the ground plane.

14. The device of claim 8, wherein the one or more processors are further configured to:

determine a size of a perimeter of the second horizontal plane; and

wherein the one or more processors, when designating the second horizontal plane as the ground plane, are configured to;

designate, based on determining the size of the perimeter, the second horizontal plane as the ground plane.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to;

detect, based on feature points in an image, multiple horizontal planes in the image;

estimate a vertical distance between the device and a first horizontal plane of the multiple horizontal planes;

eliminate the first horizontal plane from consideration as a ground plane based on the vertical distance not satisfying a threshold;

designate, based on eliminating the first horizontal plane from consideration as the ground plane, a second horizontal plane, of the multiple horizontal planes, as the ground plane; and

provide, for display, an indication responsive to the second horizontal plane being designated as the ground plane.

16. The non-transitory computer-readable medium of claim 15, wherein the vertical distance is a first vertical distance;

wherein the one or more instructions, when executed by the one or more processors, cause the one or more processors to;

estimate a second vertical distance between the device and the second horizontal plane; and

wherein the one or more instructions, that cause the one or more processors to designate the second horizontal plane as the ground plane, cause the one or more processors to;

designate, based on estimating the second vertical distance, the second horizontal plane as the ground plane.

17. The non-transitory computer-readable medium of claim 16, wherein the one or more instructions, that cause the one or more processors to designate the second horizontal plane as the ground plane further, cause the one or more processors to:

designate, based on the second vertical distance satisfying the threshold, the second horizontal plane as the ground plane.

18. The non-transitory computer-readable medium of claim 15, wherein the threshold is configurable based on detecting whether a user of the device is standing or sitting.

19. The non-transitory computer-readable medium of claim 15, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

detect whether a user of the device is standing or sitting based on at least one of;

a movement of the device,

an acceleration of the device, or

gait detection; and

configure the threshold based on detecting whether the user is standing or sitting.

20. The non-transitory computer-readable medium of claim 15, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

determine an area value of a perimeter of the second horizontal plane; and

wherein the one or more instructions, that cause the one or more processors to designate the second horizontal plane as the ground plane, cause the one or more processors to;

designate, based on determining the area value of the perimeter, the second horizontal plane as the ground plane.