Biasing a rendering location of an augmented reality object

• US 9,646,418 B1
• Filed: 06/10/2014
• Issued: 05/09/2017
• Est. Priority Date: 06/10/2014
• Status: Active Grant

• Current Assignee: Ripple, Inc. of Delaware
• Original Assignee: Ripple Inc.
• Inventors: Lotto, Ray Beau
• Primary Examiner(s): Crawford, Jacinta M
• Assistant Examiner(s): NGUYEN, PHONG X
• Application Number:
  US14/301,145
• Time in Patent Office: 1,064 Days
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

Rendering a digital element is disclosed. An orientation of an observing platform is determined. It is determined whether a first rendering location of the digital element rendered on a captured image associated with a geographical location of the observing platform meets a criteria. In the event the first rendering location meets the criteria, a second rendering location of the digital element is biased using the determined orientation of the observing platform.

Claims

1. A system for rendering a digital element, comprising:

a processor configured to;

determine an orientation of an observing platform;

determine whether a first rendering location of the digital element rendered on a captured image associated with a geographical location of the observing platform meets a criteria, wherein determining whether the first rendering location meets the criteria includes determining whether a difference between a directional component of the first rendering location and a directional component of the orientation of the observing platform is within a threshold difference and the threshold difference corresponds to only a portion of the capture image;

in the event the first rendering location meets the criteria, based on a determination that the first rendering location is associated with the threshold difference that corresponds to only the portion of the captured image, bias a second rendering location of the digital element using the determined orientation of the observing platform; and

in the event the first rendering location does not meet the criteria despite being rendered, based on the determination that the first rendering location is not associated with the threshold difference that corresponds to only the portion of the captured image determine to not bias the second rendering location of the digital element; and

a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions.

2. The system of claim 1, wherein determining the orientation of the observing platform includes receiving data from one or more of the following:

an accelerometer, a gyroscope sensor, and a device orientation sensor.

3. The system of claim 1, wherein determining the orientation of the observing platform includes determining which portion of an augmented reality environment is currently displayed by the observing platform.

4. The system of claim 1, wherein the observing platform includes a mobile device.

5. The system of claim 1, wherein the first rendering location is a current rendering location of the digital element.

6. The system of claim 1, wherein the first rendering location is specified by at least a directional heading and a distance from the geographical location of the observing platform to a geographical location of the digital element.

7. The system of claim 1, wherein the captured image was captured using a camera of the system at the geographical location.

8. The system of claim 1, wherein determining whether the first rendering location meets the criteria includes determining whether the digital element has been indicated by a user.

9. The system of claim 1, wherein determining whether the first rendering location meets the criteria includes determining whether the digital element has been indicated by a user using a touch input.

10. The system of claim 1, wherein determining whether the first rendering location meets the criteria includes determining whether the digital element has been placed within a selection area portion of a display of the observing platform.

11. The system of claim 1, wherein determining whether the first rendering location meets the criteria includes determining whether a directional component of the first rendering location is within a threshold range.

12. The system of claim 11, wherein the threshold range is associated with a parameter of a camera that captured the captured image.

13. The system of claim 1, wherein the second rendering location is a next rendering location of the digital element.

14. The system of claim 1, wherein the second rendering location is a target rendering location of the digital element.

15. The system of claim 1, wherein biasing the second rendering location includes using a directional heading of the orientation of the observing platform.

16. The system of claim 1, wherein biasing the second rendering location includes calculating a weighted sum of an original directional heading component of the second rendering location and a directional heading of the orientation of the observing platform.

17. The system of claim 1, wherein biasing the second rendering location includes using a directional heading of a center of a selection area portion of a display of the observing platform.

18. The system of claim 1, wherein biasing the second rendering location includes not updating the second rendering location based on an update of the geographical location of the observing platform.

19. A method for rendering a digital element, comprising:

determining an orientation of an observing platform;

determining whether a first rendering location of the digital element rendered on a captured image associated with a geographical location of the observing platform meets a criteria, wherein determining whether the first rendering location meets the criteria includes determining whether a difference between a directional component of the first rendering location and a directional component of the orientation of the observing platform is within a threshold difference and the threshold difference corresponds to only a portion of the capture image;

in the event the first rendering location meets the criteria, based on a determination that the first rendering location is associated with the threshold difference that corresponds to only the portion of the captured image, using a processor to bias a second rendering location of the digital element using the determined orientation of the observing platform; and

in the event the first rendering location does not meet the criteria despite being rendered, based on the determination that the first rendering location is not associated with the threshold difference that corresponds to only the portion of the captured image determining to not bias the second rendering location of the digital element.

20. A computer program product for rendering a digital element, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

determining an orientation of an observing platform;

determining whether a first rendering location of the digital element rendered on a captured image associated with a geographical location of the observing platform meets a criteria, wherein determining whether the first rendering location meets the criteria includes determining whether a difference between a directional component of the first rendering location and a directional component of the orientation of the observing platform is within a threshold difference and the threshold difference corresponds to only a portion of the capture image; and

in the event the first rendering location meets the criteria, based on a determination that the first rendering location is associated with the threshold difference that corresponds to only the portion of the captured image, biasing a second rendering location of the digital element using the determined orientation of the observing platform; and

in the event the first rendering location does not meet the criteria despite being rendered, based on the determination that the first rendering location is not associated with the threshold difference that corresponds to only the portion of the captured image determining to not bias the second rendering location of the digital element.