SIMULATING THREE-DIMENSIONAL VIEWS USING PLANES OF CONTENT

• US 20150091903A1
• Filed: 09/27/2013
• Published: 04/02/2015
• Est. Priority Date: 09/27/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Costello, Kevin Robert, Lockhart, Christopher Wayne
• Granted Patent: US 9,224,237 B2
• Time in Patent Office: Days
• US Class Current: 345/426
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G06T 15/60 Shadow generation
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

Approaches enable image content (e.g., still or video content) to be displayed in such a way that the image content will appear, to a viewer, to include portions with different locations in physical space, with the relative positioning of those portions being determined at least in part upon a current relative position and/or orientation of the viewer with respect to the device, as well as changes in that relative position and/or orientation. For example, image content can be grouped or otherwise contained or assigned to different planes, levels, or other such groupings of content. The planes of content can enable image content included within those planes to be displayed to provide a viewer with an appearance or view of the content that appears to be positioned and/or displayed in 3D space. As that viewing angle changes, the content can be re-rendered or otherwise updated to display the image content from a perspective that reflects the change in viewing angle.

Claims

1. A computing device, comprising:

a display screen;

a camera;

at least one computing device processor;

a memory device including instructions that, when executed by the at least one computing device processor, enable the computing device to;

associate a first plane of content of a plurality of planes of content with a first node of a plurality of nodes of a node hierarchy and a second plane of content of the plurality of planes of content with a second node of the plurality of nodes, the first plane of content including first content and the second plane of content including second content, the first content and the second content capable of being displayed on a display screen of a computing device;

determine depth relationships among the first plane of content and the second plane of content based at least in part upon a first depth position associated with the first plane of content and a second depth position associated with the second plane of content;

determine a draw order in which to display the first plane of content relative to the second plane of content, the draw order being based at least in part upon the depth relationships among the first plane of content and the second plane of content, wherein planes of content associated with nodes at a lowest depth position are displayed first; and

display, on the display screen, the first content included in the first plane of content and the second content included in the second plane of content in an order based at least in part upon the draw order.

2. The computing device of claim 1, further including a virtual light source, wherein the first depth position is a lower depth position relative to the display screen than the second depth position, and wherein the instructions, when executed, further cause the computing device to:

render at least one shadow on the first plane of content based at least in part on an intersection of virtual light from the virtual light source with the second plane of content.

3. The computing device of claim 1, wherein the first depth position is a lower depth position relative to the display screen than the second depth position, and wherein the instructions, when executed, further cause the computing device to:

display the first content included in the first plane of content before displaying the second content included in the second plane of content.

4. The computing device of claim 1, wherein each plane of content of the plurality of planes of content corresponds to a node of a plurality of nodes of a hierarchy, wherein the plurality of nodes of the hierarchy include at least one parent node and one or more child nodes depending from the at least one parent node, a depth position of the one or more child nodes being relative to at least one of the display screen or the at least one parent node.

5. A computer implemented method, comprising:

associating each one of a plurality of planes to a corresponding one of a subset of a plurality of nodes of a node hierarchy, each plane of the plurality of planes including content capable of being displayed on a display screen of a computing device;

determining depth relationships among the plurality of planes based at least upon position information included in the subset of the plurality of nodes, each node of the subset of the plurality of nodes including position information corresponding to a display position relative to the display screen for a corresponding plane of the plurality of planes;

determining a draw order in which to render the plurality of planes, the draw order being based at least in part upon the depth relationships among the plurality of planes; and

displaying, on the display screen, a first view of the content included in each of the plurality of planes, each plane of the plurality of planes being displayed according to its respective position information and in an order corresponding to the draw order, the first view being rendered from a perspective corresponding to a location of a viewer with respect to the display screen.

6. The computer implemented method of claim 5, wherein determining depth relationships among the plurality of planes includes:

determining at least one of a depth position of one or more of the plurality of planes relative to the display screen or a depth position of one or more of the plurality of planes relative to another plane.

7. The computer implemented method of claim 5, further comprising:

rendering, based at least upon the draw order, a first plane of the plurality of planes with a first depth position before rendering a second plane of the plurality of planes with a second depth position, the second plane being displayed to appear closer to a viewer of the computing device than first plane of the plurality of planes.

8. The computer implemented method of claim 7, wherein the first depth position is a lower depth position relative to the display screen than the second depth position of the second plane, and wherein the method further includes:

rendering a shadow on the first plane based at least in part on an intersection of virtual light from a virtual light source with the second plane.

9. The computer implemented method of claim 5, further comprising:

determining a change in position of first content in a first plane of the plurality of planes, wherein the change in position is caused by at least one of an animation of the first content or a scrolling of an interface displaying the first content;

updating position information for the first plane based at least upon the change in position; and

updating position information for at least one other plane of the plurality of planes based at least upon the change in position of the first content.

10. The computer implemented method of claim 5, wherein displaying the first view further includes:

displaying at least one plane of the plurality of planes to appear to be closer to a viewer of the computing device than at least one other plane of the plurality of planes.

11. The computer implemented method of claim 5, wherein displaying the first view further includes:

adjusting an appearance of at least one of the plurality of planes according to the location of the viewer, wherein adjusting the appearance of the at least one of the plurality of planes includes adjusting at least one of a size, shape, color, shading, or blur of the at least one of the plurality of planes according to the location of the viewer, and wherein content included in the at least one of the plurality of planes inherits at least some adjustments to the appearance of the at least one of the plurality of planes.

12. The computer implemented method of claim 5, further comprising:

determining a change in orientation of the computing device relative to the viewer of the display screen;

determining a second location of the viewer with respect to the computing device, the second location being determined based on the change in the orientation; and

displaying, on the display screen, a second view of the content based at least in part on a lateral position and a depth position associated with each of the plurality of planes, the second view being rendered from a perspective of the second location.

13. The computer implemented method of claim 5, further comprising:

assigning a first plane of the plurality of planes to a first depth position;

assigning a second plane of the plurality of planes to a second depth position, the first depth position being different from the second depth position;

determining a change in position of the computing device relative to the viewer of the display screen;

determining a second location of the viewer with respect to the computing device, the second location of the viewer corresponding to the change in position; and

rendering a change from a first lateral position to a second lateral position for each of the first plane and the second plane based at least in part upon the first depth position for the first plane, the second depth position for the second plane, and the second location of the viewer relative to the computing device.

14. The computer implemented method of claim 5, further comprising:

determining a change in position of the computing device relative to the viewer of the display screen;

determining a second location of the viewer with respect to the computing device, the second location of the viewer corresponding to the change in position;

shifting a position of a first plane of the plurality of planes based at least upon the second location of the viewer, the shifting providing a display of a second plane of the plurality of planes previously occluded by the first plane of the plurality of planes.

15. The computer implemented method of claim 5, further comprising:

determining, based at least in part upon the location of the viewer, coefficients for a set of transformation equations to adjust a scale and a translation for a respective plane with respect to a determined pivot point associated with a center of the display screen; and

adjusting an appearance of content associated with at least one of the plurality of planes using the set of transformation equations.

16. The computer implemented method of claim 5, wherein a first element in a first plane of the plurality of planes is capable of partially obscuring a second element in a second plane of the plurality of planes based at least in part upon the depth relationships.

17. A non-transitory computer readable storage medium storing one or more sequences of instructions executable by one or more processors to perform a set of operations comprising:

associating each one of a plurality of planes to a corresponding one of a subset of a plurality of nodes of a node hierarchy, each plane of the plurality of planes including content capable of being displayed on a display screen of a computing device;

determining depth relationships among the plurality of planes based at least upon position information included in the subset of the plurality of nodes, each node of the subset of the plurality of nodes including position information corresponding to a display position relative to the display screen for a corresponding plane of the plurality of planes;

determining a draw order in which to render the plurality of planes, the draw order being based at least in part upon the depth relationships among the plurality of planes; and

displaying, on the display screen, a first view of the content included in each one of the plurality of planes, each plane of the plurality of planes being displayed according to respective position information and in an order corresponding to the draw order, the first view being rendered from a perspective corresponding to a location of a viewer with respect to the display screen.

18. The non-transitory computer readable storage medium of claim 17, further comprising instructions executed by the one or more processors to perform the operations of:

rendering, based at least upon the draw order, a first plane of the plurality of planes with a first depth position before rendering a second plane of the plurality of planes with a second depth position, the first plane being displayed to appear closer to a viewer of the computing device than second plane of the plurality of planes.

19. The non-transitory computer readable storage medium of claim 17, further comprising instructions executed by the one or more processors to perform the operations of:

determining a change in position of first content in a first plane of the plurality of planes, wherein the change in position is caused by at least one of an animation of the first content or a scrolling of an interface displaying the first content;

updating position information for the first plane based at least upon the change in position; and

updating position information for at least one other plane of the plurality of planes based at least upon the change in position of the first content.

20. The non-transitory computer readable storage medium of claim 17, further comprising instructions executed by the one or more processors to perform the operations of:

displaying at least one plane of the plurality of planes to appear to be closer to a viewer of the computing device than at least one other plane of the plurality of planes.