Rendering rich media content based on head position information

• US 10,386,919 B2
• Filed: 07/13/2018
• Issued: 08/20/2019
• Est. Priority Date: 03/26/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Jassal, Reginald, Smith, Graeme
• Primary Examiner(s): Lin, Chun-Nan
• Application Number:
  US16/034,561
• Publication Number:
  US 20180321738A1
• Time in Patent Office: 403 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06Q 30/0261 based on user location

Abstract

Rich media content, such as advertising, can be provided for display on a two-dimensional screen to give the user an impression that the screen is a window into a three-dimensional (3D) environment. For example, the user'"'"'s head can be tracked and the graphical elements of the advertisement can be rendered based on the position of the user'"'"'s head relative to a computing device such that the graphical elements appear to have 3D depth. A full or substantially full 3D view of a product can be presented. Additional information, such as a product description, features, pricing, user ratings, user reviews, among others, can also be displayed based on the position of the user'"'"'s head relative to the computing device. A 3D video can also be presented, and a user can view different perspectives of the video based on the position of the user'"'"'s head with respect to the computing device.

Claims

1. A portable computing device, comprising:

a processor;

two cameras;

a display screen; and

memory including instructions that, upon being executed by the processor, cause the portable computing device to;

capture, using the cameras, image data including representations of at least one portion of a face of a user;

determine a plurality of three-dimensional (3D) positions of the face of the user relative to the portable computing device;

determine at least one respective 3D rendering of a graphical element of media content using the plurality of three-dimensional positions, the at least one respective 3D rendering of the graphical element of the media content to be included with the media content; and

display, on the display screen, the media content including the at least one respective 3D rendering, the at least one respective 3D rendering being offset in response to a change between the respective 3D positions associated with the at least one respective 3D rendering exceeding a threshold distance.

2. The portable computing device of claim 1, wherein the instructions upon being executed further cause the portable computing device to:

obtain a permission to utilize the cameras;

send a request to an advertising entity for at least one advertisement including at least one 3D graphical element that is rendered based on a 3D position of at least the one portion of the face of the user, the request including information indicating that the portable computing device is capable of tracking at least the one portion of the face of the user; and

obtain at least the one advertisement including a 3D model of the graphical element and rendering logic based on face position information of the user.

3. The portable computing device of claim 2, the instructions upon being executed further cause the portable computing device to:

display information regarding the graphical element upon displaying the media content including the at least one respective 3D rendering of the graphical element, the information including at least one of a product description, pricing, user ratings, or user reviews.

4. A computer-implemented method, comprising:

capture a first image including a first representation of at least one first portion of a face of a user;

determine a first three-dimensional (3D) position of the face of the user using at least the first image;

display media content including at least one first 3D rendering of a graphical element, the at least one first 3D rendering being based at least in part upon the first 3D position of the face of the user, the at least one first 3D rendering to be included with the media content;

capture a second image including a second representation of at least one second portion of the face of the user;

determine a second 3D position of the face of the user using at least the second image; and

display the media content including at least one second 3D rendering of the graphical element, the at least one second 3D rendering being based at least in part upon the second 3D position of the face of the user.

5. The computer-implemented method of claim 4, wherein the graphical element corresponds to a product, the method further comprising:

displaying information regarding the product upon displaying the media content including the at least one second rendering of the graphical element.

6. The computer-implemented method of claim 4, wherein the graphical element is a 3D video.

7. The computer-implemented method of claim 4, further comprising:

obtaining a permission to utilize cameras of the computing device;

sending a request to an advertising entity for at least one advertisement including the graphical element that is rendered based on a position of at least one portion of the face of the user; and

obtaining at least the one advertisement including the graphical element and rendering logic based on face position information of the user.

8. The computer-implemented method of claim 7, wherein the advertising entity is at least one of an ad network, an ad mediator, or an ad exchange.

9. The computer-implemented method of claim 7, wherein the graphical element and the rendering logic are formatted as a Multi-Purpose Internet Mail Extensions (MIME) type.

10. The computer-implemented method of claim 4, further comprising:

determining a head gesture as input to the computing device.

11. The computer-implemented method of claim 4, further comprising:

determining an emotional reaction of the user to the media content from one of the first image or the second image.

12. The computer-implemented method of claim 4, wherein the media content is a banner advertisement.

13. The computer-implemented method of claim 4, wherein the media content is a full-screen advertisement.

14. The computer-implemented method of claim 4, further comprising:

obtaining a permission to collect a demographic trait of the user based on at least one of the first image or the second image; and

determining the demographic trait of the user from one of the first image or the second image.

15. The computer-implemented method of claim 14, wherein the demographic trait is one of a gender, an ethnicity, or an age of the user.

16. A system, comprising:

a processor;

memory including instructions that, upon being executed by the processor, cause the system to;

obtain a request for media content from a computing device;

determine that the computing device is capable of three-dimensional (3D) rendering at least one view of a graphical element based on a 3D position of at least one portion of a face of a user, the 3D rendering of the at least one view of the graphical element to be included with the media content; and

provide, to the computing device, the media content including the at least one view of the graphical element and 3D rendering logic based on the 3D position of the at least one portion of the face of the user.

17. The system of claim 16, wherein the instructions upon being executed to cause the system to determine that the computing device is capable of the 3D rendering the object includes causing the computing device to:

obtain user agent information from the computing device; and

determine one or more capabilities of the computing device based on the user agent information.

18. The system of claim 16, wherein the at least one view of the object and the 3D rendering logic are formatted as a MIME type.

19. The system of claim 16, wherein the media content is one of a banner advertisement or a full-screen advertisement.

20. The system of claim 16, wherein the instructions upon being executed further cause the computing device to:

obtain at least one of a demographic trait of the user or an emotional reaction of the user to the media content.