Systems and methods for generating and facilitating access to a personalized augmented rendering of a user

• US 10,593,121 B2
• Filed: 02/01/2019
• Issued: 03/17/2020
• Est. Priority Date: 04/27/2018
• Status: Active Grant

• Current Assignee: Nicholas T. Hariton
• Original Assignee: Nicholas T. Hariton
• Inventors: Hariton, Nicholas T.
• Primary Examiner(s): Du, Haixia
• Application Number:
  US16/265,812
• Publication Number:
  US 20190333277A1
• Time in Patent Office: 410 Days
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: G06F 21/1013 to locations
• CPC Class Codes: G06F 2221/2137 Time limited access, e.g. to a computer or data
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

Systems and methods for generating and facilitating access to a personalized augmented rendering of a user to be presented in an augmented reality environment are discussed herein. The augmented rendering of a user may be personalized by the user to comprise a desired representation of the user in an augmented reality environment. When a second user is detected within the field of view of a first user, the second user may be identified and virtual content (e.g., an augmented rendering) for the second user may be obtained. The virtual content obtained may differ based on one or more subscriptions for the first user and/or permissions associated with the virtual content of the second user. The virtual content obtained may be rendered and appear superimposed over or in conjunction with a view of the second in the augmented reality environment.

Claims

1. A system configured to generate and facilitate access to a personalized augmented rendering of a user visible in an augmented reality environment, the system comprising:

a presentation device configured to convey information to a first user such that images of virtual content are perceived by the first user in the augmented reality environment as if it were present in a real world; and

one or more physical computer processors configured by computer readable instructions to;

generate an augmented rendering of the first user to be presented in the augmented reality environment;

facilitate access to first information defining the augmented rendering of the first user by one or more other users;

identify a second user visible within a field of view of the first user via the presentation device;

responsive to the identification of the second user within the field of view of the first user, obtain second information defining an augmented rendering of the second user and a correlation between a set of linkage points defined with respect to the second user and a reference frame of the augmented rendering of the second user, wherein positions of individual linkage points of the set of linkage points in the real world define the reference frame with respect to a position of the second user in the real world;

generate an image of the augmented rendering of the second user to be presented in the augmented reality environment, wherein the image of the augmented rendering of the second user is generated based on the second information, the field of view of the first user, a position of the presentation device in the real world, and the positions of the individual linkage points of the set of linkage points in the real world; and

cause the image of the augmented rendering of the second user to be presented in the augmented reality environment via the presentation device.

2. The system of claim 1, wherein the one or more other users include the second user, and wherein an image of the augmented rendering of the first user is to be presented in a second augmented reality environment via a second presentation device of the second user based on the first information, a field of view of the second user, a position of the second presentation device in the real world, and a position of a set of linkage points associated with the first user in the real world.

3. The system of claim 2, wherein the one or more processors are further configured to:

obtain subscription information for the second user, wherein the subscription information for the second user indicates one or more subscriptions of the second user; and

determine that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user, wherein the access by the second user to the first information defining the augmented rendering of the first user is facilitated responsive to the determination that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user.

4. The system of claim 3, wherein to facilitate access to the first information, the one or more processors are further configured to:

cause the first information to be transmitted to a device of the second user.

5. The system of claim 2, wherein to generate the augmented rendering of the first user, the one or more processors are further configured to:

obtain one or more images of the first user;

generate a three-dimensional representation of the first user based on the one or more images of the first user;

obtain user input from the first user indicating a request to modify the three-dimensional representation of the first user; and

cause the first information defining the augmented rendering of the first user to be stored, wherein the augmented rendering of the first user comprises a modified three-dimensional representation of the first user based on the user input.

6. The system of claim 5, wherein the request to modify the three-dimensional representation of the first user may comprise a request to modify one or more parameters of the three-dimensional representation of the first user, wherein the one or more parameters define the three-dimensional representation of the first user.

7. The system of claim 6, wherein the one or more parameters define the apparent height, apparent weight, apparent muscle tone, apparent skin tone, appearance of one or more specific body parts, and/or appearance of one or more wrinkles depicted by the three-dimensional representation of the first user.

8. The system of claim 5, wherein the user input may comprise physical input received via a user device, voice input, gesture-based input, input based on movement of the presentation device, or input based on user eye movement.

9. The system of claim 2, wherein to generate the augmented rendering of the first user, the one or more processors are further configured to:

receive a user selection of a predefined three-dimensional representation;

cause the predefined three-dimensional representation to be downloaded responsive to the selection;

obtain user input from the first user indicating a request to modify the predefined three-dimensional representation; and

cause the first information defining the augmented rendering of the first user to be stored, wherein the augmented rendering of the first user comprises a modified version of the predefined three-dimensional representation based on the user input.

10. The system of claim 1, wherein the second information defines multiple augmented renderings of the second user, wherein the one or more processors are further configured to:

cause an indication that the second user has been identified within the field of view of the first user;

receive an indication of a selection by the second user of one of the multiple augmented renderings of the second user, wherein the selected one of the multiple augmented renderings of the second user comprises the augmented rendering of the second user; and

obtain the second information defining the augmented rendering of the second user based on the selection by the second user.

11. The system of claim 1, wherein the one or more processors are further configured to:

cause at least a portion of the first information defining the augmented rendering of the first user and instructions to be transmitted to a 3-D printer, wherein transmitting at least the portion of the first information and the instructions to the 3-D printer causes the 3-D printer to generate a physical representation of the augmented rendering of the first user.

12. The system of claim 1, wherein the one or more processors are further configured to:

receive a request to access the first information defining the augmented rendering of the first user from a third party application related to an interactive game;

obtain user input from the first user indicating a desire to permit access to the first information by the third party application related to the interactive game; and

facilitate access to the first information by the third party application, wherein facilitating access to the first information by the third party application permits the third party application to utilize the augmented rendering of the first user in the interactive game.

13. The system of claim 1, wherein the one or more processors are further configured to:

access subscription information for the first user, wherein the subscription information for the first user indicates one or more subscriptions of the first user; and

determine that at least one of the one or more subscriptions of the first user permits access to the second information, wherein the second information defining the augmented rendering of the second user is obtained responsive to the determination that at least one of the one or more subscriptions of the first user permits access to the augmented rendering of the second user.

14. The system of claim 1, wherein the field of view of the first user is defined based on location information and orientation information, the location information indicating at least a current location associated with the presentation device, and the orientation information indicating at least a pitch angle, a roll angle, and a yaw angle associated with the presentation device.

15. The system of claim 1, wherein the augmented rendering of the second user is generated based on the positions of the individual linkage points of the set of linkage points in the real world at a first time, wherein the one or more processors are further configured to:

obtain an indication of updated positions of the individual linkage points of the set of linkage points in the real world at a second time, wherein the updated positions of the individual linkage points of the set of linkage points is different than the positions of the individual linkage points of the set of linkage points; and

cause an updated image of the augmented rendering of the second user to be presented in the augmented reality environment via the presentation device in real-time, such that the updated augmented rendering of the second user appears synchronized with the set of linkage points and appears superimposed over the second user as the second user moves within the field of view of the first user.

16. A method of generating and facilitating access to a personalized augmented rendering of a user visible in an augmented reality environment, the method comprising:

generating an augmented rendering of a first user to be presented in the augmented reality environment;

facilitating access to first information defining the augmented rendering of the first user by one or more other users;

identifying a second user visible within a field of view of the first user via a presentation device;

responsive to the identification of the second user within the field of view of the first user, obtaining second information defining an augmented rendering of the second user and a correlation between a set of linkage points defined with respect to the second user and a reference frame of the augmented rendering of the second user, wherein positions of individual linkage points of the set of linkage points in the real world define the reference frame with respect to a position of the second user in the real world;

generating an image of the augmented rendering of the second user to be presented in the augmented reality environment, wherein the image of the augmented rendering of the second user is generated based on the second information, the field of view of the first user, a position of the presentation device in the real world, and the positions of the individual linkage points of the set of linkage points in the real world; and

causing the image of the augmented rendering of the second user to be presented in the augmented reality environment via the presentation device, wherein the presentation device is configured to convey information to the first user such that images of virtual content are perceived by the first user in the augmented reality environment as if it were present in the real world.

17. The method of claim 16, wherein the one or more other users include the second user, and wherein an image of the augmented rendering of the first user is to be presented in a second augmented reality environment via a second presentation device of the second user based on the first information, a field of view of the second user, a position of the second presentation device in the real world, and a position of a set of linkage points associated with the first user in the real world.

18. The method of claim 17, the method further comprising:

obtaining subscription information for the second user, wherein the subscription information for the second user indicates one or more subscriptions of the second user; and

determining that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user, wherein the access by the second user to the first information defining the augmented rendering of the first user is facilitated responsive to the determination that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user.

19. The method of claim 18, wherein facilitating access to the first information comprises:

causing the first information to be transmitted to a device of the second user.

20. The method of claim 16, wherein the second information defines multiple augmented renderings of the second user, the method further comprising:

causing an indication that the second user has been identified within the field of view of the first user;

receiving an indication of a selection by the second user of one of the multiple augmented renderings of the second user, wherein the selected one of the multiple augmented renderings of the second user comprises the augmented rendering of the second user; and

obtaining the second information defining the augmented rendering of the second user based on the selection by the second user.