Systems and methods for generating and facilitating access to a personalized augmented rendering of a user

• US 10,198,871 B1
• Filed: 04/27/2018
• Issued: 02/05/2019
• Est. Priority Date: 04/27/2018
• Status: Active Grant

• Current Assignee: Nicholas T. Hariton
• Original Assignee: Nicholas T. Hariton
• Inventors: Hariton, Nicholas T.
• Primary Examiner(s): Du, Haixa
• Application Number:
  US15/965,689
• Time in Patent Office: 284 Days
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: G06F 21/1013 to locations
• CPC Class Codes: G06F 2221/2137 Time limited access, e.g. to a computer or data
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

Systems and methods for generating and facilitating access to a personalized augmented rendering of a user to be presented in an augmented reality environment are discussed herein. The augmented rendering of a user may be personalized by the user to comprise a desired representation of the user in an augmented reality environment. When a second user is detected within the field of view of a first user, the second user may be identified and virtual content (e.g., an augmented rendering) for the second user may be obtained. The virtual content obtained may differ based on one or more subscriptions of the first user and/or permissions associated with the virtual content of the second user. The virtual content obtained may be rendered and appear superimposed over or in conjunction with a view of the second in the augmented reality environment.

Claims

1. A system configured to generate and facilitate access to a personalized augmented rendering of a user visible in an augmented reality environment, the system comprising:

a display device configured to generate light and provide the light to an eye of a first user such that the light forms images of virtual content configured to be perceived in the augmented reality environment as if it were present in a real world;

one or more physical computer processors configured by computer readable instructions to;

generate an augmented rendering of the first user to be displayed in an augmented reality environment;

facilitate access to first information defining the augmented rendering of the first user by one or more other users;

identify a second user visible within a field of view of the first user via the display device;

responsive to the identification of the second user within the field of view of the first user, obtain second information defining at least one augmented rendering of the second user and a correlation between a set of linkage points defined with respect to the second user and a reference frame of the augmented rendering of the second user, wherein positions in the real world of linkage points in the set of linkage points define the reference frame with respect to a position of the second user in the real world;

generate an image of an augmented rendering from the at least one augmented rendering of the second user defined by the second information to be displayed in the augmented reality environment, wherein the image of the augmented rendering of the second user is generated based on the second information, the field of view of the first user, a position of the display device in the real world, and a position of the set of linkage points in the real world; and

cause the image of the augmented rendering of the second user to be displayed in the augmented reality environment via the display device.

2. The system of claim 1, wherein the one or more other users include the second user, and wherein an image of the augmented rendering of the first user is to be displayed in a second augmented reality environment via a second display device of the second user based on the first information, a field of view of the second user, a position of the second display device in the real world, and a position of a set of linkage points associated with the first user in the real world.

3. The system of claim 2, wherein the one or more processors are further configured to:

obtain subscription information for the second user, wherein the subscription information for the second user indicates one or more subscriptions of the second user; and

determine that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user, wherein the access by the second user to the first information defining the augmented rendering of the first user is facilitated responsive to the determination that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user.

4. The system of claim 3, wherein to facilitate access to the first information, the one or more processors are further configured to:

cause the first information to be transmitted to a device of the second user.

5. The system of claim 2, wherein to generate the augmented rendering of the first user, the one or more processors are further configured to:

obtain one or more images of the first user;

generate a three-dimensional representation of the first user based on the one or more images of the first user;

obtain user input from the first user indicating a request to modify the three-dimensional representation of the first user; and

cause the first information defining the augmented rendering of the first user to be stored, wherein the augmented rendering of the first user comprises a modified three-dimensional representation of the first user based on the user input.

6. The system of claim 5, wherein the request to modify the three-dimensional representation of the first user may comprise a request to modify one or more parameters of the three-dimensional representation of the first user, wherein the one or more parameters define the three-dimensional representation of the first user.

7. The system of claim 6, wherein the one or more parameters define the apparent height, apparent weight, apparent muscle tone, apparent skin tone, appearance of one or more specific body parts, and/or appearance of one or more wrinkles depicted by the three-dimensional representation of the first user.

8. The system of claim 5, wherein the user input may comprise physical input received via a user device, voice input, gesture-based input, input based on movement of the display device, or input based on user eye movement.

9. The system of claim 2, wherein to generate the augmented rendering of the first user, the one or more processors are further configured to:

receive a user selection of a predefined three-dimensional representation;

cause the predefined three-dimensional representation to be downloaded responsive to the selection;

obtain user input from the first user indicating a request to modify the predefined three-dimensional representation; and

cause the first information defining the augmented rendering of the first user to be stored, wherein the augmented rendering of the first user comprises a modified version of the predefined three-dimensional representation based on the user input.

10. The system of claim 1, wherein the second information defines multiple augmented renderings wherein the one or more processors are further configured to:

cause an indication that the second user has been identified within the field of view of the first user;

receive an indication of a selection by the second user of one of the multiple augmented renderings of the second user, wherein the selected one of the multiple augmented renderings of the second user comprises the augmented rendering of the second user of which the image is generated; and

obtain the second information defining the augmented rendering of the second user based on the selection by the second user in order to generate the image.

11. The system of claim 1, wherein the one or more processors are further configured to:

cause at least a portion of the first information defining the augmented rendering of the first user and instructions to be transmitted to a 3-D printer, wherein transmitting at least the portion of the first information and the instructions to the 3-D printer causes the 3-D printer to generate a physical representation of the augmented rendering of the user.

12. The system of claim 1, wherein the one or more processors are further configured to:

receive a request to access the first information defining the augmented rendering of the first user from a third party application related to an interactive game;

obtain user input from the first user indicating a desire to permit access to the first information by the third party application related to the interactive game; and

facilitate access to the first information by the third party application, wherein facilitating access to the first information by the third party application permits the third party application to utilize the augmented rendering of the first user in the interactive game.

13. The system of claim 1, wherein the one or more processors are further configured to:

access subscription information for the first user, wherein the subscription information for the first user indicates one or more subscriptions of the first user; and

determine that at least one of the one or more subscriptions of the first user permits access to the second information, wherein the second information defining the augmented rendering of the second user is obtained responsive to the determination that at least one of the one or more subscriptions of the first user permits access to the augmented rendering of the second user.

14. The system of claim 1, wherein the field of a view of the user is defined based on location information and orientation information, the location information indicating at least a current location associated with the display device, and the orientation information indicating at least a pitch angle, a roll angle, and a yaw angle associated with the display component.

15. The system of claim 1, wherein the image of the augmented rendering of the second user is generated based on the position of the set of linkage points in the real world at a first time, wherein the one or more processors are further configured to:

obtain an indication of updated positions of the linkage points in the set of linkage points in the real world at a second time, wherein at least one of the updated positions of the set of linkage points is different than the positions of the set of linkage points; and

cause an updated image of the augmented rendering of the second user to be displayed in the augmented reality environment via the display device in real-time, such that the augmented rendering of the second user appears synchronized with the set of linkage points as the second user moves within the field of view of the first user.

16. A method of generating and facilitating access to a personalized augmented rendering of a user visible in an augmented reality environment, the method comprising:

generating an augmented rendering of a first user to be displayed in an augmented reality environment;

facilitating access to first information defining the augmented rendering of the first user by one or more other users;

identifying a second user visible within a field of view of the first user via a display device;

responsive to the identification of the second user within the field of view of the first user, obtaining second information defining at least one augmented rendering of the second user and a correlation between a set of linkage points defined with respect to the second user and a reference frame of the augmented rendering of the second user, wherein positions in the real world of linkage points in the set of linkage points in a real world define the reference frame with respect to a position of the second user in the real world;

generating an image of an augmented rendering from the at least one augmented rendering of the second user defined by the second information to be displayed in the augmented reality environment, wherein the image of the augmented rendering of the second user is generated based on the second information, the field of view of the first user, a position of the display device in the real world, and a position of the set of linkage points in the real world; and

causing the image of the augmented rendering of the second user to be displayed in the augmented reality environment via the display device, wherein the display device is configured to generate light and provide the light to an eye of the user such that the light forms images of virtual content configured to be perceived in the augmented reality environment as if it were present in the real world.

17. The method of claim 16, wherein the one or more other users include the second user, and wherein an image of the augmented rendering of the first user is to be displayed in a second augmented reality environment via a second display device of the second user based on the first information, a field of view of the second user, a position of the second display device in the real world, and a position of a set of linkage points associated with the first user in the real world.

18. The method of claim 17, the method further comprising:

obtaining subscription information for the second user, wherein the subscription information for the second user indicates one or more subscriptions of the second user; and

determining that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user, wherein the access by the second user to the first information defining the augmented rendering of the first user is facilitated responsive to the determination that at least one of the one or more subscriptions of the second user permits access to the augmented rendering of the first user.

19. The method of claim 18, wherein facilitating access to the first information comprises:

causing the first information to be transmitted to a device of the second user.

20. The method of claim 17, wherein generating an augmented rendering of the first user comprises:

obtaining one or more images of the first user;

generating a three-dimensional representation of the first user based on the one or more images of the first user;

obtaining user input from the first user indicating a request to modify the three-dimensional representation of the first user; and

causing the first information defining the augmented rendering of the first user to be stored, wherein the augmented rendering of the first user comprises a modified three-dimensional representation of the first user based on the user input.

21. The method of claim 20, wherein the request to modify the three-dimensional representation of the first user may comprise a request to modify one or more parameters of the three-dimensional representation of the first user, wherein the one or more parameters define the three-dimensional representation of the first user.

22. The method of claim 21, wherein the one or more parameters define the apparent height, apparent weight, apparent muscle tone, apparent skin tone, appearance of one or more specific body parts, and/or appearance of one or more wrinkles depicted by the three-dimensional representation of the first user.

23. The method of claim 20, wherein the user input may comprise physical input received via a user device, voice input, gesture-based input, input based on movement of the display device, or input based on user eye movement.

24. The method of claim 17, wherein generating the augmented rendering of the first user comprises:

receiving a user selection of a predefined three-dimensional representation;

causing the predefined three-dimensional representation to be downloaded responsive to the selection;

obtaining user input from the first user indicating a request to modify the predefined three-dimensional representation; and

causing the first information defining the augmented rendering of the first user to be stored, wherein the augmented rendering of the first user comprises a modified version of the predefined three-dimensional representation based on the user input.

25. The method of claim 16, wherein the second information defines multiple augmented renderings, and wherein the method further comprises:

causing an indication that the second user has been identified within the field of view of the first user;

receiving an indication of a selection by the second user of one of the multiple augmented renderings of the second user, wherein the selected one of the multiple augmented renderings of the second user comprises the augmented rendering of the second user of which the image is generated; and

obtaining the second information defining the augmented rendering of the second user based on the selection by the second user in order to generate the image.

26. The method of claim 16, the method further comprising:

causing at least a portion of the first information defining the augmented rendering of the first user and instructions to be transmitted to a 3-D printer, wherein transmitting at least the portion of the first information and the instructions to the 3-D printer causes the 3-D printer to generate a physical representation of the augmented rendering of the user.

27. The method of claim 16, the method further comprising:

receiving a request to access the first information defining the augmented rendering of the first user from a third party application related to an interactive game;

obtaining user input from the first user indicating a desire to permit access to the first information by the third party application related to the interactive game; and

facilitating access to the first information by the third party application, wherein facilitating access to the first information by the third party application permits the third party application to utilize the augmented rendering of the first user in the interactive game.

28. The method of claim 16, the method further comprising:

accessing subscription information for the first user, wherein the subscription information for the first user indicates one or more subscriptions of the first user; and

determining that at least one of the one or more subscriptions of the first user permits access to the second information, wherein the second information defining the augmented rendering of the second user is obtained responsive to the determination that at least one of the one or more subscriptions of the first user permits access to the augmented rendering of the second user.

29. The method of claim 16, wherein the field of a view of the user is defined based on location information and orientation information, the location information indicating at least a current location associated with the display device, and the orientation information indicating at least a pitch angle, a roll angle, and a yaw angle associated with the display component.

30. The method of claim 16, wherein the image of the augmented rendering of the second user is generated based on the position of the set of linkage points in the real world at a first time, the method further comprising:

obtaining an indication of updated positions of the linkage points in the set of linkage points in the real world at a second time, wherein at least one of the updated positions of the set of linkage points is different than the positions of the set of linkage points; and

causing an updated image of the augmented rendering of the second user to be displayed in the augmented reality environment via the display device in real-time, such that the augmented rendering of the second user appears synchronized with the set of linkage points and as the second user moves within the field of view of the first user.