Methods and systems for determining user interaction based data in a virtual environment transmitted by three dimensional assets

• US 9,870,571 B1
• Filed: 05/26/2017
• Issued: 01/16/2018
• Est. Priority Date: 07/13/2016
• Status: Active Grant

• Current Assignee: Trivver, Inc.
• Original Assignee: Trivver, Inc.
• Inventors: LaMontagne, Joel, Keating, Simon
• Primary Examiner(s): Chen, Yu
• Application Number:
  US15/607,132
• Publication Number:
  US 20180018698A1
• Time in Patent Office: 235 Days
• Field of Search: None
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06T 15/06 Ray-tracing
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

In one embodiment, a plurality of 3D digital assets that can be associated with scripts to transmit user interaction, when displayed within a 3D environment in a client machine. The system includes a 3D digital asset processing system configured to receive user interaction data related to the 3D digital asset from the client machine and generate metrics related to user interaction with the 3D digital asset. In one embodiment, the metrics are generated by determining whether the 3D digital asset, comprising a collidable mesh, is drawn on a culling mask of a camera, and further using ray casting, drawing a line between the camera and the 3D digital asset. When the line collides with the collidable mesh of the 3D digital asset, using a screen bounding function of a 3D engine of the virtual environment, a proportion of the 3D digital asset on a user interface is determined to obtain a percentage of the user interface that is covered by the 3D digital asset. Thereafter, data related to user interaction with the 3D digital asset in the 3D environment is determined using the percentage.

Claims

1. A system to determine and record user interaction in a virtual three dimensional (3D) environment, comprising:

an asset repository comprising a plurality of 3D digital assets, wherein each of the plurality of 3D digital assets can be displayed within the virtual 3D environment;

a 3D digital asset processing system, coupled to the asset repository, configured to;

receive data related to user interaction with a 3D digital asset out of the plurality of 3D digital assets in the virtual 3D environment, and

generate metrics related to user interaction, including tapping, touching, moving, time spent, viewing, requesting detailed description related to the 3D digital asset in the virtual 3D environment; and

a client computer, coupled to the 3D digital asset processing system, configured to;

display the 3D digital asset in the virtual 3D environment via a graphical user interface,

determine whether the 3D digital asset is drawn on a culling mask of a camera in the virtual 3D environment, wherein the 3D digital asset comprises a collidable mesh,

using ray casting, draw a line between the camera and the 3D digital asset,

determine that the line collides with the collidable mesh of the 3D digital asset,

using a screen bounding function of a 3D engine, determine a proportion of the 3D digital asset covering the graphical user interface when it is determined that the line collides with the collidable mesh,

based on the proportion, obtain a percentage of the graphical user interface that is covered by the 3D digital asset, and

based on the percentage, generate the data related to user interaction with the 3D digital asset in the virtual 3D environment, wherein the client computer transmits the data related to user interaction to the 3D digital asset processing system.

2. The system of claim 1, further comprising:

a 3D digital asset placement system, coupled to the asset repository, the 3D digital asset placement system configured to;

receive a request to present the 3D digital asset, in a 3D development environment, the 3D development environment generating the virtual 3D environment;

retrieve the 3D digital asset and associated asset data from the asset repository, the associated asset data further associated with an asset category and asset type; and

transmit the 3D digital asset and associated asset data to the 3D development environment.

3. The system of claim 1, wherein the 3D digital asset is a generic representation of an object or shape.

4. The system of claim 3, wherein the generic representation can be replaced with a representation of a brand.

5. The system of claim 2, wherein the associated asset data further includes at least one of a minimum or maximum polygon count value of the 3D digital asset.

6. A non-transitory computer readable medium comprising instructions which when executed by at least one processing system comprising at least one hardware processing core, executes a method for determining and recording data related to user interaction in a virtual three dimensional (3D) environment, comprising:

receiving data related to user interaction with a 3D digital asset in the virtual 3D environment, wherein the data related to user interaction with the 3D digital asset is received from a client computer, the client computer;

displaying the 3D digital asset in the virtual 3D environment via a graphical user interface,

determining whether the 3D digital asset is drawn on a culling mask of a camera in the virtual 3D environment, wherein the 3D digital asset comprises a collidable mesh,

using ray casting, draw a line between the camera and the 3D digital asset,

determining that the line collides with the collidable mesh of the 3D digital asset,

using a screen bounding function of a 3D engine, determining a proportion of the 3D digital asset covering the graphical user interface when it is determined that the line collides with the collidable mesh,

based on the proportion, obtaining a percentage of the graphical user interface that is covered by the 3D digital asset, and

based on the percentage, generating the data related to user interaction with the 3D digital asset in the virtual 3D environment, wherein the client computer transmits the data related to user interaction to the at least one processing system; and

generating metrics related to user interaction, including tapping, touching, moving, time spent, viewing, requesting detailed description related to the 3D digital asset in the virtual 3D environment.

7. The non-transitory computer readable medium of claim 6, further comprising:

receiving a request to present the 3D digital asset, in a 3D development environment, the 3D development environment generating the virtual 3D environment;

retrieving the 3D digital asset and associated asset data from an asset repository, the associated asset data further associated with an asset category and asset type; and

transmitting the 3D digital asset and associated asset data to the 3D development environment.

8. The non-transitory computer readable medium of claim 6, wherein the 3D digital asset is a generic representation of an object or shape.

9. The non-transitory computer readable medium of claim 8, wherein the generic representation can be replaced with a representation of a brand.

10. The non-transitory computer readable medium of claim 7, wherein the associated asset data further includes at least one of a minimum or maximum polygon count value of the 3D digital asset.

11. A method for determining and recording data related to user interaction in a virtual three dimensional (3D) environment, comprising:

receiving, by a computing device, data related to user interaction with a 3D digital asset in the virtual 3D environment, wherein the data related to user interaction with the 3D digital asset is received from a client computer, the client computer;

displaying the 3D digital asset in the virtual 3D environment via a graphical user interface,

determining whether the 3D digital asset is drawn on a culling mask of a camera in the virtual 3D environment, wherein the 3D digital asset comprises a collidable mesh,

using ray casting, drawing a line between the camera and the 3D digital asset,

determining that the line collides with the collidable mesh of the 3D digital asset,

using a screen bounding function of a 3D engine, determining a proportion of the 3D digital asset covering the graphical user interface when it is determined that the line collides with the collidable mesh,

based on the proportion, obtaining a percentage of the graphical user interface that is covered by the 3D digital asset, and

based on the percentage, generating the data related to user interaction with the 3D digital asset in the virtual 3D environment, wherein the client computer transmits the data related to user interaction to the computing device; and

generating, by the computing device, metrics related to user interaction, including tapping, touching, moving, time spent, viewing, requesting detailed description related to the 3D digital asset in the virtual 3D environment.

12. The method of claim 11, further comprising:

receiving a request to present the 3D digital asset, in a 3D development environment, the 3D development environment generating the virtual 3D environment;

retrieving the 3D digital asset and associated asset data from an asset repository, the associated asset data further associated with an asset category and asset type; and

transmitting the 3D digital asset and associated asset data to the 3D development environment.

13. The method of claim 11, wherein the 3D digital asset is a generic representation of an object or shape.

14. The method of claim 12, wherein the 3D digital associated asset data further includes at least one of a minimum or maximum polygon count value of the 3D digital asset.

15. The method of claim 13, wherein the generic representation can be replaced with a representation of a brand.