VIRTUAL REALITY APPLICATION DATA PROCESSING METHOD, COMPUTER DEVICE AND STORAGE MEDIUM

• US 20190332418A1
• Filed: 07/11/2019
• Published: 10/31/2019
• Est. Priority Date: 05/09/2017
• Status: Active Grant

• Current Assignee: Tencent Technology Shenzhen Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Shenzhen Company Limited (Tencent Holdings Limited)
• Inventors: Zhou, Yang, Lin, Long fang
• Granted Patent: US 11,307,891 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/48 Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
• CPC Class Codes: A63F 13/493 Resuming a game, e.g. after pausing, malfunction or power failure
• CPC Class Codes: A63F 13/497 Partially or entirely replaying previous game actions
• CPC Class Codes: A63F 13/5252 using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: A63F 13/77 involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/485 Task life-cycle, e.g. stopping, restarting, resuming execution G06F9/4881 takes precedence
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A method of processing data in a virtual reality (VR) application is provided. The VR application is restored to an initial running state in response to receiving a playback start instruction. Manipulation data that are transmitted to a runtime library to be pre-captured and stored are obtained, the manipulation data having a time sequence and being used to control running of the VR application. The manipulation data are imported into the runtime library based on the time sequence. The imported manipulation data are transferred to the VR application in the initial running state by using the runtime library and performing playback processing based on the transferred manipulation data.

Claims

1. A method of processing data in a virtual reality (VR) application, performed by a computing device comprising at least one processor, comprising:

restoring, by the at least one of the at least one processor, the VR application to an initial running state in response to receiving a playback start instruction;

obtaining, by the at least one of the at least one processor, manipulation data that are transmitted to a runtime library to be pre-captured and stored, the manipulation data having a time sequence and being used to control running of the VR application;

importing, by the at least one of the at least one processor, the manipulation data into the runtime library based on the time sequence; and

transferring, by the at least one of the at least one processor, the imported manipulation data to the VR application in the initial running state by using the runtime library and performing playback processing based on the transferred manipulation data.

2. The method according to claim 1, further comprising:

registering, by at least one of the at least one processor, a callback function with the runtime library; and

invoking, by at least one of the at least one processor, the callback function in response to receiving the manipulation data, to capture and store the manipulation data.

3. The method according to claim 1, wherein the importing comprises:

in response to determining that a playback manner being a first playback manner, shortening, by at least one of the at least one processor, a record time interval between manipulation data, neighboring based on the time sequence, based on an acceleration import multiple corresponding to the first playback manner; and

importing, by at least one of the at least one processor, the manipulation data sequentially into the runtime library based on the time sequence and the shortened record time interval.

4. The method according to claim 1, further comprising:

in response to determining that a playback manner being a second playback manner, obtaining, by at least one of the at least one processor, a time node corresponding to the manipulation data; and

importing, by at least one of the at least one processor, the manipulation data sequentially into the runtime library based on the obtained time node.

5. The method according to claim 3, further comprising:

determining, by at least one of the at least one processor, that the playback manner is the first playback manner based on a one-to-one mapping relationship between virtual three-dimensional coordinates in the VR application and physical three-dimensional coordinates in physical space.

6. The method according to claim 4, further comprising:

determining, by at least one of the at least one processor, that the playback manner is the second playback manner in response to virtual three-dimensional coordinates in the VR application and physical three-dimensional coordinates in physical space not satisfying a one-to-one mapping relationship.

7. The method according to claim 1, further comprising:

obtaining, by at least one of the at least one processor, a playback picture that is generated by the VR application based on the manipulation data;

performing, by at least one of the at least one processor, blur processing on the playback picture; and

displaying, by at least one of the at least one processor, the playback picture on which the blur processing is performed.

8. The method according to claim 7, further comprising:

generating, by at least one of the at least one processor, a picture of a third-party view of angle corresponding to the playback picture; and

displaying, by at least one of the at least one processor, the picture of the third-party view of angle, to superimpose the picture of the third-party view of angle onto the playback picture on which the blur processing is performed.

9. The method according to claim 8, wherein the generating comprises:

obtaining, by at least one of the at least one processor a picture drawing parameter value transferred by the VR application to a drawing function in the VR application;

changing, by at least one of the at least one processor, the picture drawing parameter value based on a drawing parameter value conversion relationship of a first-party view of angle and the third-party view of angle; and

invoking, by at least one of the at least one processor, the drawing function, to draw the picture of the third-party view of angle based on the changed picture drawing parameter value.

10. The method according to claim 9, wherein the obtaining the picture drawing parameter value comprises:

obtaining, by at least one of the at least one processor, the picture drawing parameter value transferred by the VR application to the drawing function by using a hook function injected into the drawing function, and

wherein the invoking comprises;

invoking, by at least one of the at least one processor, the drawing function by using the hook function injected into the drawing function, to draw the picture of the third-party view of angle based on the changed picture drawing parameter value.

11. The method according to claim 1, further comprising:

in response to receiving a playback stop instruction, stopping, by at least one of the at least one processor, importing the manipulation data into the runtime library, to end the playback processing;

receiving, by at least one of the at least one processor by using the runtime library, instant manipulation data, and transferring the instant manipulation data to the VR application; and

generating, by at least one of the at least one processor, a VR picture by using the VR application based on the instant manipulation data, and displaying the VR picture.

12. A computer device, comprising:

at least one memory operable to store program code; and

at least one processor operable to read the program code and operate as instructed by the program code, the program code comprising;

restoring code configured to cause at least one of the at least one processor to restore the VR application to an initial running state in response to receiving a playback start instruction;

first obtaining code configured to cause at least one of the at least one processor to obtain manipulation data that are transmitted to a runtime library to be pre-captured and stored, the manipulation data having a time sequence and being used to control running of the VR application;

first importing code configured to cause at least one of the at least one processor to import the manipulation data into the runtime library based on the time sequence; and

transferring code configured to cause at least one of the at least one processor to transfer the imported manipulation data to the VR application in the initial running state by using the runtime library and performing playback processing based on the transferred manipulation data.

13. The computer device according to claim 12, wherein the program code further comprises:

registering code configured to cause at least one of the at least one processor to register a callback function with the runtime library; and

first invoking code configured to cause at least one of the at least one processor to invoke the callback function in response to receiving the manipulation data, to capture and store the manipulation data.

14. The computer device according to claim 12, wherein the first importing code comprises:

shortening code configured to cause at least one of the at least one processor to, in response to determining that a playback manner being a first playback manner, shorten a record time interval between manipulation data, neighboring based on the time sequence, based on an acceleration import multiple corresponding to the first playback manner; and

importing code configured to cause at least one of the at least one processor to import the manipulation data sequentially into the runtime library based on the time sequence and the shortened record time interval.

15. The computer device according to claim 12, wherein the program code further comprises:

second obtaining code configured to cause at least one of the at least one processor to obtain, in response to determining that a playback manner being a second playback manner, a time node corresponding to the manipulation data; and

second importing code configured to cause at least one of the at least one processor to import the manipulation data sequentially into the runtime library based on the obtained time node.

16. The computer device according to claim 12, wherein the program code further comprises:

third obtaining code configured to cause at least one of the at least one processor to obtain a playback picture that is generated by the VR application based on the manipulation data;

performing code configured to cause at least one of the at least one processor to perform blur processing on the playback picture; and

first displaying code configured to cause at least one of the at least one processor to display the playback picture on which the blur processing is performed.

17. The computer device according to claim 16, wherein the program code further comprises:

first generation code configured to cause at least one of the at least one processor to generate a picture of a third-party view of angle corresponding to the playback picture; and

second displaying code configured to cause at least one of the at least one processor to display the picture of the third-party view of angle, to superimpose the picture of the third-party view of angle onto the playback picture on which the blur processing is performed.

18. The computer device according to claim 17, wherein the first generation code comprises:

fourth obtaining code configured to cause at least one of the at least one processor to obtain a picture drawing parameter value transferred by the VR application to a drawing function in the VR application;

changing code configured to cause at least one of the at least one processor to change the picture drawing parameter value based on a drawing parameter value conversion relationship of a first-party view of angle and the third-party view of angle; and

second invoking code configured to cause at least one of the at least one processor to invoke the drawing function, to draw the picture of the third-party view of angle based on the changed picture drawing parameter value.

19. The computer device according to claim 12, wherein the program code further comprises:

stopping code configured to cause at least one of the at least one processor to, in response to receiving a playback stop instruction, stop importing the manipulation data into the runtime library, to end the playback processing;

receiving code configured to cause at least one of the at least one processor to, by using the runtime library, receive instant manipulation data, and transfer the instant manipulation data to the VR application; and

second generating code configured to cause at least one of the at least one processor to generate a VR picture by using the VR application based on the instant manipulation data, and display the VR picture.

20. A non-transitory storage medium storing a computer-readable instruction, which is executable by at least one processor to perform:

restoring the VR application to an initial running state in response to receiving a playback start instruction;

obtaining manipulation data that are transmitted to a runtime library to be pre-captured and stored, the manipulation data having a time sequence and being used to control running of the VR application;

importing the manipulation data into the runtime library according to the time sequence; and

transferring the imported manipulation data to the VR application in the initial running state by using the runtime library and performing playback processing based on the transferred manipulation data.