System and method for displaying AR content

• US 10,419,566 B2
• Filed: 01/31/2018
• Issued: 09/17/2019
• Est. Priority Date: 01/24/2018
• Status: Active Grant

• Current Assignee: Veeva Systems Incorporated
• Original Assignee: Veeva Systems Incorporated
• Inventors: Sosna, Arno, Murphy, Timothy S., Juotasniemi, Martti, Davuluri, Srinivasa S.
• Primary Examiner(s): Pollack, Melvin H
• Application Number:
  US15/885,623
• Publication Number:
  US 20190230177A1
• Time in Patent Office: 594 Days
• Field of Search: 709246
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

The system and method described allow AR content to be packaged according to the CLM packaging structure and loaded to a content management system without coding, and allow the AR content to be viewed directly with a CLM content player without requiring build or patch distribution processes. The content creator may define a standard configuration with a JSON file based on the guidelines and parameters of the CLM packaging structure. Users may view and place AR content over a physical world video using a camera in a user computing device, and move, rotate, zoom in and zoom out the AR content.

Claims

1. A machine-implemented method for displaying AR content, the method comprising:

receiving a first piece of AR content and a description file of the first piece of AR content from an AR content distribution system over a network, wherein the AR content distribution system comprises a controlled content repository and a customer relationship management (CRM) system, wherein the first piece of AR content and the description file of the first piece of AR content are packaged according to a first packaging structure of the AR content distribution system, wherein the first packaging structure of the AR content distribution system comprises a packaging structure of a closed loop marketing (CLM) system, wherein the description file of the first piece of AR content describes the first piece of AR content and defines interactions with the first piece of AR content in an AR environment, and wherein an access control rule of the CRM system is applied to the first piece of AR content to configure its accessibility by a first user and a second user; and

storing the packaged first piece of AR content and the description file of the first piece of AR content in a local storage of a user computing device.

2. The method of claim 1, further comprising:

receiving a request for displaying the first piece of AR content in an AR environment.

3. The method of claim 2, further comprising:

enabling display of a menu of configurable AR models, wherein the first piece of AR content is displayed as a thumbnail in the menu of configurable AR models.

4. The method of claim 3, further comprising:

receiving a request for displaying the first piece of AR content on the menu of configurable AR models, and rendering the first piece of AR content based on the first packaging structure.

5. The method of claim 4, further comprising:

sending the rendered first piece of AR content to an AR controller to enable the AR controller to display the first piece of AR content in an AR environment.

6. The method of claim 5, further comprising:

receiving on a user interface, which displays the first piece of AR content in an AR environment, a request for manipulating the first piece of AR content.

7. The method of claim 6, further comprising:

re-rendering the first piece of AR content in response to the request for manipulating the first piece of AR content, and sending re-rendered first piece of AR content to the AR controller to enable the AR controller to display the re-rendered first piece of AR content in the AR environment.

8. The method of claim 6, wherein the request for manipulating the first piece of AR content comprises:

moving the first piece of AR content, zooming in and zooming out.

9. The method of claim 5, further comprising:

adding information of display of the first piece of AR content to a call report.

10. The method of claim 1, wherein the description file of the first piece of AR content is a JSON file.

11. The method of claim 1, wherein the description file of the first piece of AR content is a file for creating a content menu for controlling the first piece of AR content in the AR environment.

12. The method of claim 1, wherein the description file of the first piece of AR content defines a media type of the first piece of AR content to enable presentation of the first piece of AR content in the AR environment.

13. The method of claim 1, wherein the first piece of AR content and the description file of the first piece of AR content are packaged into a .zip file.

14. The method of claim 1, wherein the description file of the first piece of AR content comprises metadata of the first piece of AR content.

15. The method of claim 1, wherein the description file of the first piece of AR content is based on parameters of the first packaging structure.

16. An AR content controller for:

receiving a first piece of AR content and a description file of the first piece of AR content from an AR content distribution system over a network, wherein the AR content distribution system comprises a controlled content repository and a customer relationship management (CRM) system, wherein the first piece of AR content and the description file of the first piece of AR content are packaged according to a first packaging structure of the AR content distribution system, wherein the first packaging structure of the AR content distribution system comprises a packaging structure of a closed loop marketing (CLM) system, wherein the description file of the first piece of AR content describes the first piece of AR content and defines interactions with the first piece of AR content in an AR environment; and

wherein an access control rule of the CRM system is applied to the first piece of AR content to configure its accessibility by a first user and a second user.

17. The AR content controller of claim 16, further rendering the first piece of AR content in response to a request based on the first packaging structure.

18. The AR content controller of claim 17, further sending the rendered first piece of AR content to an AR controller to enable the AR controller to display the first piece of AR content in an AR environment.