Interference based augmented reality hosting platforms

• US 10,403,051 B2
• Filed: 11/09/2018
• Issued: 09/03/2019
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Soon-Shiong, Patrick
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US16/186,405
• Publication Number:
  US 20190080518A1
• Time in Patent Office: 298 Days
• Field of Search: 345633
• CPC Class Codes: A63F 13/21 characterised by their sensors, purposes or types
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/016 Exploded view
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H05K 999/99 dummy group

Abstract

Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.

Claims

1. An augmented reality (AR) platform system comprising:

an AR object repository storing available AR objects in a first non-transitory computer readable memory; and

an AR server coupled with the AR object repository and, upon execution of software instructions stored in a second non-transitory computer readable memory by a processor, is configured to;

obtain digital data representative of an environment of an AR capable mobile device, the digital data including a device location of the AR capable device and a virtual element attribute;

determine at least one context related to the AR capable device and pertinent to the environment based at least on the device location;

identify relevant AR objects from the AR repository representing available AR objects corresponding to the at least one context;

determine whether to alter presence of a relevant AR object based on at least the device location and the virtual element attribute; and

cause the AR capable device to render the relevant AR object according to its altered presence.

2. The system of claim 1, wherein the first non-transitory computer readable memory is the second non-transitory computer readable memory.

3. The system of claim 1, wherein the AR capable device comprises the AR repository.

4. The system of claim 1, wherein the AR capable device comprises the AR server.

5. The system of claim 1, wherein the AR server is a remote server coupled with the AR capable device via a wireless network.

6. The system of claim 1, wherein the relevant AR objects is caused to be rendered based on a position of the AR capable device relative to the environment.

7. The system of claim 1, wherein the relevant AR objects is caused to be rendered based on an orientation of the AR capable device relative to the environment.

8. The system of claim 1, wherein the relevant AR objects is caused to be rendered within an AR game.

9. The system of claim 1, wherein the relevant AR objects is caused to be rendered by superimposing a visual image of at least one relevant AR object over an image of the environment.

10. The system of claim 1, wherein the relevant AR objects is caused to be rendered within an overlapping augmented reality among multiple AR capable devices.

11. The system of claim 10, wherein the overlapping augmented reality comprises a team-based augmented reality.

12. The system of claim 1, wherein common attributes of the available AR objects and a gaming context adhere to a common namespace.

13. The system of claim 1, wherein common attributes include location attributes.

14. The system of claim 13, wherein the location attributes include GPS coordinates.

15. The system of claim 1, wherein the relevant AR objects is caused to be rendered according to a haptic format.

16. The system of claim 1, wherein the presence of the relevant AR object is enhanced.

17. The system of claim 1, wherein the presence of the relevant AR object is suppressed.

18. The system of claim 1, wherein the presence of the relevant AR object is altered to include a non-visible presence.

19. The system of claim 18, wherein the non-visible presence comprises a tactile presentation.

20. The system of claim 1, wherein virtual elements relate to virtual attributes.

21. The system of claim 1, wherein the virtual element attribute comprises at least some common attributes.

22. The system of claim 1, wherein the determination of whether to alter presence of the relevant AR depends on a time.

23. The system of claim 22, wherein the presence alteration of the relevant AR changes with the time.

24. The system of claim 1, wherein the AR server is further configured to enable the AR capable device to conduct a commercial transaction with a commerce engine.

25. The system of claim 24, wherein the commercial transaction includes an exchange of virtual currency.

26. The system of claim 24, wherein the commercial transaction includes a transfer of real-world funds.

27. The system of claim 1, wherein the AR server is further configured to enable the AR capable device to populate the environment with at least one of the relevant AR objects.

28. The system of claim 1, wherein the environment comprises an AR environment.

29. The system of claim 28, wherein the AR environment includes real-world elements and virtual elements.

30. The system of claim 28, wherein the interference further depends on real-world element attributes of the real-world elements.

31. The system of claim 30, wherein the real-world elements include a game goal.

32. The system of claim 31, wherein, upon sensing the game goal, the server is further configured to cause presentation of a game reward on the AR capable device.

33. The system of claim 31, wherein the game goal includes a real-world sign.

34. The system of claim 1, wherein the AR server is further configured to enable the AR capable device to have an interaction with at least one of the rendered relevant AR objects.

35. The system of claim 34, wherein the interaction includes at least one of the following:

executing instructions of the at least one rendered relevant AR objects, presenting AR content via at least one of a speaker or tactile interface depending on nature of AR content, sharing an AR object with other devices, presenting a purchasable product, incorporating a shopping context, allowing access to data records, allowing a user to link to object information via an AR object, interacting with a remote computing device, and managing AR objects.

36. The system of claim 1, wherein the mobile device is a cell phone.

37. The system of claim 1, wherein the mobile device is a vehicle.

38. The system of claim 1, wherein the mobile device is a tablet computer.

39. The system of claim 1, wherein the mobile device is a PDA.

40. The system of claim 1, wherein the mobile device is a portable computer.

41. The system of claim 1, wherein the mobile device is an appliance.

42. The system of claim 1, wherein the mobile device comprises an AR-related API.

43. An Augmented Reality (AR) server coupled with an AR object repository and configured to:

obtain digital data representative of an environment of an AR capable mobile device, the digital data including a device location of the AR capable device and a virtual element attribute;

determine at least one context related to the AR capable device and pertinent to the environment based at least on the device location;

identify relevant AR objects from the AR repository representing available AR objects corresponding to the at least one context;

determine whether to make present relevant AR objects based on at least the device location and the virtual element attribute; and

cause the AR capable device to render one or more of the relevant AR objects if they have been determined to be made present.

44. A non-transitory computer readable memory storing instructions that, when executed by a processor, cause the processor to perform a method comprising:

obtaining digital data representative of an environment of an AR capable mobile device, the digital data including a device location of the AR capable device and a virtual element attribute;

determining at least one context related to the AR capable device and pertinent to the environment based at least on the device location;

identifying relevant AR objects from the AR repository representing available AR objects corresponding to the at least one context;

determining whether to make present relevant AR objects based on at least the device location and the virtual element attribute; and

causing the AR capable device to render one or more of the relevant AR objects if they have been determined to be made present.