Interference based augmented reality hosting platforms

• US 10,127,733 B2
• Filed: 10/17/2017
• Issued: 11/13/2018
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Soon-Shiong, Patrick
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US15/786,242
• Publication Number:
  US 20180040168A1
• Time in Patent Office: 392 Days
• CPC Class Codes: A63F 13/21 characterised by their sensors, purposes or types
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/016 Exploded view
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H05K 999/99 dummy group

Abstract

Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.

Claims

1. An augmented reality (AR) platform system comprising:

an AR object repository storing available AR objects in a first non-transitory computer readable memory; and

an AR server coupled with the AR object repository and, upon execution of software instructions stored in a second non-transitory computer readable memory by a processor, is configured to;

obtain digital data representative of an environment of an AR capable mobile device, the digital data including a device location of the AR capable device, user attributes and virtual element attributes of virtual elements considered proximate to the AR capable device;

determine a context related to the AR capable device and pertinent to the environment based at least on the device location;

identify relevant AR objects from the AR repository representing available AR objects having common attributes germane to the context;

determine degrees of presence for relevant AR objects based on at least the device location, user attributes, and virtual element attributes; and

cause the AR capable device to render at least some of the relevant AR objects according to their corresponding degrees of presence.

2. The system of claim 1, wherein the first non-transitory computer readable memory is the second non-transitory computer readable memory.

3. The system of claim 1, wherein the AR capable mobile device comprises the AR repository.

4. The system of claim 1, wherein the AR capable mobile device comprises the AR server.

5. The system of claim 1, wherein the AR server is a remote server coupled with the AR capable device via a wireless network.

6. The system of claim 1, wherein the at least some of the relevant AR objects are caused to be rendered based on a position of the AR capable mobile device relative to the environment.

7. The system of claim 1, wherein the at least some of the relevant AR objects are caused to be rendered based on an orientation of the AR capable mobile device relative to the environment.

8. The system of claim 1, wherein the at least some of the relevant AR objects are caused to be rendered within an AR game.

9. The system of claim 1, wherein the at least some of the relevant AR objects are caused to be rendered by superimposing a visual image of at least one relevant AR object over an image of the environment.

10. The system of claim 1, wherein the at least some of the relevant AR objects are caused to be rendered within an overlapping augmented reality among multiple AR capable devices.

11. The system of claim 10, wherein the overlapping augmented reality comprises a team-based augmented reality.

12. The system of claim 1, wherein the common attributes of the available AR objects and a gaming context adhere to a common namespace.

13. The system of claim 1, wherein the common attributes include location attributes.

14. The system of claim 13, wherein the location attributes include GPS coordinates.

15. The system of claim 1, wherein the at least some of the relevant AR objects are caused to be rendered according to a haptic format.

16. The system of claim 1, wherein the degrees of presence include an enhanced presence.

17. The system of claim 1, wherein the degrees of presence include a suppressed presence.

18. The system of claim 1, wherein the degrees of presence include non-visible presence.

19. The system of claim 18, wherein the non-visible presence comprises a tactile presentation.

20. The system of claim 1, wherein the virtual elements considered proximate to the AR capable device include at least some of the relevant AR objects.

21. The system of claim 1, wherein the virtual element attributes comprise at least some of the common attributes.

22. The system of claim 1, wherein the degrees of presence depend on a time.

23. The system of claim 22, wherein the degrees of presence change with time.

24. The system of claim 1, wherein the AR server is further configured to enable the AR capable mobile device to conduct commercial transactions with a commerce engine.

25. The system of claim 24, wherein the commercial transaction includes an exchange of virtual currency.

26. The system of claim 24, wherein the commercial transaction includes a transfer of real-world funds.

27. The system of claim 1, wherein the AR server is further configured to enable the AR capable mobile device to populate the environment with at least one of the relevant AR objects.

28. The system of claim 1, wherein the environment comprises an AR environment.

29. The system of claim 28, wherein the AR environment included real-world elements and the virtual elements.

30. The system of claim 28, wherein the degrees of presence further depend on real-world element attributes of the real-world elements.

31. The system of claim 30, wherein the real-world elements include a game goal.

32. The system of claim 31, wherein, upon sensing the game goal, the server is further configured to cause presentation of a game reward on the AR capable mobile device.

33. The system of claim 31, wherein the game goal includes a real-world sign.

34. The system of claim 1, wherein the AR server is further configured to enable the AR capable mobile device to have an interaction with at least one of the rendered relevant AR objects.

35. The system of claim 1, wherein the interaction includes at least one of the following:

executing instructions of the at least one rendered relevant AR objects, presenting AR content via at least one of a speaker or tactile interface, sharing an AR object with other devices, presenting a purchasable product, incorporating a shopping context, allowing access to data records, allowing a user to link to object information via an AR object, interacting with a remote computing device, and managing AR objects.

36. The system of claim 1, wherein the AR capable mobile device is a cell phone.

37. The system of claim 1, wherein the AR capable mobile device is a vehicle.

38. The system of claim 1, wherein the AR capable mobile device is a tablet computer.

39. The system of claim 1, wherein the AR capable mobile device is a PDA.

40. The system of claim 1, wherein the AR capable mobile device is a portable computer.

41. The system of claim 22, wherein the AR capable mobile device is an appliance.

42. The system of claim 22, wherein the AR-capable mobile device comprises an AR-related API.

43. An Augmented Reality (AR) server coupled with an AR object repository and configured to:

obtain digital data representative of an environment of an AR capable mobile device, the digital data including a device location of the AR capable device, user attributes and virtual element attributes of virtual elements considered proximate to the AR capable device;

determine a context related to the AR capable device and pertinent to the environment based at least on the device location;

identify relevant AR objects from the AR repository representing available AR objects having common attributes germane to the context;

determine degrees of presence for relevant AR objects based on at least the device location, user attributes, and virtual element attributes; and

cause the AR capable device to render at least some of the relevant AR objects according to their corresponding degrees of presence.

44. A non-transitory computer readable memory storing instructions that, when executed by a processor, cause the processor to perform a method comprising:

obtaining digital data representative of an environment of an AR capable mobile device, the digital data including a device location of the AR capable device, user attributes and virtual element attributes of virtual elements considered proximate to the AR capable device;

determining a context related to the AR capable device and pertinent to the environment based at least on the device location;

identifying relevant AR objects from an AR repository representing available AR objects having common attributes germane to the context;

determining degrees of presence for relevant AR objects based on at least the device location, user attributes, and virtual element attributes; and

causing the AR capable device to render at least some of the relevant AR objects according to their corresponding degrees of presence.