WIDE AREA AUGMENTED REALITY LOCATION-BASED SERVICES

• US 20150109338A1
• Filed: 10/17/2014
• Published: 04/23/2015
• Est. Priority Date: 10/17/2013
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: McKinnon, David, Wnuk, Kamil, Sudol, Jeremi, Siddiqui, Matheen, Wiacek, John, Song, Bing, Witchey, Nicholas J.
• Granted Patent: US 9,582,516 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: H05K 999/99 dummy group

Abstract

Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.

Claims

1. An augmented reality (AR) content management system comprising:

an area database configured to store area data related to an area of interest;

an AR content database storing AR content objects; and

an AR management engine coupled with area database and the AR content database, and configured to;

obtain a initial map of the area of interest from the area data within the area database;

derive a set of views of interest from the initial map and area data;

obtain a set of AR content objects related to the set of views of interest;

establish AR experience clusters within the initial map as a function the set of AR content objects and the set of view of interest;

generate a tile map of the area based on the AR experience clusters, wherein the tile map comprises a plurality of tessellated tiles covering at least some of the area of interest, and wherein at least one tile of the plurality of tiles is bound to a subset of the set of AR content objects; and

configure a device to obtain at least a portion of the subset of the AR content objects based on the tile map.

2. The system of claim 1, wherein the area data comprises image data.

3. The system of claim 2, wherein the image data comprises still image data.

4. The system of claim 2, wherein the image data comprises video image data.

5. The system of claim 2, wherein the image data comprises real-time image data.

6. The system of claim 1, wherein the area data comprises signal data.

7. The system of claim 6, wherein the area data comprises a composite source signal (CSS).

8. The system of claim 6, wherein the area data comprises a WiFi signal.

9. The system of claim 6, wherein the area data comprises a beacon signal.

10. The system of claim 1, wherein the area of interest comprises an interior setting.

11. The system of claim 10, wherein the interior setting comprises at least one of the following:

an office space, a retail space, an arena, a school, a healthcare facility, a library, a home, and a building.

12. The system of claim 1, wherein the area of interest comprises an outdoor setting.

13. The system of claim 12, wherein the outdoor setting comprises at least one of the following:

a stadium, a park, a wilderness area, an arena, a route, a highway, and a rooftop.

14. The system of claim 1, wherein the initial map comprises a computer aided design (CAD) drawing.

15. The system of claim 1, wherein the initial map comprises a three dimensional representation of the area of interest.

16. The system of claim 1, wherein the initial map comprises a blueprint.

17. The system of claim 1, wherein the AR management engine is further configured to obtain the initial map by generating the initial map.

18. The system of claim 1, wherein at least one view of interest of the set of views of interest comprises a view-point origin.

19. The system of claim 1, wherein at least one view of interest of the set of views of interest comprises at least one field of view.

20. The system of claim 1, wherein at least one view of interest of the set of views of interest comprises at least one of the following:

an owner, metadata, a direction, an orientation, a cost, a search attribute, a descriptor set, and an object of interest.

21. The system of claim 1, wherein at least one view of interest of the set of views of interest comprises a view-point origin, at least one field of view, and an object of interest.

22. The system of claim 1, wherein at least one view of interest of the set of views of interest comprises a view-point origin, at least two fields of view, and an object of interest.

23. The system of claim 1, wherein the set of AR content objects include at least one of the following:

a virtual object, chroma key content, a digital image, a digital video, audio data, an application, a script, a promotion, an advertisement, a game, a workflow, a kinesthetic, a tactile, and a lesson plan.

24. The system of claim 1, wherein the AR management engine is further configured to obtain the set of AR objects based on a characteristic of the initial map.

25. The system of claim 1, wherein the AR management engine is further configured to obtain the set of AR content objects based on a user selection.

26. The system of claim 1, wherein the AR management engine is further configured to obtain the set of AR content objects based on a search query.

27. The system of claim 1, wherein the AR management engine is further configured to obtain the set of AR content objects based on a context of an intended use.

28. The system of claim 1, wherein the AR management engine is further configured to obtain the set of AR content objects based on a recommendation.

29. The system of claim 1, wherein the AR management engine is further configured to obtain the set of AR content objects based on a request.

30. The system of claim 1, wherein the AR management engine is further configured to present at least a portion of the AR content objects on a display of the device.

31. The system of claim 1, wherein at least one of the AR experience clusters represent a subset of the views of interest and associated AR content objects.

32. The system of claim 1, wherein the tessellated tiles comprise non-regular tessellated tiles.

33. The system of claim 1, wherein the device comprises a mobile device.

34. The system of claim 33, wherein the mobile device comprises at least one of a cell phone, a tablet, a watch, and a vehicle.

35. The system of claim 1, wherein the device comprises a server.

36. The system of claim 1, wherein the device is coupled with a cloud server.

37. The system of claim 1, wherein the device composes a data center.

38. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with an identification.

39. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with an owner.

40. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with an object of interest.

41. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with a set of descriptors.

42. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with an advertiser.

43. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with a cost.

44. The system of claim 1, wherein at least one tile of the plurality of tessellated tiles is associated with a time.

45. The system of claim 1, wherein at least two tiles of the plurality of tessellated tiles is dynamic.

46. The system of claim 1, wherein the AR management engine is further configured to cause the mobile device to:

capture a digital representation of a pattern within the area of interest;

derive at least one descriptor from the digital representation of the pattern;

calculate the position of the mobile device as a function of the at least one descriptor; and

determine a tile from the plurality of tiles corresponding to the calculated position.

47. The system of claim 46, wherein the at least one descriptor comprises at least a first section and a second section.

48. The system of claim 47, wherein the first section comprises values associated with an X coordinate in planar space and the second section comprises values associated with a Y coordinate in planar space.