Augmented reality system with agent device for viewing persistent content and method of operation thereof

• US 10,335,677 B2
• Filed: 12/10/2015
• Issued: 07/02/2019
• Est. Priority Date: 12/23/2014
• Status: Active Grant

• Current Assignee: Matthew Daniel Fuchs
• Original Assignee: Matthew Daniel Fuchs
• Inventors: Fuchs, Matthew Daniel
• Primary Examiner(s): Pringle-Parker, Jason A
• Application Number:
  US14/965,006
• Publication Number:
  US 20160180602A1
• Time in Patent Office: 1,300 Days
• Field of Search: None
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/69 by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
• CPC Class Codes: A63F 13/73 Authorising game programs or game devices, e.g. checking authenticity
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A system and method of operation of an augmented reality system includes: a position sensor for calculating a current location; an orientation sensor, coupled to the position sensor, for calculating a current orientation; and a control mechanism, coupled to the position sensor, for presenting a system object based on the current location, the current orientation, an object location, an object orientation, an access right, a visibility, and a persistence.

Claims

1. A method of operation for an augmented reality system comprising:

configuring an agent device to detect a current location using a position sensor and a current orientation using an orientation sensor, the current location is a current real-world location;

detecting an entry point between a first frame of reference and a second frame of reference, the entry point within a detection threshold of the current location;

accessing the second frame of reference from the first frame of reference by entering the entry point;

detecting a system object in the second frame of reference;

retrieving a content associated with the system object;

calculating a persistence of the system object based on a current time less than a persistence extent;

calculating a visibility of the system object for the agent device having a role matching a visibility access right; and

presenting real world imagery with an overlay of content associated with the system object to a viewing unit of the agent device based on the persistence and the visibility.

2. The method as claimed in claim 1 wherein calculating the visibility includes calculating the visibility based on theft role associated with the agent device.

3. The method as claimed in claim 1 wherein calculating the visibility includes calculating the visibility based on theft role associated with the agent device, where the role includes a token set and the access right for accessing the system object.

4. The method as claimed in claim 1 further comprising:

generating a query result for a query operation based on a query search term and the current location; and

detecting the entry point of the second frame of reference within the query result.

5. The method as claimed in claim 1 wherein presenting the content of the system object includes displaying the system object based on display information from an external data system.

6. A method of operation for an augmented reality system comprising:

configuring an agent device to detect a current location using a position sensor of the agent device and a current orientation using an orientation sensor of the agent device, and the current location is a current real-world location;

detecting an entry point between a first frame of reference and a second frame of reference, the entry point within a detection threshold of the current location;

accessing the second frame of reference from the first frame of reference by entering the entry point;

detecting a system object having an object location in the second frame of reference;

retrieving a content associated with the system object;

calculating a persistence of the system object based on the current time less than or equal to a persistence extent of the system object;

calculating a visibility of the system object at the agent device based on the point of interest, an access right, and the object location;

presenting real world imagery with an overlay of the content associated with the system object to a viewing unit of the agent device based on the current location, the current orientation, the persistence, and the visibility; and

performing an action on an external device associated with the system object.

7. The method as claimed in claim 6 wherein calculating the visibility includes calculating the visibility based on the object location, the current location, and the current orientation.

8. The method as claimed in claim 6 wherein calculating the visibility includes calculating the visibility based on theft role associated with the agent device where the role includes a token set having the access right for viewing the system object.

9. The method as claimed in claim 6 wherein the first frame of reference is based on geographical coordinates and the second frame of reference is based on a building-room based coordinate system.

10. The method as claimed in claim 6 wherein displaying the system object includes displaying the system object based on display information from a gaming system.

11. An augmented reality system comprising:

a position sensor configured to calculate a current location, the current location is a real-world location;

an orientation sensor configured to calculate a current orientation;

a storage device configured to store information about a system object including a persistence extent;

an agent device, coupled to the position sensor and the orientation sensor, having a viewing unit, and wherein;

the agent device is configured to detect an entry point between a first frame of reference and a second frame of reference within a detection threshold of the current location, to detect a system object in the second frame of reference, to retrieve a content associated with the system object from the storage device, to calculate a persistence of the system object based on a current time less than the persistence extent, to calculate a visibility of the system object for the agent device having a role matching a visibility access right, and to present real world imagery with an overlay of the content on the viewing unit based on the persistence and visibility of the system object.

12. The system as claimed in claim 11 wherein the visibility is based on the role associated with the agent device.

13. The system as claimed in claim 11 wherein the visibility is based on the role associated with the agent device where the role includes a token set and the access right for accessing the system object.

14. The system as claimed in claim 11 wherein the system object is associated with a point of interest in the second frame of reference.

15. The system as claimed in claim 11 wherein the system object is presented based on display information from an external data system.

16. The system as claimed in claim 11 further comprising:

a external device, coupled to the system object, configured to receive an action instruction from the agent device.

17. The system as claimed in claim 16 wherein the visibility is based on the object location, the current location, and the current orientation.

18. The system as claimed in claim 16 wherein the visibility is based on the role associated with the agent device where the role includes a token set having the access right for viewing the system object.

19. The system as claimed in claim 16 wherein the first frame of reference is based on geographical coordinates and the second frame of reference is based on a building-room based coordinate system.

20. The system as claimed in claim 16 wherein the system object is displayed based on display information from a gaming system.