Systems and methods for sharing augmentation data

• US 10,713,846 B2
• Filed: 11/29/2012
• Issued: 07/14/2020
• Est. Priority Date: 10/05/2012
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Fein, Gene, Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Rinaldo, Jr., John D., Tegreene, Clarence T.
• Primary Examiner(s): Patel, Shivang I
• Application Number:
  US13/689,372
• Publication Number:
  US 20140098129A1
• Time in Patent Office: 2,784 Days
• Field of Search: 345633
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Computationally implemented methods and systems include acquiring one or more first augmentations for inclusion in a first augmented view of a first scene, displaying the first augmented view including the one or more first augmentations, and transmitting augmentation data associated with the one or more first augmentations to facilitate remote display of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that are also included in the first scene. In addition to the foregoing, other aspects are described in the claims, drawings, and text.

Claims

1. A computationally-implemented method comprising:

performing recognition at a first augmented reality device to identify a real-world visual item that is physically present within a real-world environment visible within a field of view of the first augmented reality device;

acquiring one or more augmentations regarding the real-world visual item that is physically present within the real-world environment at the first augmented reality device via a wireless broadcast from a source local to the real-world visual item;

displaying, via the first augmented reality device, an augmented view including the one or more augmentations regarding the real-world visual item; and

transmitting the one or more augmentations regarding the real-world visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the real-world visual item in response to detection of a different instance of the real-world visual item within a second field of view of a second real-world environment viewed by the at least one second augmented reality device.

2. The computationally-implemented method of claim 1, further comprising:

soliciting the one or more augmentations.

3. The computationally-implemented method of claim 1, wherein said acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item, in response to presence at a location.

4. The computationally-implemented method of claim 1, wherein said acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item, wherein the visual item comprises a face.

5. The computationally-implemented method of claim 1, wherein said transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item.

6. The computationally-implemented method of claim 5, wherein said transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item, the one or more format rules requiring formatting of the one or more augmentations in one or more particular ways in order to prevent one or more items from being obfuscated.

7. The computationally-implemented method of claim 5, wherein the transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item, the one or more format rules requiring the one or more augmentations to be at least semi-transparent.

8. The computationally-implemented method of claim 5, wherein the transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more format rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item, the one or more format rules requiring the one or more augmentations to be located in one or more particular locations.

9. The computationally-implemented method of claim 1, wherein said transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of a modified version of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item.

10. The computationally-implemented method of claim 1, further comprising:

after transmitting the one or more augmentations regarding the real-world visual item and one or more visibility rules to at least one second augmented reality device, receiving at the first augmented reality device usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device; and

displaying one or more additional augmentations within the field of view of the first augmented reality device in response to said usage/non-usage data.

11. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving via a wireless network usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device.

12. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving usage/non-usage data that indicates reception of the one or more augmentations by the at least one second augmented reality device.

13. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving usage/non-usage data that indicates remote display of the one or more augmentations by the at least one second augmented reality device.

14. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving usage/non-usage data that indicates one or more modifications applied to the one or more augmentations by the at least one second augmented reality device.

15. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving usage/non-usage data that indicates one or more formats of the one or more augmentations displayed by the at least one second augmented reality device.

16. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving usage/non-usage data that indicates content of the one or more augmentations displayed by the at least one second augmented reality device.

17. The computationally-implemented method of claim 10, wherein said receiving usage/non-usage data that indicates remote usage and/or non-usage of the one or more augmentations by the at least one second augmented reality device comprises:

receiving usage/non-usage data that indicates hiding or obfuscation caused by the one or more augmentations at the at least one second augmented reality device.

18. The computationally-implemented method of claim 10, wherein said displaying one or more additional augmentations in response to said usage/non-usage data comprises:

displaying one or more additional augmentations that indicate the one or more augmentations have been remotely displayed by the at least one second augmented reality device.

19. The computationally-implemented method of claim 10, wherein said displaying one or more additional augmentations in response to said usage/non-usage data comprises:

displaying one or more additional augmentations that are a modified version or versions of the one or more augmentations.

20. The computationally-implemented method of claim 10, wherein said displaying one or more additional augmentations in response to said usage/non-usage data comprises:

displaying one or more additional augmentations that indicate one or more differences between the one or more augmentations displayed at the at least one second augmented reality device.

21. The computationally-implemented method of claim 10, wherein said displaying one or more additional augmentations in response to said usage/non-usage data comprises:

displaying one or more additional augmentations that indicate that at least a portion of the one or more augmentations have now been hidden or obfuscated.

22. The computationally-implemented method of claim 10, wherein said displaying one or more additional augmentations in response to said usage/non-usage data comprises:

displaying one or more additional augmentations that indicate that the one or more augmentations that were hidden or obfuscated have again been redisplayed.

23. The computationally-implemented method of claim 10, wherein said displaying one or more additional augmentations in response to said usage/non-usage data comprises:

displaying one or more additional augmentations that indicate one or more degrees of correspondence with the one or more augmentations displayed by the at least one second augmented reality device.

24. The computationally-implemented method of claim 1, further comprising:

receiving data that provides information related to one or more remotely displayed augmentations;

outputting one or more additional augmentations that indicate one or more degrees of correspondence between the one or more augmentations and the one or more remotely displayed augmentations.

25. The method of claim 1, further comprising:

receiving one or more wireless signals emitted from one or more wireless transmitters including the one or more augmentations and identification of a face for which the one or more augmentations are associated.

26. The method of claim 1, further comprising:

storing to memory the one or more augmentations for inclusion in the first augmented view of the first real-world scene in an event that the visual item is recognized.

27. The method of claim 1, further comprising:

displaying at the first augmented reality device one or more additional augmentations indicating usage data associated with the at least one second augmented reality device.

28. The method of claim 1, wherein the acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item, the one or more augmentations regarding a name and a background summary of an individual.

29. The method of claim 1, wherein the acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a transmitter physically present with the visual item.

30. The method of claim 1, wherein the transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item, the one or more visibility rules providing identification information for the visual item and format information for the one or more augmentations.

31. The method of claim 1, wherein the acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a router device local to the visual item.

32. The method of claim 1, wherein the acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

downloading one or more augmentations regarding the visual item at the first augmented reality device from a source local to the visual item.

33. The method of claim 1, wherein the acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a source local to the visual item comprises:

acquiring one or more augmentations regarding the visual item at the first augmented reality device via a wireless broadcast from a device positioned at a geographical location of the visual item.

34. The method of claim 1, wherein the transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item comprises:

transmitting the one or more augmentations regarding the visual item and one or more visibility rules to at least one second augmented reality device that is geographically remote from the first augmented reality device to facilitate display of the one or more augmentations regarding the visual item in response to detection of a different instance of the visual item, wherein the at least one second augmented reality device is outside a communication range of the source local to the visual item.

35. A computationally-implemented system comprising:

at least one computing device; and

one or more instructions that, when executed by the at least one computing device, program the at least one computing device for;

performing recognition at a first augmented reality device to identify a real-world visual item that is physically present within a real-world environment visible within a field of view of the first augmented reality device;

acquiring, at the first augmented reality device, one or more augmentations received from one or more wireless transmitters located within broadcast range to the real-world visual item, the one or more augmentations providing information regarding the real-world visual item that is physically present within the real-world environment;

displaying, via the first augmented reality device, a first augmented view of a first real-world scene including the one or more augmentations in association with the real-world visual item; and

transmitting the one or more augmentations to at least one second augmented reality device that is remote from the first augmented reality device to facilitate display of at least part of the one or more augmentations within a second augmented view of a second real-world scene viewed by the at least one second augmented reality device that includes at least one substantially similar additional instance of the real-world visual item.

36. A system comprising:

circuitry configured for performing recognition at a first augmented reality device to identify a real-world visual item that is physically present within a real-world environment visible within a field of view of the first augmented reality device;

circuitry configured for acquiring, at the first augmented reality device, one or more augmentations received from one or more wireless transmitters located within broadcast range to the real-world visual item, the one or more augmentations providing information regarding the real-world visual item that is physically present within the real-world environment;

circuitry configured for displaying, via the first augmented reality device, a first augmented view of a first real-world scene including the one or more augmentations in association with the real-world visual item; and

circuitry configured for transmitting the one or more augmentations to at least one second augmented reality device that is remote from the first augmented reality device to facilitate display of at least part of the one or more augmentations within a second augmented view of a second real-world scene viewed by the at least one second augmented reality device that includes at least one substantially similar additional instance of the real-world visual item.