Systems and methods for sharing augmentation data

• US 9,105,126 B2
• Filed: 11/30/2012
• Issued: 08/11/2015
• Est. Priority Date: 10/05/2012
• Status: Expired due to Fees

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Fein, Gene, Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Rinaldo, John D. Jr., Tegreene, Clarence T.
• Primary Examiner(s): Zarka, David
• Assistant Examiner(s): PRINGLE-PARKER, JASON A
• Application Number:
  US13/690,003
• Publication Number:
  US 20140098130A1
• Time in Patent Office: 984 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Computationally implemented methods and systems include acquiring one or more first augmentations for inclusion in a first augmented view of a first scene, displaying the first augmented view including the one or more first augmentations, and transmitting augmentation data associated with the one or more first augmentations to facilitate remote display of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that are also included in the first scene. In addition to the foregoing, other aspects are described in the claims, drawings, and text.

Claims

1. A system, comprising:

one or more display monitors;

an augmentation procuring module configured to procure one or more first augmentations for inclusion in a first augmented view of a first scene;

an augmented view presenting module configured to present the first augmented view through the one or more display monitors, the first augmented view to be presented including the one or more first augmentations;

an augmentation data relaying module configured to relay, via one or more wireless and/or wired networks, augmentation data associated with the one or more first augmentations to an augmented reality (AR) device to facilitate remote display at the AR device of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that mirror or are the same as one or more first visual items included in the first scene;

a usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data; and

wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data.

2. The system of claim 1, wherein said augmentation procuring module configured to procure one or more first augmentations for inclusion in a first augmented view of a first scene comprises:

an augmentation procuring module configured to procure the one or more first augmentations from one or more sources associated with the first scene.

3. The system of claim 2, wherein said augmentation procuring module configured to procure the one or more first augmentations from one or more sources associated with the first scene comprises:

an augmentation procuring module including an associated party ascertaining module configured to procure the one or more first augmentations from the one or more sources by procuring the one or more first augmentations from one or more parties that were ascertained by the associated party ascertaining module to be associated with the first scene.

4. The system of claim 3, wherein said augmentation procuring module including an associated party ascertaining module configured to procure the one or more first augmentations from the one or more sources by procuring the one or more first augmentations from one or more parties that were ascertained by the associated party ascertaining module to be associated with the first scene comprises:

an augmentation procuring module including a location associated party ascertaining module configured to procure the one or more first augmentations from the one or more parties that were ascertained by the location associated party ascertaining module to be associated with one or more locations associated with the first scene.

5. The system of claim 3, wherein said augmentation procuring module including an associated party ascertaining module configured to procure the one or more first augmentations from the one or more sources by procuring the one or more first augmentations from one or more parties that were ascertained by the associated party ascertaining module to be associated with the first scene comprises:

an augmentation procuring module including an associated party ascertaining module configured to procure the one or more first augmentations from the one or more parties that were ascertained by the associated party ascertaining module to be associated with the first scene, the ascertaining by the associated party ascertaining module being based on one or more received wireless signals transmitted by one or more network sources associated with the one or more parties.

6. The system of claim 2, wherein said augmentation procuring module configured to procure the one or more first augmentations from one or more sources associated with the first scene comprises:

an associated party ascertaining module configured to determine the one or more sources associated with the first scene;

an augmentation seeking module configured to seek from the one or more sources the one or more first augmentations; and

an augmentation obtaining module configured to obtain the one or more first augmentations from the one or more sources in response to the soliciting.

7. The system of claim 1, wherein said augmentation procuring module configured to procure one or more first augmentations for inclusion in a first augmented view of a first scene comprises:

an augmentation procuring module including a visual item sensing module configured to procure the one or more first augmentations in response, at least in part, to sensing by the visual item sensing module of the presence of one or more visual items in the first scene.

8. The system of claim 1, wherein said augmentation procuring module configured to procure one or more first augmentations for inclusion in a first augmented view of a first scene comprises:

an augmentation procuring module including a scene location detecting module configured to procure the one or more first augmentations in response, at least in part, to a detected location of the first scene as detected by the scene location detecting module.

9. The system of claim 1, wherein said augmentation data relaying module configured to relay, via one or more wireless and/or wired networks, augmentation data associated with the one or more first augmentations to an augmented reality (AR) device to facilitate remote display at the AR device of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that mirror or are the same as one or more first visual items included in the first scene comprises:

an augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations that provide information for presenting the one or more second augmentations.

10. The system of claim 9, wherein said augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations that provide information for presenting the one or more second augmentations comprises:

a content information augmentation data relaying module configured to relay to the AR device the augmentation data that provide content information of the one or more first augmentations.

11. The system of claim 9, wherein said augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations that provide information for presenting the one or more second augmentations comprises:

a format information augmentation data relaying module configured to relay to the AR device the augmentation data that provide format information of the one or more first augmentations.

12. The system of claim 11, wherein said format information augmentation data relaying module configured to relay to the AR device the augmentation data that provide format information of the one or more first augmentations comprises:

a visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires formatting of the one or more second augmentations in one or more particular ways in order to prevent one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view of the second scene.

13. The system of claim 12, wherein said visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires formatting of the one or more second augmentations in one or more particular ways in order to prevent one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view of the second scene comprises:

a visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires the one or more second augmentations to be at least semi-transparent in the second augmented view in order to prevent the one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view.

14. The system of claim 13, wherein said visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires the one or more second augmentations to be at least semi-transparent in the second augmented view in order to prevent the one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view comprises:

a visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires the one or more second augmentations that contain content information that is also included in the one or more first augmentations to be excluded in the second augmented view, the one or more visibility rules further requiring the second augmented view to include one or more third augmentations that does not include the content information.

15. The system of claim 12, wherein said visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires formatting of the one or more second augmentations in one or more particular ways in order to prevent one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view of the second scene comprises:

a visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires the one or more second augmentations to be located in one or more particular locations in the second augmented view in order to prevent the one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view.

16. The system of claim 12, wherein said visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires formatting of the one or more second augmentations in one or more particular ways in order to prevent one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view of the second scene comprises:

a visibility rule relaying module configured to relay to the AR device one or more visibility rules that identifies the one or more visible items.

17. The system of claim 12, wherein said visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires formatting of the one or more second augmentations in one or more particular ways in order to prevent one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view of the second scene comprises:

a visibility rule relaying module configured to relay to the AR device one or more visibility rules that requires the one or more second augmentations to be at least semi-transparent or located in one or more particular locations in the second augmented view in order to prevent the one or more visible items in the second scene from being obfuscated by the one or more second augmentations in the second augmented view and in response at least on a location associated with the second scene.

18. The system of claim 1, wherein said augmentation data relaying module configured to relay, via one or more wireless and/or wired networks, augmentation data associated with the one or more first augmentations to an augmented reality (AR) device to facilitate remote display at the AR device of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that mirror or are the same as one or more first visual items included in the first scene comprises:

an augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations to facilitate remote display at the AR device of the one or more second augmentations that are the same as the one or more first augmentations.

19. The system of claim 18, wherein said augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations to facilitate remote display at the AR device of the one or more second augmentations that are at least substantially same as the one or more first augmentations comprises:

an augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations to facilitate remote display at the AR device of the one or more second augmentations that are the same as the one or more first augmentations.

20. The system of claim 18, wherein said augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations to facilitate remote display at the AR device of the one or more second augmentations that are at least substantially same as the one or more first augmentations comprises:

an augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations to facilitate remote display at the AR device of the one or more second augmentations that include the same content as the one or more first augmentations.

21. The system of claim 1, wherein said augmentation data relaying module configured to relay, via one or more wireless and/or wired networks, augmentation data associated with the one or more first augmentations to an augmented reality (AR) device to facilitate remote display at the AR device of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that mirror or are the same as one or more first visual items included in the first scene comprises:

an augmentation data relaying module configured to relay to the AR device the augmentation data associated with the one or more first augmentations to facilitate remote display at the AR device of the one or more second augmentations that are modified version or versions of the one or more first augmentations.

22. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a network acquiring module configured to acquire the augmentation usage/non-usage data via one or more wireless and/or wired networks.

23. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a successful reception indicating data acquiring module configured to acquire data that indicate successful reception of the transmitted augmentation data by an augmented reality device that the augmentation data was transmitted to.

24. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a remotely displayed indicating data acquiring module configured to acquire data that indicate that the one or more second augmentations have been remotely displayed.

25. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a modification indicating data acquiring module configured to acquire data that indicate one or more modifications that were applied to the one or more first augmentations in order to generate the one or more second augmentations.

26. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a format indicating data acquiring module configured to acquire data that indicate one or more formats of the one or more second augmentations that were remotely displayed.

27. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a content information acquiring module configured to acquire data that provide content information included in the one or more second augmentations that were remotely displayed.

28. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a usage/non-usage data acquiring module configured to acquire data that indicate that the one or more second augmentations that were remotely displayed have been made to be content-free.

29. The system of claim 1, wherein said usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data comprises:

a usage/non-usage data acquiring module configured to acquire data that indicate that the one or more second augmentations that were previously remotely displayed have now been hidden or obfuscated.

30. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises:

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate that the relayed augmentation data has been successfully relayed to the AR device.

31. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises:

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate that the one or more second augmentations have been remotely displayed at the AR device.

32. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises:

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that are modified version or versions of the one or more first augmentations and that directly or indirectly indicate that the one or more second augmentations have been remotely displayed at the AR device.

33. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises:

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate one or more differences between the one or more first augmentations and the one or more second augmentations that were remotely displayed at the AR device.

34. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate that the one or more second augmentations that were remotely displayed at the AR device was one or more non-informational augmentations.

35. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises:

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate that the one or more second augmentations that were previously remotely displayed at the AR device have now been hidden or obfuscated by the AR device.

36. The system of claim 35, wherein said augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate that the one or more second augmentations that were previously remotely displayed at the AR device have now been hidden or obfuscated by the AR device comprises:

an augmented view presenting module configured to present the third augmented view that includes the one or more third augmentations that directly or indirectly indicate that the one or more second augmentations that were hidden or obfuscated from being remotely displayed at the AR device have again been redisplayed.

37. The system of claim 1, wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data comprises:

an augmented view presenting module configured to present the third augmented view including the one or more third augmentations that indicate one or more degrees of correspondence between the one or more first augmentations and the one or more second augmentations.

38. The system of claim 1, further comprising:

an augmentation data acquiring module configured to acquire data that provide information related to the one or more second augmentations that were remotely displayed; and

wherein said augmentation data relaying module configured to relay one or more third augmentations that indicate one or more degrees of correspondence between the one or more first augmentations and the one or more second augmentations.

39. An article of manufacture, comprising:

a non-transitory storage medium bearing;

one or more instructions for procuring one or more first augmentations for inclusion in a first augmented view of a first scene;

one or more instructions for presenting the first augmented view through one or more display monitors, the first augmented view to be presented including the one or more first augmentations;

one or more instructions for relaying, via one or more wireless and/or wired networks, augmentation data associated with the one or more first augmentations to an augmented reality (AR) device to facilitate remote display at the AR device of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that mirror or are the same as one or more first visual items included in the first scene;

one or more instructions for acquiring usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data; and

one or more instructions for presenting a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data.

40. A wearable augmented reality (AR) device, comprising:

a coupling device for coupling the wearable AR device to a user'"'"'s head;

one or more display monitors;

an augmentation procuring module configured to procure one or more first augmentations for inclusion in a first augmented view of a first scene;

an augmented view presenting module configured to present the first augmented view through the one or more display monitors, the first augmented view to be presented including the one or more first augmentations;

an augmentation data relaying module configured to relay, via one or more wireless and/or wired networks, augmentation data associated with the one or more first augmentations to an augmented reality (AR) device to facilitate remote display at the AR device of one or more second augmentations in a second augmented view of a second scene, the second scene having one or more visual items that mirror or are the same as one or more first visual items included in the first scene;

a usage/non-usage data acquiring module configured to acquire usage/non-usage data that indicate remote usage and/or non-usage of the relayed augmentation data; and

wherein said augmented view presenting module is configured to present a third augmented view including one or more third augmentations in response to acquisition by the usage/non-usage data acquiring module of the usage/non-usage data.