Systems and methods for obtaining and using augmentation data and for sharing usage data

• US 9,111,383 B2
• Filed: 12/10/2012
• Issued: 08/18/2015
• Est. Priority Date: 10/05/2012
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Fein, Gene, Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Rinaldo, John D. Jr., Tegreene, Clarence T.
• Primary Examiner(s): Zarka, David
• Assistant Examiner(s): PRINGLE-PARKER, JASON A
• Application Number:
  US13/709,465
• Publication Number:
  US 20140098131A1
• Time in Patent Office: 981 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Computationally implemented methods and systems include receiving augmentation data associated with one or more first augmentations, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at a remote augmented reality (AR) device, displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data, and transmitting to the remote AR device usage data that indicates usage information related at least to usage or non-usage of the received augmentation data. In addition to the foregoing, other aspects are described in the claims, drawings, and text.

Claims

1. A computationally-implemented method implemented via one or more computer processors, comprising:

receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device;

displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data; and

transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations.

2. A computationally-implemented system, comprising:

means for receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device;

means for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data; and

means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations.

3. The computationally-implemented system of claim 2, wherein said means for receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device comprises:

means for receiving the augmentation data including data that provides content information related to the one or more first augmentations.

4. The computationally-implemented system of claim 2, wherein said means for receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device comprises:

means for receiving the augmentation data including data that provides information related to one or more visual items present in the first scene and that are affiliated with the one or more first augmentations.

5. The computationally-implemented system of claim 2, wherein said means for receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device comprises:

means for receiving the augmentation data including data that provides format information related to one or more formats of the one or more first augmentations.

6. The computationally-implemented system of claim 5, wherein said means for receiving the augmentation data including data that provides format information related to one or more formats of the one or more first augmentations comprises:

means for receiving the data that provides format information including data that provides one or more visibility rules that include one or more directives for displaying the one or more first augmentations.

7. The computationally-implemented system of claim 6, wherein said means for receiving the data that provides format information including data that provides one or more visibility rules that include one or more directives for displaying the one or more first augmentations comprises:

means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs inclusion of the one or more first augmentations in an augmented view of an actual scene, the one or more visibility rules further directing the one or more first augmentations to be affiliated with one or more specified visual items.

8. The computationally-implemented system of claim 6, wherein said means for receiving the data that provides format information including data that provides one or more visibility rules that include one or more directives for displaying the one or more first augmentations comprises:

means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs the one or more first augmentations to be at least semi-transparent in an augmented view of an actual scene in order to prevent one or more priority visual items that are present in the actual scene from being completely obfuscated by the one or more first augmentations in the augmented view.

9. The computationally-implemented system of claim 8, wherein said means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs the one or more first augmentations to be at least semi-transparent in an augmented view of an actual scene in order to prevent one or more priority visual items that are present in the actual scene from being completely obfuscated by the one or more first augmentations in the augmented view comprises:

means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs the one or more first augmentations to be conditionally transparent in the augmented view of the actual scene so long as the one or more priority visual items are detected as being present in the actual scene.

10. The computationally-implemented system of claim 6, wherein said means for receiving the data that provides format information including data that provides one or more visibility rules that include one or more directives for displaying the one or more first augmentations comprises:

means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs the one or more first augmentations to be one or more functional augmentations.

11. The computationally-implemented system of claim 10, wherein said means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs the one or more first augmentations to be one or more functional augmentations comprises:

means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that directs the one or more first augmentations to be one or more functional augmentations that are in a form of one or more functional tags that when selected or activated results in display of information related to one or more visual items present in the first augmented view and/or in the first actual scene.

12. The computationally-implemented system of claim 6, wherein said means for receiving the data that provides format information including data that provides one or more visibility rules that include one or more directives for displaying the one or more first augmentations comprises:

means for receiving the data that provides the one or more visibility rules including data that provides one or more visibility rules that identifies one or more priority visual items that are directed by the visibility rules to have visibility priority over the one or more first augmentations in an augmented view of an actual scene.

13. The computationally-implemented system of claim 2, wherein said means for receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device comprises:

means for transmitting a request to the AR device for the augmentation data.

14. The computationally-implemented system of claim 2, wherein said means for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data comprises:

means for displaying locally the one or more second augmentations in the second augmented view via one or more display monitors.

15. The computationally-implemented system of claim 2, wherein said means for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data comprises:

means for displaying the one or more second augmentations in the second augmented view by displaying one or more second augmentations in the second augmented view that are same or substantially same as the one or more first augmentations that were remotely displayed at the remote AR device.

16. The computationally-implemented system of claim 2, wherein said means for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data comprises:

means for displaying the one or more second augmentations in the second augmented view by displaying one or more second augmentations in the second augmented view that are modified version or versions of the one or more first augmentations that were remotely displayed at the remote AR device.

17. The computationally-implemented system of claim 2, wherein said means for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data comprises:

means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed.

18. The computationally-implemented system of claim 17, wherein said means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on content information and one or more visibility rules provided by the received augmentation data and based on the environmental context in which the second augmented view is to be displayed.

19. The computationally-implemented system of claim 17, wherein said means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on a combination of content information and one or more visibility rules provided by the received augmentation data, one or more visibility rules provided by one or more sources other than the AR device, and the environmental context in which the second augmented view is to be displayed.

20. The computationally-implemented system of claim 19, wherein said means for generating the one or more second augmentations based on a combination of content information and one or more visibility rules provided by the received augmentation data, one or more visibility rules provided by one or more sources other than the AR device, and the environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on a combination of content information and one or more visibility rules provided by the received augmentation data, one or more visibility rules that were locally provided, and the environmental context in which the second augmented view is to be displayed.

21. The computationally-implemented system of claim 17, wherein said means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on content information provided by the received augmentation data, based on one or more locally provided visibility rules, and based on the environmental context in which the second augmented view is to be displayed.

22. The computationally-implemented system of claim 17, wherein said means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on the received augmentation data and based on social networking data obtained through one or more social networking sources and that are indicative of the environmental context in which the second augmented view is to be displayed.

23. The computationally-implemented system of claim 17, wherein said means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on the received augmentation data and based on audio data indicative of the environmental context in which the second augmented view is to be displayed.

24. The computationally-implemented system of claim 17, wherein said means for displaying the one or more second augmentations in the second augmented view by generating the one or more second augmentations based on the received augmentation data and based on environmental context in which the second augmented view is to be displayed comprises:

means for generating the one or more second augmentations based on the received augmentation data and based on movement data indicative of the environmental context in which the second augmented view is to be displayed.

25. The computationally-implemented system of claim 2, wherein said means for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data comprises:

means for displaying the one or more second augmentations in the second augmented view including displaying one or more indicators that directly or indirectly indicate differences between the one or more first augmentations and the one or more second augmentations.

26. The computationally-implemented system of claim 25, wherein said means for displaying the one or more second augmentations in the second augmented view including displaying one or more indicators that directly or indirectly indicate differences between the one or more first augmentations and the one or more second augmentations comprises:

means for displaying the one or more indicators indicating the differences between the one or more first augmentations and the one or more second augmentations by displaying one or more modifications applied to the one or more first augmentations in order to generate the one or more second augmentations.

27. The computationally-implemented system of claim 25, wherein said means for displaying the one or more second augmentations in the second augmented view including displaying one or more indicators that directly or indirectly indicate differences between the one or more first augmentations and the one or more second augmentations comprises:

means for displaying the one or more indicators indicating the differences between the one or more first augmentations and the one or more second augmentations by displaying one or more degrees of correspondence between the one or more first augmentations and the one or more second augmentations.

28. The computationally-implemented system of claim 25, wherein said means for displaying the one or more second augmentations in the second augmented view including displaying one or more indicators that directly or indirectly indicate differences between the one or more first augmentations and the one or more second augmentations comprises:

means for displaying the one or more indicators indicating the differences between the one or more first augmentations and the one or more second augmentations by displaying one or more degrees of difference between the one or more first augmentations and the one or more second augmentations.

29. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data including usage data that indicates that the augmentation data was successfully received.

30. The computationally-implemented system of claim 29, wherein said means for transmitting the usage data including usage data that indicates that the augmentation data was successfully received comprises:

means for transmitting the usage data in response to receiving the augmentation data successfully.

31. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data including usage data that indicates that the one or more second augmentations have been displayed.

32. The computationally-implemented system of claim 31, wherein said means for transmitting the usage data including usage data that indicates that the one or more second augmentations have been displayed comprises:

means for transmitting the usage data in response to the one or more second augmentations being locally displayed.

33. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data including usage data that includes the one or more second augmentations.

34. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data including usage data that indicates one or more differences between the one or more first augmentations and the one or more second augmentations.

35. The computationally-implemented system of claim 34, wherein said means for transmitting the usage data including usage data that indicates one or more differences between the one or more first augmentations and the one or more second augmentations comprises:

means for transmitting the usage data including usage data that indicates one or more modifications that were made to the one or more first augmentations in order to generate the one or more second augmentations.

36. The computationally-implemented system of claim 34, wherein said means for transmitting the usage data including usage data that indicates one or more differences between the one or more first augmentations and the one or more second augmentations comprises:

means for transmitting the usage data including usage data that indicates one or more degrees of correspondence between the one or more first augmentations and the one or more second augmentations.

37. The computationally-implemented system of claim 34, wherein said means for transmitting the usage data including usage data that indicates one or more differences between the one or more first augmentations and the one or more second augmentations comprises:

means for transmitting the usage data including usage data that indicates one or more degrees of difference between the one or more first augmentations and the one or more second augmentations.

38. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data including usage data that indicates changes to the display of the one or more second augmentations.

39. The computationally-implemented system of claim 38, wherein said means for transmitting the usage data including usage data that indicates changes to the display of the one or more second augmentations comprises:

means for transmitting the usage data including usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with a one or more third augmentations.

40. The computationally-implemented system of claim 39, wherein said means for transmitting the usage data including usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with a one or more third augmentations comprises:

means for transmitting usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with one or more third augmentations that include less content information than the one or more second augmentations.

41. The computationally-implemented system of claim 39, wherein said means for transmitting the usage data including usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with a one or more third augmentations comprises:

means for transmitting usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with one or more third augmentations that are one or more functional tags for retrieving and displaying the one or more second augmentations when the one or more functional tags are selected or activated.

42. The computationally-implemented system of claim 41, wherein said means for transmitting usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with one or more third augmentations that are one or more functional tags for retrieving and displaying the one or more second augmentations when the one or more functional tags are selected or activated comprises:

means for transmitting usage data that indicates that the one or more second augmentations that were included in the second augmented view have been replaced in the second augmented view with one or more third augmentations that are one or more functional tags for retrieving and displaying the one or more second augmentations when the one or more functional tags are selected or activated, the one or more third augmentations that are to replace the one or more second augmentations having substantially no content information included in the one or more second augmentations.

43. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data including usage data that indicates that the one or more second augmentations are no longer being displayed.

44. The computationally-implemented system of claim 43, wherein said means for transmitting the usage data including usage data that indicates that the one or more second augmentations are no longer being displayed comprises:

means for transmitting the usage data that indicates that the one or more second augmentations are no longer being displayed in response to one or more visual items affiliated with the one or more second augmentations no longer being visually detected.

45. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

a means for transmitting the usage data to the remote AR device, the usage data to facilitate the remote AR device to display one or more third augmentations that directly or indirectly indicate that the transmitted augmentation data was successfully received.

46. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data to the remote AR device, the usage data to facilitate the remote AR device to display one or more third augmentations that directly or indirectly indicate that the one or more second augmentations was displayed.

47. The computationally-implemented system of claim 2, wherein said means for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations comprises:

means for transmitting the usage data to the remote AR device, the usage data to facilitate the remote AR device to display one or more third augmentations that directly or indirectly indicate one or more differences between the one or more first augmentations and the one or more second augmentations.

48. A system, comprising:

circuitry for receiving augmentation data associated with one or more first augmentations from a remote augmented reality (AR) device via one or more wireless and/or networks, the one or more first augmentations having been included in a first augmented view of a first actual scene that was remotely displayed at the remote AR device augmented reality (AR) device;

circuitry for displaying one or more second augmentations in a second augmented view of a second actual scene, the displaying of the one or more second augmentations being in response, at least in part, to the augmentation data; and

circuitry for transmitting to the remote AR device, via the one or more wireless and/or networks, usage data that indicates usage information related at least to usage or non-usage of the received augmentation data, the usage data to facilitate the remote AR device to display one or more third augmentations, the usage data to facilitate the remote AR device to display one or more third augmentations.