Displaying second augmentations that are based on registered first augmentations

• US 10,269,179 B2
• Filed: 02/15/2013
• Issued: 04/23/2019
• Est. Priority Date: 10/05/2012
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Fein, Gene, Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Rinaldo, Jr., John D., Tegreene, Clarence T.
• Primary Examiner(s): Amin, Jwalant
• Application Number:
  US13/768,048
• Publication Number:
  US 20140098136A1
• Time in Patent Office: 2,258 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Computationally implemented methods and systems include registering one or more first augmentations that were shown to a user through a first augmented view of a first actual scene, the one or more first augmentations having been shown at least at end of a segment of time, detecting, following the showing of the one or more first augmentations up to the end of the segment of time, one or more user behaviors of the user that when detected as occurring infers user'"'"'s interest in seeing the one or more first augmentations; and displaying, in response at least in part to said detecting, one or more second augmentations through a second augmented view of the first actual scene or of a second actual scene, the one or more second augmentations to be displayed being based, at least in part, on the registering of the one or more first augmentations. In addition to the foregoing, other aspects are described in the claims, drawings, and text.

Claims

1. A system, comprising:

at least one processing device; and

at least one non-transitory computer-readable medium including at least one or more instructions that, when executed by the at least one processing device, configure the at least one processing device as at least;

circuitry configured for recognizing at least one visual cue in an actual scene;

circuitry configured for selecting one or more dynamic augmentations based, at least in part, on the circuitry configured for recognizing the at least one visual cue in the actual scene;

circuitry configured for causing a first augmented view of the actual scene to be shown, the first augmented view including at least the one or more dynamic augmentations;

circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown;

circuitry configured for creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the circuitry configured for acquiring the at least one physiological indication; and

circuitry configured for causing a second augmented view of the actual scene to be shown, the second augmented view including at least the at least one updated augmentation.

2. The system of claim 1, wherein circuitry configured for selecting one or more dynamic augmentations based, at least in part, on the circuitry configured for recognizing the at least one visual cue in the actual scene comprises:

circuitry configured for registering one or more aspects of the one or more dynamic augmentations.

3. The system of claim 2, wherein circuitry configured for registering one or more aspects of the one or more dynamic augmentations comprises:

circuitry configured for registering one or more visual formats of the one or more dynamic augmentations.

4. The system of claim 2, wherein circuitry configured for registering one or more aspects of the one or more dynamic augmentations comprises:

circuitry configured for registering one or more locations of the one or more dynamic augmentations, the one or more locations measured relative to one or more locations of one or more non-augmentation scene elements present in the first augmented view.

5. The system of claim 2, wherein circuitry configured for registering one or more aspects of the one or more dynamic augmentations comprises:

circuitry configured for registering one or more contents of the one or more dynamic augmentations that were shown.

6. The system of claim 5, wherein circuitry configured for registering one or more contents of the one or more dynamic augmentations that were shown comprises:

circuitry configured for registering at least one of one or more textual contents or one or more image contents of the one or more dynamic augmentations that were shown.

7. The system of claim 1, wherein circuitry configured for selecting one or more dynamic augmentations based, at least in part, on the circuitry configured for recognizing the at least one visual cue in the actual scene comprises:

circuitry configured for selecting one or more dynamic augmentations that change in response to one or more environmental factors associated with the actual scene.

8. The system of claim 7, wherein circuitry configured for selecting one or more dynamic augmentations that change in response to one or more environmental factors associated with the actual scene comprises:

circuitry configured for selecting one or more dynamic augmentations that change in response to one or more atmospheric conditions associated with the actual scene detected at least in part using one or more atmospheric condition sensors of the at least one augmented reality device.

9. The system of claim 7, wherein circuitry configured for selecting one or more dynamic augmentations that change in response to one or more environmental factors associated with the actual scene comprises:

circuitry configured for selecting one or more dynamic augmentations that change at least one of in response to passage of time or in response to one or more changes to one or more non-time factors over time.

10. The system of claim 9, wherein circuitry configured for selecting one or more dynamic augmentations that change at least one of in response to passage of time or in response to one or more changes to one or more non-time factors over time comprises:

circuitry configured for selecting a rotating augmentation that is designed to rotate at least one of form or content of one or more advertisements over time in response to at least one of passage of time or one or more changes to one or more non-time factors.

11. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for detecting at least one physiological indication that is inconsistent with at least one physiological indication acquired previous to the first augmented view of the actual scene being shown.

12. The system of claim 11, wherein circuitry configured for detecting at least one physiological indication that is inconsistent with at least one physiological indication acquired previous to the first augmented view of the actual scene being shown comprises:

circuitry configured for detecting one or more movements of a wearer of the at least one augmented reality device in a direction other than a direction of movement of the wearer of the at least one augmented reality device previous to the first augmented view of the actual scene being shown.

13. The system of claim 12, wherein circuitry configured for detecting one or more movements of a wearer of the at least one augmented reality device in a direction other than a direction of movement of the wearer of the at least one augmented reality device previous to the first augmented view of the actual scene being shown comprises:

circuitry configured for detecting one or more movements of the wearer of the at least one augmented reality device in a direction away from one or more specific geographical locations where the first augmented view of the actual scene was shown.

14. The system of claim 13, wherein circuitry configured for detecting one or more movements of the wearer of the at least one augmented reality device in a direction away from one or more specific geographical locations where the first augmented view of the actual scene was shown comprises:

circuitry configured for detecting, using an accelerometer as the at least one physiological sensor of the at least one augmented reality device, the one or more movements of the wearer of the at least one augmented reality device in the direction away from the one or more specific geographical locations where the first augmented view of the actual scene was shown.

15. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for detecting one or more ocular characteristics of a user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown.

16. The system of claim 15, wherein circuitry configured for detecting one or more ocular characteristics of a user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for detecting one or more dwell paths of one or more eyes of the user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown.

17. The system of claim 16, wherein circuitry configured for detecting one or more dwell paths of one or more eyes of the user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for detecting the one or more dwell paths of the one or more eyes of the user relative to at least one aspect visible in the first augmented view of the actual scene.

18. The system of claim 15, wherein circuitry configured for detecting one or more ocular characteristics of a user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for detecting one or more focus points of one or more eyes of the user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown.

19. The system of claim 18, wherein circuitry configured for detecting one or more focus points of one or more eyes of the user wearing the at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for detecting the one or more focus points of the one or more eyes of the user, including at least detecting the user focusing on at least one aspect visible in the first augmented view of the actual scene.

20. The system of claim 19, further comprising:

circuitry configured for inferring interest on the part of the user in the one or more dynamic augmentations based, at least in part, on the circuitry configured for detecting the one or more focus points of the one or more eyes of the user.

21. The system of claim 1, wherein circuitry configured for recognizing at least one visual cue in an actual scene comprises:

circuitry configured for detecting one or more non-augmentation scene elements in the actual scene, the one or more non-augmentation scene elements capable of triggering a selection of a particular one or more dynamic augmentations.

22. The system of claim 1, wherein circuitry configured for creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the acquiring the at least one physiological indication comprises:

circuitry configured for creating at least one updated augmentation having at least one visual format that was included as one or more visual formats of the one or more dynamic augmentations.

23. The system of claim 1, wherein circuitry configured for creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the acquiring the at least one physiological indication comprises:

circuitry configured for creating at least one updated augmentation having at least one content that was included as a content of the one or more dynamic augmentations.

24. The system of claim 1, wherein circuitry configured for creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the circuitry configured for acquiring the at least one physiological indication comprises:

circuitry configured for creating the at least one updated augmentation based, at least in part, on at least one physiological indication indicative of at least one intensity of user interest in the one or more dynamic augmentations.

25. The system of claim 1, wherein circuitry configured for creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the acquiring the at least one physiological indication comprises:

circuitry configured for creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the at least one physiological indication not being within an environmental context associated with the actual scene.

26. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one physiological indication indicative of one or more user exercise or athletic activities associated with the actual scene.

27. The system of claim 26, wherein circuitry configured for acquiring at least one physiological indication indicative of one or more user exercise or athletic activities associated with the actual scene comprises:

circuitry configured for acquiring at least one indication of respiration of a wearer of the at least one augmented reality device.

28. The system of claim 1, wherein circuitry configured for selecting one or more dynamic augmentations based, at least in part, on the circuitry configured for recognizing the at least one visual cue in the actual scene comprises:

circuitry configured for selecting the one or more dynamic augmentations based, at least in part, in response to receiving at least one of an electronic message or an electronic communication indicative of the at least one visual cue in the actual scene.

29. The system of claim 1, wherein circuitry configured for selecting one or more dynamic augmentations based, at least in part, on the circuitry configured for recognizing the at least one visual cue in the actual scene comprises:

circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to receiving at least one of an electronic message or an electronic communication.

30. The system of claim 1, wherein circuitry configured for selecting one or more dynamic augmentations based, at least in part, on the circuitry configured for recognizing the at least one visual cue in the actual scene comprises:

circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to at least some sensor provided data.

31. The system of claim 30, wherein circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to at least some sensor provided data comprises:

circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to at least some physiological data received from the at least one physiological sensor of the at least one augmented reality device on which the one or more dynamic textual augmentations are shown.

32. The system of claim 31, wherein circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to at least some physiological data received from the at least one physiological sensor of the at least one augmented reality device on which the one or more dynamic textual augmentations are shown comprises:

circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to at least some physiological data related to a wearer of the at least one augmented reality device, the at least some physiological data received from the at least one physiological data sensor of the at least one augmented reality device on which the one or more dynamic textual augmentations are shown.

33. The system of claim 32, wherein circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that changes in response to at least some physiological data related to a wearer of the at least one augmented reality device, the at least some physiological data received from the at least one physiological data sensor of the at least one augmented reality device on which the one or more dynamic textual augmentations are shown comprises:

circuitry configured for selecting one or more dynamic textual augmentations including at least one augmentation that causes at least one indication of the at least some physiological data related to the wearer of the at least one augmented reality device to be shown as a part of the at least one augmentation, the at least some physiological data received from the at least one physiological data sensor of at least one augmented reality device on which the one or more dynamic textual augmentations are shown.

34. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one indication of a pulse of a wearer of the at least one augmented reality device on which the first augmented view of the actual scene is shown, the at least one indication of the pulse of the wearer acquired at least in part via the at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown.

35. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one indication of a galvanic skin characteristic of a wearer of the at least one augmented reality device on which the first augmented view of the actual scene is shown, the at least one indication of the galvanic skin characteristic of the wearer acquired at least in part via the at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown.

36. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one indication of a body movement of a wearer of the at least one augmented reality device on which the first augmented view of the actual scene is shown, the at least one indication of the body movement of the wearer acquired at least in part via the at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown.

37. The system of claim 36, wherein circuitry configured for acquiring at least one indication of a body movement of a wearer of the at least one augmented reality device on which the first augmented view of the actual scene is shown, the at least one indication of the body movement of the wearer acquired at least in part via the at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one indication of a physical behavior including at least the body movement of the wearer of the at least one augmented reality device on which the first augmented view of the actual scene is shown, the at least one indication of the physical behavior including at least the body movement of the wearer acquired at least in part via the at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown.

38. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one blood sugar indication from at least one blood sugar sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown.

39. The system of claim 1, wherein circuitry configured for acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown comprises:

circuitry configured for acquiring at least one blood pressure indication from at least one blood pressure sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown.

40. A method, comprising:

recognizing at least one visual cue in an actual scene;

selecting one or more dynamic augmentations based, at least in part, on the recognizing the at least one visual cue in the actual scene;

causing a first augmented view of the actual scene to be shown, the first augmented view including at least the one or more dynamic augmentations;

acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown;

creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the acquiring the at least one physiological indication; and

causing a second augmented view of the actual scene to be shown, the second augmented view including at least the at least one updated augmentation,

wherein at least one of the recognizing, selecting, causing, acquiring, or creating is at least partially implemented using at least one processing device.

41. A system, comprising:

at least one computing device; and

one or more instructions which, when executed by the at least one computing device, configure the at least one computing device to perform one or more operations including at least;

recognizing at least one visual cue in an actual scene;

selecting one or more dynamic augmentations based, at least in part, on the recognizing the at least one visual cue in the actual scene;

causing a first augmented view of the actual scene to be shown, the first augmented view including at least the one or more dynamic augmentations;

acquiring at least one physiological indication from at least one physiological sensor of at least one augmented reality device on which the first augmented view of the actual scene is shown;

creating at least one updated augmentation from the one or more dynamic augmentations based, at least in part, on the acquiring the at least one physiological indication; and

causing a second augmented view of the actual scene to be shown, the second augmented view including at least the at least one updated augmentation.