METHOD AND APPARATUS FOR COLLABORATIVE AUGMENTED REALITY DISPLAYS

• US 20120299962A1
• Filed: 05/27/2011
• Published: 11/29/2012
• Est. Priority Date: 05/27/2011
• Status: Abandoned Application

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: White, Sean, Williams, Lance
• Application Number:
  US13/117,402
• Publication Number:
  US 20120299962A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6181 involving transmission via a mobile phone network arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection

Abstract

Methods and apparatuses are provided for facilitating interaction with augmented reality devices, such as augmented reality glasses and/or the like. A method may include receiving a visual recording of a view from a first user from an imaging device. The method may also include displaying the visual recording to a display. Further, the method may include receiving an indication of a touch input to the display. In addition, the method may include determining, by a processor, a relation of the touch input to the display. The method may also include displaying, at least in part on the determined relation, an icon representative of the touch input to the imaging device. Corresponding apparatuses are also provided.

Claims

1. A method comprising:

receiving an image of a view of an augmented reality device;

causing the image to be displayed;

receiving an input indicating a respective portion of the image;

determining, by a processor, a location of the input within the image; and

causing information regarding the location of the input to be provided to the augmented reality device such that an indication may be imposed upon the view provided by the augmented reality device corresponding to the input.

2. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

receive an image of a view of an augmented reality device;

cause the image to be displayed;

receive an input indicating a respective portion of the image;

determine, by a processor, a location of the input within the image; and

cause information regarding the location of the input to be provided to the augmented reality device such that an indication may be imposed upon the view provided by the augmented reality device at the location of the input.

3. The apparatus of claim 2, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least receive the image in real time so that the image that is caused to be displayed is also displayed by the augmented reality device.

4. The apparatus of claim 2, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least:

receive a video recording; and

cause the video recording to be displayed.

5. The apparatus of claim 4, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to receive the input to identify a respective feature within an image of the video recording and continue to identify the respective feature as the image changes.

6. The apparatus of claim 5, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to employ feature recognition to identify the respective feature within the video recording.

7. The apparatus of claim 2, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to receive an input that moves across the image so as to indicate both a location and a direction.

8. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions comprising program instructions configured to cause an apparatus to perform a method comprising:

receiving an image of a view from an augmented reality device;

causing the image to be displayed;

receiving an input indicating a respective portion of the image;

determining, by a processor, a location of the input within the image; and

causing information regarding the location of the input to be provided to the augmented reality device such that an indication may be imposed upon the view provided by the augmented reality device at the location of the input.

9. The computer program product of claim 8 configured to cause an apparatus to perform a method further comprising receiving the image in real time so that the image that is caused to be displayed is also displayed by the augmented reality device.

10. The computer program product of claim 8 configured to cause an apparatus to perform a method further comprising:

receiving a video recording; and

causing the video recording to be displayed.

11. The computer program product of claim 10 configured to cause an apparatus to perform a method further comprising receiving the input to identify a respective feature within an image of the video recording and continuing to identify the respective feature as the image changes.

12. The computer program product of claim 11 configured to cause an apparatus to perform a method further comprising employing feature recognition to identify the respective feature within the video recording.

13. The computer program product of claim 8 configured to cause an apparatus to perform a method further comprising receiving an input that moves across the image so as to indicate both a location and a direction.

14. A method comprising:

causing an image of a field of view of an augmented reality device to be captured;

causing the image to be provided a remote user interface;

receiving information indicative of an input to the at least one remote user interface corresponding to a respective portion of the image; and

causing at least one indicator to be provided upon a view provided by the augmented reality device based upon the information from the remote user interface.

15. A method according to claim 14, wherein causing the image to be provided comprises causing the image to be provided to the remote user interface in real time.

16. A method according to claim 14, wherein causing an image of a field of view to be captured comprises causing a video recording to be captured, and wherein causing the image to be provided comprises causing the video recording to be provided to the remote user interface in real time.

17. A method according to claim 16, wherein receiving information indicative of an input to the remote user interface comprises receiving information indicative of an input to the remote user interface identifying a respective feature within an image of the video recording, and continuing to receive information indicative of an input to the remote user interface identifying the respective feature as the image changes.

18. A method according to claim 17, wherein continuing to receive information indicative of an input to the remote user interface identifying a respective feature comprises receiving information employing feature recognition to identify the respective feature within the video recording.

19. A method according to claim 14, wherein receiving information comprises receiving information indicative of an input to the remote user interface that moves across the image so as to indicate both a location and a direction.

20. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

cause an image of a field of view of an augmented reality device to be captured;

cause the image to be provided to a remote user interface;

receive information indicative of an input to the remote user interface corresponding to a respective portion of the image; and

cause an indicator to be provided upon the view provided by the apparatus based upon the information from the remote user interface.

21. The apparatus of claim 20, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least cause the image to be provided to the remote user interface in real time.

22. The apparatus of claim 20, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least:

cause a video recording to be captured; and

cause the video recording to be provided to the remote user interface in real time.

23. The apparatus of claim 22, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least receive information indicative of an input to the remote user interface identifying a respective feature within an image of the video recording, and continue to receive information indicative of an input to the remote user interface identifying the respective feature as the image changes.

24. The apparatus of claim 23, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least receive information employing feature recognition to identify the respective feature within the video recording.

25. The apparatus of claim 20, wherein the at least one processor and at least one memory storing computer program code are configured, with the at least one processor, to cause the apparatus to at least receive information indicative of an input to the remote user interface that moves across the image so as to indicate both a location and a direction.

26. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions comprising program instructions configured to cause an apparatus to perform a method comprising:

causing an image of a field of view of an augmented reality device to be captured;

causing the image to be provided to a remote user interface;

receiving information indicative of an input to the remote user interface corresponding to a respective portion of the image; and

causing an indicator to be provided upon the view provided by the augmented reality device based upon the information from the remote user interface.

27. The computer program product of claim 26 configured to cause an apparatus to perform a method further comprising causing the image to be provided to the remote user interface in real time.

28. The computer program product of claim 26 configured to cause an apparatus to perform a method further comprising:

causing a video recording to be captured; and

causing the video recording to be provided to the remote user interface in real time.

29. The computer program product of claim 28 configured to cause an apparatus to perform a method further comprising receiving information indicative of an input to the remote user interface identifying a respective feature within an image of the video recording, and continuing to receive information indicative of an input identifying the respective feature as the image changes.

30. The computer program product of claim 29 configured to cause an apparatus to perform a method further comprising receiving information employing feature recognition to identify the respective feature within the video recording.

31. The computer program product of claim 26 configured to cause an apparatus to perform a method further comprising receiving information indicative of an input to the remote user interface that moves across the image so as to indicate both a location and a direction.