Methods, apparatuses, and computer program products for enhancing activation of an augmented reality mode

• US 9,727,128 B2
• Filed: 09/02/2010
• Issued: 08/08/2017
• Est. Priority Date: 09/02/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Nurmi, Mikko Antero
• Primary Examiner(s): Johnson, M Good
• Application Number:
  US12/874,840
• Publication Number:
  US 20120058801A1
• Time in Patent Office: 2,532 Days
• Field of Search: 345633
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Methods, apparatuses, and computer program products are provided for enhancing activation of an augmented reality mode. A method may include detecting a predefined trigger for activating an augmented reality mode. The method may further include determining, responsive to the predefined trigger, at least a portion of content visibly displayed. The method may additionally include activating the augmented reality mode, wherein content displayed in the augmented reality mode is at least partially defined by the determined content. Corresponding apparatuses and computer program products are also provided.

Claims

1. A method comprising:

detecting a predefined trigger for activating an augmented reality mode;

receiving an indication of a selected portion of content displayed on an interface, the interface comprising the selected portion of content and an unselected portion of content other than the selected portion of content, wherein the selected portion of content relates to a first application and the unselected portion of content relates to at least one other application;

determining, responsive to the predefined trigger, the selected portion of content displayed in the interface, wherein determining the selected portion of content visibly displayed comprises determining displayed content with a relevancy value which satisfies a predetermined relevancy threshold based at least in part on a user preference and a user context, wherein the user context includes a non-location-based property of the user, and wherein the user preference is determined based at least in part on user history; and

activating, by augmented reality control circuitry, the augmented reality mode, wherein content displayed in the augmented reality mode is at least partially defined by the determined selected portion of content, and wherein the augmented reality mode does not display content associated with the unselected portion of content.

2. The method of claim 1, wherein determining the selected portion of content displayed comprises determining one or more content items displayed in a selected portion of a graphical user interface or content displayed within a predefined portion of a display.

3. The method of claim 1, further comprising, determining, responsive to the predefined trigger, whether map content is visibly displayed;

and

wherein activating the augmented reality mode comprises activating the augmented reality mode only in an instance in which it is determined that map content is visibly displayed.

4. The method of claim 1, wherein activating the augmented reality mode comprises:

transitioning from a two-dimensional display view in which the determined selected portion of content is displayed to a three-dimensional display view; and

transitioning from the three-dimensional view to an augmented reality display view.

5. The method of claim 4, further comprising detecting a second predefined trigger, and wherein transitioning from the three-dimensional display view to the augmented reality display view comprises transitioning from the three-dimensional display view to the augmented reality display view responsive to the second predefined trigger.

6. The method of claim 4, wherein transitioning from the two-dimensional display view to the three-dimensional display view comprises causing a transition from display of two-dimensional map content to display of three-dimensional map content.

7. The method of claim 1, further comprising:

determining, prior to detecting the predefined trigger, based at least in part on context data regarding an augmented reality apparatus that there is a likelihood of the augmented reality mode being activated; and

responsive to determining that there is a likelihood of the augmented reality mode being activated, pre-launching a viewfinder, thereby enabling more rapid activation of the augmented reality mode when the augmented reality mode is activated.

8. The method of claim 1, wherein the first application comprises a social networking service and the at least one other application comprises contact information.

9. The method of claim 8, wherein the content displayed in the augmented reality mode comprises an augmented reality view including features of the first application.

10. The method of claim 1, wherein the content displayed on the interface comprises a plurality of containers, wherein each container relates to a different type of content associated with a different application, and wherein the selected portion of content relates to a first container associated with the first application, and the unselected portion of content relates to at least one other container related to a respective at least one other application.

11. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

detect a predefined trigger for activating an augmented reality mode;

receive an indication of a selected portion of content displayed on an interface, the interface comprising the selected portion of content and an unselected portion of content other than the selected portion of content, wherein the selected portion of content relates to a first application and the unselected portion of content relates to at least one other application;

determine, responsive to the predefined trigger, the selected portion of content displayed in the interface, wherein determining the selected portion of content visibly displayed comprises determining displayed content with a relevancy value which satisfies a predetermined relevancy threshold based at least in part on a user preference and a user context, wherein the user context includes a non-location-based property of the user, and wherein the user preference is determined based at least in part on user history; and

activate the augmented reality mode, wherein content displayed in the augmented reality mode is at least partially defined by the determined selected portion of content, and wherein the augmented reality mode does not display content associated with the unselected portion of content.

12. The apparatus of claim 11, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to detect the predefined trigger by detecting movement of the apparatus along a predefined trajectory of motion.

13. The apparatus of claim 11, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to determine the selected portion of content displayed at least in part by determining one or more of content displayed in a selected portion of a graphical user interface or content displayed within a predefined portion of a display.

14. The apparatus of claim 11, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to further cause the apparatus to:

determine, responsive to the predefined trigger, whether map content is visibly displayed; and

activate the augmented reality mode only in an instance in which it is determined that map content is visibly displayed.

15. The apparatus of claim 11, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to further cause the apparatus to activate the augmented reality mode at least in part by:

transitioning from a two-dimensional display view in which the determined content is displayed to a three-dimensional display view; and

transitioning from the three-dimensional view to an augmented reality display view.

16. The apparatus of claim 15, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to further cause the apparatus to:

detect a second predefined trigger; and

transition from the three-dimensional display view to the augmented reality display view responsive to the second predefined trigger.

17. The apparatus of claim 11, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to further cause the apparatus to:

determine, prior to detecting the predefined trigger, based at least in part on context data regarding the apparatus that there is a likelihood of the augmented reality mode being activated; and

responsive to determining that there is a likelihood of the augmented reality mode being activated, pre-launch a viewfinder, thereby enabling more rapid activation of the augmented reality mode when the augmented reality mode is activated.

18. The apparatus according to claim 11, wherein the apparatus comprises or is embodied on a mobile phone, the mobile phone comprising user interface circuitry and user interface software stored on one or more of the at least one memory;

wherein the user interface circuitry and user interface software are configured to;

facilitate user control of at least some functions of the mobile phone through use of a display; and

cause at least a portion of a user interface of the mobile phone to be displayed on the display to facilitate user control of at least some functions of the mobile phone.

19. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions comprising:

program instructions configured to detect a predefined trigger for activating an augmented reality mode;

program instructions configured to receive an indication of a selected portion of content displayed on an interface, the interface comprising the selected portion of content and an unselected portion of content other than the selected portion of content, wherein the selected portion of content relates to a first application and the unselected portion of content relates to at least one other application;

program instructions configured to determine, responsive to the predefined trigger, the selected portion of content displayed in the interface, wherein determining the selected portion of content visibly displayed comprises determining displayed content with a relevancy value which satisfies a predetermined relevancy threshold based at least in part on a user preference and a user context, wherein the user context includes a non-location-based property of the user, and wherein the user preference is determined based at least in part on user history; and

program instructions configured to activate the augmented reality mode, wherein content displayed in the augmented reality mode is at least partially defined by the determined selected portion of content, and wherein the augmented reality mode does not display content associated with the unselected portion of content.

20. The computer program product according to claim 19, further comprising:

program instructions configured to determine, responsive to the predefined trigger, whether map content is visibly displayed; and

wherein the program instructions configured to activate the augmented reality mode comprise program instructions configured to activate the augmented reality mode only in an instance in which it is determined that map content is visibly displayed.