User interface for augmented reality

• US 10,133,438 B2
• Filed: 12/24/2008
• Issued: 11/20/2018
• Est. Priority Date: 09/17/2008
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Murphy, David Joseph, Kahari, Markus Tapio
• Primary Examiner(s): Belousov, Andrey
• Application Number:
  US13/119,609
• Publication Number:
  US 20110173576A1
• Time in Patent Office: 3,618 Days
• Field of Search: 715863, 715705, 715708, 715855
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The disclosed embodiments are directed to a method, an apparatus, and a user interface. The disclosed embodiments include acquiring an image, identifying one or more objects of interest in the image, and providing an indication that additional information is available for the one or more of the objects of interest without obscuring the one or more objects of interest.

Claims

1. A method comprising:

providing for presentation, by a display, of a first view in response to detecting a first orientation of an apparatus, wherein the first view comprises a map view;

causing a gesture to be detected, wherein the gesture is provided by changing an orientation of the apparatus to a second orientation;

providing for presentation, by the display, of a second view in response to detecting the gesture, wherein the second view comprises an augmented reality view;

causing an image to be acquired using an image capture device in response to detecting the gesture;

identifying two or more objects of interest in the image;

providing for display in a portion of the display of two or more icons for indicating that additional information is available for two or more of the objects of interest, wherein the two or more icons provided for display each comprise icon representations of their respective objects of interest and are presented in an order corresponding to real world positions of their respective objects of interest, wherein the portion of the display having the two or more icons resides in a location that avoids obscuring the augmented reality view;

receiving a selection of one of the icons representing an object of interest for which additional information is available; and

providing for display of the additional information in the augmented reality view without obscuring the object of interest represented by the selected icon.

2. The method of claim 1, further comprising providing for identification of the one or more objects of interest in the map view.

3. The method of claim 1, further comprising causing further information about the selected icon representing the object of interest to be displayed in response to a detected second gesture, wherein the second gesture is provided by changing an orientation of the apparatus to a third orientation.

4. A computer program product comprising computer readable code stored on a computer readable medium, the computer readable code configured to execute the method according to claim 1.

15. The method of claim 1, wherein the two or more icons provided for display are each provided in a size representative of a distance from the apparatus, and a position representative of a position relative to the apparatus.

16. The method of claim 1, further comprising:

receiving a selection of an icon representing a first object of interest in the image; and

highlighting the first object of interest in the image in response to receiving the selection of the icon representing the first object of interest.

17. The method of claim 1, wherein the two or more icons comprise pictorial representations of their respective objects of interest.

18. The method of claim 1, further comprising providing for display of the selected one of the icons in an enlarged view without obscuring the object of interest represented by the selected icon in the augmented reality view.

5. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

provide for presentation, by a display, of a first view in response to detecting a first orientation of an apparatus, wherein the first view comprises a map view;

receive an indication of a gesture, wherein the gesture is provided by changing the orientation of the apparatus to a second orientation;

provide for presentation, by the display, of a second view in response to detecting the gesture, wherein the second view comprises an augmented reality view;

cause an image to be acquired in response to sensing the gesture;

identify two or more objects of interest in the image;

provide for display in a portion of the display of two or more icons for indicating that additional information is available for two or more of the objects of interest, wherein the two or more icons provided for display each comprise icon representations of their respective objects of interest and are presented in an order corresponding to real world positions of their respective objects of interest, wherein the portion of the display having the two or more icons resides in a location that avoids obscuring the augmented reality view;

receive selection of one of the icons representing an object of interest for which additional information is available, and

provide for display of the additional information in the augmented reality view without obscuring the object of interest represented by the selected icon.

6. The apparatus of claim 5, wherein the apparatus is further caused to identify the one or more objects of interest in the map view.

7. The apparatus of claim 5, wherein the apparatus is further caused to provide for display of further information for the selected object of interest upon sensing a second gesture, wherein the second gesture is provided by changing an orientation of the apparatus to a third orientation.

8. A user interface comprising:

a display;

a sensor configured to detect a first orientation of an apparatus, wherein the display is configured for presenting a first view in response to the sensor detecting the first orientation of the apparatus, wherein the first view comprises a map view;

wherein the display is configured for presenting a second view in response to the sensor detecting a gesture, wherein the gesture is provided by changing the orientation of an apparatus to a second orientation, wherein the second view comprises an augmented reality view; and

an image capture device configured for acquiring an image in response to the sensor detecting the gesture;

wherein a portion of the display is configured for displaying two or more objects of interest identified in the image and providing for display of two or more icons for indicating that additional information is available for two or more of the objects of interest, wherein the two or more icons provided for display each comprise icon representations of their respective objects of interest and are presented in an order corresponding to real world positions of their respective objects of interest, wherein the portion of the display having the two or more icons resides in a location that avoids obscuring the augmented reality view, and

wherein the display is further configured for displaying additional information within another portion of the second view about an object of interest associated with a selected icon representing the object of interest without obscuring the selected identified object.

9. The user interface of claim 8, wherein the display is further configured for displaying the identified objects of interest in the map view.

10. The user interface of claim 8, wherein the display is further configured to cause further information for the selected object of interest to be displayed upon demand.

11. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising:

program code instructions to provide for presentation, by a display, of a first view in response to detecting a first orientation of an apparatus, wherein the first view comprises a map view;

program code instructions to receive an indication of a gesture, wherein the gesture is provided by changing an orientation of the apparatus to a second orientation;

program code instructions to provide for presentation, by the display, of a second view in response to detecting the gesture, wherein the second view comprises an augmented reality view;

program code instructions to cause an image to be acquired in response to detecting the gesture;

program code instructions to identify two or more objects of interest in the image;

program code instructions to provide for display in a portion of the display of two or more icons for indicating that additional information is available for two or more of the objects of interest, wherein the two or more icons provided for display each comprise icon representations of their respective objects of interest and are presented in an order corresponding to real world positions of their respective objects of interest, wherein the portion of the display having the two or more icons resides in a location that avoids obscuring the augmented reality view;

program code instructions to receive selection of one of the icons representing an object of interest for which additional information is available, and

program code instructions to display the additional information in another portion of the augmented reality view without obscuring the object of interest represented by the selected icon.

12. The computer program product of claim 11, further comprising program code instructions to display one or more icons to indicate that additional information is available for the one or more of the objects of interest.

13. The computer program product of claim 11, further comprising program code instructions to identify the one or more objects of interest in the map view.

14. The computer program product of claim 12, further comprising program code instructions to provide for display of further information for the selected object of interest upon sensing a second gesture, wherein the second gesture is provided by changing an orientation of the apparatus to a third orientation.

19. A method comprising:

providing for presentation, by a display, of a first view in response to detecting a first orientation of an apparatus, wherein the first view comprises a map view;

causing a gesture to be detected, wherein the gesture is provided by changing an orientation of the apparatus to a second orientation;

providing for presentation, by the display, of a second view in response to detecting the gesture, wherein the second view comprises an augmented reality view;

causing an image to be acquired using an image capture device in response to detecting the gesture;

identifying two or more objects of interest in the image;

providing for display of two or more icons for indicating that additional information is available for two or more of the objects of interest, wherein the two or more icons provided for display each comprise icon representations of their respective objects of interest and are presented along an edge of the display in an order corresponding to real world positions of their respective objects of interest in the augmented reality view;

receiving a selection of one of the icons representing an object of interest for which additional information is available; and

providing for display of the additional information in the augmented reality view without obscuring the object of interest represented by the selected icon.