USER INTERFACE TRANSITION BETWEEN CAMERA VIEW AND MAP VIEW

• US 20110310087A1
• Filed: 06/16/2010
• Published: 12/22/2011
• Est. Priority Date: 06/16/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Keating, Virginia Walker, Wright, Gerald V. Jr., Bernarte, Joel Simbulan
• Granted Patent: US 9,684,989 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A user interface transition between a camera view and a map view displayed on a mobile platform is provided so as present a clear visual connection between the orientation in the camera view and the orientation in the map view. The user interface transition may be in response to a request to change from the camera view to the map view or vice-versa. Augmentation overlays for the camera view and map view may be produced based on, e.g., the line of sight of the camera or identifiable environmental characteristics visible in the camera view and the map view. One or more different augmentation overlays are also produced and displayed to provide the visual connection between the camera view and map view augmentation overlays. For example, a plurality of augmentation overlays may be displayed consecutively to clearly illustrate the changes between the camera view and map view augmentation overlays.

Claims

1. A method comprising:

displaying a current view on a display;

requesting a transition between a current view and a subsequent view on the display, wherein the current view and the subsequent view are different views selected from one of a camera view and a map view;

producing and displaying a user interface transition on the display, the user interface transition comprising one or more frames that provide a visual connection between an orientation in the current view and an orientation in the subsequent view; and

displaying the subsequent view on the display.

2. The method of claim 1, wherein the user interface transition comprises a first augmentation overlay displayed over the current view, a second augmentation overlay displayed over the subsequent view, and at least one different augmentation overlay displayed between the first augmentation overlay and the second augmentation overlay to provide a visual connection between the first augmentation overlay and the second augmentation overlay.

3. The method of claim 1, wherein the user interface transition identifies at least one of the line of sight and a visibly identifiable environmental characteristic.

4. The method of claim 1, wherein producing and displaying the user interface transition comprises producing and displaying a change of at least one of the position, orientation, shape and perspective of a displayed augmentation overlay.

5. The method of claim 1, further comprising:

identifying at least one visibly identifiable environmental characteristic in the current view;

identifying the same at least one visibly identifiable environmental characteristic in the subsequent view;

preparing a first augmentation overlay for the at least one visibly identifiable environmental characteristic in the current view;

preparing a second augmentation overlay for the at least one visibly identifiable environmental characteristic in the subsequent view;

preparing at least one different augmentation overlay that provides a visual connection between the first augmentation overlay and the second augmentation overlay;

displaying the first augmentation overlay for the current view;

displaying the at least one different augmentation overlay; and

displaying the second augmentation overlay for the subsequent view.

6. The method of claim 5, wherein the identified at least one visibly identifiable environmental characteristic is at least one of a line, geometric shape, an area, building, and a color mass.

7. The method of claim 5, wherein the first augmentation overlay and the second augmentation overlay for the at least one visibly identifiable environmental characteristic are at least one of a line, geometric shape, an area, a color, an outline, a cropped image of the visibly identifiable environmental characteristic, and is at least one of opaque, transparent, two-dimensional, three-dimensional.

8. The method of claim 1, further comprising removing an image from the current view while displaying the user interface transition.

9. The method of claim 1, wherein the transition between the current view and the subsequent view is requested using a gesture.

10. The method of claim 1, wherein the current view is the camera view and the subsequent view is the map view.

11. The method of claim 1, wherein the current view is the map view and the subsequent view is the camera view.

12. The method of claim 1, wherein the subsequent view is displayed while displaying the user interface transition.

13. The method of claim 1, further comprising showing a user'"'"'s location in the map view.

14. The method of claim 1, further comprising indicating a line of site path from a user'"'"'s location by at least one of a line, dotted line, two-dimensional arrow, three-dimensional arrow, and a pie-slice view orientation element.

15. The method of claim 1, wherein the map view is at least one of a two-dimensional map representation, a three-dimensional map representation, a three-dimensional top view, and a satellite image view.

16. The method of claim 1, wherein the user interface transition comprises a plurality of frames that provide a visual connection between the orientation in the current view and the orientation in the subsequent view.

17. A mobile platform comprising:

a camera being operable to capture an image in a direction that the camera is facing;

orientation sensors that provide data with respect to the direction the camera is facing;

a satellite positioning system receiver that provides positioning data;

a processor connected to the camera, the orientation sensors, and the satellite positioning system;

memory connected to the processor;

a display connected to the memory; and

software held in the memory and run in the processor to cause the processor to determine the position of the mobile platform using the positioning data from the satellite positioning system and the direction that the camera is facing using the data from the orientation sensors;

to obtain a digital map based on the position of the mobile platform, to display a current view on the display; and

in response to a request for a transition between the current view and a subsequent view the processor produces and displays a user interface transition that comprises one or more frames that provide a visual connection between an orientation in the current view and an orientation in the subsequent view, wherein the current view and the subsequent view are different views selected from one of a camera view and a map view; and

to display the subsequent view on the display.

18. The mobile platform of claim 17, further comprising a wireless transceiver, wherein the digital map is obtained using the wireless transceiver.

19. The mobile platform of claim 17, wherein the user interface transition comprises a first augmentation overlay displayed over the current view, a second augmentation overlay displayed over the subsequent view, and at least one different augmentation overlay displayed between the first augmentation overlay and the second augmentation overlay to provide a visual connection between the first augmentation overlay and the second augmentation overlay.

20. The mobile platform of claim 17, wherein the user interface transition identifies at least one of the line of sight and visibly identifiable environmental characteristics in an image produced by the camera.

21. The mobile platform of claim 17, wherein the user interface transition is a change in at least one of the position, orientation, shape and perspective of a displayed augmentation overlay.

22. The mobile platform of claim 17, wherein the software further causes the processor to obtain a top view image based on the position of the mobile station, to identify at least one visibly identifiable environmental characteristic in an image from the camera and the same at least one visibly identifiable environmental characteristic in the top view image, to prepare a first augmentation overlay for the at least one visibly identifiable environmental characteristic in the current view, to prepare a second augmentation overlay for the at least one visibly identifiable environmental characteristic in the subsequent view, and to prepare at least one different augmentation overlay that provides a visual connection between the first augmentation overlay and the second augmentation overlay and to display the first augmentation overlay for the current view, to display the at least one different augmentation overlay and to display the second augmentation overlay for the subsequent view.

23. The mobile platform of claim 22, wherein the identified at least one visibly identifiable environmental characteristic is at least one of a line, geometric shape, an area, building, and a color mass.

24. The mobile platform of claim 22, wherein the first augmentation overlay and the second augmentation overlay for the at least one visibly identifiable environmental characteristic are at least one of a line, geometric shape, an area, a color, an outline, a cropped image of the visibly identifiable environmental characteristic, and is at least one of opaque, transparent, two-dimensional, three-dimensional.

25. The mobile platform of claim 17, wherein the software causes the processor to detect a request for the transition based on a gesture detected by the orientation sensors.

26. The mobile platform of claim 17, wherein the current view is the camera view showing an image from the camera and the subsequent view is the map view.

27. The mobile platform of claim 17, wherein the current view is the map view and the subsequent view is the camera view showing an image from the camera.

28. The mobile platform of claim 17, wherein the software causes the processor to show a user'"'"'s location in the map view.

29. The mobile platform of claim 17, wherein the map view may is at least one of a two-dimensional map representation, a three-dimensional map representation, a three-dimensional top view, a satellite image view.

30. The mobile platform of claim 17, wherein the user interface transition comprises a plurality of frames that provide a visual connection between the orientation in the current view and the orientation in the subsequent view.

31. A system for providing a user interface transition between a current view and a subsequent view in a display of a mobile platform, the user interface transition providing a visual connection between an orientation in the current view and an orientation in the subsequent view, where the current view and the subsequent view are different views selected from one of a camera view and a map view, the system comprising:

means for providing the camera view;

means for obtaining the map view;

means for producing a user interface transition comprising one or more frames that provide a visual connection between the orientation in the current view and the orientation in the subsequent view;

means for displaying current view, the subsequent view and the user interface transition between the current view and the subsequent view.

32. The system of claim 31, further comprising a means for requesting a transition between the current view and the subsequent view, wherein the means for producing the user interface transition produces the user interface transition in response to the request.

33. The system of claim 31, wherein the user interface transition is a change in at least one of the position, orientation, shape and perspective of a displayed augmentation overlay.

34. The system of claim 31, further comprising a means for identifying at least one visibly identifiable environmental characteristic in the camera view and the same at least one visibly identifiable environmental characteristic in the map view subsequent view, wherein the means for producing a user interface transition comprises a means for preparing a first augmentation overlay for the visibly identifiable environmental characteristic in the current view, a second augmentation overlay for the visibly identifiable environmental characteristic in the subsequent view and at least one different augmentation overlay that provides a visual connection between the first augmentation overlay and the second augmentation overlay.

35. The system of claim 34, wherein the identified at least one visibly identifiable environmental characteristic is at least one of a line, geometric shape, an area, building, and a color mass.

36. The system of claim 31, wherein the means for obtaining a map view is a wireless transceiver for obtaining a digital map to display as the map view.

37. The system of claim 31, wherein the map view is at least one of a two-dimensional map representation, a three-dimensional map representation, a three-dimensional top view, and a satellite image view.

38. The system of claim 31, wherein the user interface transition comprises a plurality of frames that provide a visual connection between the orientation in the current view and the orientation in the subsequent view.

39. A computer-readable medium including program code stored thereon, comprising:

program code to determine a direction that a mobile platform is facing;

program code to determine a position of a mobile platform;

program code to obtain a digital map based on the position of the mobile platform;

program code to display a current view and a subsequent view on a display of the mobile platform, wherein the current view and the subsequent view are different views selected from one of a camera view and a view of the digital map; and

program code to produce and display a user interface transition between the current view and the subsequent view, the user interface transition comprising one or more frames that provide a visual connection between an orientation in the current view and an orientation in the subsequent view.

40. The computer-readable medium of claim 39, further comprising:

program code to identify at least one visibly identifiable environmental characteristic in an image from a camera of the mobile platform and the same at least one visibly identifiable environmental characteristic in the digital map; and

program code to generate a first augmentation overlay for the at least one visibly identifiable environmental characteristic in the current view and a second augmentation overlay for the at least one visibly identifiable environmental characteristic in the subsequent view and at least one different augmentation overlay that provides a visual connection between the first augmentation overlay and the second augmentation overlay, wherein the user interface transition comprises the first augmentation overlay, the second augmentation overlay and the at least one different augmentation overlay.