Data services based on gesture and location information of device

• US 10,509,477 B2
• Filed: 06/08/2017
• Issued: 12/17/2019
• Est. Priority Date: 06/20/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Khosravy, Moe, Novik, Lev, Morris, Katrika Marie
• Primary Examiner(s): Pauls, John A
• Application Number:
  US15/617,248
• Publication Number:
  US 20170269703A1
• Time in Patent Office: 922 Days
• Field of Search: 702153
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/3811 Point data, e.g. Point of Interest [POI]
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

With the addition of directional information and gesture based input in a location based services environment, a variety of service(s) can be provided. For example, a computer system can identify a spatially-related point of interest based on a geographical location of the computer system and based on directional information. The computer system can display a first visualization of a first type, including an indication of the point of interest, which represents the geographical location. Then, based on detecting a gesture, the computer can display a second visualization of a second type, also including an indication of the point of interest, which also represents the geographical location.

Claims

1. A computer system, comprising:

one or more processors;

one or more directional sensors; and

one or more computer-readable media having stored thereon computer-executable instructions that, when executed by the one or more processors, cause the computer system to perform at least the following;

identify a point of interest that is spatially-related to the computer system, based at least on a detected geographical location of the computer system and on directional information received from the one or more directional sensors;

display a first visualization of a first type that represents the geographical location, including displaying a first indication of the point of interest within the first visualization;

detect a gesture at the computer system; and

based at least on detecting the gesture, display a second visualization of a second type that also represents the geographical location, including displaying a second indication of the point of interest within the second visualization.

2. The computer system of claim 1, wherein the gesture is detected when the computer system is at the detected geographical location.

3. The computer system of claim 1, wherein the detected geographical location of the computer system and the directional information received from the one or more directional sensors indicate that at least one portion of the computer system is pointing to the point of interest.

4. The computer system of claim 1, wherein the gesture initiates a zoom operation, and wherein the first visualization displays a different level of detail regarding the point of interest than the second visualization.

5. The computer system of claim 1, wherein the computer system also includes one or more cameras, wherein at least one of the first visualization or the second visualization represents one or more virtual objects on one or more images captured with at least one of the one or more cameras, and wherein the first or second indication of the point of interest is presented over the one or more images.

6. The computer system of claim 1, wherein at least one of the first visualization or the second visualization displays a three-dimensional virtual model of a real world object at the detected geographical location, based at least on geometry data concerning the real world object, and wherein the first or second indication of the point of interest is presented over the three-dimensional virtual model.

7. The computer system of claim 1, wherein detecting the gesture at the computer system comprises detecting physical movement of the computer system.

8. The computer system of claim 1, wherein at least one of the first visualization or the second visualization comprises a map-based representation of the geographical location, and wherein the first or second indication of the point of interest is presented over the map-based representation.

9. The computer system of claim 1, wherein the first visualization comprises a two-dimensional visualization, and the second visualization comprises a three-dimensional visualization.

10. A method, implemented at a computer system that includes one or more processors, for displaying location-based point of interest data, the method comprising:

identifying a point of interest that is spatially-related to the computer system, based at least on a detected geographical location of the computer system and on directional information received from one or more directional sensors;

displaying a first visualization of a first type that represents the geographical location, including displaying a first indication of the point of interest within the first visualization;

detecting a gesture at the computer system; and

based at least on detecting the gesture, displaying a second visualization of a second type that also represents the geographical location, including displaying a second indication of the point of interest within the second visualization.

11. The method of claim 10, wherein at least one of the first visualization or the second visualization displays supplemental information about the point of interest.

12. The method of claim 10, wherein the gesture is detected when the computer system is at the detected geographical location.

13. The method of claim 10, wherein the detected geographical location of the computer system and the directional information received from the one or more directional sensors indicate that at least one portion of the computer system is pointing to the point of interest.

14. The method of claim 10, wherein at least one of the first visualization or the second visualization represents one or more virtual objects on one or more images captured with at least one camera at the computer system.

15. The method of claim 10, wherein at least one of the first visualization or the second visualization displays a three-dimensional virtual model of a real world object at the detected geographical location, based at least on geometry data concerning the real world object.

16. The method of claim 10, wherein detecting the gesture at the computer system comprises detecting physical movement of the computer system.

17. The method of claim 10, wherein at least one of the first visualization or the second visualization comprises a map-based representation of the geographical location.

18. The method of claim 10, wherein the first visualization comprises a two-dimensional visualization, and the second visualization comprises a three-dimensional visualization.

19. A computer program product comprising one or more hardware storage devices having stored thereon computer-executable instructions that, when executed by one or more processors, cause a computer system to perform at least the following:

identify a point of interest that is spatially-related to the computer system, based at least on a detected geographical location of the computer system and on directional information received from one or more directional sensors;

display a first visualization of a first type that represents the geographical location, including displaying a first indication of the point of interest within the first visualization;

detect a gesture at the computer system; and

based at least on detecting the gesture, display a second visualization of a second type that also represents the geographical location, including displaying a second indication of the point of interest within the second visualization.

20. The computer program product of claim 19, wherein detecting the gesture at the computer system comprises detecting physical movement of the computer system while the computer system is at the detected geographical location, and while the directional information indicates that at least one portion of the computer system is pointed at the point of interest.