Data services based on gesture and location information of device

• US 8,868,374 B2
• Filed: 06/03/2013
• Issued: 10/21/2014
• Est. Priority Date: 06/20/2008
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Khosravy, Moe, Novik, Lev, Morris, Katrika Marie
• Primary Examiner(s): PAULS, JOHN A
• Application Number:
  US13/908,737
• Publication Number:
  US 20130265223A1
• Time in Patent Office: 505 Days
• Field of Search: 701/211, 702/153
• US Class Current: 702/153
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/3811 Point data, e.g. Point of Interest [POI]
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

With the addition of directional information and gesture based input in a location based services environment, a variety of service(s) can be provided on top of user identification or interaction with specific object(s) of interest. For instance, when a user gestures at or points at a particular item, or gestures at a particular location or place, this creates an opportunity, e.g., an advertising opportunity, for anyone having an interest in that particular item or place to communicate with the user regarding that item or related items at a point in time when the user'"'"'s focus is on the particular item. User context for the interaction can also be taken into account to supplement the provision of one or more interactive direction based services.

Claims

1. A method, implemented at a portable computing device that includes one or more processors, for displaying different views at the portable computing device, the method comprising:

receiving a first gesture at the portable computing device, the first gesture received at a physical location, the first gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the first gesture;

based on receiving the first gesture;

displaying a two-dimensional (2D) map-based view of a geographical area corresponding to the physical location based on location and direction information measured by the portable computing device; and

displaying at least one indication of a particular point of interest that is contextually relevant to the portable computing device within the 2D map-based view of the geographical area; and

receiving a second gesture at the portable computing device, the second gesture received at the physical location, the second gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the second gesture;

based on receiving the second gesture;

displaying a three-dimensional (3D) perspective view of the geographical area instead of the 2D map-based view of the geographical area; and

displaying at least one indication of the particular point of interest within the 3D perspective view of the geographical area.

2. The method of claim 1, wherein receiving the first gesture comprises detecting a first type of physical motion of the portable computing device.

3. The method of claim 2, wherein receiving the second gesture comprises detecting a second type of physical motion of the portable computing device.

4. The method of claim 1, wherein the 2D map-based view of the geographical area comprises a topographical map.

5. The method of claim 1, wherein the 3D perspective view of the geographical area comprises an image view of a real space as captured by a camera at the portable computing device, and wherein the at least one indication of the particular point of interest is overlaid over the image view of the real space.

6. The method of claim 1, further comprising:

receiving a third gesture comprising a tilting of the portable computing device.

7. The method of claim 6, further comprising:

in response to receiving the third gesture, zooming the 2D map-based view of the geographical area or the 3D perspective view of the geographical area.

8. The method of claim 6, further comprising:

in response to receiving the third gesture, displaying one or more additional details about the particular point of interest.

9. A computer program product comprising one or more physical storage media having stored thereon computer-executable instruction that, when executed by one or more processors of a portable computing device, cause the portable computing device to implement a method for displaying different views at the portable computing device, including the following:

receiving a first gesture at the portable computing device, the first gesture received at a physical location, the first gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the first gesture;

based on receiving the first gesture;

displaying a two-dimensional (2D) map-based view of a geographical area corresponding to the physical location based on location and direction information measured by the portable computing device; and

displaying at least one indication of a particular point of interest that is contextually relevant to the portable computing device within the 2D map-based view of the geographical area; and

receiving a second gesture at the portable computing device, the second gesture received at the physical location, the second gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the second gesture;

based on receiving the second gesture;

displaying a three-dimensional (3D) perspective view of the geographical area instead of the 2D map-based view of the geographical area; and

displaying at least one indication of the particular point of interest within the 3D perspective view of the geographical area.

10. The computer program product of claim 9, wherein receiving the first gesture comprises detecting a first type of physical motion of the portable computing device.

11. The computer program product of claim 9, wherein receiving the second gesture comprises detecting a second type of physical motion of the portable computing device.

12. The computer program product of claim 9, wherein the 2D map-based view of the geographical area comprises a topographical map.

13. The computer program product of claim 9, wherein the 3D perspective view of the geographical area comprises an image view of a real space as captured by a camera at the portable computing device, and wherein the at least one indication of the particular point of interest is overlaid over the image view of the real space.

14. The computer program product of claim 9, further comprising:

receiving a third gesture comprising a tilting of the portable computing device.

15. The computer program product of claim 14, further comprising:

in response to receiving the third gesture, zooming the 2D map-based view of the geographical area or the 3D perspective view of the geographical area.

16. The computer program product of claim 14, further comprising:

in response to receiving the third gesture, displaying one or more additional details about the particular point of interest.

17. A computer system, comprising:

one or more processors; and

one or more computer-readable media having stored thereon computer-executable instruction that, when executed by one or more processors of a portable computing device, cause the portable computing device to implement a method for displaying different views at the portable computing device, including the following;

receiving a first gesture at the portable computing device, the first gesture received at a physical location, the first gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the first gesture;

based on receiving the first gesture;

displaying a two-dimensional (2D) map-based view of a geographical area corresponding to the physical location based on location and direction information measured by the portable computing device; and

displaying at least one indication of a particular point of interest that is contextually relevant to the portable computing device within the 2D map-based view of the geographical area;

receiving a second gesture at the portable computing device, the second gesture received at the physical location, the second gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the second gesture;

based on receiving the second gesture;

displaying a three-dimensional (3D) perspective view of the geographical area instead of the 2D map-based view of the geographical area; and

displaying at least one indication of the particular point of interest within the 3D perspective view of the geographical area; and

while displaying the 3D perspective view of the geographical area or the 2D map-based view of the geographical area, receiving a third gesture comprising a tilting of the portable computing device, the third gesture comprising one or more physical movements of the portable computing device in which one or more detected change in motion, direction or orientation of the portable computing device is used to define the third gesture;

based on receiving the third gesture;

zooming the 2D map-based view of the geographical area or the 3D perspective view of the geographical area;

or

displaying one or more additional details about the particular point of interest.

18. The computer system of claim 17, wherein zooming the 2D map-based view of the geographical area or the 3D perspective view of the geographical area comprises increasing or decreasing the granularity of information displayed on the 2D map-based view or the 3D perspective view.

19. The computer system of claim 17, wherein displaying at least one indication of a particular point of interest comprises displaying a plurality of points of interest.

20. The computer system of claim 19, wherein the plurality of points of interest include one or more of venues within a determined distance from the portable device, one or more properties for sale within a determined distance from the portable device, or one or more people within a determined distance from the portable device.