Multi-Modal Life Organizer

• US 20110137548A1
• Filed: 12/07/2009
• Published: 06/09/2011
• Est. Priority Date: 12/07/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Yang, Fan, Zheng, Kun, Shen, Guo Bin, Zhang, Zheng, Wang, Min, Zou, Xin
• Application Number:
  US12/632,575
• Publication Number:
  US 20110137548A1
• Time in Patent Office: Days
• US Class Current: 701/201
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals

Abstract

A system for organizing a variety of information related to a user is disclosed. A user may input geo-tagged multi-modal information into a mobile device. This data is automatically transferred to cloud computing resources, and made available for access by the user at a desktop or laptop computing device. After input, an implicit search based on the geolocation of the input may be undertaken and results provided to the user. Input may be flags to designate a personal point of interest (PPOI), for sharing with others, for enabling location or people-based reminders, and so forth. Reminders for upcoming activities are provided to the user such that the user has sufficient time to move from the current geolocation to the geolocation of the activity.

Claims

1. A computer-implemented method comprising:

under control of one or more computer systems configured with executable instructions,

detecting a shaking of portable electronic device;

beginning acquisition of a note upon the detecting of the shaking of the portable electronic device;

determining a geolocation of the portable electronic device when the note is acquired;

assigning the geolocation to the note;

initiating a search based at least in part on the geolocation and generating search results from the initiated search;

generating a map corresponding to at least a portion of the search results;

presenting the note, the search results, and the map on the portable electronic device; and

generating a reminder from the note.

2. The method of claim 1, wherein the shaking of the portable electronic device awakens the portable electronic device from a standby mode.

3. The method of claim 1, wherein the determining of the geolocation comprises:

interrogating the portable electronic device;

interrogating a user via the portable electronic device;

accessing a location service from a wireless communication service;

or

accessing a geolocation service.

4. The method of claim 1, wherein the note comprises:

an audio recording;

a text entry;

a picture;

or

a video.

5. The method of claim 1, wherein the portable electronic device is in a locked state prior to shaking and wherein the portable electronic device acquires the note while remaining in the locked state.

6. The method of claim 5, wherein the locked state renders the portable electronic device unresponsive to keypad inputs from a user.

7. The method of claim 1, wherein the geolocation is assigned to the note after geolocation information becomes available from a geolocation module.

17. The method of claim 1, wherein the geolocation is assigned to the note after geolocation information becomes available.

8. A cloud computing system coupled to a communication system and comprising:

a storage module configured to communicate with a handheld computing device via the communication system and store a note comprising geolocation data;

a query module configured to execute a query using the geolocation data from the note and generate search results based at least in part on the execution of the query;

a reminder module configured to generate a time-to-arrive, a time-to-leave or both when the note comprises an appointment;

a mapping module configured to generate a map associated with at least one of the search results or appointments and overlaid with a quick zoom grid; and

a delivery module configured to deliver the note, the search results, and the map to a computing device via the communication system.

9. The system of claim 8, wherein the search results further comprise reservation information corresponding to a geolocation of an appointment.

10. The system of claim 8, wherein the note comprises:

an audio recording;

a text entry;

a picture;

or

a video.

11. The system of claim 8, wherein the quick zoom grid is configured to accept a user selection of a rectilinear region of the quick zoom grid and enlarge the selected rectilinear region to a pre-determined magnification.

12. The system of claim 8, wherein the time-to-arrive or time-to-leave are based at least in part on a geolocation of an appointment and a current geolocation of the handheld computing device.

13. One or more computer-readable storage media storing instructions that, when executed by a processor cause the processor to perform acts comprising:

acquiring a note on a portable electronic device;

determining a geolocation of the portable electronic device associated with acquisition of the note;

assigning the geolocation to the note;

initiating a search based at least in part on the geolocation; and

presenting search results from the search.

14. The computer-readable storage media of claim 13, wherein the acquisition of the note commences upon a first shaking of the portable electronic device and terminates upon;

(1) a second shaking of the portable electronic device;

(2) meeting or exceeding a pre-determined time subsequent to the first shaking, or (3) reaching a pre-determined storage threshold of the portable electronic device.

15. The computer-readable storage media of claim 13, wherein the portable electronic device is in a locked state prior to shaking and wherein the portable electronic device acquires the note while remaining in the locked state.

16. The computer-readable storage media of claim 15, wherein the locked state renders the portable electronic device unresponsive to inputs other than shaking.

18. The computer-readable storage media of claim 13, wherein the search results comprises a map with a quick zoom overlay, and wherein the quick zoom overlay defines user-selectable regions on the map which, when selected, enlarges the selected region to a pre-determined magnification.

19. The computer-readable storage media of claim 13, wherein the note comprises:

an appointment;

an audio recording;

a text entry;

a picture;

or

a video.

20. The computer-readable storage media of claim 13, wherein the appointment further comprises a time-to-arrive, time-to-leave or both that is dynamically updated to reflect a changing geolocation of the portable electronic device.