Mobile device using images and location for reminders

• US 9,554,050 B2
• Filed: 03/04/2013
• Issued: 01/24/2017
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Dave, Swapnil R., Rao, Kaustubh M.
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): Haliyur, Padma
• Application Number:
  US13/784,695
• Publication Number:
  US 20140247383A1
• Time in Patent Office: 1,422 Days
• Field of Search: 348/211.3, 348/231.6, 348/333.02, 348/333.11, 348/333.12
• US Class Current: 1/1
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

Images can be used to improve setting reminders and the usefulness of reminders. For example, a mobile device can enable the user to request a reminder that uses one or more images obtained from a camera of the mobile device. The user can set a time period for when the image-based reminder is provided to the user. The image can provide information about the reminder as well as a visual depiction of the location the reminder is intended. A location can be detected in conjunction with capturing an image, and the location can be used to form a reminder message. The image can also be analyzed to provide the content of a message (e.g., text can be identified in the image and inserted into the message or used to access a database of corresponding messages). The derived message and/or the image can be provided for the reminder.

Claims

1. A method of providing a reminder to a user, the method comprising:

receiving, at a mobile device, a user request to create an image-based reminder, the user request including a time period;

capturing, with the mobile device, one or more images in conjunction with receiving the user request, the mobile device including a camera for capturing the one or more images;

detecting, with the mobile device, a first location of the mobile device in conjunction with receiving the user request;

storing, in a memory, the one or more images and the first location with an association to the time period;

monitoring time to detect when the time period is reached; and

when the time period is reached;

accessing the memory to obtain the one or more images and the first location;

detecting, with the mobile device, a current location of the mobile device;

determining a distance between the first location and the current location;

comparing the distance to a threshold distance;

in accordance with a determination that the distance does not exceed the threshold distance;

providing the image-based reminder to the user, the image-based reminder including the one or more images and the first location; and

in accordance with a determination that the distance exceeds the threshold distance;

identifying one or more other locations that are associated with one or more keywords that match one or more keywords associated with the first location; and

in accordance with a determination that the one or more other locations are within the threshold distance of the current location, providing the one or more other locations to the user.

2. The method of claim 1, wherein the first location is detected in response to the receiving of the user request or the capturing of the one or more images.

3. The method of claim 1, wherein providing the image-based reminder to the user includes:

displaying the one or more images with a link to a map indicating the first location, or

displaying a map indicating the first location with a link to the one or more images.

4. The method of claim 1, wherein the user request is received after the one or more images are captured, the method further comprising:

displaying a user input object for the user to indicate whether the one or more images are to be used for an image-based reminder, wherein receiving the user request includes;

receiving the user request via the user input object.

5. The method of claim 1, wherein the user request includes a message for providing with the image-based reminder.

6. The method of claim 1, wherein the memory is at a server or on the mobile device.

7. The method of claim 1, wherein the time period includes:

a date and time, or

an elapsed time from a start time of receiving the user request.

8. The method of claim 1, wherein capturing the one or more images is performed in response to receiving the user request.

19. The method of claim 1, further comprising:

prior to creating the image-based reminder, cross-referencing the first location with a database to identify a first keyword associated with the first location;

wherein the image-based reminder provided to the user further includes the first keyword.

20. The method of claim 1, wherein identifying the one or more other locations that are associated with the one or more keywords that match the one or more keywords associated with the first location comprises:

cross-referencing the first location with a database to identify the one or more keywords associated with the first location; and

cross-referencing at least one of the one or more keywords associated with the first location with the database to identify the one or more other locations associated with the one or more matching keywords.

9. A mobile device comprising:

a user interface configured to receive a user request to create an image-based reminder, the user request including a time period;

a camera for capturing one or more images in conjunction with receiving the user request;

a location detector configured to determine a first location of the mobile device in conjunction with receiving the user request;

a storage controller configured to store, in a memory, the one or more images and the first location with an association to the time period;

a processing subsystem configured to;

monitor time to detect when the time period is reached; and

when the time period is reached;

access the memory to obtain the one or more images and the first location;

determine a distance between the first location and a current location of the mobile device determined using the location detector;

compare the distance to a threshold distance;

in accordance with a determination that the distance does not exceed the threshold distance;

provide the image-based reminder to the user, the image-based reminder including the one or more images and the first location; and

in accordance with a determination that the distance exceeds the threshold distance;

identify one or more other locations that are associated with one or more keywords that match one or more keywords associated with the first location; and

in accordance with a determination that the one or more other locations are within the threshold distance of the current location, providing the one or more other locations to the user.

10. The mobile device of claim 9, wherein:

the location detector is configured to determine the first location of the mobile device in response to the receiving of the user request or the capturing of the one or more images.

11. The mobile device of claim 9, wherein the storage controller is configured to store the one or more images associated with the time period in a memory on a server in communication with the mobile device.

12. A method of providing a reminder to a user, the method comprising:

receiving, at a mobile device, a user request to create an image-based reminder, the user request including a time period;

capturing, with the mobile device, one or more images in conjunction with receiving the user request, the mobile device including a camera for capturing the one or more images;

extracting one or more identifying data items from the one or more images, wherein the one or more identifying data items include location information;

cross-referencing the location information with a database that stores one or more locations each associated with at least one of a corresponding keyword or a corresponding message, to identify a first message stored in the database and associated with the location information;

using the first message to form a reminder message;

storing, in a memory, the reminder message with an association to the time period;

monitoring time to detect when the time period is reached; and

when the time period is reached;

accessing the memory to obtain the reminder message; and

providing the reminder message to the user.

13. The method of claim 12, wherein extracting one or more identifying data items from the one or more images includes:

identifying text in the one or more images; and

the method further comprises using the text to form the reminder message.

14. The method of claim 12, wherein extracting one or more identifying data items from the one or more images includes:

identifying text in the one or more images;

the method further comprising;

cross-referencing the text with the database, the database including one or more keywords associated with messages in the database;

identifying a first keyword in the database that matches the text;

determining a second message that is associated with the first keyword; and

using the second message to form the reminder message.

15. The method of claim 12, wherein

cross-referencing the location information with the database to identify the first message associated with the location information includes:

cross-referencing the location information with the database to identify a first keyword associated with the location information; and

identifying the first message using the first keyword, wherein the first message is associated with the first keyword.

16. A mobile device comprising:

a user interface configured to receive a user request to create an image-based reminder, the user request including a time period;

a camera for capturing one or more images in conjunction with receiving the user request; and

a processing subsystem configured to;

extract one or more identifying data items from the one or more images, wherein the one or more identifying data items include location information;

cross-reference the location information with a database that stores one or more locations each associated with at least one of a corresponding keyword or a corresponding message, to identify a first message stored in the database and associated with the location information;

use the first message to form a reminder message;

store, in a memory, the reminder message with an association to the time period;

monitor time to detect when the time period is reached; and

when the time period is reached;

access the memory to obtain the reminder message; and

provide the reminder message to the user.

17. The mobile device of claim 16, wherein the processing subsystem is further configured to:

identify text in the one or more images;

cross-reference the text with the database;

identify a first keyword in the database that matches the text;

determine a second message using the first keyword, wherein the second message is associated with the first keyword; and

use the second message to form the reminder message.

18. The mobile device of claim 16,

wherein the processing subsystem is further configured to:

cross-reference the location information with the database to identify a first keyword associated with the location information;

identify the first message using the first keyword, wherein the first message is associated with the first keyword.