MOBILE DEVICE USING IMAGES AND LOCATION FOR REMINDERS

• US 20140247383A1
• Filed: 03/04/2013
• Published: 09/04/2014
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Dave, Swapnil R., Rao, Kaustubh M.
• Granted Patent: US 9,554,050 B2
• Time in Patent Office: Days
• US Class Current: 348/333.02
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

Images can be used to improve setting reminders and the usefulness of reminders. For example, a mobile device can enable the user to request a reminder that uses one or more images obtained from a camera of the mobile device. The user can set a time period for when the image-based reminder is provided to the user. The image can provide information about the reminder as well as a visual depiction of the location the reminder is intended. A location can be detected in conjunction with capturing an image, and the location can be used to form a reminder message. The image can also be analyzed to provide the content of a message (e.g., text can be identified in the image and inserted into the message or used to access a database of corresponding messages). The derived message and/or the image can be provided for the reminder.

Claims

1. A method of providing a reminder to a user, the method comprising:

receiving, at a mobile device, a user request to create an image-based reminder, the user request including a time period;

capturing, with the mobile device, one or more images in conjunction with receiving the user request, the mobile device including a camera for capturing the one or more images;

storing, in a memory, the one or more images with an association to the time period;

monitoring time to detect when the time period is reached; and

when the time period is reached;

accessing the memory to obtain the one or more images, and

providing the image-based reminder to the user, the image-based reminder including the one or more images.

2. The method of claim 1, further comprising:

detecting, with the mobile device, a first location of the mobile device, the first location being detected in response to the receiving of the user request or the capturing of the one or more images;

storing, in the memory, the first location with an association to the time period and the one or more images;

when the time period is reached, accessing the memory to obtain the first location, wherein the image-based reminder further includes the first location.

3. The method of claim 2, further comprising:

detecting, with the mobile device, a current location of the mobile device when the time period is reached;

determining a distance between the first location and the current location;

comparing the distance to a threshold distance; and

when the distance exceeds the threshold distance;

identifying one or more other locations that are associated with keywords that match keywords associated with the first location, and

determining whether the one or more other locations are within the threshold distance of the current location.

4. The method of claim 2, wherein providing the image-based reminder to the user includes:

displaying the one or more images with a link to a map indicating the first location, or

displaying a map indicating the first location with a link to the one or more images.

5. The method of claim 1, wherein the user request is received after the one or more images are captured, the method further comprising:

displaying a user input object for the user to indicate whether the one or more images are to be used for an image-based reminder, wherein receiving the user request includes;

receiving the user request via the user input object.

6. The method of claim 1, wherein the user request includes a message for providing with the image-based reminder.

7. The method of claim 1, wherein the memory is at a server or on the mobile device.

8. The method of claim 1, wherein the time period includes:

a date and time, or

an elapsed time for a start time of receiving the user request.

9. The method of claim 1, wherein capturing the one or more images is performed in response to receiving the user request.

10. A mobile device comprising:

a user interface configured to receive a user request to create an image-based reminder, the user request including a time period

a camera for capturing one or more images in conjunction with receiving the user request;

a storage controller configured to store, in a memory, the one or more images with an association to the time period;

a processing subsystem configured to;

monitor time to detect when the time period is reached; and

when the time period is reached;

access the memory to obtain the one or more images; and

provide the image-based reminder to the user, the image-based reminder including the one or more images.

11. The mobile device of claim 10, further comprising:

a location detector configured to determine a first location of the mobile device in response to the receiving of the user request or the capturing of the one or more images,

wherein the storage controller is further configured to store, in the memory, the first location with an association to the time period and the one or more images, and

wherein the processing subsystem is further configured to;

when the time period is reached, access the memory to obtain the first location, wherein the image-based reminder further includes the first location.

12. The mobile device of claim 10, wherein the storage controller is configured to store the one or more images associated with the time period in a memory on a server in communication with the mobile device.

13. A method of providing a reminder to a user, the method comprising:

receiving, at a mobile device, a user request to create an image-based reminder, the user request including a time period;

capturing, with the mobile device, one or more images in conjunction with receiving the user request, the mobile device including a camera for capturing the one or more images;

extracting one or more identifying data items from the one or more images to form a reminder message;

storing, in a memory, the reminder message with an association to the time period;

monitoring time to detect when the time period is reached; and

when the time period is reached;

accessing the memory to obtain the reminder message; and

providing the reminder message to the user.

14. The method of claim 13, wherein extracting one or more identifying data items from the one or more images to form the reminder message includes:

identifying text in the one or more images; and

using the text to form the reminder message.

15. The method of claim 13, wherein extracting one or more identifying data items from the one or more images to form the reminder message includes:

identifying text in the one or more images;

cross-referencing the text with a database table of keywords, the keywords being associated with messages in the database table;

identifying a first keyword in the database table that matches the text;

determining a first message that is associated with the first keyword; and

using the first message to form the reminder message.

16. The method of claim 13, wherein capturing the one or more images includes:

detecting, with the mobile device, a first location of the mobile device, wherein the first location is stored as part of the one or more images, wherein extracting one or more identifying data items from the one or more images to form the reminder message includes;

extracting the first location as an identifying data item;

cross-referencing the first location with a database to identify a first keyword associated with the first location;

identifying a first message that is associated with the first keyword; and

using the first message to form the reminder message.

17. The method of claim 13, wherein capturing the one or more images includes:

detecting, with the mobile device, a first location of the mobile device, wherein the first location is stored as part of the one or more images, wherein extracting one or more identifying data items from the one or more images to form the reminder message includes;

extracting the first location as an identifying data item;

cross-referencing the first location with a database to identify a first message associated with the first location; and

using the first message to form the reminder message.

18. The method of claim 16, wherein the detecting the first location is in response to a signal to capture the one or more images.

19. A mobile device comprising:

a user interface configured to receive a user request to create an image-based reminder, the user request including a time period

a camera for capturing one or more images in conjunction with receiving the user request; and

a processing subsystem configured to;

extract one or more identifying data items from the one or more images to form a reminder message;

store, in a memory, the reminder message with an association to the time period;

monitor time to detect when the time period is reached; and

when the time period is reached;

access the memory to obtain the reminder message; and

provide the reminder message to the user.

20. The mobile device of claim 19, wherein the memory includes a database table that stores keywords associated with messages, and wherein the processing subsystem is further configured to:

identify text in the one or more images;

cross-reference the text with the database table of keywords;

identify a first keyword in the database table that matches the text;

determine a first message that is associated with the first keyword; and

use the first message to form the reminder message.

21. The mobile device of claim 19, further comprising:

a location detector configured to determine a first location of the mobile device in response to the receiving of the user request or the capturing of the one or more images, wherein the memory includes a database that stores locations associated with messages, and wherein the processing subsystem is further configured to;

extract the first location as an identifying data item of the one or more images;

cross-reference the first location with the database to identify a first keyword associated with the first location;

identify a first message that is associated with the first keyword; and

use the first message to form the reminder message.

22. The mobile device of claim 19, further comprising:

a location detector configured to determine a first location of the mobile device in response to the receiving of the user request or the capturing of the one or more images, wherein the memory includes a database that stores locations associated with messages, and wherein the processing subsystem is further configured to;

extract the first location as an identifying data item of the one or more images;

cross-reference the first location with a database to identify a first message associated with the first location; and

use the first message to form the reminder message.