Semantic note taking system

• US 9,141,698 B2
• Filed: 12/06/2013
• Issued: 09/22/2015
• Est. Priority Date: 01/27/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Brown, Stephen J., Schobel, Andreas
• Primary Examiner(s): LE, THIEN MINH
• Application Number:
  US14/099,890
• Publication Number:
  US 20140089313A1
• Time in Patent Office: 655 Days
• Field of Search: 23546201-46245, 23547201-47203, 235/454, 235/375
• US Class Current: 1/1
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/9554 by using bar codes
• CPC Class Codes: G06K 7/10554 Moving beam scanning
• CPC Class Codes: G06K 7/1413 1D bar codes
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A semantic note taking system and method for collecting information, enriching the information, and/or binding the information to services is provided. User-created notes are enriched with labels, context traits, and relevant data to minimize friction in the note-taking process. In other words, the present invention is directed to collecting unscripted data, adding more meaning and use out of the data, and binding the data to services. Mutable and late-binding to services is also provided to allow private thoughts to be published to a myriad of different applications and services in a manner compatible with how thoughts are processed in the brain. User interfaces and semantic skins are also provided to derive meaning out of notes without requiring a great deal of user input. Linking physical objects to notes are also provided, such as through QR codes.

Claims

1. A method comprising:

scanning, by a first mobile device including a sensor, a machine readable code attached to a physical object, the machine readable code including data identifying a food item;

retrieving, by the first mobile device, using the data identifying the food item, nutrition data corresponding to the food item;

associating the nutrition data with a new entry created in a dietary log to yield an updated dietary log;

sharing the updated dietary log with a second mobile device; and

categorizing the updated dietary log based on the food item.

2. The method of claim 1, further comprising associating supplemental information with the new entry created in the dietary log, wherein the supplemental information comprises at least one of an image of the physical object, information derived from the image of the physical object, wirelessly received information, a machine readable code associated with the physical object, information based on the machine readable code, or contextual traits related to the physical object.

3. The method of claim 2, wherein the contextual traits comprise at least one of a location, a place, a time, a source, a related entry, a person, people, a group, a tag, an identity, sensor data, a media file, an audio file, physical data relating to the first mobile device, or derived data.

4. The method of claim 2, wherein the image of the physical object comprises a visual representation of the machine readable code.

5. The method of claim 4, wherein the machine readable code comprises at least one of a quick response (QR) code or a bar code.

6. The method of claim 1, wherein the new entry comprises at least one of text, audio media, visual media, audio-visual media, recorded data, a weblink, or a pointer to an information source.

7. A first mobile device comprising:

a computer processor; and

a memory containing instructions that, when executed, cause the computer processor to;

scan a machine readable code attached to a physical object, the machine readable code including data identifying a food item;

retrieve, using the data identifying the food item, nutrition data corresponding to the food item;

associate the nutrition data with a new note created in a dietary log to yield an updated dietary log;

sharing the updated dietary log with a second mobile device; and

categorizing the updated dietary log based on the food item.

8. The first mobile device of claim 7, wherein the instructions further cause the computer processor to:

associate supplemental information with the new note created in the dietary log, wherein the supplemental information comprises at least one of an image of the physical object, information derived from the image of the physical object, wirelessly received information, a machine readable code associated with the physical object, information based on the machine readable code, or contextual traits related to the physical object.

9. The first mobile device of claim 8, wherein the contextual traits comprise at least one of a location, a place, a time, a source, a related note, a person, people, a group, a tag, an identity, sensor data, a media file, an audio file, physical data relating to the first mobile device, or derived data.

10. The first mobile device of claim 8, wherein the image of the physical object comprises a visual representation of the machine readable code.

11. The first mobile device of claim 10, wherein the machine readable code comprises at least one of a quick response (QR) code or a bar code.

12. The first mobile device of claim 7, wherein the new note comprises at least one of text, audio media, visual media, audio-visual media, recorded data, a weblink, or a pointer to an information source.

13. A non-transitory computer-readable medium containing instructions that, when executed by a computer processor of a first mobile device, cause the computer processor to:

scan a machine readable code attached to a physical object, the machine readable code including data identifying a food item;

retrieve, using the data identifying the food item, nutrition data corresponding to the food item;

associate the nutrition data with a new note created in a dietary log to yield an updated dietary log;

sharing the updated dietary log with a second mobile device; and

categorizing the updated dietary log based on the food item.

14. The non-transitory computer-readable medium of claim 13, wherein the instructions further cause the computer processor to:

associate supplemental information with the new note created in the dietary log, wherein the supplemental information comprises at least one of an image of the physical object, information derived from the image of the physical object, wirelessly received information, a machine readable code associated with the physical object, information based on the machine readable code, or contextual traits related to the physical object.

15. The non-transitory computer-readable medium of claim 14, wherein the contextual traits comprise at least one of a location, a place, a time, a source, a related note, a person, people, a group, a tag, an identity, sensor data, a media file, an audio file, physical data relating to the first mobile device, or derived data.

16. The non-transitory computer-readable medium of claim 14, wherein the image of the physical object comprises a visual representation of the machine readable code.

17. The non-transitory computer-readable medium of claim 16, wherein the machine readable code comprises at least one of a quick response (QR) code or a bar code.

18. The non-transitory computer-readable medium of claim 13, wherein the new note comprises at least one of text, audio media, visual media, audio-visual media, recorded data, a weblink, or a pointer to an information source.