Geotemporal web and mobile service system and methods

• US 9,552,334 B1
• Filed: 05/10/2012
• Issued: 01/24/2017
• Est. Priority Date: 05/10/2011
• Status: Active Grant

• Current Assignee: Myplanit, Inc.
• Original Assignee: Myplanit, Inc.
• Inventors: Meisels, Adrienne, Besseling, Bart, Weinstein, Matthew, Gray, Michael
• Primary Examiner(s): Reyes, Mariela
• Assistant Examiner(s): CONYERS, DAWAUNE A
• Application Number:
  US13/468,898
• Time in Patent Office: 1,720 Days
• Field of Search: 707/722
• US Class Current: 1/1
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/295 Named entity recognition
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

A system and a method are presented for providing a data schema for managing people'"'"'s important relationships to other people and businesses, past-present-future plans and events, places, activities, memorable life moments and any information about anything that exists or occurred in the earth'"'"'s time-space reality, as well as a set of Internet services and transactions that allow people to make plans for the future, discover what to do and where to go for their present and future, discover content and commercial offerings for places in which they are or may be interested, and let them organize, share, recall and relive their history in useful and powerful ways.

Claims

1. A computer-based method of organizing and structuring electronically stored information comprising:

receiving data at a central database comprising one or more server computers executing on one or more processors, from a computing device or one or more web service server computers executing on one or more processors in communication with the central database, the received data related to content types stored on the computing device or the web service server computers, the content types comprising text, videos, photos, audio recordings, notes, calendar entries, contact entries, and GPS location data;

extracting at the central database any people, date, place, event, and related descriptor data from the received data regardless of the content types to which the received data relate and storing the extracted data in the central database;

determining at the central database if the place data has a GPS value and an estimate of error for the GPS value;

determining if the central database has any other data having a deterministic relationship to the place data that indicates a place where a moment or event took place when there is no GPS value for the place data or the estimate of error for the GPS value is above a maximum allowed error and using the other data, data received from a venue database aggregator and a geocoder service server computer in communication with the central database or the computing device to compute a valid GPS value for the place data to update the place data;

generating a plurality of nodes comprising portions of the extracted data in a plurality of formats corresponding to the generated nodes, the generated nodes comprising a person node, an event node, a date node, a place node, and related descriptor node;

generating, by the one or more processors of the central database, a plurality of composite moment records from the generated nodes, wherein each composite moment record comprises linked nodes having at least three of a person node type, date node type, place node type, event node type, and related descriptor node;

receiving at the central database a request from the computing device or from one or more web service server computers executing on one or more processors in communication with the central database or the computing device to display on the computing device a slice of data related to the extracted data, wherein the slice comprises one or more of date, person, place, or event data, weak links, slice attributes or relationship records related to the extracted data;

identifying or receiving an ordering for the requested slice at the central database;

ordering, at the central database the composite moment records to identify a sorted list of the composite moment records based on a comparison of the ordering and corresponding data of the composite moment records;

obtaining from the central database data and content on the computing device or the web service servers in communication with the computing device or the central database, data and the content corresponding to the requested slice of data related to the extracted data; and

displaying from the central database or the one or more servers in communication with the central database a display of the requested slice on the computing device.

2. The method of claim 1, further comprising receiving data related to content stored on a social networking service server computer in communication with the computing device or the central database;

extracting at the central database any event, date, person, and place data associated with the content stored on the social networking service computer;

determining if the place data associated with the content stored on the social networking service computer data has a GPS value and an estimate of error for the GPS value; and

determining if the central database has any other data having a deterministic relationship to the place data associated with the content stored on the social networking service that indicates where a moment took place and using the other data, data received from the venue database aggregator, the place data associated with the content stored on the social networking service server, and data received from the geocoder service server computer, to compute a valid GPS value for the place data when there is no GPS value for the place data or the estimate of error is above the maximum allowed error.

3. The method of claim 2, further comprising

sharing, by the processing device, the sorted list of related composite moment records between application software on the computing device such that the relative time and space context is retained and wherein the ordering comprises a time order and a geographic order.

4. The method of claim 3, further comprising

computing map annotations corresponding to the place data corresponding to the requested slice of the extracted data;

grouping the map annotations for the requested slice; and

communicating the grouped map annotations for presentation in a visual display on the computing device, wherein the annotations contain links to the content on the computing device corresponding to the requested slice, wherein the map can be zoomed in or out and pan, dynamically retrieving additional place data corresponding to the requested slice.

5. The method of claim 4, further comprising presenting the requested slice of the extracted data using a date-time slider that dynamically retrieves map annotations from the central data base corresponding to a date and time indicated on the date-time slider display on the computing device when a marker on the date-time slider is moved and updates annotations on the map.

6. The method of claim 5, further comprising analyzing photo and video data from the central database using a face recognition or other body part recognition system to identify persons associated with moments and associating persons identified with the composite records.

7. The method of claim 6, wherein the data received at the central database includes data received from a web service server computer or the computing device comprising historical online credit card, debit card, or ATM transactions.

8. The method of claim 6, further comprising receiving at the central database descriptors of feelings, adjectives, moods, or activities associated with the content;

and

the slice comprises one or more of the date, person, place, or event extracted data and the descriptors of feelings, adjectives, moods, or activities associated with the content

when the map is zoomed in or out or panned or markers of the date-time slider are moved, dynamically retrieving additional place data corresponding to the extracted data for the requested slice with the date and time modified by the markers of the date-time slider and boundaries of the zoomed or panned map.

9. A system for storing and managing personal information comprising:

a central database executing on one or more processors and one or more servers in communication with computing device, one or more web service server computers, a venue database aggregator service server, and a geocoder service server executing on one or more processors,

the central database programmed or configured to receive data from the computing device or the servers in communication with the central database, the received data related to content types stored on the computing device or the one or more web service server computers, the content types comprising text, video, audio recordings, photos, calendar entries, GPS location data, and contact entries;

extract any people, date, place, event and related descriptor data from the received data regardless of the content types to which the received data relate;

determine if the place data has a GPS value and an estimate of error for the GPS value;

determine if the central database has any other data having a deterministic relationship to the place data that indicates a place where a moment or event took place if there is no GPS value for the place data or the estimate of error is above a maximum allowed error, and use the other data, data received from the venue database aggregator server, and the geocoder service server to compute a valid GPS value for the extracted place data;

generate a plurality of nodes comprising portions of the extracted data in a plurality of formats corresponding to the generated nodes, the generated nodes comprising a person node, an event node, a date node, a place node, and related descriptor node;

generate a plurality of composite moment records from the generated nodes, wherein each composite moment record comprises linked nodes having at least three of a person node, date node, and related descriptor node;

receive at the central database a request from the computing device or from one or more web service server computers executing on one or more processors in communication with the computing device or the central database to display on the computing device a slice of data related to the extracted data, wherein the slice comprises one or more of date, person, place, or event data, weak links or relationship records, or slice attributes related to the extracted data;

identify or receive an ordering for the requested slice at the central database;

order, at the central database the composite moment records to identify a sorted list of the composite moment records based on a comparison of the ordering characteristic and the corresponding data of the composite moment records;

obtain from the central database the data and content on the computing device or the web service servers in communication with the computing device or the central database the data and the content corresponding to the requested slice of the extracted data; and

display from the central database or from the one or more server computers in communication with the central database a display of the requested slice on the computing device in a textual display, a calendar display, or a timeline display.

10. The system of claim 9, wherein the central database is further configured or programmed to:

compute map annotations corresponding to the place data corresponding to the requested slice of the extracted data;

group the map annotations for the requested slice;

communicate the grouped map annotations for presentation in a visual display on the computing device, wherein the annotations contain links to the content on the device corresponding to the requested slice, wherein the map can be zoomed in or out and pan, dynamically retrieving additional place data corresponding to the extracted data for the requested slice; and

present the requested slice of the extracted data using a date-time slider that dynamically retrieves map annotations from the central data base corresponding to a date and time indicated on the time-date slider display on the computing device and presents updated annotations on the map.

11. The system of claim 10, wherein the central database is further configured or programmed to:

analyze photo and video data from the central database using a face recognition or other body part recognition system to identify persons associated with moments and associate persons identified with the composite records.

12. The system of claim 11, wherein the central database is further configured or programmed to:

receive and process moment data received from a web service server computer or the computing device comprising historical online credit card, debit card, or ATM transactions.

13. A method for automatically generating and storing moment templates for creating a composite moment record in a central database for managing electronic personal information comprising:

receiving at a central database data from a computing device a date, time, and location of the computing device;

retrieving and analyzing previously stored moment templates of composite moment records from the central database or the computing device based on the time and the location of the computing device;

generating behavioral filters of multiple record moments to predict moment attributes;

automatically generating a moment template for person, place, date, and event information based on comparing the date, time, and location of the computing device or recently created composite moment records with previously created composite moment records and the predicted moment attributes;

receiving at the central database edited or additional person, place, date, and event data and content associated with the moment template from the computing device or one or more web service computers executing on one or more processors, the content comprising content types including one or more of text, video, audio recordings, photos, calendar entries, GPS location data, social media feeds, weather, traffic, or contact entries;

updating the moment template with the edited or additional data, regardless of the content types; and

creating and storing in the central database the composite moment record, wherein each composite moment record comprises linked nodes having at least a person node type, place node type, and date node type, and comprising normalized data associated with a particular node type from the updated template.

14. The method of claim 13, further comprising receiving content comprising text, videos, photos, audio recordings, notes, calendar entries, contact entries, and GPS location data associated with the moment template;

and updating the composite moment record with the associated content.

15. The method of claim 13, further comprising receiving a request to convert the moment template to an auto-event having a start and end time and date;

and creating the auto-event and storing the auto-event in the central database.

16. The method of claim 13, wherein the received additional or edited data of the moment template comprises descriptors of feelings, adjectives, moods, or activities associated with the person, place, date, and event data and content associated with the moment template.

17. The method of claim 16, further comprising receiving content comprising text, videos, photos, audio recordings, calendar entries, or contact entries associated with the descriptors of the moment template;

and updating the composite moment record with the descriptors and the associated content.