ELECTRONIC NOTEBOOK SYSTEM

• US 20180270628A1
• Filed: 05/24/2018
• Published: 09/20/2018
• Est. Priority Date: 06/30/2016
• Status: Active Grant

• Current Assignee: The Notebook, LLC
• Original Assignee: Karen Elaine Khaleghi
• Inventors: Khaleghi, Karen Elaine
• Granted Patent: US 10,187,762 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: G10L 25/72 for transmitting results of analysis
• CPC Class Codes: G16H 20/00 ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: H04W 12/02 Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
• CPC Class Codes: H04W 4/14 Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]

Abstract

An electronic notebook system is described that comprises a housing, a computing device, wireless interfaces, antennas, sensors, a touch display configured to receive input via a stylus and/or human digit input, the stylus comprising a pressure and/or an inclination sensor, a microphone, camera, the notebook system configured to provide a user condition interface, receive a user selection of a first user condition, provide an interface configured to receive user details, receive audible user details via the microphone, convert the audible user details received via the microphone to text, perform natural language processing to identify text keywords utilizing sentence segmentation, part-of-speech tagging, paraphrase recognition, and/or co-reference resolution, identify a condition based at least in part on the identified one or more keywords, dynamically generate an alert based at least in part on the identified condition, wirelessly transmit the generated alert to one or more destinations via at least a first wireless interface and antenna.

Claims

1. A distributed system comprising:

handheld electronic notebook system comprising;

a housing;

at least one computing device;

a plurality of wireless interfaces;

a plurality of antennas coupled to respective wireless interfaces in the plurality of wireless interfaces, one or more of the plurality of antennas located within or on the housing;

a microphone;

a camera;

a cloud system comprising a plurality of geographically distributed server systems, and at least a first network interface;

wherein the distributed system is programmatically configured to perform operations comprising;

establishing, using a network interface of the handheld electronic notebook system and the first network interface of the cloud system, an encrypted transmission over a network between the handheld electronic notebook system and the cloud system using a secure transfer mechanism;

authenticating a user by causing;

capture of an image of the user using the handheld electronic notebook camera,

extraction of features of the user from the image,

comparison of the extracted features to stored features of an authorized user,

determination as to whether the extracted features are a match for the stored features of an authorized user, and if so, identify the user as the authorized user;

or

scanning of a fingerprint of the user using the handheld electronic notebook using a fingerprint scanner,

comparison of the scanned fingerprint to that of the authorized user,

determination as to whether the fingerprint of the user using the handheld electronic notebook is a match for the authorized user, and if so, identify the user as an authorized user;

enabling the handheld electronic notebook system to access, using the secure transfer mechanism, user medical data from a plurality of sources stored on the cloud system at least partly in response to determining that the user is the authorized user;

generating a user interface rendering at least a portion of the data from the plurality of sources using a zoomable graphic timeline configured to provide a quick overview of the user'"'"'s medical history;

causing, at a first time period, the user to be prompted, using a first prompt, to provide medical status information;

receiving, via the microphone on the handheld electronic notebook system, a first spoken response to the first prompt from the user, the first spoken response comprising a first sequence of words;

transmitting the first spoken response to the first prompt from the handheld electronic notebook system over the network to the cloud system using the secure transfer mechanism;

performing natural language processing, comprising language modeling and statistical analysis, on the received first spoken response comprising the first sequence of words to convert the first spoken response to text;

identifying one or more keywords in the first sequence of words to at least determine if the first sequence of words includes patient concerns;

generating a criticality score using the keywords identified in the first sequence of words and respective keyword weightings, wherein a first keyword in the first sequence of words is associated with a first weight and a second keyword in the first sequence of words is associated with a second weight;

identifying an urgent user condition based at least in part on the criticality score generated using the keywords identified in the first sequence of words and respective keyword weightings;

dynamically generating an alert based at least in part on the identified user urgent condition, wherein the dynamically generated alert comprises one or more of the keywords identified in the first sequence of words; and

transmitting the dynamically generated alert, including the one or more of the keywords identified in the first sequence of words, over the network to one or more destinations.

2. The system as defined in claim 1, the operations further comprising:

distributing respective tasks among nodes in the cloud system based at least in part on geographic proximity to data needed to perform the respective tasks.

3. The system as defined in claim 1, wherein performing natural language processing further comprising:

determining a probability of certain words or sounds following on from one another to thereby speed up word recognition and improve recognition accuracy.

4. The system as defined in claim 1, the operations further comprising:

accessing user data, the user data comprising;

biographical information;

diagnosis dates,

medical intervention dates,

appointments with medical professionals,

generating the zoomable graphic timeline using the accessed user data;

detecting a user selection of an item on the generated zoomable timeline; and

causing additional information regarding the timeline item selection to be presented.

5. The system as defined in claim 1, the operations further comprising:

generating a calendar entry for a first appointment;

recording audio content related to the first appointment using the handheld electronic notebook microphone;

transmitting the audio content from the handheld electronic notebook system over the network to the cloud system using the secure transfer mechanism;

using, at the cloud system, natural language processing, comprising language modeling and statistical analysis, to be performed on the audio content to convert the audio content to text; and

adding the text, one or more medical test results, and one or more prescriptions to the calendar entry for the first appointment.

6. The system as defined in claim 1, the operations further comprising:

recording audio content of a medical professional at a first appointment using the handheld electronic notebook microphone;

transmitting the audio content transmitting the audio content from the handheld electronic notebook system over the network to the cloud system using the secure transfer mechanism;

using, at the cloud system, natural language processing, comprising language modeling and statistical analysis, to be performed on the audio content to convert the audio content of the medical professional to text;

determining if the text includes a recommendation; and

at least partly in response to determining that the text includes a recommendation, adding the recommendation to an electronic to-do list.

7. The system as defined in claim 1, the operations further comprising:

generating a calendar entry for a first appointment;

recording video and audio content related to the first appointment using the handheld electronic notebook camera and microphone;

associating a timestamp with the recorded video and audio content; and

adding the video and audio content to the calendar entry.

8. The system as defined in claim 1, the operations further comprising:

determining a medical condition of the user;

selecting and displaying on the handheld electronic notebook a user interface corresponding to the medical condition from a set of available user interfaces comprising;

an autistic spectrum disorder user interface,

developmental disorder user interface,

emotional disorder user interface,

aging user interface user interface,

receiving data in one or more fields of the selected user interface; and

utilizing the secure transfer mechanism to synchronize the received data on the handheld electronic notebook data stored on the cloud system.

9. The system as defined in claim 1, the operations further comprising:

receiving referral contact information for a first medical provider;

automatically augmenting at least one calendar entry with at least a portion of the referral contact information.

10. The system as defined in claim 1, the operations further comprising:

providing an appointment user interface via the handheld electronic notebook, the appointment user interface including a field configured to receive user questions for a medical service provider with which the user has a scheduled appointment;

receiving the user questions via the appointment user interface;

transmitting, over the network, the user questions to the medical service provider prior to the appointment;

generating on the day of the appointment a reminder to the user via the handheld electronic notebook, the reminder indicating that the user to ask the user questions during the appointment with the medical service provider.

11. The system as defined in claim 1, the operations further comprising:

generating a specialists search user interface;

receiving, via the specialists search user interface, a user query for a specialist of a specified type that are in a first geographic area;

identifying names of specialists that match the user query;

causing a listing of names of specialists that match the user query to be rendered, wherein a given name comprises a link;

receiving a user selecting of a given name comprising a link;

enabling addition information regarding the selected name to be accessed and rendered.

12. The system as defined in claim 1, the operations further comprising:

generating a sharing user interface configured to share information from a plurality of sources regarding medical matters with other users;

the sharing user interface comprising;

a search field configured to receive a user search query enabling a user to search through postings regarding the medical matters;

a search filter user interface comprising predefined search filters, the search filters including one or more medical diagnosis or medical conditions;

a posting field configured to receive information to be posted;

a tag field configured to receive a tag to be associated with the received information to be posted;

a favorite control that enables the user to designate a posting or a posting user as a favorite;

conducting a search use the user search query and one or more user-selected search filters; and

providing search results for display.

13. The system as defined in claim 1, the operations further comprising:

providing a team user interface that enables;

a medical team comprising a plurality of team members to be defined for the user;

respective tasks to be associated with respective members of the medical team;

a designation of a team leader;

receiving, via the team user interface, a medical team definition, respective tasks, and a team leader designation;

wherein transmitting the dynamically generated alert, including the one or more of the keywords identified in the first sequence of words, over the network, comprises transmitting the alert to the designated team leader; and

enabling members of the defined team to communicate with each other and access data related to the user.