Mobile information gateway for use in emergency situations or with special equipment

• US 9,763,071 B2
• Filed: 01/22/2014
• Issued: 09/12/2017
• Est. Priority Date: 09/22/2013
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Balram, Nikhil, Berkner, Kathrin, Tosic, Ivana, Wu, Wanmin
• Primary Examiner(s): Appiah, Charles
• Assistant Examiner(s): HOLLIDAY, JAIME MICHELE
• Application Number:
  US14/161,613
• Publication Number:
  US 20150087257A1
• Time in Patent Office: 1,329 Days
• Field of Search: 4554141, 4554041, 340 81, 34053912, 3405721, 3405731
• CPC Class Codes: G02B 2027/0167 Emergency system, e.g. to prevent injuries
• CPC Class Codes: G02B 26/101 with both horizontal and vertical deflecting means, e.g. raster or XY scanners colour television using laser beams scanning a display screen H04N9/3129
• CPC Class Codes: G02B 27/00 Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04M 11/04 with alarm systems, e.g. fire, police or burglar alarm systems
• CPC Class Codes: H04M 2250/56 including a user help function
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Abstract

A mobile information gateway comprises: a wearable human interface module having an image delivery and display mechanism for presenting information overlaid upon a wide field of view, a computing and communication module adapted to send and receive information to and from the human interface module; and a backend service server coupled for processing data. The present invention also includes a method for using a mobile information gateway comprises: capturing information with a mobile information gateway device; processing the information captured by the mobile information gateway device to detect an emergency condition; analyzing the information captured by the mobile information gateway device to identify an emergency response; retrieving instructional information corresponding the emergency response; and providing the instructional information on the mobile information gateway device.

Claims

1. A method for using one or more mobile information gateways, the method comprising:

capturing information with a first mobile information gateway device worn by a first user;

processing the information captured by the first mobile information gateway device to;

code patients with color-coded tags based on severity of patient condition;

overlay the color-coded tags for display in a first virtual plane so the color-coded tags appear overlaid over corresponding patients on a first view of the first mobile information gateway device worn by the first user;

identify locations of the patients; and

communicate with a second mobile information gateway device worn by a second user based on the locations of the patients and the color-coded tags overlaid over the corresponding patients on a second view of the second mobile information gateway device worn by the second user;

analyzing the information captured by the first mobile information gateway device to identify an emergency response for an emergency condition detected based on a particular color-coded tag;

retrieving instructional information corresponding to the emergency response;

providing the instructional information on the first mobile information gateway device;

capturing an action performed based on the instructional information;

determining whether the action was performed beyond a tolerance; and

in response to the action being performed beyond the tolerance, providing adjusted instructions on the first mobile information gateway device.

2. The method of claim 1 wherein the instructional information is a list of step-by-step instructions for addressing the emergency condition.

3. The method of claim 1 wherein the detected emergency condition is a specific injury to a human being and the instructional information is first aid instructions corresponding to the specific injury.

4. The method of claim 3 wherein:

the first mobile information gateway device includes a human interface module and a computing and communication module;

the computing and communication module stores the first aid instructions; and

the human interface module retrieves the first aid instructions from the computing and communication module, and presents the first aid instructions.

5. The method of claim 1 wherein the first mobile information gateway device is coupled to control a third device;

and the method comprises;

analyzing the captured information to determine whether the third device is used in the emergency response;

processing the instructional information to determine whether the third device should be activated; and

sending a signal with the first mobile information gateway device to control the third device.

6. The method of claim 1 wherein the first mobile information gateway device automatically generates and sends a message to an emergency dispatch center if the emergency condition is detected.

7. The method of claim 1 wherein the first mobile information gateway device captures and records additional information if the emergency condition is detected.

8. A method for using one or more mobile information gateways, the method comprising:

capturing information with a first mobile information gateway device;

processing the information captured by the first mobile information gateway device to;

code patients with color-coded tags based on severity of patient condition;

detect an emergency condition based on the color-coded tags;

overlay the color-coded tags for display in a first virtual plane so the color-coded tags appear overlaid over corresponding patients on a first view of the first mobile information gateway device worn by the first user;

identify locations of the patients;

communicate with a second mobile information gateway device worn by a second user based on the locations of the patients and the color-coded tags overlaid over the corresponding patients on a second view of the second mobile information gateway device worn by the second user; and

determine whether a third device is present and used in responding the emergency condition;

analyzing the information captured by the first mobile information gateway device to identify a type of the third device;

retrieving instructional information corresponding to the type of the third device;

presenting the instructional information on the first mobile information gateway device;

capturing an action performed based on the instructional information;

determining whether the action was performed beyond a tolerance; and

in response to the action being performed beyond the tolerance, providing adjusted instructions on the first mobile information gateway device.

9. The method of claim 8 wherein the third device is a defibrillator.

10. The method of claim 8 wherein the third device is a transportation vehicle, and the instructional information is step-by-step instructions for operating safety equipment built into the transportation vehicle.

11. The method of claim 8 comprising identifying and authenticating the first user based on the captured information, and wherein processing the information captured by the first mobile information gateway device is responsive to identifying and authenticating the first user.

12. The method of claim 8 comprising:

capturing additional information about use of the third device with the first mobile information gateway device;

processing the additional information to detect incorrect use of the third device; and

if incorrect use of the third device is detected, retrieving corrective instructions with the first mobile information gateway device and presenting the corrective instructions on the first mobile information gateway device.

13. The method of claim 8 comprising:

capturing additional information with the first mobile information gateway device;

processing the additional information to determine if the third device is used; and

generating and sending a message from the first mobile information gateway device indicating that the third device has been used.

14. A system for using one or more mobile information gateways comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

capture information with a first mobile information gateway device worn by a first user;

process the information captured by the first mobile information gateway device to;

code patients with color-coded tags based on severity of patient conditions;

overlay the color-coded tags for display in a first virtual plane so the color-coded tags appear overlaid over corresponding patients on a first view of the first mobile information gateway device worn by the first user;

identify locations of the patients; and

communicate with a second mobile information gateway device worn by a second user based on the locations of the patients and the color-coded tags overlaid over the corresponding patients on a second view of the second mobile information gateway device worn by the second user;

analyze the information captured by the first mobile information gateway device to identify an emergency response for an emergency condition detected based on a particular color-coded tag;

retrieve instructional information corresponding to the emergency response;

provide the instructional information on the first mobile information gateway device;

capture an action performed based on the instructional information;

determine whether the action was performed beyond a tolerance; and

in response to the action being performed beyond the tolerance, provide adjusted instructions on the first mobile information gateway device.

15. The system of claim 14 wherein the instructional information is a list of step-by-step instructions for addressing the emergency condition.

16. The system of claim 14 wherein the detected emergency condition is a specific injury to a human being and the instructional information is first aid instructions corresponding to the specific injury.

17. The system of claim 16 wherein:

the first mobile information gateway device includes a human interface module and a computing and communication module;

the computing and communication module stores the first aid instructions; and

the human interface module retrieves the first aid instructions from the computing and communication module, and presents the first aid instructions.

18. The system of claim 14 wherein the first mobile information gateway device is coupled to control a third device;

and the memory also stores instructions that, when executed, cause the system to;

analyze the captured information to determine whether the third device used in the emergency response;

process the instructional information to determine whether the third device should be activated; and

send a signal with the first mobile information gateway device to control the third device.

19. The system of claim 14 wherein the first mobile information gateway device automatically generates and sends a message to an emergency dispatch center if the emergency condition is detected.

20. The system of claim 14 wherein the first mobile information gateway device captures and records additional information if the emergency condition is detected.