Mobile information gateway for private customer interaction

• US 9,665,901 B2
• Filed: 12/20/2013
• Issued: 05/30/2017
• Est. Priority Date: 08/20/2013
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Balram, Nikhil, Berkner, Kathrin, Wu, Wanmin, Tosic, Ivana
• Primary Examiner(s): Smith, Jeffrey A
• Assistant Examiner(s): SMITH, LINDSEY B
• Application Number:
  US14/137,558
• Publication Number:
  US 20150058159A1
• Time in Patent Office: 1,257 Days
• Field of Search: 705 261- 272
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/00 Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06Q 20/321 using wearable devices
• CPC Class Codes: G06Q 20/3821 Electronic credentials
• CPC Class Codes: G06Q 30/0609 Buyer or seller confidence or verification
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: H04W 4/00 Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Abstract

A system and method for facilitating private user interaction is disclosed. The method comprises capturing information with a first mobile information gateway device; processing the captured information to determine an identity of a first user; processing the captured information to authenticate the first user; processing the identity of the first user to retrieve information of the first user; and presenting the retrieved information of the first user overlaid upon a first field of view by the first mobile information gateway device; and presenting the retrieved information to a second user overlaid upon a second field of view by the second mobile information gateway device.

Claims

1. A method for private user interaction, the method comprising:

capturing, by a human interface module of a first mobile information gateway device wearable by a first user, information about the first user;

transmitting, by the human interface module to a computing and communication module of the first mobile information gateway device, the captured information;

processing, by the computing and communication module, the captured information about the first user to determine an identity of the first user and to authenticate the first user;

processing, by the computing and communication module, the identity of the first user to retrieve user information of the first user and to retrieve a specialized service for use in servicing the first user based on the captured information and the user information;

determining, by the computing and communication module, a second user that is available and capable of assisting the first user in performing the specialized service, the second user being determined based on a service capability of the second user and a prior interaction with the first user, an availability of the second user being determined based on activities queued to be performed by a second mobile information gateway device wearable by the second user;

transmitting, by the computing and communication module to the human interface module of the first mobile information gateway device, the retrieved user information of the first user;

transmitting, by the computing and communication module to a human interface module of the second mobile information gateway device, the retrieved user information and the retrieved specialized service;

presenting, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on a see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon a first field of view of the first mobile information gateway device wearable by the first user; and

presenting, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user and the retrieved specialized service for use in servicing the first user on a see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon a first portion of a second field of view of the second mobile information gateway device wearable by the second user and the retrieved specialized service is overlaid upon a second portion of the second field of view of the second mobile information gateway device wearable by the second user.

2. The method of claim 1 wherein the processing, by the computing and communication module, the captured information about the first user to determine an identity of the first user and to authenticate the first user includes performing facial recognition or iris recognition.

3. The method of claim 1 wherein the presenting, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user includes displaying virtual teller services on the see-through medium of the human interface module of the first mobile information gateway device.

4. The method of claim 1 wherein the processing, by the computing and communication module, the identity of the first user to retrieve the specialized service includes retrieving a customized recommendation of services available based on the identity of the first user and the authentication of the first user.

5. The method of claim 1 further comprising:

processing, by the second mobile information gateway device, captured information about the second user to authenticate the second user.

6. The method of claim 1 wherein:

the presenting, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on the see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon the first field of view includes providing a first set of data including data of the first user on a private display of the first mobile information gateway device;

the presenting, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user on the see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon the first portion of the second field of view includes providing the first set of data including the data of the first user on a private display of the second mobile information gateway device; and

wherein the first set of data includes bank account information.

7. The method of claim 6 wherein:

the presenting, by the human interface module of the second mobile information gateway device, the retrieved specialized service for use in servicing the first user on the see-through medium of the human interface module of the second mobile information gateway device so the retrieved specialized service is overlaid upon the second portion of the second field of view includes providing a second set of data in addition to the first set of data on the private display of the second mobile information gateway device;

wherein the second set of data is not provided on the private display of the first mobile information gateway device; and

wherein the second set of data includes one from a group of credit history, loan status, credit card status, offers and promotions.

8. The method of claim 1 wherein:

the presenting, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on the see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon the first field of view includes providing a three dimensional image of data from a first perspective of the first user based on a position of the first mobile information gateway device; and

the presenting, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user and the retrieved specialized service for use in servicing the first user on the see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon the first portion of the second field of view and the retrieved specialized service is overlaid upon the second portion of the second field of view includes providing the three dimensional image of the data from a second perspective of the second user based on a position of the second mobile information gateway device.

9. The method of claim 5 further comprising establishing a private encrypted communication channel between the first mobile information gateway device and the second mobile information gateway device.

10. The method of claim 9 further comprising performing language translation of data transmitted over the private encrypted communication channel.

11. The method of claim 1 further comprising:

capturing, by the second mobile information gateway device, information about the first user;

analyzing, by the second mobile information gateway device, the information captured about the first user for authenticity;

detecting, by the second mobile information gateway device, whether an item associated with the first user is authentic; and

presenting a notification on the see-through medium of the human interface module of the second mobile information gateway device so it is overlaid upon the second portion of the second field of view of the second mobile information gateway device if the item is detected as not authentic.

12. A system for private user interaction comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

capture, by a human interface module of a first mobile information gateway device wearable by a first user, information about the first user;

transmit, by the human interface module to a computing and communication module of the first mobile information gateway device, the captured information;

process, by the computing and communication module, the captured information about the first user to determine an identity of the first user and to authenticate the first user;

process, by the computing and communication module, the identity of the first user to retrieve user information of the first user and to retrieve a specialized service for use in servicing the first user based on the captured information and the user information;

determine, by the computing and communication module, a second user that is available and capable of assisting the first user in performing the specialized service, the second user being determined based on a service capability of the second user and a prior interaction with the first user, an availability of the second user being determined based on activities queued to be performed by a second mobile information gateway device wearable by the second user;

transmit, by the computing and communication module to the human interface module of the first mobile information gateway device, the retrieved user information of the first user;

transmit, by the computing and communication module to a human interface module of the second mobile information gateway device, the retrieved user information and the retrieved specialized service;

present, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on a see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon a first field of view of the first mobile information gateway device wearable by the first user; and

present, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user and the retrieved specialized service for use in servicing the first user on a see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon a first portion of a second field of view and the retrieved specialized service is overlaid upon a second portion of the second field of view of the second mobile information gateway device wearable by the second user.

13. The system of claim 12 wherein the presentation, by the human interface module of the first mobile information gateway device, of the retrieved user information of the first user on the see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon a first field of view includes presenting financial information of the first user and displaying virtual teller servers on the see-through medium of the human interface module of the first mobile information gateway device.

14. The system of claim 12 wherein the processing, by the computing and communication module, of the identity of the first user to retrieve the specialized service includes retrieving a customized recommendation of services available based on the identity of the first user and the authentication of the first user.

15. The system of claim 12 wherein the memory also stores instructions that, when executed, cause the system to:

process, by the second mobile information gateway device, captured information about the second user to authenticate the second user.

16. The system of claim 12 wherein the memory also stores instructions that, when executed, cause the system to:

present, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on the see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon the first field of view includes providing a first set of data including data of the first user on a private display of the first mobile information gateway device;

present, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user on the see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon the first portion of the second field of view includes providing the first set of data including the data of the first user on a private display of the second mobile information gateway device; and

wherein the first set of data includes bank account information.

17. The system of claim 12 wherein the memory also stores instructions that, when executed, cause the system to:

present, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on the see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon the first field of view includes providing a three dimensional image of data from a first perspective of the first user based on a position of the first mobile information gateway device; and

present, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user and the retrieved specialized service for use in servicing the first user on the see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon the first portion of the second field of view and the retrieved specialized service is overlaid upon the second portion of the second field of view includes providing the three dimensional image of the data from a second perspective of the second user based on a position of the second mobile information gateway device.

18. The system of claim 12 wherein the memory also stores instructions that, when executed, cause the system to establish a private encrypted communication channel between the first mobile information gateway device and the second mobile information gateway device.

19. The system of claim 12 wherein the memory also stores instructions that, when executed, cause the system to:

capture, by the second mobile information gateway device, information about the first user;

analyze, by the second mobile information gateway device, the information captured about the first user for authenticity;

detect, by the second mobile information gateway device, whether an item associated with the first user is authentic; and

present a notification on the see-through medium of the human interface module of the second mobile information gateway device so it is overlaid upon the second portion of the second field of view of the second mobile information gateway device if the item is detected as not authentic.

20. A computer program product comprising a computer useable medium including a computer readable program, wherein the compute readable program when executed on a computer causes the computer to perform:

capturing, by a human interface module of a first mobile information gateway device wearable by a first user, information about the first user;

transmitting, by the human interface module to a computing and communication module of the first mobile information gateway device, the captured information;

processing, by the computing and communication module, the captured information about the first user to determine an identity of the first user and to authenticate the first user;

processing, by the computing and communication module, the identity of the first user to retrieve user information of the first user and to retrieve a specialized service for use in servicing the first user based on the captured information and the user information;

determining, by the computing and communication module, a second user that is available and capable of assisting the first user in performing the specialized service, the second user being determined based on a service capability of the second user and a prior interaction with the first user, an availability of the second user being determined based on activities queued to be performed by a second mobile information gateway device wearable by the second user;

transmitting, by the computing and communication module to the human interface module of the first mobile information gateway device, the retrieved user information of the first user;

transmitting, by the computing and communication module to a human interface module of the second mobile information gateway device, the retrieved user information and the retrieved specialized service;

presenting, by the human interface module of the first mobile information gateway device, the retrieved user information of the first user on a see-through medium of the human interface module of the first mobile information gateway device so the retrieved user information is overlaid upon a first field of view of the first mobile information gateway device wearable by the first user; and

presenting, by the human interface module of the second mobile information gateway device, the retrieved user information of the first user and the retrieved specialized service for use in servicing the first user on a see-through medium of the human interface module of the second mobile information gateway device so the retrieved user information is overlaid upon a first portion of a second field of view of the second mobile information gateway device wearable by the second user and the retrieved specialized service is overlaid upon a second portion of the second field of view of the second mobile information gateway device wearable by the second user.