Visual assistance systems and related methods

• US 9,843,678 B2
• Filed: 03/31/2016
• Issued: 12/12/2017
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Sorenson Ip Holdings, LLC
• Original Assignee: Sorenson Ip Holdings, LLC
• Inventors: Maxwell, Conrad Arlo, Shields, Richard
• Primary Examiner(s): Patel, Hemant
• Application Number:
  US15/088,008
• Publication Number:
  US 20160219147A1
• Time in Patent Office: 621 Days
• Field of Search: 348 1401- 1416, 370351-357, 379 37- 52, 37920101, 37926501-2661, 379 671- 8828, 709201-207, 709217-248
• CPC Class Codes: H04M 1/236 including keys on side or rear faces
• CPC Class Codes: H04M 1/72481 for visually impaired users
• CPC Class Codes: H04M 11/045 using recorded signals, e.g. speech
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04M 3/42068 where the identifier is used to access a profile
• CPC Class Codes: H04M 3/51 Centralised call answering arrangements requiring operator intervention , e.g. call or contact centers for telemarketing
• CPC Class Codes: H04M 3/5108 Secretarial services
• CPC Class Codes: H04M 3/5183 Call or contact centers with computer-telephony arrangements
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

Visual assistance systems and related methods are disclosed. A visual assistance system includes a visual assistance service configured to receive and display images from a user device on an electronic display for a live assistant. The visual assistance service is also configured to transmit assistant audio from the live assistant conveying information derived by the live assistant'"'"'s review of the images. A visual assistance system comprises a user device configured to capture and transmit the images to the visual assistance service. The user device is also configured to receive the assistant audio from the visual assistance service, and reproduce the assistant audio to a user of the user device. The user is registered with the visual assistance service as having at least a minimum level of visual disability. A method of operating the visual assistance system includes receiving the images from, and transmitting the assistant audio to the user device.

Claims

1. A visual assistance system comprising:

a visual assistance service configured to;

receive one or more call requests from a plurality of registered communication devices for providing visual assistance to visually-impaired users;

establish a first communication session between a first live assistant and a first registered communication device associated with a first visually-impaired user responsive to a first call request;

receive images from the first registered communication device during the first communication session;

display the images on an electronic display associated with the first live assistant;

access, at a call station of the first live assistant, one or more of a call history, past voice messages, or past text messages for the first registered communication device during the first communication session;

transmit audio data to the first registered communication device during the first communication session; and

perform call routing during the communication session to route the communication session to a third party user device associated with a third party.

2. The visual assistance system of claim 1, wherein the visual assistance service is configured to access a contacts list for the first registered communication device during the first communication session for the live assistant to route the call to a contact from the contacts list.

3. The visual assistance system of claim 2, wherein the contact list for the first registered communication device is stored in a memory device associated with the visual assistance service such that the contact list is accessed by the visual assistance service during the first communication session from the memory device and not directly from the first registered communication device.

4. The visual assistance system of claim 1, wherein the visual assistance service is further configured to verify that the first registered communication device is a registered user prior to establishing the first communication session by querying a database of qualified registered users.

5. The visual assistance system of claim 1, wherein the visual assistance service includes a call center having a plurality of call stations for live assistants to receive the one or more call requests from the plurality of registered communication devices.

6. The visual assistance system of claim 1, wherein the visual assistance service is further configured to enable the first live assistant to remotely control a camera of the first registered communication device during the first communication session by performing an operation selected from the group consisting of remotely activating the camera during the first communication session, remotely deactivating the camera during the first communication session, remotely controlling a position of the camera during the first communication session, remotely taking a still image using camera during the first communication session, or any combination thereof.

17. The visual assistance system of claim 1, wherein visual assistance service is configured to access the call history, past voice messages, or past text messages from a centralized database storing such information for each registered user of the visual assistance system.

18. The visual assistance system of claim 1, wherein visual assistance service is configured to access the call history, past voice messages, and past text messages stored in memory of the a visual assistance service.

19. The visual assistance system of claim 1, wherein the visual assistance service includes a portal for enabling volunteers to act as live assistants through their personal computing devices modified to perform functions of the call station.

7. A visual assistance system comprising:

a visual assistance service; and

a plurality of registered communication devices networked with the visual assistance service remote from the plurality of registered communication devices, and configured to call the visual assistance service to establish communication sessions for one or more live assistants at the visual assistance service to provide visual assistance to a visually-impaired user associated with one of the registered communication devices, wherein the visual assistance service is configured to;

receive image data from the plurality of registered communication devices and send assistant audio data to the plurality of registered communication devices during their respective communication sessions;

access, via a live call assistant at a call station at the visual assistance service, one or more of a call history, past voice messages, or past text messages for the respective registered communication device during the respective communication sessions; and

route the communication sessions to third parties.

8. The visual assistance system of claim 7, wherein at least one registered communication device of the plurality includes a dedicated call button separate from other input devices for the at least one registered communication device, wherein the dedicated call button is configured to initiate a call directly to the visual assistance service responsive to a user input to the dedicated call button without dialing a full phone number on the other input devices.

9. The visual assistance system of claim 8, wherein the dedicated call button is a textured call button to enable the visually-impaired user to locate the dedicated call button by touch.

10. The visual assistance system of claim 7, wherein at least one registered communication device of the plurality includes one or more sensors configured to generate and transmit sensor data to the visual assistance service during its respective communication session.

11. The visual assistance system of claim 7, wherein at least one registered communication device of the plurality is configured to automatically initiate a call to the visual assistance service without user input responsive to detecting a predetermined event.

12. The visual assistance system of claim 11, wherein the predetermined event includes a detection using sensor data of the at least one registered communication device that the sensor data has crossed a predetermined threshold indicating a dangerous situation.

13. The visual assistance system of claim 7, wherein at least one registered communication device is configured to generate an audible alert responsive to the at least one registered communication device detecting an obstacle based on sensor data from one or more sensors of the at least one registered communication device.

20. The visual assistance system of claim 10, the sensor data includes accelerometer data and GPS data from the at least one registered user device from which the visual assistance service is configured to determine a number of steps per unit of distance traveled by the user.

14. A method of operating a visual assistance system, the method comprising:

receiving call requests from a plurality of registered communication devices at a visual assistance service for providing visual assistance to visually-impaired users associated with the plurality of registered communication devices;

establishing individual communication sessions between an individual registered communication device and a live assistant selected from a plurality of live assistant available for providing the visual assistance responsive to an individual call request;

receiving image data from the individual registered communication device during the individual communication session;

sending assistant audio data to the individual registered communication device during the individual communication session;

accessing, at a call station of the first live assistant, one or more of a call history, past voice messages, or past text messages for the individual registered communication device during the first communication session; and

routing the individual communication session to a third party to connect the individual registered communication device to the third party.

15. The method of claim 14, further comprising remotely controlling a camera of the individual registered communication device from the visual assistance service during the individual communication session.

16. The method of claim 14, wherein routing he individual communication session to the third party includes the visual assistance service retrieving a calling number for the third party by accessing a contact list associated with the individual registered communication device.