Methods, apparatus and systems for providing remote assistance for visually-impaired users
First Claim
1. A system for providing remote assistance for one or more visually-impaired users, the system comprising:
- an agent device having one or more processors and a display, the one or more processors configured to;
receive video content including images of an environment in which a client device is located;
receive information indicating a visual impairment of a user of the client device;
identify a mask that simulates the visual impairment, the mask comprising a fixed component filter and a variable-component filter, wherein the variable-component filter is adjustable to simulate variations in the visual impairment;
apply the mask to the received video content to generate filtered video content representative of what the environment looks like to the user based on the visual impairment of the user; and
cause the filtered video content to be displayed on the display.
1 Assignment
0 Petitions
Accused Products
Abstract
Techniques and systems are provided for assisting a user through a guidance mode activity. Such a user may be visually or otherwise impaired, or a user requiring help for other reasons. In some embodiments, a client device, held or worn by the user, may comprise a video capture device and several sensors, and may send video data and sensor data to a server. The server may comprise a processor and artificial intelligence. The server may send the video data and sensor data to an agent device. The agent device may provide content for display on an agent interface. An agent may view the agent interface, and assist the user in real time through audio instructions or other feedback.
-
Citations
15 Claims
-
1. A system for providing remote assistance for one or more visually-impaired users, the system comprising:
an agent device having one or more processors and a display, the one or more processors configured to; receive video content including images of an environment in which a client device is located; receive information indicating a visual impairment of a user of the client device; identify a mask that simulates the visual impairment, the mask comprising a fixed component filter and a variable-component filter, wherein the variable-component filter is adjustable to simulate variations in the visual impairment; apply the mask to the received video content to generate filtered video content representative of what the environment looks like to the user based on the visual impairment of the user; and cause the filtered video content to be displayed on the display. - View Dependent Claims (2, 3, 4, 5)
-
6. A computer-implemented method of providing remote assistance for one or more visually-impaired users, the method comprising:
-
receiving video content at an agent device, the video content including images of an environment in which a client device is located; receiving information indicating a visual impairment of a user of the client device; identifying a mask that simulates the visual impairment of the user, the mask comprising a fixed component filter and a variable-component filter, wherein the variable-component filter is adjustable to simulate variations in the visual impairment; applying the mask to the received video content to generate filtered video content representative of what the environment looks like to the user based on the visual impairment of the user; and providing the filtered video content for display on the agent device. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A computer-readable memory storing a plurality of instructions executable by one or more processors, the plurality of instructions comprising:
-
instructions that cause the one or more processors to receive video content at an agent device, the video content including images of an environment in which a client device is located; instructions that cause the one or more processors to receive information indicating a visual impairment of a user of the client device; instructions that cause the one or more processors to identify a mask that simulates the visual impairment of the user, the mask comprising a fixed component filter and a variable-component filter, wherein the variable-component filter is adjustable to simulate variations in the visual impairment; instructions that cause the one or more processors to apply the mask to the video content to generate filtered video content representative of what the environment looks like to the user based on the visual impairment of the user; and instructions that cause the one or more processors to provide the filtered video content for display on the agent device. - View Dependent Claims (12, 13, 14, 15)
-
Specification