INTERACTIVE TEXT RECOGNITION BY A HEAD-MOUNTED DEVICE
First Claim
1. A system for assisting a user in a real-world environment, the system comprising:
- an assistance engine configured to;
receive, from a network transceiver of a head-mounted device, at least one context,receive, from the network transceiver, a video stream that comprises a first set of images,perform, based on the at least one context, an optical character recognition (OCR) process on the video stream, andtransmit, to the network transceiver, user information in response to performing the OCR process; and
the head-mounted device comprising;
a microphone configured to receive the at least one context from the user,a camera configured to capture the video stream from the real-world environment,a speaker configured to communicate the user information to the user, andthe network transceiver configured to transmit the video stream and the at least one context to the assistance engine, the network transceiver further configured to receive the user information from the assistance engine.
1 Assignment
0 Petitions
Accused Products
Abstract
A user is assisted in a real-world environment. An assistance engine receives at least one context from the user. The assistance engine also receives a video stream of the real-world environment. The assistance engine performs an optical character recognition process on the video stream based upon the at least one context. The assistance engine generates a response for the user. A microphone on a head-mounted device receives the context from the user. A camera on the head-mounted device captures the video stream of the real-world environment. A speaker on the head-mounted device communicates the response to the user. The user may move in the real-world environment based upon the response to improve the optical character recognition process.
-
Citations
20 Claims
-
1. A system for assisting a user in a real-world environment, the system comprising:
-
an assistance engine configured to; receive, from a network transceiver of a head-mounted device, at least one context, receive, from the network transceiver, a video stream that comprises a first set of images, perform, based on the at least one context, an optical character recognition (OCR) process on the video stream, and transmit, to the network transceiver, user information in response to performing the OCR process; and the head-mounted device comprising; a microphone configured to receive the at least one context from the user, a camera configured to capture the video stream from the real-world environment, a speaker configured to communicate the user information to the user, and the network transceiver configured to transmit the video stream and the at least one context to the assistance engine, the network transceiver further configured to receive the user information from the assistance engine. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer program product for assisting a user in an environment, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to perform a method comprising:
-
capturing, by a head-mounted device, a video stream that includes a first set of images; receiving, by the head-mounted device, a verbal context from the user; performing, by an assistance engine, an optical character recognition (OCR) process to generate a textual status based on the verbal context and the video stream; generating, by the assistance engine, an auditory response based upon the textual status; and playing, by the head-mounted device, the auditory response to the user. - View Dependent Claims (12, 13, 14)
-
-
15. A method of assisting a user in an environment, the method comprising:
-
capturing, by a head-mounted device, a first set of images; performing, by an assistance engine, a first optical character recognition (OCR) process on the first set of images to generate a first content evaluation related to a segment of text in the environment; generating, by the assistance engine, an auditory command based on the first content evaluation; playing, by the head-mounted device, the auditory command to the user; capturing, by the head-mounted device, a second set of images subsequent to movement of the user in response to the auditory command; performing, by the assistance engine, a second OCR process on the second set of images to generate a second content evaluation related to the segment of text; generating, by the assistance engine, a auditory response based on the second content evaluation; and playing, by the head-mounted device, the auditory response to the user. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification