Augmented Reality Panorama Supporting Visually Impaired Individuals
First Claim
1. An augmented reality engine comprising:
- a remote device interface configured to receive ambient sensor data from a remote mobile sensing device over a network, the ambient sensor data reflecting a remote environment of a visually impaired person and including a current field of view and device position data;
a panoramic engine configured to construct an augmented reality panorama representing a model of the remote environment and some of its objects at least partially based on the ambient sensor data with current field of view integrated into the augmented reality panorama as a function of the device position; and
a sighted assistant interface configured to;
present visually the augmented reality panorama with the integrated current field of view to a sighted assistant, andtransmit, via the remote device interface, device commands to the remote mobile sensing device, the device commands instructing the mobile sensing device to capture additional object data associated with the objects in the augmented reality panorama.
3 Assignments
0 Petitions
Accused Products
Abstract
There is presented a system and method for providing real-time object recognition to a remote user. The system comprises a portable communication device including a camera, at least one client-server host device remote from and accessible by the portable communication device over a network, and a recognition database accessible by the client-server host device or devices. A recognition application residing on the client-server host device or devices is capable of utilizing the recognition database to provide real-time object recognition of visual imagery captured using the portable communication device to the remote user of the portable communication device. In one embodiment, a sighted assistant shares an augmented reality panorama with a visually impaired user of the portable communication device where the panorama is constructed from sensor data from the device.
-
Citations
23 Claims
-
1. An augmented reality engine comprising:
-
a remote device interface configured to receive ambient sensor data from a remote mobile sensing device over a network, the ambient sensor data reflecting a remote environment of a visually impaired person and including a current field of view and device position data; a panoramic engine configured to construct an augmented reality panorama representing a model of the remote environment and some of its objects at least partially based on the ambient sensor data with current field of view integrated into the augmented reality panorama as a function of the device position; and a sighted assistant interface configured to; present visually the augmented reality panorama with the integrated current field of view to a sighted assistant, and transmit, via the remote device interface, device commands to the remote mobile sensing device, the device commands instructing the mobile sensing device to capture additional object data associated with the objects in the augmented reality panorama. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
Specification