Wearable muscle interface systems, devices and methods that interact with content displayed on an electronic display
First Claim
1. A wearable muscle interface device for controlling navigable content displayed on a wearable head-mounted display, the wearable muscle interface device comprising:
- a plurality of electromyography sensors to be worn on an arm of a user, the plurality of electromyography sensors for detecting electrical signals of muscle activity corresponding to a gesture performed by the user;
at least one accelerometer for detecting motion of the arm of the user corresponding to the gesture performed by the user;
a first processor, communicatively coupled to the plurality of electromyography sensors and the at least one accelerometer, for;
generating, based on at least the electrical signals detected by the plurality of electromyography sensors and the motion of the arm of the user detected by the at least one accelerometer,a first interpretation of the gesture performed by the user, anda second interpretation of the gesture performed by the user, andgenerating at least one control signal to request input from the user to select one of the first interpretation of the gesture or the second interpretation of the gesture,wherein the first interpretation of the gesture and the second interpretation of the gesture represent different gestures selected by the first processor from a set of at least three defined gestures; and
a transmitter communicatively coupled to the first processor, wherein the transmitter transmits the at least one control signal from the wearable muscle interface device directly to a receiver on the wearable head-mounted display,wherein the at least one control signal causes a second processor of the wearable head-mounted display to execute data and/or instructions stored in a non-transitory computer-readable storage medium of the wearable head-mounted display to effect at least one control interaction including requesting the input from the user to select one of the first interpretation of the gesture performed by the user or the second interpretation of the gesture performed by the user.
6 Assignments
0 Petitions
Accused Products
Abstract
Systems, devices and methods that enable a user to access and interact with content displayed on a portable electronic display in an inconspicuous, hands-free manner are described. There is disclosed a completely wearable system comprising a wearable muscle interface device and a wearable head-mounted display, as well as methods for using the wearable system to effect interactions between the user and content displayed on the wearable head-mounted display. The wearable muscle interface device includes muscle activity sensors worn on an arm of the user to detect muscle activity generated when the user performs a physical gesture. The wearable system is adapted to recognize a plurality of gestures made by the user and, in response to each recognized gesture, to effect one or more interaction(s) with content displayed on the wearable head-mounted display.
-
Citations
7 Claims
-
1. A wearable muscle interface device for controlling navigable content displayed on a wearable head-mounted display, the wearable muscle interface device comprising:
-
a plurality of electromyography sensors to be worn on an arm of a user, the plurality of electromyography sensors for detecting electrical signals of muscle activity corresponding to a gesture performed by the user; at least one accelerometer for detecting motion of the arm of the user corresponding to the gesture performed by the user; a first processor, communicatively coupled to the plurality of electromyography sensors and the at least one accelerometer, for; generating, based on at least the electrical signals detected by the plurality of electromyography sensors and the motion of the arm of the user detected by the at least one accelerometer, a first interpretation of the gesture performed by the user, and a second interpretation of the gesture performed by the user, and generating at least one control signal to request input from the user to select one of the first interpretation of the gesture or the second interpretation of the gesture, wherein the first interpretation of the gesture and the second interpretation of the gesture represent different gestures selected by the first processor from a set of at least three defined gestures; and a transmitter communicatively coupled to the first processor, wherein the transmitter transmits the at least one control signal from the wearable muscle interface device directly to a receiver on the wearable head-mounted display, wherein the at least one control signal causes a second processor of the wearable head-mounted display to execute data and/or instructions stored in a non-transitory computer-readable storage medium of the wearable head-mounted display to effect at least one control interaction including requesting the input from the user to select one of the first interpretation of the gesture performed by the user or the second interpretation of the gesture performed by the user. - View Dependent Claims (2, 3)
-
-
4. A wearable system for providing hands-free access to and control of a portable electronic display, the wearable system comprising:
-
i) a wearable muscle interface device comprising; a plurality of electromyography sensors to be worn on an arm of a user, the plurality of electromyography sensors for detecting electrical signals of muscle activity corresponding to a gesture performed by the user; at least one accelerometer for detecting motion of the arm of the user corresponding to the gesture performed by the user; a first processor communicatively coupled to the plurality of electromyography sensors and the at least one accelerometer, for; generating, based on at least the electrical signals detected by the plurality of electromyography sensors and the motion of the arm of the user detected by the at least one accelerometer, a first interpretation of the gesture performed by the user, and a second interpretation of the gesture performed by the user, and generating at least one control signal to request input from the user to select one of the first interpretation of the gesture or the second interpretation of the gesture, wherein the first interpretation of the gesture and the second interpretation of the gesture represent different gestures selected by the first processor from a set of at least three defined gestures; and a transmitter communicatively coupled to the first processor, wherein the transmitter transmits the at least one control signal from the wearable muscle interface device; and ii) a wearable head-mounted display comprising; at least one display screen to be worn on a head of the user, the at least one display screen arranged to be positioned in front of at least one eye of the user when worn on the head of the user; a receiver communicatively coupled to the at least one display screen, wherein the receiver directly receives the at least one control signal transmitted from the transmitter of the wearable muscle interface device; a second processor communicatively coupled to the receiver and to the at least one display screen; a non-transitory computer-readable storage medium communicatively coupled to the processor; and data and/or instructions stored in the non-transitory computer-readable storage medium that, when executed by the second processor in response to the at least one control signal, cause the second processor to effect at least one control interaction including requesting the input from the user to select one of the first interpretation of the gesture performed by the user or the second interpretation of the gesture performed by the user. - View Dependent Claims (5)
-
-
6. A method of using a wearable system to achieve hands-free access to and control of a portable electronic display, wherein the wearable system includes a wearable muscle interface device to be worn on an arm of the user and a wearable head-mounted display, the method comprising:
-
detecting electrical signals of muscle activity corresponding to a gesture performed by a user of the wearable system by at least one electromyography sensor of the wearable muscle interface device; detecting motion of the arm of the user corresponding to the gesture performed by the user of the wearable system, by at least one accelerometer of the wearable muscle interface device; generating, by a first processor of the wearable muscle interface device, based on at least the electrical signals detected by the at least one electromyography sensor of the wearable muscle interface device and the motion of the arm of the user detected by the at least one accelerometer of the wearable muscle interface device, a first interpretation of the gesture performed by the user, and a second interpretation of the gesture performed by the user, wherein the first interpretation of the gesture and the second interpretation of the gesture represent different gestures selected by the first processor from a set of at least three defined gestures; generating, by the first processor, a control signal to request input from the user to select one of the first interpretation of the gesture performed by the user or the second interpretation of the gesture performed by the user; transmitting the at least one control signal from the wearable muscle interface device by a transmitter of the wearable muscle interface device; receiving the at least one control signal directly from the wearable muscle interface device by a receiver of the wearable head-mounted display; and processing the at least one control signal by a second processor of the wearable head-mounted display by; executing, by the second processor of the wearable head-mounted display, data and/or instructions stored in a non-transitory computer-readable storage medium of the wearable head-mounted display to effect at least one control interaction including requesting the input from the user to select one of the first interpretation of the gesture performed by the user or the second interpretation of the gesture performed by the user. - View Dependent Claims (7)
-
Specification