WEARABLE AUGMENTED REALITY EYEGLASS COMMUNICATION DEVICE INCLUDING MOBILE PHONE AND MOBILE COMPUTING VIA VIRTUAL TOUCH SCREEN GESTURE CONTROL AND NEURON COMMAND
First Claim
1. An augmented reality eyeglass communication device comprising:
- a frame having a first end and a second end;
a right earpiece and a left earpiece, wherein the right earpiece is connected to the first end of the frame and the left earpiece is connected to the second end of the frame;
a camera disposed on the frame, the right earpiece or the left earpiece, the camera being configured to;
track a hand gesture command of a user,capture a sequence of images containing a finger of the user and virtual objects, finger motions in relation to virtual objects being detected based on the sequence, wherein one or more gestures are recognized based on the finger motions,capture a skeletal representation of a body of the user, a virtual skeleton being computed based on the skeletal representation, and body parts being mapped to segments of the virtual skeleton,wherein the capturing is performed in real time,a processor disposed in the frame, the right earpiece or the left earpiece and configured to;
receive one or more commands of the user,perform operations associated with the commands of the user,process the hand gesture command tracked by the camera, the hand gesture command being inferred from a collection of vertices and lines in a three dimensional mesh associated with a hand of the user,derive parameters from the hand gesture command using a template database, the template database storing captured storing deformable two dimensional templates of a human hand, a deformable two dimensional template of the human hand being associated with a set of points on outline of the human hand, point variability parameters, and external deformators;
receive product information, andprocess the product information;
at least one display connected to the frame and configured to display data received from the processor, the display comprising;
an optical prism element embedded in the display, anda projector embedded in the display, the projector being configured to project the data received from the processor to the optical prism element and to project the data received from the processor to a surface in environment of the user, the data including a virtual touch screen environment;
a transceiver electrically coupled to the processor and configured to receive and transmit data over a wireless network;
a Subscriber Identification Module (SIM) card slot disposed in the frame, the right earpiece or the left earpiece and configured to receive a SIM card;
at least one earphone disposed on the right earpiece or the left earpiece;
a microphone configured to sense a voice command of the user; and
a charging unit connected to the frame, the right earpiece or the left earpiece;
at least one electroencephalograph sensor configured to sense brain activity of the user;
a gesture recognition unit including at least three dimensional gesture recognition sensors, a range finder, a depth camera, and a rear projection system, the gesture recognition unit being configured to track the hand gesture command of the user, the hand gesture command being processed by the processor, wherein the hand gesture command is associated with the vertices and lines of the hand of the user, the vertices and lines being in a specific relation;
a band configured to secure the augmented reality eyeglass communication device on a head of the user; and
wherein the augmented reality eyeglass communication device is configured to perform phone communication functions.
0 Assignments
0 Petitions
Accused Products
Abstract
Provided are an augmented reality eyeglass communication device and a method for facilitating shopping using an augmented reality eyeglass communication device. The augmented reality eyeglass communication device may comprise a frame, and a right earpiece and a left earpiece connected to the frame. Furthermore, the eyeglass communication device may comprise a processor configured to receive one or more commands of a user, perform operations associated with the commands of the user, receive product information, and process the product information. The eyeglass communication device may comprise a display connected to the frame and configured to display data received from the processor. In addition to that, the eyeglass communication device may comprise a transceiver electrically connected to the processor and configured to receive and transmit data over a wireless network. The eyeglass communication device may comprise a Subscriber Identification Module card slot, a camera, an earphone, a microphone, and a charging unit.
358 Citations
125 Claims
-
1. An augmented reality eyeglass communication device comprising:
-
a frame having a first end and a second end; a right earpiece and a left earpiece, wherein the right earpiece is connected to the first end of the frame and the left earpiece is connected to the second end of the frame; a camera disposed on the frame, the right earpiece or the left earpiece, the camera being configured to; track a hand gesture command of a user, capture a sequence of images containing a finger of the user and virtual objects, finger motions in relation to virtual objects being detected based on the sequence, wherein one or more gestures are recognized based on the finger motions, capture a skeletal representation of a body of the user, a virtual skeleton being computed based on the skeletal representation, and body parts being mapped to segments of the virtual skeleton, wherein the capturing is performed in real time, a processor disposed in the frame, the right earpiece or the left earpiece and configured to; receive one or more commands of the user, perform operations associated with the commands of the user, process the hand gesture command tracked by the camera, the hand gesture command being inferred from a collection of vertices and lines in a three dimensional mesh associated with a hand of the user, derive parameters from the hand gesture command using a template database, the template database storing captured storing deformable two dimensional templates of a human hand, a deformable two dimensional template of the human hand being associated with a set of points on outline of the human hand, point variability parameters, and external deformators; receive product information, and process the product information; at least one display connected to the frame and configured to display data received from the processor, the display comprising; an optical prism element embedded in the display, and a projector embedded in the display, the projector being configured to project the data received from the processor to the optical prism element and to project the data received from the processor to a surface in environment of the user, the data including a virtual touch screen environment; a transceiver electrically coupled to the processor and configured to receive and transmit data over a wireless network; a Subscriber Identification Module (SIM) card slot disposed in the frame, the right earpiece or the left earpiece and configured to receive a SIM card; at least one earphone disposed on the right earpiece or the left earpiece; a microphone configured to sense a voice command of the user; and a charging unit connected to the frame, the right earpiece or the left earpiece; at least one electroencephalograph sensor configured to sense brain activity of the user; a gesture recognition unit including at least three dimensional gesture recognition sensors, a range finder, a depth camera, and a rear projection system, the gesture recognition unit being configured to track the hand gesture command of the user, the hand gesture command being processed by the processor, wherein the hand gesture command is associated with the vertices and lines of the hand of the user, the vertices and lines being in a specific relation; a band configured to secure the augmented reality eyeglass communication device on a head of the user; and wherein the augmented reality eyeglass communication device is configured to perform phone communication functions. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99)
-
-
100. A method for alerting a driver using an augmented reality eyeglass communication device, wherein the augmented reality eyeglass communication device comprises at least a processor, a neuron sensor, and a camera, the method comprising:
-
capturing, by the camera, at least an eye of the driver; processing, by the processor, the capturing to detect a state of the eye, the state including an open eye and a closed eye; sensing, by the neuron sensor, one or more facial muscles of the driver; determining, by the processor, a condition of the one or more facial muscles, the condition including a slackened muscle and an active muscle; identifying, by the processor, based on the state of the eye and the condition of the one or more facial muscles, a sleeping status of the driver, the sleeping status including a driver awake and a driver asleep; and providing, based on the identifying, an alert to the driver. - View Dependent Claims (101, 102, 103, 104, 105)
-
-
106. An augmented reality eyeglass navigation device comprising:
-
a frame having a first end and a second end; a right earpiece and a left earpiece, wherein the right earpiece is connected to the first end of the frame and the left earpiece is connected to the second end of the frame; a memory unit configured to store one or more geographical maps; a Global Positioning System (GPS) unit configured to determine a geographical location of a user; a magnetic direction sensor configured to determine an orientation of a head of the user; a processor disposed in the frame, the right earpiece or the left earpiece, communicating with the memory unit, and configured to receive an itinerary, the one or more geographical maps, the geographical location of the user, and the orientation of the head of the user, and generate navigation hints; a plurality of Light Emitting Diodes (LEDs) coupled to the frame and disposed in a peripheral field of vision of the user, wherein the LEDs are configured to change color to provide the navigation hints to the user. - View Dependent Claims (107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124)
-
-
125. A non-transitory computer-readable medium comprising instructions, which when executed by one or more processors, perform the following operations:
-
receive product information associated with products comprised in a list of products of a user; receive location information associated with location of the user; search a database associated with a store for availability, location and pricing information associated with the products; receive the availability, location and pricing information associated with the product; and display the availability, location and pricing information associated with the product.
-
Specification