×

Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command

  • US 9,153,074 B2
  • Filed: 08/22/2013
  • Issued: 10/06/2015
  • Est. Priority Date: 07/18/2011
  • Status: Expired due to Fees
First Claim
Patent Images

1. An augmented reality eyeglass communication device comprising:

  • an eyeglass frame having a first end and a second end;

    a right earpiece and a left earpiece, wherein the right earpiece is connected to the first end of the frame and the left earpiece is connected to the second end of the frame;

    a camera disposed on the frame, the right earpiece or the left earpiece, the camera being configured to;

    track a hand gesture command of a user,capture a sequence of images containing a finger of the user and virtual objects of a virtual keypad displayed by the eyeglass communication device and operable to provide input to the eyeglass communication device by the user, finger motions in relation to virtual objects being detected based on the sequence, wherein one or more gestures are recognized based on the finger motions, wherein the one or more gestures define user commands input to the eyeglass communication device,capture a skeletal representation of a body of the user, a virtual skeleton being computed based on the skeletal representation, and body parts being mapped to segments of the virtual skeleton, wherein the capturing is performed in real time,a processor disposed in the frame, the right earpiece or the left earpiece and configured to;

    receive one or more hand gesture commands of the user, wherein the one or more hand gesture commands comprise displaying product information comprising product description and product pricing of one or more products fetched from a networked database in response to user input of identifiers of the one or more products into the processor and displaying location information associated with the one or more products determined by the eyeglass communication device, including displaying a route on a map of a store to guide the user to the location within the store to obtain the product, and changing the frequency of a WiFi signal of the eyeglass communication device,perform the one or more hand gesture commands of the user,process the one or more hand gesture commands tracked by the camera, the hand gesture command being inferred from a collection of vertices and lines in a three dimensional mesh associated with a hand of the user,derive parameters from the hand gesture command using a template database, the template database storing captured storing deformable two dimensional templates of a human hand, a deformable two dimensional template of the human hand being associated with a set of points on outline of the human hand;

    receive product information, andprocess the product information;

    at least one display connected to the frame and configured to display data received from the processor corresponding to each of the one or more hand gesture commands, the display comprising;

    an optical prism element embedded in the display, anda projector embedded in the display, the projector being configured to project the data received from the processor to the optical prism element and to project the data received from the processor to a surface in environment of the user, the data including a virtual touch screen environment;

    a transceiver electrically coupled to the processor and configured to receive and transmit data over a wireless network;

    a Subscriber Identification Module (SIM) card slot disposed in the frame, the right earpiece or the left earpiece and configured to receive a SIM card;

    at least one earphone disposed on the right earpiece or the left earpiece;

    a microphone configured to sense a voice command of the user, wherein the voice command is operable to perform commands of the one or more hand gestures commands; and

    a charging unit connected to the frame, the right earpiece or the left earpiece;

    at least one electroencephalograph sensor configured to sense brain activity of the user and provide an alert when undesired brain activity is sensed;

    a gesture recognition unit including at least three dimensional gesture recognition sensors, a range finder, a depth camera, and a rear projection system, the gesture recognition unit being configured to track the hand gesture command of the user, the hand gesture command being processed by the processor, wherein the hand gesture command is associated with the vertices and lines of the hand of the user, the vertices and lines being in a specific relation;

    a band configured to secure the augmented reality eyeglass communication device on a head of the user;

    wherein the augmented reality eyeglass communication device is configured to perform phone communication functions, and wherein the eyeglass communication device is operable to calculate a total price for the one or more products, encode the total price into a code that is scannable by a merchant scanning device, and wherein the eyeglass communication device is operable to communicate with the merchant scanning device and perform a payment transaction for the one or more products.

View all claims
  • 0 Assignments
Timeline View
Assignment View
    ×
    ×