Autonomous computing and telecommunications head-up displays glasses

• US 10,268,276 B2
• Filed: 03/15/2014
• Issued: 04/23/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Eyecam LLC
• Original Assignee: Eyecam LLC
• Inventors: Fisher, Ronald, Davis, Bryan, Fisher, James, Merit, Andrew, Gautreaux, Paul
• Primary Examiner(s): Harris, Dorothy
• Application Number:
  US14/777,515
• Publication Number:
  US 20160299569A1
• Time in Patent Office: 1,865 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A pair of eyeglasses (100) has a frame (104) and lenses (102) mounted on the frame. A computer processor (130) is mounted on eyeglasses together with a plurality of cameras (105) and a digital projection system. IR sensors and/or dual zoom cameras may also be mounted on the glasses (100) and configured to track the movement of the user'"'"'s hand (800).

Claims

1. An apparatus comprising

head-up displays glasses having a frame and lenses mounted on said frame;

a computer processor mounted on said head-up displays glasses;

a digital display, mounted in one or both of said lenses;

a digital projection system mounted on said head-up displays glasses, said digital projection system being operably connected to said computer processor;

a plurality of digital cameras mounted on said head-up displays glasses, said digital cameras being operably connected to said computer processor;

IR sensors and/or dual zoom cameras mounted on said head-up displays glasses and being configured to detect and track hand movements and gesture patterns at least one wearer'"'"'s hand, or other object or surface, said IR sensors and/or said dual zoom cameras being operably connected to said computer processor;

wherein said computer processer being configured to determine at least one camera control hand gesture pattern and control an operation of at least one of said digital cameras, and

wherein said computer processer being further configured to control said digital display to at least in part display at least one camera feed from said digital cameras without a representation of the wearer'"'"'s hand, or other object or surface, in said digital display; and

wherein said computer processor is configured to recognize said camera control hand gesture pattern and in response thereto dedicates at least one of said digital cameras to the detecting and tracking of the wearer'"'"'s hand, or other object or surface, and further dedicates at least one other of said digital cameras for providing said camera feed without the representation of the wearer'"'"'s hand, or other object or surface, in said digital display.

2. The apparatus of claim 1, wherein said computer processor being configured to recognize at least one other hand gesture pattern and in response thereto controls said digital projection system so as to project a graphical user interface onto a wearer'"'"'s hand, or other object or surface, in said digital display, and wherein said IR sensors and/or said dual zoom cameras are configured to track the movement of the wearer'"'"'s hand, or other object or surface, and dynamically update a position of the graphical user interface in association with the representation of the wearer'"'"'s hand, or other object or surface, in said digital display.

3. The apparatus of claim 2, wherein said apparatus further comprising:

dual inward-facing eye motion tracking sensors, integrated into said frame, for tracking a wearer'"'"'s eye movements; and

motion sensors mounted on said head-up displays glasses and configured to detect head motion; and

wherein said processor being configured to activate a video scroll feature on said digital display in response to receiving head motion detection from said motion sensors.

4. The apparatus of claim 3, wherein said processor being configured to receive at least one signal from said IR sensors and/or said dual zoom cameras associated with said hand movements and gesture pattern or from said eye motion tracking sensors associated with the wearer'"'"'s eye movements, said processor being further configured to interact said signal with said graphical user interface.

5. The apparatus of claim 4, wherein said processor being configured to dynamically and continuously alter said graphical user interface to fit at least one dimension and at least one surface of the wearer'"'"'s hand, or other object or surface, based on a position and a distance of the wearer'"'"'s hand, or other object or surface, in relation to said head-up displays glasses.

6. The apparatus of claim 2, wherein said plurality of digital cameras include dual forward-facing cameras, a left side-facing camera, a right side-facing camera and at least one rear-facing camera, said dual forward-facing cameras being configured for recording any one of wide angle, stereographic, 2D and 3D video or still image content, said plurality of digital cameras being configured for providing a 360 degree surround video feed around a wearer of said head-up displays glasses.

7. The apparatus of claim 1, wherein said plurality of digital cameras comprise extendable cameras, wherein said head-up displays glasses include arms and recessed tracks in said arms and wherein said extendable cameras and tracks are configured such that said extendable cameras are swivelable and bendable between a stored position in which said extendable cameras are stored in said recessed tracks when not in use and an operating position in which said extendable cameras are swiveled out from said tracks and bent in a desired orientation.

8. The apparatus of claim 1, further comprising at least one or any combination of gyroscopic motion sensor(s), accelerometer(s), global position system(s) mounted on said head-up displays glasses.

9. The apparatus of claim 8, wherein said processor is configured to determine at least one or any combination of motion orientation, spatial position and location of at least one of said plurality of digital cameras based on measurements from said at least one or any combination of said gyroscopic motion sensor(s), accelerometer(s), global position system(s).

10. The apparatus of claim 1, wherein said head-up display glasses are configured to provide mapping and gesture interfacing functions for interfacing with the projected graphical user interface.

11. The apparatus of claim 1, further comprising at least one or any combination of wireless, cellular and satellite communication devices mounted on said head-up display glasses.

12. The apparatus of claim 11, wherein said processor and devices have location, wide, local and/or personal area networking configurations and said head-up display glasses are configured to simultaneously engage in peer-to-peer networking and/or pairing with other modules and devices while connecting wirelessly to the Internet, calling and/or instantly connecting with one or more wireless devices and optionally streaming and/or receiving audio-video and location based data in real-time.

13. The apparatus of claim 1, wherein said head-up display glasses are configured to provide mapping and gesture interfacing functions for controlling the head-up display glasses and interfaces thereof.