METHODS AND SYSTEMS OF SMART EYEGLASSES

• US 20180329209A1
• Filed: 11/24/2017
• Published: 11/15/2018
• Est. Priority Date: 11/24/2016
• Status: Abandoned Application

• Current Assignee: Rohildev Nattukallingal
• Original Assignee: Rohildev Nattukallingal
• Inventors: NATTUKALLINGAL, ROHILDEV
• Application Number:
  US15/822,082
• Publication Number:
  US 20180329209A1
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04M 1/05 specially adapted for use on head, throat or breast
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Abstract

In one aspect, a method of a smart eyeglass system includes the step of providing a smart eyeglass system. The smart eyeglass system includes a digital video camera system. The digital video camera system is coupled with a processor in the smart eyeglass system, and wherein the smart eyeglass system is worn by a user. With the video camera integrated into the smart eyeglass system the method obtains an image of a pair of a set of user fingers in a space in front of the user as a function of time. A user'"'"'s palm of each hand is facing the video camera system. With the processor, the method identifies each finger of a set of user fingers on each hand of the user. The method identifies a set of finger pad regions of each finger of the set of user fingers. The method identifies a thumb of each hand.

Claims

1. A method of a smart eyeglass system comprising:

providing a smart eyeglass system, wherein the smart eyeglass system comprises a digital video camera system, wherein the digital video camera system is coupled with a processor in the smart eyeglass system, and wherein the smart eyeglass system is worn by a user;

with the video camera integrated into the smart eyeglass system;

obtaining an image of a pair of a set of user fingers in a space in front of the user as a function of time, wherein a user'"'"'s palm of each hand is facing the video camera system;

with the processor;

identifying each finger of a set of user fingers on each hand of the user;

identifying a set of finger pad regions of each finger of the set of user fingers;

identifying a thumb of each hand; and

tracking the thumb;

assigning each finger pad of the set of finger pad regions to a specified functionality of the smart eyeglass system; and

detecting a series of thumb tapping movements to one or more finger pad regions of each finger of the set of user fingers.

2. The method of claim 1, wherein a tapping of a finger pad region is determined by:

identifying a set of other fingers and other finger pad regions that are not overlapped by the thumb.

3. The method of claim 2, wherein a tapping of a finger pad region is further determined by:

identifying which of the set of other fingers and the other finger pad regions that are left of the thumb, right of the thumb, above the thumb and below the thumb.

4. A smart eyeglass system comprising:

a smart eyeglass system, wherein the smart eyeglass system comprises a digital video camera system, wherein the digital video camera system is coupled with a processor in the smart eyeglass system, and wherein the smart eyeglass system is worn by a user;

wherein the video camera integrated into the smart eyeglass system is configured to obtain an image of a pair of a set of user fingers in a space in front of the user as a function of time, wherein a user'"'"'s palm of each hand is facing the video camera system;

with the processor smart eyeglass system;

identify each finger of a set of user fingers on each hand of the user;

identify a set of finger pad regions of each finger of the set of user fingers;

identify thumb of each hand;

track the thumb;

assign each finger pad of the set of finger pad regions to a specified functionality of the smart eyeglass system; and

detect a series of thumb tapping movements to one or more finger pad regions of each finger of the set of user fingers;

identify a set of other fingers and other finger pad regions that are not overlapped by the thumb; and

identify which of the set of other fingers and the other finger pad regions that are left of the thumb, right of the thumb, above the thumb and below the thumb.