CONTROL OF A WEARABLE DEVICE

• US 20130169536A1
• Filed: 02/13/2013
• Published: 07/04/2013
• Est. Priority Date: 02/17/2011
• Status: Abandoned Application

• Current Assignee: OrCam Technologies Ltd
• Original Assignee: OrCam Technologies Ltd
• Inventors: Wexler, Yonatan, Shashua, Amnon, Naaman, Erez
• Application Number:
  US13/766,160
• Publication Number:
  US 20130169536A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted

Abstract

A wearable device including a camera and a processor and a control interface between the wearable device and a user of the wearable device. An image frame is captured from the camera. Within the image frame, an image of a finger of the user is recognized. The recognition of the finger by the wearable device controls the wearable device.

Claims

1. A method for interfacing between a wearable device and a user of the wearable device, the device including a camera and a processor connectible thereto, the method comprising:

capturing an image frame from the camera; and

within the image frame, recognizing an image of a finger of the user thereby controlling the wearable device.

2. The method of claim 1, wherein said recognizing is performed by using an appearance-based classifier.

3. The method of claim 2, further comprising:

previously training said appearance-based classifier on at least one training set of images selected from the group consisting of;

images of a plurality of fingers and a plurality of images of the finger of the user.

4. The method of claim 1, wherein said recognizing is performed from information in a single image frame.

5. The method of claim 1, wherein said recognizing is performed while said camera immobile.

6. The method of claim 1, further comprising:

upon said recognizing, providing confirmation to the user that said finger is recognized.

7. The method of claim 1, wherein said recognizing a finger includes said recognizing two fingers selected from the group consisting of:

an index finger and thumb, an index finger and middle finger and a thumb and pinky finger.

8. The method of claim 1, upon said recognizing, searching in the vicinity of the image of the finger for text.

9. The method of claim 1, upon said recognizing, searching in the vicinity of the image of the finger for an image of an object selected from the group consisting of:

a vehicle, a newspaper, a signpost, a notice, a book, a bus, a bank note and a traffic signal.

10. The method of claim 1, wherein the image of the finger is located on selectively either an image of a left hand or an image of a right hand.

11. The method of claim 1, further comprising:

locating in a sequence of image frames an image of said finger;

tracking changes of said image in said sequence, wherein said changes are indicative of a query of the user regarding an object in the field of view of the camera.

12. A wearable device including a camera connectible to a processor, the processor operable to:

capture an image frame from the camera; and

within the image frame, recognize an image of a finger of the user to control the wearable device.

13. The wearable device of claim 12, wherein the image of the finger of the user is recognized by using an appearance-based classifier.

14. The wearable device of claim 12, wherein recognition of respective images of different fingers of the user provides different control inputs to the wearable device.

15. The wearable device of claim 12, further comprising a speaker or an ear piece operable to audibly confirm to the person that a finger is detected.

16. A wearable device including a camera connectible to a processor, the processor operable to:

capture an image frame from the camera;

within the image frame, recognize an image of the finger of the user; and

upon recognition of the image the finger, search the image frame in the vicinity of the image of the finger for an image of an object in the environment of the user.

17. The wearable device of claim 16, further comprising a text detection module configured to search in the vicinity of the image of the finger for text.

18. The wearable device of claim 16, further comprising at least one module configured for searching in the vicinity of the image of the finger for an image of an object selected from the group consisting of:

a vehicle, a newspaper, a signpost, a notice, a book, a bus, a bank note and a traffic signal.