USER WEARABLE VISUAL ASSISTANCE DEVICE

• US 20130271584A1
• Filed: 06/11/2013
• Published: 10/17/2013
• Est. Priority Date: 02/17/2011
• Status: Abandoned Application

• Current Assignee: OrCam Technologies Ltd
• Original Assignee: OrCam Technologies Ltd
• Inventors: Wexler, Yonatan, Shashua, Amnon, Tadmor, Oren, Ehrlich, Itai
• Application Number:
  US13/914,792
• Publication Number:
  US 20130271584A1
• Time in Patent Office: Days
• US Class Current: 348/62
• CPC Class Codes: G06F 18/41 Interactive pattern learning with a human teacher
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted

Abstract

A device wearable by a person including a processor operatively connectible to a camera. The processor is adapted to capture multiple image frames, is operable to detect motion of a gesture by using differences between the image frames and to classify the gesture responsive to the detected motion.

Claims

1. A method for visually assisting a person using a device wearable by the person, wherein the device includes a processor operatively connectible to a camera, wherein the processor is adapted to capture a plurality of image frames, the method comprising:

detecting motion of a gesture by using differences between the image frames;

classifying said gesture responsive to said detected motion.

2. The method of claim 1, wherein said motion of said gesture is repetitive.

3. The method of claim 1, wherein said detecting and said classifying are performed while avoiding pressing of a button on the device.

4. The method of claim 2, wherein said gesture includes selectively either holding an object in a hand of the person or waving said object held in said hand in the field of view of the camera.

5. The method of claim 4, further comprising:

enabling the person to audibly name said object; and

recording said name.

6. The method of claim 4, further comprising:

audibly informing the person upon failing to classify said object.

7. The method of claim 4, further comprising:

classifying said object;

wherein said classifying is performed using a trained classifier; and

upon the device failing to detect a new object, further training said classifier by the person audibly naming the new object.

8. The method of claim 4, further comprising:

performing said detecting by identifying portions of a hand holding said object.

9. The method of claim 1, wherein said detecting includes:

detecting features of an image of said object;

tracking the features within the image between said image frames;

grouping said features into groups, wherein said groups include said features with similar image movement.

10. The method of claim 1, further comprising:

performing optical character recognition (OCR) of characters on said object.

11. A device wearable by the person, wherein the device includes a processor operatively connectible to a camera, wherein the processor is adapted to capture a plurality of image frames, the device operable to:

detect motion of a gesture by using differences between the image frames;

classify said gesture responsive to said detected motion.

12. The device of claim 11, wherein said motion of said gesture is repetitive.

13. The device of claim 11, further comprising:

an earphone operatively attached to said processor, wherein the device detects an object and recognizes the object, wherein said processor audibly informs the person by utilizing said earphone to name said object.

14. A method of using a device including a camera and a processor, the method comprising:

upon presenting an object to the device for a first time, detecting the object;

upon said detecting, labeling by a person the object using a sound;

recording the sound by the device, thereby producing a recorded sound;

upon second presenting the object a second time to the device, recognizing the object and upon said recognizing, playing said recorded sound by the device for hearing by a person.

15. The method according to claim 14, the method further comprising:

upon said presenting the object said second time to the device,

providing by the device further information associated with the object.

16. The method according to claim 14, wherein said presenting includes moving the object in the field of view of the camera, and wherein said moving triggers the device to act in response.

17. The method according to claim 14, further comprising:

prior to said detecting, tracking motion of the object; and

separating the image of the object from image background responsive to the tracked motion of the object.

18. The method according to claim 14, wherein said presenting includes inserting the object into the field of view of the camera and wherein said inserting triggers the device.

19. The method according to claim 14, wherein the object is not successfully recognized, the method further comprising:

playing an audible sound to the person indicating that the object is not recognized.

20. The method according to claim 14, further comprising:

managing a data base of objects personal to the person, wherein said objects when presented to the device are recognizable by the device.