WEARABLE APPARATUS WITH WIDE VIEWING ANGLE IMAGE SENSOR

• US 20160026240A1
• Filed: 07/23/2015
• Published: 01/28/2016
• Est. Priority Date: 07/23/2014
• Status: Active Grant

• Current Assignee: OrCam Technologies Ltd
• Original Assignee: OrCam Technologies Ltd
• Inventors: Wexler, Yonatan, Shashua, Amnon
• Granted Patent: US 9,826,133 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/18 Packaging or power distribution
• CPC Class Codes: G06F 1/188 Mounting of power supply units
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/53 Querying
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 18/217 Validation; Performance evaluation; Active pattern learning techniques
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 : Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/038 : Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06Q 30/0246 : Traffic
• CPC Class Codes: G06Q 30/0257 : User requested
• CPC Class Codes: G06Q 30/0267 : Wireless devices
• CPC Class Codes: G06Q 30/0269 : based on user profile or attribute
• CPC Class Codes: G06T 2207/10004 : Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 : Video; Image sequence
• CPC Class Codes: G06T 2207/30232 : Surveillance
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/74 : involving reference images or patches
• CPC Class Codes: G06T 7/97 : Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 10/776 : Validation; Performance evaluation
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/30 : in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/41 : Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/64 : Three-dimensional objects
• CPC Class Codes: G06V 20/647 : by matching two-dimensional images to three-dimensional objects
• CPC Class Codes: G06V 2201/07 : Target detection
• CPC Class Codes: G06V 2201/09 : Recognition of logos
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 1/2112 : using still video cameras
• CPC Class Codes: H04N 23/45 : for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/50 : Constructional details
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/57 : Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/58 : Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/61 : based on recognised objects
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 : Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/6812 : based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/73 : by influencing the exposure time
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control

Abstract

A wearable apparatus and method are provided for capturing image data. In one implementation, a wearable apparatus for capturing image data is provided. The wearable apparatus includes at least one image sensor for capturing image data of an environment of a user, wherein a field of view of the image sensor includes a chin of the user. The wearable apparatus includes two or more microphones, and an attachment mechanism configured to enable the image sensor and microphones to be worn by the user. The wearable apparatus includes a processing device programmed to capture at least one image, identify the chin of the user to obtain a location of the chin, select a microphone from the two or more microphones based on the location, process input from the selected microphone using a first processing scheme, and process input from a microphone that is not selected using a second processing scheme.

Claims

1. A wearable apparatus for capturing image data, the wearable apparatus comprising:

at least one image sensor for capturing image data of an environment of a user, wherein a field of view of the image sensor includes at least a portion of a chin of the user;

two or more microphones;

an attachment mechanism configured to enable the at least one image sensor and the two or more microphones to be worn by the user; and

at least one processing device programmed to;

capture at least one image using the at least one image sensor;

identify the chin of the user in the at least one image to obtain a location of the chin of the user in the at least one image;

select at least one microphone from the two or more microphones based on the location of the chin of the user in the at least one image; and

process input from the selected at least one microphone using a first processing scheme, and process input from at least one of the two or more microphones that are not selected using a second processing scheme.

2. The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 100°

.

3. The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 180°

.

4. The wearable apparatus of claim 1, wherein the field of view of the at least one image sensor is more than 300°

.

5. The wearable apparatus of claim 1, wherein the first processing scheme includes storing the input from the selected at least one microphone.

6. The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to:

identify a portion of the at least one image captured by the at least one image sensor based on the location of the chin of the user; and

process the identified portion of the at least one image.

7. The wearable apparatus of claim 6, wherein processing the identified portion of the at least one image includes storing the identified portion of the at least one image.

8. The wearable apparatus of claim 1, wherein the second processing scheme is to ignore the input from the one or more microphones that are not selected.

9. The wearable apparatus of claim 1, further comprising at least one solar cell configured to provide power to the image sensor.

10. The wearable apparatus of claim 9, wherein the at least one solar cell is included in a capturing unit that includes the image sensor.

11. The wearable apparatus of claim 10, wherein the image sensor is associated with a corresponding lens located on the capturing unit, and the capturing unit includes a plurality of solar cells proximate to the lens.

12. The wearable apparatus of claim 9, further comprising a power unit that includes a battery for storing at least some energy generated by the at least one solar cell.

13. The wearable apparatus of claim 1, further comprising a power unit including an energy storage device configured to store energy derived from movements of the user.

14. The wearable apparatus of claim 13, wherein the stored energy is used to power the image sensor.

15. A wearable apparatus for capturing image data, the wearable apparatus comprising:

at least one image sensor for capturing image data of an environment of a user;

at least one microphone;

an attachment mechanism configured to enable the at least one image sensor and the at least one microphone to be worn by the user; and

at least one processing device programmed to;

identify a direction of sound received by the at least one microphone;

identify a portion of at least one image captured by the at least one image sensor based on the direction of the sound received by the at least one microphone; and

process the identified portion of the at least one image.

16. The wearable apparatus of claim 15, wherein a field of view of the image sensor includes at least a portion of a chin of the user.

17. The wearable apparatus of claim 16, wherein the at least one processing device is further programmed to identify the chin of the user in the at least one image captured by the image sensor.

18. The wearable apparatus of claim 15, wherein the field of view of the at least one image sensor is more than 180°

.

19. The wearable apparatus of claim 15, wherein the field of view of the at least one image sensor is more than 300°

.

20. The wearable apparatus of claim 15, further comprising at least one solar cell configured to provide power to the image sensor.

21. The wearable apparatus of claim 20, wherein the at least one solar cell is included in a capturing unit that includes the image sensor.

22. The wearable apparatus of claim 15, further comprising a power unit including an energy storage device configured to store energy derived from movements of the user.

23. The wearable apparatus of claim 22, wherein the stored energy is used to power the image sensor.

24. The wearable apparatus of claim 15, wherein processing the identified portion of the at least one image includes storing the identified portion of the at least one image.

25. A wearable apparatus for capturing image data, the wearable apparatus comprising:

at least one image sensor for capturing image data of an environment of a user, wherein a field of view of the image sensor includes at least a portion of a chin of the user;

an attachment mechanism configured to enable the at least one image sensor to be worn by the user; and

at least one processing device programmed to;

capture at least one image using the at least one image sensor;

identify the chin of the user the in at least one image to obtain a location of the chin of the user in the at least one image;

identify a portion of the at least one image captured by the at least one image sensor based on the location of the chin of the user; and

process the identified portion of the at least one image.

26. The wearable apparatus of claim 25, wherein the field of view of the at least one image sensor is more than 100°

.

27. The wearable apparatus of claim 25, wherein the field of view of the at least one image sensor is more than 180°

.

28. The wearable apparatus of claim 25, wherein the field of view of the at least one image sensor is more than 300°

.

29. The wearable apparatus of claim 25, wherein the at least one image sensor is exactly one image sensor.

30. The wearable apparatus of claim 25, wherein processing the identified portion of the at least one image includes storing the identified portion of the at least one image.

31. The wearable apparatus of claim 25, further comprising at least one solar cell configured to provide power to the image sensor.

32. The wearable apparatus of claim 31, wherein the at least one solar cell is included in a capturing unit that includes the image sensor.

33. The wearable apparatus of claim 32, wherein the image sensor is associated with a corresponding lens located on the capturing unit, and the capturing unit includes a plurality of solar cells proximate to the lens.

34. The wearable apparatus of claim 31, further comprising a power unit that includes a battery for storing at least some energy generated by the at least one solar cell.

35. The wearable apparatus of claim 31, further comprising a power unit including an energy storage device configured to store energy derived from movements of the user.

36. The wearable apparatus of claim 35, wherein the stored energy is used to power the image sensor.

37. A method comprising:

processing at least one image captured using a wearable camera to identify a chin of a user in the at least one image to obtain a location of the chin of the user in the at least one image;

selecting at least one microphone from two or more microphones attached to the wearable camera based on the location of the chin of the user in the at least one image; and

processing input from the selected at least one microphone using a first processing scheme, and processing input from at least one of the two or more microphones that are not selected using a second processing scheme.

38. The method of claim 37, wherein the first processing scheme includes storing the input from the selected at least one microphone.

39. The method of claim 37, further comprising:

identifying a portion of the at least one image captured by the at least one image sensor based on the location of the chin of the user; and

processing the identified portion of the at least one image.

40. The method of claim 39, wherein processing the identified portion of the at least one image includes storing the identified portion of the at least one image.

41. The wearable apparatus of claim 37, wherein the second processing scheme is to ignore the input from the one or more microphones that are not selected.

42. A software product stored on a non-transitory computer readable medium and comprising data and computer implementable instructions for carrying out the method of claim 37.

43. A method comprising:

identifying a direction of sound received by at least one microphone attached to a wearable camera to obtain a sound direction;

capturing at least one image using a wearable camera;

identifying a portion of the at least one image based on the sound direction; and

processing the identified portion of the at least one image.

44. The method of claim 43, wherein processing the identified portion of the at least one image includes storing the identified portion of the at least one image.

45. A software product stored on a non-transitory computer readable medium and comprising data and computer implementable instructions for carrying out the method of claim 43.

46. A method comprising:

capturing at least one image using a wearable camera;

identifying a chin of a user in the at least one image to obtain a location of the chin of the user in the at least one image;

identifying a portion of the at least one image captured by the at least one image sensor based on the location of the chin of the user; and

processing the identified portion of the at least one image.

47. The wearable apparatus of claim 46, wherein processing the identified portion of the at least one image includes storing the identified portion of the at least one image.

48. A software product stored on a non-transitory computer readable medium and comprising data and computer implementable instructions for carrying out the method of claim 46.