User-friendlier interfaces for a camera

• US 7,697,827 B2
• Filed: 10/17/2005
• Issued: 04/13/2010
• Est. Priority Date: 10/17/2005
• Status: Active Grant

• Current Assignee: Cutting Edge Vision LLC
• Original Assignee: Jeffrey C. Konicek
• Inventors: Konicek, Jeffrey C.
• Primary Examiner(s): FULLER, RODNEY EVAN
• Application Number:
  US11/163,391
• Publication Number:
  US 20070086764A1
• Time in Patent Office: 1,639 Days
• Field of Search: 396/56, 396/263, 396/264, 348/211.1, 348/211.2, 348/211.6
• US Class Current: 396/56
• CPC Class Codes: G03B 13/02 Viewfinders
• CPC Class Codes: G03B 17/02 Bodies
• CPC Class Codes: G03B 29/00 Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: G03B 31/06 in which sound track is associated with successively-shown still pictures
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 3/42204 Arrangements at the exchange for service or number selection by voice at the terminal H04M1/27
• CPC Class Codes: H04N 1/00095 Systems or arrangements for the transmission of the picture signal
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00209 Transmitting or receiving image data, e.g. facsimile data, via a computer, e.g. using e-mail, a computer network, the internet, I-fax
• CPC Class Codes: H04N 1/00212 Attaching image data to computer messages, e.g. to e-mails
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/64 : Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

This invention provides a camera system, including voice recognition, one or multiple microphones, gaze tracking, touch sensitive inputs and others. The voice recognition unit is operable for, among other things, receiving multiple different voice commands, recognizing the vocal commands, associating the different voice commands to one camera command and controlling at least some aspect of the digital camera operation in response to these voice commands. The gaze tracking unit is operable for, among other things, determining the location on the viewfinder image that the user is gazing upon. One aspect of the touch sensitive inputs provides that the touch sensitive pad is mouse-like and is operable for, among other things, receiving user touch inputs to control at least some aspect of the camera operation. Another aspect of the disclosed invention provides for gesture recognition to be used to interface with and control the camera system.

Claims

1. A system comprising:

a) a camera that is operable to take and store pictures, and that includes a lens, an image sensor, at least two microphones, a voice-recognition unit, and a camera controller;

b) the camera controller including a control program having instructions to control and respond to the voice-recognition unit; and

c) wherein (i) the voice-recognition unit is coupled to the microphones and the camera-controller, and is configured to receive and process a first and a second sound;

(ii) the first and second sounds correspond to the same utterance, as spoken by a person at a specific time, detected at two microphones; and

, (iii) the voice-recognition unit is configured to apply a voice-recognition algorithm based on the energy detected at each of two microphones.

2. The method of claim 1 wherein at least two microphones face substantially opposite directions.

3. A method of controlling a camera with voice commands comprising:

a) operating a camera controller and a voice-recognition unit in the camera to recognize and associate a first utterance with a first camera command;

b) operating a camera controller and a voice-recognition unit in the camera to recognize and associate a second utterance with a second camera command; and

,

c) wherein the first and the second utterances are spoken by the same person and recognized as including distinctly different words, and the first and the second camera commands result in the same camera operation.

4. A method of taking a time-delayed picture with a camera system including at least two microphones comprising:

a) receiving a sound at the microphones coupled to the camera system;

b) determining a relative direction of the sound to the camera system based on the energy detected at each microphone and the orientation of each microphone with respect to the camera system;

c) operating a recognition unit in the camera to recognize the sound from at least one of the at least two microphones; and

d) operating a controller in the camera to determine and execute camera commands corresponding to the recognized sound

e) wherein the camera system delays implementing the corresponding camera command by a set amount of time.

5. The method of claim 4 wherein at least two microphones face substantially opposite directions.

6. A method of controlling a camera in a cellular mobile device including at least two microphones comprising the acts of:

a) receiving a sound at both microphones;

b) selecting the sound as detected at one of the at least two microphones;

c) directing the selected sound to a processor in the cellular mobile device;

d) recognizing the sound with the processor as a command to perform a camera operation; and

,

e) automatically performing the camera operation in response to the processor having recognized the sound.

7. The method of claim 6 wherein at least two microphones face substantially opposite directions.

8. A voice recognizing camera comprising:

a) a camera including a lens, an image sensor, and a controller that is configured to control the camera;

b) a voice recognizer coupled to the controller and including a control program that is executed to recognize at least two different vocal utterances that indicate the same camera command;

c) at least two spaced apart microphones facing substantially different directions coupled to the voice recognizer; and

d) an energy detection circuit that measures the energy detected at each microphone.

9. The camera of claim 8 wherein the two different vocal utterances comprise the same vocal utterance spoken under different conditions.

10. The camera of claim 8 wherein the two different vocal utterances comprise one utterance detected at more than one microphone.

11. A voice recognizing camera comprising:

a) a camera including a lens, an image sensor, and a controller that is configured to control the camera;

b) a voice recognizer coupled to the controller and including a control program that is executed to recognize at least two different sounds that indicate the same camera command;

c) at least two spaced apart microphones coupled to the voice recognizer; and

,

d) wherein the two different sounds comprise the same vocal utterance detected at both microphones; and

,

e) wherein the controller is configured to condition the implemented camera command on the difference between the two sounds.

12. The camera of claim 11 wherein each microphone outputs a signal corresponding to the vocal utterance and the voice recognizer is configured to select one of the signals to recognize.

13. The method of claim 11 wherein at least two microphones face substantially opposite directions.

14. The camera of claim 11 wherein the difference is in phase.

15. The camera of claim 11 wherein the difference is in amplitude.

16. A method of automatically controlling a camera including at least a first and a second microphone using voice recognition to allow multiple different utterances to perform the same camera command, comprising:

a) programming a voice recognition controller in the camera to associate a first vocal utterance with a defined camera command;

b) programming the voice recognition controller to associate a second different vocal utterance with the defined camera command; and

,

c) determining the relative energy levels detected at the first and the second microphone when programming the voice recognition controller with the first vocal utterance and the second vocal utterance.

17. A method of initiating a camera command comprising:

a) receiving signals from at least two microphones coupled to a processor within the camera;

b) operating the processor to convert the received signals into digitized signals;

c) operating the processor to compare the digitized signals to a list of entries stored in the camera and associated with camera commands;

d) operating the processor to determine the approximate location of the source of the sound signals relative to the camera.

18. The method of claim 17 wherein at least two of the entries in the list are associated with a specific camera command.

19. A voice recognizing camera comprising:

a plurality of simultaneously operable microphones disposed on the voice recognizing camera, the voice recognizing camera configured to execute a recognized voice command by receiving signals from at least two of the plurality of simultaneously operable microphones, and wherein the camera is configured to determine an approximate location of a source of the recognized voice command by comparing the received signals.

20. The camera of claim 19 wherein the camera is configured to either implement a delay before executing the associated voice command or implement a voice recognition algorithm conditioned on the approximate location of the source of the recognized voice command.

21. A camera system including a microphone selection circuit, comprising:

a) an amplifier coupled to the output of a microphone;

b) an energy detector coupled to the output of the amplifier;

c) a comparator coupled to the energy detector; and

,

d) a multiplexer with an input coupled to the microphone and a select input coupled to the comparator.

e) an additional amplifier coupled to the output of an additional microphone;

f) an additional energy detector coupled to the output of the additional amplifier;

g) wherein the output of the additional energy detector is coupled to the comparator and the output of the additional microphone is coupled to an additional multiplexer input.

22. A system comprising:

a) a camera that is operable to take and store pictures, and that includes a lens, an image sensor, a microphone, a voice-recognition unit, and a camera controller;

b) the camera controller including a control program having instructions to control and respond to the voice-recognition unit; and

c) wherein (i) the voice-recognition unit is coupled to the microphone and the camera-controller, and is configured to receive and process a first and a second sound;

(ii) the first and the second sounds indicate the same camera command spoken by the same person; and

, (iii) the first sound includes at least one word that is distinctly different from a word in the second sound.