Image capturing device and electronic keyboard using the image capturing device

• US 10,199,025 B2
• Filed: 08/22/2015
• Issued: 02/05/2019
• Est. Priority Date: 08/23/2014
• Status: Active Grant

• Current Assignee: Moon Key Lee
• Original Assignee: Moon Key Lee
• Inventors: Lee, Moon Key
• Primary Examiner(s): Enad, Elvin G
• Assistant Examiner(s): Schreiber, Christina
• Application Number:
  US15/505,723
• Publication Number:
  US 20170278499A1
• Time in Patent Office: 1,263 Days
• Field of Search: 84744
• CPC Class Codes: G01N 21/41 Refractivity; Phase-affecting properties, e.g. optical path length G01N21/21 takes precedence
• CPC Class Codes: G02B 26/0816 by means of one or more reflecting elements
• CPC Class Codes: G02B 5/045 Prism arrays
• CPC Class Codes: G02B 5/12 Reflex reflectors
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G10C 3/12 Keyboards; Keys
• CPC Class Codes: G10H 1/0553 using optical or light-responsive means
• CPC Class Codes: G10H 1/34 Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
• CPC Class Codes: G10H 1/344 Structural association with individual keys electrically operated wind-actuated organs G10B3/22
• CPC Class Codes: G10H 2220/305 using a light beam to detect key, pedal or note actuation
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Abstract

An electronic keyboard using a camera, and more particularly, to an electronic keyboard using a camera, which includes a retroreflective film, a light source for irradiating light on to the retroreflective film, a camera for capturing light of a light source retroreflected from the retroreflective film, and an image processing means that analyzes the captured image to track the position of the reflected light source, to find a depressed state of the keyboard, and to generate a sound of an instrument corresponding to the depressed state.

Claims

1. An image capturing device comprising:

a camera for capturing images;

a first optical portion for changing direction of light incident on the first optical portion from a right side of the camera, toward the camera, wherein an image to be captured by the camera extends along a first direction and has a right side and a left side along the first direction; and

a second optical portion for changing direction of light incident on the second optical portion from a left side of the camera, toward the camera, wherein

the first and second optical portions are arranged along a second direction, transverse to the first direction, with the first optical portion spaced apart from the second optical portion by a space through which light that is captured by the camera passes,

the camera captures respective first, second, and third images of the light incident on the first optical portion, passing through the space between the first and second optical portions, and incident on the second optical portion, and

the first, second, and third images are separated from each other and appear along three respective rows.

2. The image capturing device of claim 1, wherein each of the first and second optical portions comprises one of a prism, a prism sheet, a hologram, and a mirror.

3. An electronic keyboard device comprising:

a keyboard including a plurality of individually movable keys arranged along a first direction, wherein the keyboard has right and left sides along the first direction;

an image capturing device comprising

a camera for capturing images,

a first optical portion for changing direction of light incident on the first optical portion from a right side of the keyboard, toward the camera, and

a second optical portion for changing direction of light incident on the second optical portion from the left side of the keyboard, toward the camera, wherein

the first and second optical portions are arranged along a second direction, transverse to the first direction, with the first optical portion spaced apart from the second optical portion by a space through which light that is captured by the camera,

the camera captures respective first, second, and third images of the keys from the light incident on the first optical portion, passing through the space between the first and second optical portions, and incident on the second optical portion, and

the first, second, and third images are separated from each other and appear along three respective rows; and

image processing means for detecting movement of respective keys from the first, second, and third images captured by the camera, and outputting a musical instrument sound or a musical instrument digital interface (MIDI) signal corresponding to each movement of a key that is detected.

4. The electronic keyboard device of claim 3, wherein each of the first and second optical portions includes one of a prism, a prism sheet, a hologram, and a mirror.

5. The electronic keyboard device of claim 3, wherein

each of the keys includes a mark, and

the image processing means detects the marks in the images captured to identify the movement of respective keys.

6. The electronic keyboard device of claim 5, wherein the marks are retroreflecting means.

7. The electronic keyboard device of claim 3, wherein

the keyboard has an L shaped bar attached to the keyboard, beneath the keyboard,

the camera is located beneath the keyboard and captures an image of the bar, and

the image processing means detects motion of the bar on the image captured and outputs the musical instrument sound or the MIDI signal.

8. The electronic keyboard device of claim 3, wherein

the keyboard includes a right angle prism or a mirror, and

the camera captures images for detecting the movement of the keys via the right angle prism or the mirror and is positioned below or above the keyboard.

9. The electronic keyboard device of claim 3, wherein the image processing means outputs a musical instrument sound or a MIDI signal in proportion to speed of movement of a key or depressed depth of a key.