Sensing apparatus, program execution apparatus and image-taking system

• US 20070071425A1
• Filed: 09/27/2006
• Published: 03/29/2007
• Est. Priority Date: 09/27/2005
• Status: Abandoned Application

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Kubo, Hiroshi, Horinouchi, Kazuyuki, Koyanagi, Katsubumi, Shiomi, Masashi
• Application Number:
  US11/527,450
• Publication Number:
  US 20070071425A1
• Time in Patent Office: Days
• US Class Current: 396/54
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1068 being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: G03B 15/00 Special procedures for taking photographs; Apparatus therefor
• CPC Class Codes: G03B 29/00 Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A sensing apparatus for detecting a predetermined type of physical information which changes in accordance with an external factor, such as an operation force from the outside or the like, includes a camera, an attachment which includes a subject which changes a state thereof in accordance with the external factor, and a CPU which detects the physical information described above based on image data from the camera. For example, as the subject, a globe is provided which is arranged on a concave surface. Tilting of a case fitted with the attachment causes the globe to move on the surface. The CPU, from the image data, analyzes the position of the globe and detects the inclination of the case.

Claims

1. A sensing apparatus for detecting physical information of a predetermined type which changes in accordance with an external factor, the sensing apparatus comprising:

an image taking part;

a subject state change part which includes a subject of the image taking part and which changes a state of the subject in accordance with the external factor; and

a detection part which detects the physical information based on image data obtained by photographing the subject by the image taking part.

2. A sensing apparatus according to claim 1,

wherein the subject state change part is fitted in a freely attachable and detachable manner to a case fitted with the image taking part.

3. A sensing apparatus according to claim 1,

wherein, as the subject state change part, there are at least a first subject state change part and a second subject state change part,

wherein the first subject state change part includes as the subject a first subject of the image taking part, and changes a state of the first subject in accordance with a first external factor as the external factor,

wherein the second subject state change part includes as the subject a second subject of the image taking part, and changes a state of the second subject in accordance with a second external factor as the external factor,

wherein the first and second subjects are different from each other, and the first external factor and the second external factor are external factors of mutually different types,

wherein the first and second subject state change parts are fitted in a freely attachable and detachable manner and also selectively to the case fitted with the image taking part,

wherein, when the first subject state change part is fitted to the case, the detection part detects first physical information as the physical information based on image data obtained by photographing the first subject, and when the second subject state change part is fitted to the case, the detection part detects, as the physical information, second physical information of a type different from that of the first physical information based on image data obtained by photographing the second subject.

4. The sensing apparatus according to claim 1,

wherein the subject state change part includes as the subject a moving body that moves within a photographing region of the image taking part in accordance with inclination of a case fitted with the image taking part,

wherein the external factor is a force which changes the inclination, and

wherein the detection part detects, based on the image data, detects at least one of a position and movement of the moving body in the photographing region to thereby detect as the physical information at least one of a degree of the inclination and a change thereof.

5. The sensing apparatus according to claim 4,

wherein the subject state change part has a convex or concave surface provided in the photographing region of the image taking part, and

wherein the moving body moves along the surface by gravity force when the inclination changes.

6. The sensing apparatus according to claim 1,

wherein the subject state change part includes a surface provided in a photographing region of the image taking part and, as the subject, a moving body, which is movable on the surface,

wherein the external factor is a force which changes a position of the moving body on the surface, and

wherein the detection part, based on the image data, detects as the physical information at least one of the position and movement of the moving body in the photographing region.

7. The sensing apparatus according to claim 1,

wherein the subject state change part includes, as the subject, a magnet provided in a photographing region of the image taking part so as to be rotatable in accordance with a direction of a magnetic field,

wherein the external factor is a magnetic force by the magnetic field which rotates the magnet, and

wherein the detection part, based on the image data, detects a direction of the magnetic force as the physical information.

8. The sensing apparatus according to claim 1,

wherein the subject state change part includes:

a rotation axis, and a plurality of blades as the subject which is arranged in a photographing region of the image taking part and which is so fitted as to be rotatable with the rotation axis as a central axis,

wherein the external factor is a force which rotates the a plurality of blades, and

wherein the detection part, based on the image data, detects a rotation state of the plurality of blades as the physical information.

9. The sensing apparatus according to claim 1,

wherein the subject state change part includes, as the subject, a pressure deformable body which is arranged in a photographing region of the image taking part and which changes a shape thereof in accordance with magnitude of pressure applied thereto,

wherein the external factor is the pressure applied to the pressure deformable body, and

wherein the detection part, based on the image data, detects the magnitude of the pressure as the physical information.

10. The sensing apparatus according to claim 9,

wherein the subject state change part includes an upper plate and a lower plate which sandwich an elastic body as the pressure deformable body, and is configured so that a contact area between the pressure deformable body and the lower plate changes in accordance with the magnitude of the pressure applied to the pressure deformable body via the upper plate, and

wherein the detection part, based on the image data, calculates the contact area, and based on the calculated contact area, detects the magnitude of the pressure as the physical information.

11. The sensing apparatus according to claim 1,

wherein the subject state change part includes, as the subject, a plurality of pressure deformable bodies which change a shape thereof depending on magnitude of pressure applied thereto,

wherein the plurality of pressure deformable bodies are arranged at mutually different positions in a photographing region of the image taking part,

wherein the external factor is the pressure applied to the plurality of pressure deformable bodies, and

wherein the detection part, based on the image data, detects, as the physical information, the magnitude of the pressure and a position where the pressure has been applied.

12. The sensing apparatus according to claim 11,

wherein the subject state change part includes an upper plate and a lower plate which sandwich at mutually different positions elastic bodies as the respective pressure deformable bodies, and is configured so that a contact area between each of the plurality of pressure deformable bodies and the lower plate changes in accordance with the magnitude of the pressure applied to each of the pressure deformable bodies via the upper plate and also in accordance with a position where the pressure has been applied, and

wherein the detection part, based on the image data, calculates each contact area, and based on each contact area calculated, detects as the physical information the magnitude of the pressure and the position where the pressure has been applied.

13. The sensing apparatus according to claim 12,

wherein the subject state change part further includes a rod-shaped body which is fitted to the upper plate, and is configured so that the pressure is applied to each of the pressure deformable bodies via the rod-shaped body.

14. The sensing apparatus according to claim 1,

wherein the subject state change part includes as the subject a moving body which moves in a photographing region of the image taking part in accordance with acceleration of a case fitted with the image taking part,

wherein the external factor is a force which changes a degeree of the acceleration, and

wherein the detection part, based on the image data, detects as the physical information at least one of the degree and direction of the acceleration.

15. The sensing apparatus according to claim 14,

wherein the subject state change part further includes a first and a second elastic body which are so provided as to be capable of extending and contracting in a direction which changes the acceleration, and is configured so that with each one end of the first and second elastic bodies fixed, another ends of the first and second elastic bodies sandwich the moving body.

16. The sensing apparatus according to claim 1,

wherein the subject state change part includes as the subject a rotary body which rotates in a photographing region of the image taking part,

wherein the external factor is a force which rotates the rotary body, and

wherein the detection part, based on the image data, detects a rotation state of the rotary body as the physical information.

17. The sensing apparatus according to claim 1,

wherein the subject state change part includes a temperature indicating material which is arranged in a photographing region of the image taking part and which changes a color thereof in accordance with a temperature of an object to be measured,

wherein the external factor is heat energy from a heat source which changes the temperature, and

wherein the detection part, based on the image data, detects the temperature as the physical information.

18. A program execution apparatus comprising a program storage part which stores a program and a program execution part which executes the program, the program execution apparatus further comprising the sensing apparatus according to claim 1,

wherein the program execution part executes the program by referring to, as a variable, the physical information detected by the detection part of the sensing apparatus.

19. An image taking system comprising:

an image taking part,

a case which is fitted with the image taking part,

a rotating plate which has an opening and which is fitted to the case so as to be rotatable with an optical axis of an optical system of the image taking part as a central axis, and

a mirror which is fixed to the rotating plate and which reflects light from a first subject so that the light enters the image taking part via the opening.

20. The image taking system according to claim 19,

wherein the rotating plate is freely attachable and detachable to and from the case,

wherein the rotating plate and a subject state change part which includes a second subject of the image taking part and which, in accordance with an external factor, changes a state of the second subject are selectively fitted to the case in a freely attachable and detachable manner,

wherein the image taking system further includes a detection part, and

wherein, when the subject state change part is fitted to the case, the detection part detects physical information of a predetermined type which changes in accordance with the external factor based on image data obtained by photographing the second subject.