Image processing device

• US 20080056561A1
• Filed: 06/18/2007
• Published: 03/06/2008
• Est. Priority Date: 08/30/2006
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Sawachi, Youichi
• Granted Patent: US 7,970,204 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image

Abstract

An image processing device comprising: a plurality of image pickup sections that pick-up, from respectively different positions, a same object of sensing which carries out an instructing action, and outputting image information thereof; a position information sensing section which, by carrying out stereo matching on the plurality of image information outputted from the plurality of image pickup sections by using, as an object, two-dimensional regions, which correspond to a search space which is a three-dimensional space set in advance as a space in which the instructing action can be carried out, senses position information expressing matching positions which are positions of the object of sensing in the three-dimensional space at points corresponding to one another in the two-dimensional regions; and a specific position sensing section that senses, among the matching positions expressed by the position information, a specific position which is a matching position which matches predetermined conditions, is provided.

Claims

1. An image processing device comprising:

a plurality of image pickup sections that pick-up, from respectively different positions, a same object of sensing which carries out an instructing action, and outputting image information expressing images in which the object of sensing is included;

a position information sensing section which, by carrying out stereo matching on the plurality of image information outputted from the plurality of image pickup sections by using, as an object, two-dimensional regions, which are regions that are more narrow than a common region included commonly in each of the plurality of images expressed by the plurality of image information, and which correspond to a search space which is a three-dimensional space set in advance as a space in which the instructing action can be carried out, senses position information expressing matching positions which are positions of the object of sensing in the three-dimensional space at points corresponding to one another in the two-dimensional regions; and

a specific position sensing section that senses, among the matching positions expressed by the position information sensed by the position information sensing section, a specific position which is a matching position which matches predetermined conditions.

2. The image processing device of claim 1, wherein

the specific position that is sensed by the specific position sensing section is a position within a sensing space included in the search space,

the sensing space is a space within a rectangular parallelepiped, and

the predetermined conditions are that the position information sensed at the position information sensing section exists within the rectangular parallelepiped, and that, in a case in which the matching position does not exist on one surface of two, predetermined, opposing surfaces among surfaces of the rectangular parallelepiped but exists within a predetermined distance from another surface, the matching position which is nearest to the one surface is made to be the specific position.

3. The image processing device of claim 1, further comprising:

a consumed electric power controlling section which controls an amount of electric power consumed by the image processing device,

wherein the consumed electric power controlling section cancels a low electric power consumption mode when the low electric power consumption mode is set and, after a predetermined time period has elapsed after the specific position sensing section senses the specific position, the specific position sensing section again senses the specific position.

4. The image processing device of claim 2, further comprising:

a consumed electric power controlling section which controls an amount of electric power consumed by the image processing device,

wherein the consumed electric power controlling section cancels a low electric power consumption mode when the low electric power consumption mode is set and, after a predetermined time period has elapsed after the specific position sensing section senses the specific position, the specific position sensing section again senses the specific position.

5. The image processing device of claim 1, further comprising:

a deriving section that derives a state amount which expresses a state of movement of the specific position sensed by the specific position sensing section; and

a sensing section that senses the instructing action on the basis of the state amount derived by the deriving section.

6. The image processing device of claim 5, wherein the instructing action is an action which instructs execution of an operation processing which carries out a predetermined operation, and the image processing device further includes:

a display section;

a control section that effects control such that a predetermined screen corresponding to a cross-section of the three-dimensional space is displayed in a display region of the display section; and

a storing section in which the operation processing is stored in advance in association with respective partial regions obtained by dividing the predetermined screen into a plurality of regions,

wherein, on the basis of position information of the specific position sensed by the specific position sensing section, the deriving section derives an amount of movement of the specific position along a direction normal to the cross-section, as the state amount which expresses the state of movement of the specific position at a time when the object of sensing moves, and

when the amount of movement exceeds a predetermined amount, the sensing section senses, as the instructing action, an action instructing execution of the operation processing which is stored in association with a partial region corresponding to a position in the cross-section of the specific position at that point in time.

7. The image processing device of claim 6, wherein the control section further effects control such that a position-indicating image which shows a position of the specific position is displayed at a corresponding position of the specific position in the predetermined screen, and such that a state-indicating portion, which shows the state of movement of the specific position, is displayed at each partial region, and the control section further effects control such that a displayed state of at least one of the position-indicating image and the state-indicating portion, which is displayed at the partial region at a position where the position-indicating image is displayed, changes in accordance with the amount of movement.

8. The image processing device of claim 6, wherein the control section prohibits movement of the specific position along a planar direction of the cross-section, immediately before the amount of movement reaches the predetermined amount.

9. The image processing device of claim 7, wherein the control section prohibits movement of the specific position along a planar direction of the cross-section, immediately before the amount of movement reaches the predetermined amount.

10. The image processing device of claim 6, wherein the control section further effects control such that boundary lines, which partition the plurality of partial regions, are displayed on the predetermined screen.

11. The image processing device of claim 6, further comprising a sensing space setting section which sets a position of the sensing space,

wherein the sensing space setting section moves a search space, which is substantially an equal distance from each of the image pickup sections and which is positioned in a vicinity of the display section, in accordance with the specific position sensed by the specific position sensing section, and sets, as a position of the sensing space, the specific position at a time when the specific position has not moved for a predetermined time period.

12. The image processing device of claim 6, wherein the control section effects control such that an image, which is expressed by image information outputted from the image pickup section, and a two-dimensional image, which projects the rectangular parallelepiped expressing the sensing space, are superposed, and a mirror image, which is obtained by mirror-image-converting an image obtained by the superposing, is displayed at a display region of the display section.

13. The image processing device of claim 1, further comprising a coordinate rotating section which, in accordance with a positional relationship between the specific position sensed by the specific position sensing section and an origin of the three-dimensional space, rotates the three-dimensional space and makes it a new three-dimensional space.

14. The image processing device of claim 6, further comprising a coordinate rotating section which, in accordance with a positional relationship between the specific position sensed by the specific position sensing section and an origin of the three-dimensional space, rotates the three-dimensional space and makes it a new three-dimensional space.

15. The image processing device of claim 1, wherein the position information sensing section compares, for each of the image information outputted from the same image pickup section, the plurality of image information outputted from the plurality of image pickup sections and the plurality of image information outputted from the plurality of image pickup sections after a predetermined time period has elapsed, and executes the stereo matching in a case in which different image information exist.

16. The image processing device of claim 6, wherein the position information sensing section compares, for each of the image information outputted from the same image pickup section, the plurality of image information outputted from the plurality of image pickup sections and the plurality of image information outputted from the plurality of image pickup sections after a predetermined time period has elapsed, and executes the stereo matching in a case in which different image information exist.