INFORMATION PROCESSING DEVICE, SYSTEM, AND INFORMATION PROCESSING METHOD

• US 20140205151A1
• Filed: 01/13/2014
• Published: 07/24/2014
• Est. Priority Date: 01/22/2013
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Takahiro Yagishita
• Inventors: YAGISHITA, Takahiro
• Granted Patent: US 9,471,983 B2
• Time in Patent Office: Days
• US Class Current: 382/106
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

An information processing device according to an embodiment of the present invention includes a detection unit, a calculation unit, a determination unit, and an estimation unit. The detection unit detects each three-dimensional position of a plurality of parts of an instruction object for indicating an image output surface. The calculation unit calculates an intersection point of a direction indicated by the instruction object and the image output surface based on each three-dimensional position of the parts of the instruction object. The determination unit determines whether the intersection point is within a predetermined range on the image output surface. The estimation unit estimates a position indicated by the instruction object on the image output surface based on the determination made by the determination unit.

Claims

1. An information processing device comprising:

a detection unit configured to detect each three-dimensional position of a plurality of parts of an instruction object for indicating an image output surface to which an image is output;

a calculation unit configured to calculate an intersection point of a direction indicated by the instruction object and the image output surface based on each three-dimensional position of the parts of the instruction object detected by the detection unit;

a determination unit configured to determine whether or not the intersection point is within a predetermined range on the image output surface; and

an estimation unit configured to estimate a position indicated by the instruction object on the image output surface based on the determination made by the determination unit.

2. The information processing device according to claim 1, wherein,

when the determination unit determines that the intersection point is within the predetermined range, the estimation unit estimates, as the position indicated by the instruction object, coordinates of a position on the image output surface having a shortest distance between the image output surface and any one of the parts of the instruction object, and

when it is determined that the intersection point is outside the predetermined range, the estimation unit estimates the intersection point as the position indicated by the instruction object.

3. The information processing device according to claim 1, wherein

the detection unit detects each three-dimensional position of the parts of the instruction object existing in a space in front of the image output surface.

4. The information processing device according to claim 3, wherein

the detection unit detects each three-dimensional position of the parts of the instruction object existing in a space within 30 cm from the image output surface in a normal direction thereof.

5. The information processing device according to claim 1, wherein,

when the intersection point is within the predetermined range, the estimation unit estimates, as the position indicated by the instruction object, coordinates of a position on the image output surface having a shortest distance to any one of the parts of the instruction object passing through a virtual operation surface in the space in front of the image output surface toward the image output surface.

6. The information processing device according to claim 4, wherein

the estimation unit estimates, as the position indicated by the instruction object, coordinates of a position on the image output surface having a shortest distance to a part closest to the image output surface among the parts of the instruction object.

7. The information processing device according to claim 1, further comprising a first setting unit configured to variably set the predetermined range based on the three-dimensional position of the instruction object.

8. The information processing device according to claim 1, further comprising a second setting unit configured to receives an input of physique information indicating a physique of a user and variably sets the predetermined range based on the received physique information.

9. The information processing device according to claim 1, wherein

the calculation unit comprises

a first calculation unit configured to calculate a virtual line representing the direction indicated by the instruction object based on each three-dimensional position of the parts of the instruction object, and

a second calculation unit configured to calculate the intersection point indicating a point at which the image output surface intersects with the virtual line.

10. The information processing device according to claim 1, wherein

the predetermined range is set as a range where a user'"'"'s hand is reachable on the image output surface.

11. A system including a display device that displays an image;

and an information processing device connected to the display device, wherein

the information processing device comprises

a detection unit configured to detect each three-dimensional position of a plurality of parts of an instruction object for indicating a predetermined position on an image output surface to which the image is output,

a calculation unit configured to calculate an intersection point of a direction indicated by the instruction object and the image output surface based on each three-dimensional position of the parts of the instruction object detected by the detection unit,

a determination unit configured to determine whether or not the intersection point is within a predetermined range on the image output surface, and

an estimation unit configured to estimate a position on the image output surface indicated by the instruction object based on the determination made by the determination unit.

12. The system according to claim 11, wherein,

when the determination unit determines that the intersection point is within the predetermined range, the estimation unit estimates, as the position indicated by the instruction object, coordinates of a position on the image output surface having a shortest distance between the image output surface and any one of the parts of the instruction object, and

when it is determined that the intersection point is outside the predetermined range, the estimation unit estimates the intersection point as the position indicated by the instruction object.

13. The system according to claim 11, wherein

the detection unit detects each three-dimensional position of the parts of the instruction object existing in a space in front of the image output surface.

14. The system according to claim 13, wherein

the detection unit detects each three-dimensional position of the parts of the instruction object existing in a space within 30 cm from the image output surface in a normal direction thereof.

15. The system according to claim 11, wherein,

when the intersection point is within the predetermined range, the estimation unit estimates, as the position indicated by the instruction object, coordinates of a position on the image output surface having a shortest distance to any one of the parts of the instruction object passing through a virtual operation surface in the space in front of the image output surface toward the image output surface.

16. The system device according to claim 14, wherein

the estimation unit estimates, as the position indicated by the instruction object, coordinates of a position on the image output surface having a shortest distance to a part closest to the image output surface among the parts of the instruction object.

17. The system according to claim 11, wherein

the information processing device further comprises a first setting unit configured to variably set the predetermined range based on the three-dimensional position of the instruction object.

18. The system according to claim 11, wherein

the information processing device further comprises a second setting unit configured to receives an input of physique information indicating a physique of a user and variably sets the predetermined range based on the received physique information.

19. The system according to claim 11, wherein

the calculation unit comprises

a first calculation unit configured to calculate a virtual line representing the direction indicated by the instruction object based on each three-dimensional position of the parts of the instruction object, and

a second calculation unit configured to calculate the intersection point indicating a point at which the image output surface intersects with the virtual line.

20. An information processing method comprising:

detecting each three-dimensional position of a plurality of parts of an instruction object for indicating an image output surface onto which an image is output;

calculating an intersection point of a direction indicated by the instruction object and the image output surface based on each three-dimensional position of the parts of the instruction object detected at the detecting;

determining whether or not the intersection point is within a predetermined range on the image output surface; and

estimating a position on the image output surface indicated by the instruction object based on the determination made at the determining.