Information processing device and information processing method
First Claim
1. An information processing device comprising:
- an image capturing device configured to capture a movement of an object within a moving image, wherein the object is a person;
an input value acquisition unit configured to estimate an amount of movement of the object with respect to the image capturing device from a reference position in a three-dimensional space defined in the vertical, horizontal, and depth directions, in the moving image by referring to the head and shoulder contours of the person which is approximated by a Greek ohm-shaped curve, wherein the image of the person derived from the ohm-shaped curve is subjected to an edge extracting process, wherein one or more edges near the curve are detected so as to obtain parameters that substantially match the contours of the person and an edge image is thereby obtained, wherein the ohm-shaped curve may be translated, expanded, contracted, or rotated by changing the parameters defining the curve, wherein said edge extracting process is repeated for each frame, so that tracking of the person proceeds, wherein movement of the object is determined based, at least in part, on its horizontal and vertical coordinates relative to a reference position in a two-dimensional plane, as viewed from above the image capturing device, the vertical direction representing depth from the perspective of the image capturing device, wherein the vertical distance from the reference position is determined by the object'"'"'s detected change in size relative to its size at the reference position; and
an output data generation unit configured to make a change in a performing process according to the amount of movement in the three-dimensional space that is estimated by the input value acquisition unit and to generate output data accordingly.
4 Assignments
0 Petitions
Accused Products
Abstract
An image acquisition unit of an information processing device acquires data for moving image including an image of a user and captured by an image capturing device. An initial processing unit determines correspondence between an amount of movement of the user and a parameter defining an image to be ultimately output in a conversion information storage unit. A tracking processing unit uses a particle filter to perform visual tracking in the moving image so as to estimate the magnification and translation amount of the user'"'"'s head contour. The input value conversion unit converts the amount of movement of the user into the parameter defining an image using the magnification and the translation amount as parameters. The output data generation unit generates an image based on the parameter. The output control unit controls the generated image so as to be displayed on a display device.
-
Citations
16 Claims
-
1. An information processing device comprising:
-
an image capturing device configured to capture a movement of an object within a moving image, wherein the object is a person; an input value acquisition unit configured to estimate an amount of movement of the object with respect to the image capturing device from a reference position in a three-dimensional space defined in the vertical, horizontal, and depth directions, in the moving image by referring to the head and shoulder contours of the person which is approximated by a Greek ohm-shaped curve, wherein the image of the person derived from the ohm-shaped curve is subjected to an edge extracting process, wherein one or more edges near the curve are detected so as to obtain parameters that substantially match the contours of the person and an edge image is thereby obtained, wherein the ohm-shaped curve may be translated, expanded, contracted, or rotated by changing the parameters defining the curve, wherein said edge extracting process is repeated for each frame, so that tracking of the person proceeds, wherein movement of the object is determined based, at least in part, on its horizontal and vertical coordinates relative to a reference position in a two-dimensional plane, as viewed from above the image capturing device, the vertical direction representing depth from the perspective of the image capturing device, wherein the vertical distance from the reference position is determined by the object'"'"'s detected change in size relative to its size at the reference position; and an output data generation unit configured to make a change in a performing process according to the amount of movement in the three-dimensional space that is estimated by the input value acquisition unit and to generate output data accordingly. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An information processing device comprising:
-
an image capturing device configured to capture a movement of an object within a moving image, wherein said object is a person; an input value acquisition unit configured to estimate an amount of movement of the object with respect to the image capturing device from a reference position in a two-dimensional space defined in the vertical and horizontal directions, and further estimate a distance in the depth direction from the reference position, from the moving image by referring to the head and shoulder contours of the person which is approximated by a Greek ohm-shaped curve, wherein the image of the person derived from the ohm-shaped curve is subjected to an edge extracting process, wherein one or more edges near the curve are detected so as to obtain parameters that substantially match the contours of the person and an edge image is thereby obtained, wherein the ohm-shaped curve may be translated, expanded, contracted, or rotated by changing the parameters defining the curve, wherein said edge extracting process is repeated for each frame, so that tracking of the person proceeds, wherein movement of the object is determined based, at least in part, on its horizontal and vertical coordinates relative to a reference position in a two-dimensional plane, as viewed from above the image capturing device, the vertical direction representing depth from the perspective of the image capturing device, wherein the vertical distance from the reference position is determined by the object'"'"'s detected change in size relative to its size at the reference position; and an output data generation unit configured to make a change in a performing process according to the amount of movement in the two-dimensional space estimated by the input value acquisition unit and generate output data accordingly, wherein the input value acquisition unit estimates an actual amount of movement in the vertical and horizontal directions by correcting an apparent amount of movement in the vertical and horizontal directions determined by using the image capturing device, based on the distance of the object from the reference position in the depth direction.
-
-
13. An information processing method comprising:
-
capturing a movement of an object within a moving image using an image capturing device, wherein said object is a person; estimating an amount of movement of the object with respect to the image capturing device from a reference position in a three-dimensional space defined in the vertical, horizontal, and depth directions, in the moving image by referring to the head and shoulder contours of the person which is approximated by a Greek ohm-shaped curve, wherein the image of the person derived from the ohm-shaped curve is subjected to an edge extracting process, wherein one or more edges near the curve are detected so as to obtain parameters that substantially match the contours of the person and an edge image is thereby obtained, wherein the ohm-shaped curve may be translated, expanded, contracted, or rotated by changing the parameters defining the curve, wherein said edge extracting process is repeated for each frame, so that tracking of the person proceeds, wherein movement of the object is determined based, at least in part, on its horizontal and vertical coordinates relative to a reference position in a two-dimensional plane, as viewed from above the image capturing device, the vertical direction representing depth from the perspective of the image capturing device, wherein the vertical distance from the reference position is determined by the object'"'"'s detected change in size relative to its size at the reference position; and making a change in a performing process according to the estimated amount of movement in the three-dimensional space and generating output data accordingly. - View Dependent Claims (14)
-
-
15. A computer program embedded in a non-transitory computer-readable recording medium, comprising:
-
a module configured to capture a movement of an object within a moving image using an image capturing device, wherein said object is a person; a module configured to estimate an amount of movement of the object with respect to the image capturing device from a reference position in a three-dimensional space defined in the vertical, horizontal, and depth directions, in the moving image by referring to the head and shoulder contours of the person which is approximated by a Greek ohm-shaped curve, wherein the image of the person derived from the ohm-shaped curve is subjected to an edge extracting process, wherein one or more edges near the curve are detected so as to obtain parameters that substantially match the contours of the person and an edge image is thereby obtained, wherein the ohm-shaped curve may be translated, expanded, contracted, or rotated by changing the parameters defining the curve, wherein said edge extracting process is repeated for each frame, so that tracking of the person proceeds, wherein movement of the object is determined based, at least in part, on its horizontal and vertical coordinates relative to a reference position in a two-dimensional plane, as viewed from above the image capturing device, the vertical direction representing depth from the perspective of the image capturing device, wherein the vertical distance from the reference position is determined by the object'"'"'s detected change in size relative to its size at the reference position; and a module configured to make a change in a performing process according to the estimated amount of movement in the three-dimensional space and to generate output data accordingly.
-
-
16. A non-transitory computer-readable recording medium having embodied thereon a computer program comprising:
-
a module configured to capture a movement of an object within a moving image using an image capturing device, wherein said object is a person; a module configured to estimate an amount of movement of the object with respect to the image capturing device from a reference position in a three-dimensional space defined in the vertical, horizontal, and depth directions, in the moving image by referring to the head and shoulder contours of the person which is approximated by a Greek ohm-shaped curve, wherein the image of the person derived from the ohm-shaped curve is subjected to an edge extracting process, wherein one or more edges near the curve are detected so as to obtain parameters that substantially match the contours of the person and an edge image is thereby obtained, wherein the ohm-shaped curve may be translated, expanded, contracted, or rotated by changing the parameters defining the curve, wherein said edge extracting process is repeated for each frame, so that tracking of the person proceeds, wherein movement of the object is determined based, at least in part, on its horizontal and vertical coordinates relative to a reference position in a two-dimensional plane, as viewed from above the image capturing device, the vertical direction representing depth from the perspective of the image capturing device, wherein the vertical distance from the reference position is determined by the object'"'"'s detected change in size relative to its size at the reference position; and a module configured to make a change in a performing process according to the estimated amount of movement in the three-dimensional space and to generate output data accordingly.
-
Specification