Information processing apparatus, and information processing method to operate on virtual object using real object
First Claim
Patent Images
1. An information processing apparatus, comprising:
- processing circuitry configured to;
detect a first real object from a captured image;
determine a first position of a first characteristic point of the first real object, an orientation of the first real object, and a type of the first real object;
compare the first position, of the first characteristic point of the first real object, with each of a plurality of second positions of a corresponding second characteristic point of a plurality of second characteristic points,wherein each of the plurality of second characteristic points is associated with a respective second real object of a plurality of second real objects, andwherein the plurality of second characteristic points of the plurality of second real objects is stored in a memory;
determine a shortest distance among a plurality of first distances,wherein each of the plurality of first distances is between the first position of the first characteristic point and a respective one of the plurality of second positions;
set an identification label of the first real object based on the determined shortest distance, wherein the identification label identifies the first real object;
determine a virtual object corresponding to the captured image based on;
the first position,the identification label of the first real object,the orientation of the first real object, andthe type of the first real object;
control a display device to display the virtual object and the captured image such that the virtual object is superimposed on the captured image; and
generate a control command, for execution of an operation associated with the first real object, based on a physical movement of the first real object towards a particular object such that the first real object is at a threshold distance from the particular object,wherein the threshold distance is greater than zero.
1 Assignment
0 Petitions
Accused Products
Abstract
An information processing apparatus includes processing circuitry that is configured to issue a control command relating to a real object based on a displayed positional relationship between the real object and a predetermined object. The real object being a tangible, movable object and the predetermined object being at least one of another real object and a virtual object.
69 Citations
20 Claims
-
1. An information processing apparatus, comprising:
processing circuitry configured to; detect a first real object from a captured image; determine a first position of a first characteristic point of the first real object, an orientation of the first real object, and a type of the first real object; compare the first position, of the first characteristic point of the first real object, with each of a plurality of second positions of a corresponding second characteristic point of a plurality of second characteristic points, wherein each of the plurality of second characteristic points is associated with a respective second real object of a plurality of second real objects, and wherein the plurality of second characteristic points of the plurality of second real objects is stored in a memory; determine a shortest distance among a plurality of first distances, wherein each of the plurality of first distances is between the first position of the first characteristic point and a respective one of the plurality of second positions; set an identification label of the first real object based on the determined shortest distance, wherein the identification label identifies the first real object; determine a virtual object corresponding to the captured image based on; the first position, the identification label of the first real object, the orientation of the first real object, and the type of the first real object; control a display device to display the virtual object and the captured image such that the virtual object is superimposed on the captured image; and generate a control command, for execution of an operation associated with the first real object, based on a physical movement of the first real object towards a particular object such that the first real object is at a threshold distance from the particular object, wherein the threshold distance is greater than zero. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
19. An information processing method, comprising:
-
in an information processing apparatus; detecting, by processing circuitry, a first real object from a captured image; determining, by the processing circuitry, a first position of a first characteristic point of the first real object, an orientation of the first real object, and a type of the first real object; comparing, by the processing circuitry, the first position, of the first characteristic point of the first real object, with each of a plurality of second positions of a corresponding second characteristic point of a plurality of second characteristic points, wherein each of the plurality of second characteristic points is associated with a respective second real object of a plurality of second real objects, and wherein the plurality of second characteristic points of the plurality of second real objects is stored in a memory; determining, by the processing circuitry, a shortest distance among a plurality of first distances, wherein each of the plurality of first distances is between the first position of the first characteristic point and a respective one of the plurality of second positions; setting, by the processing circuitry, an identification label of the first real object based on the determined shortest distance, wherein the identification label identifies the first real object; determining, by the processing circuitry, a virtual object corresponding to the captured image based on; the first position, the identification label of the first real object, the orientation of the first real object, and the type of the first real object; controlling, by the processing circuitry, a display device to display the virtual object and the captured image such that the virtual object is superimposed on the captured image; and generating, by the processing circuitry, a control command, for execution of an operation associated with the first real object, based on a physical movement of the first real object towards a particular object such that the first real object is at a threshold distance from the particular object, wherein the threshold distance is greater than zero.
-
-
20. An information processing apparatus, comprising:
-
an interface configured to receive information related to movement of a first real object; and processing circuitry configured to; detect the first real object from a captured image; determine a first position of a first characteristic point of the first real object, an orientation of the first real object, and a type of the first real object; compare the first position of the first characteristic point of the first real object, with each of a plurality of second positions of a corresponding second characteristic point of a plurality of second characteristic points, wherein each of the plurality of second characteristic points is associated with a respective second real object of a plurality of second real objects, and wherein the plurality of second characteristic points of the plurality of second real objects is stored in a memory; determine a shortest distance among a plurality of distances, wherein each of the plurality of distances is between the first position of the first characteristic point and a respective one of the plurality of second positions; set an identification label of the first real object based on the determined shortest distance, wherein the identification label identifies the first real object; determine a virtual object corresponding to the captured image based on; the first position, the identification label of the first real object, the orientation of the first real object, and the type of the first real object; control a display device to display the virtual object and the captured image such that the virtual object is superimposed on the captured image; and generate a control command, for execution of an operation associated with the first real object, based on a physical movement of the first real object towards a particular object such that the first real object is at a threshold distance from the particular object, wherein the threshold distance is greater than zero.
-
Specification