Information processing apparatus, information processing method, and program for storing an image shot by a camera and projected by a projector

• US 8,325,234 B2
• Filed: 03/29/2010
• Issued: 12/04/2012
• Est. Priority Date: 04/14/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kii, Manabu
• Primary Examiner(s): GILES, NICHOLAS G
• Application Number:
  US12/748,664
• Publication Number:
  US 20100259633A1
• Time in Patent Office: 981 Days
• Field of Search: 345/633, 348/158, 348/159, 348/161, 348/207.99, 348/222.1
• US Class Current: 348/161
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44213 Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/3176 wherein the projection device is incorporated in a camera details of cameras adapted for combination with a projector not peculiar to the presence of an electronic spatial light modulator G03B17/54
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An information processing apparatus includes a projector, a camera, a first storage, and a controller. The projector projects a projection image containing a first operation image onto a predetermined area. The camera shoots an image of a subject within the predetermined area. The controller detects an operation to the first operation image based on the shot image shot by the camera and controls the first storage to store at least the image of the subject out of the shot image when the operation is detected.

Claims

1. An information processing apparatus, comprising:

a projector to project a projection image containing a first operation image onto a predetermined area;

a camera to shoot an image of a subject within the predetermined area;

a first storage; and

a controller to detect an operation to the first operation image based on the shot image shot by the camera and control the first storage to store at least the image of the subject out of the shot image when the operation is detected, wherein

the controller recognizes metadata of the subject based on the shot image and controls a second storage to store the metadata as a part of a predetermined list,

the controller controls the projector to include, in the projection image, information indicating whether the metadata has been recognized, and

the controller controls the projector to make illuminance of the projection image larger than illuminance before the operation is detected for a predetermined time period since the detection.

2. The information processing apparatus according to claim 1,

wherein the controller detects whether the subject is present within the predetermined area based on the shot image and controls the projector to include the first operation image in the projection image when it is detected that the subject is present within the predetermined area.

3. The information processing apparatus according to claim 2,

wherein the controller detects, after the image of the subject is stored in the first storage, whether the subject is moved from a position where the image of the subject has been stored, and controls the projector to project the image of the subject that is stored in the first storage to the position where the image of the subject has been stored when it is detected that the subject is moved.

4. The information processing apparatus according to claim 1,

wherein the controller controls the projector to project a pseudo animation showing how the metadata is being stored as a part of the predetermined list by using the image of the subject.

5. An information processing apparatus, comprising:

a projector to project a projection image containing a first operation image onto a predetermined area;

a camera to shoot an image of a subject within the predetermined area;

a first storage; and

a controller to detect an operation to the first operation image based on the shot image shot by the camera and control the first storage to store at least the image of the subject out of the shot image when the operation is detected, wherein

the controller recognizes metadata of the subject based on the shot image and controls a second storage to store the metadata as a part of a predetermined list, and

the controller controls the second storage to store the metadata when it is detected that the subject whose metadata has been recognized is not present within the predetermined area based on the shot image.

6. The information processing apparatus according to claim 5,

wherein the controller recognizes pieces of metadata from a plurality of subjects that are present within the predetermined area and controls the second storage to store the pieces of metadata at a time as a part of the predetermined list when it is detected that all the plurality of subjects are not present within the predetermined area.

7. The information processing apparatus according to claim 5,

wherein the controller recognizes pieces of metadata from a first subject and a second subject that is a different type from that of the first subject, the first subject and the second subject being present within the predetermined area, and controls the second storage to store first metadata of the first subject as a part of a first list when it is detected that the first subject is not present within the predetermined area and store second metadata of the second subject as a part of a second list when it is detected that the second subject is not present within the predetermined area.

8. An information processing apparatus, comprising:

a projector to project a projection image containing a first operation image onto a predetermined area;

a camera to shoot an image of a subject within the predetermined area;

a first storage; and

a controller to detect an operation to the first operation image based on the shot image shot by the camera and control the first storage to store at least the image of the subject out of the shot image when the operation is detected, wherein

the controller recognizes metadata of the subject based on the shot image and controls a second storage to store the metadata as a part of a predetermined list, and

the controller controls the projector to include a second operation image different from the first operation image in the projection image when the metadata is recognized, detects an operation to the second operation image based on the shot image, and controls the second storage to store the metadata when the operation is detected.

9. The information processing apparatus according to claim 8,

wherein the controller recognizes pieces of metadata from a plurality of subjects that are present within the predetermined area and controls the second storage to store the pieces of metadata at a time as a part of the predetermined list when the operation to the second operation image is detected.

10. The information processing apparatus according to claim 8,

wherein the controller recognizes pieces of metadata from a first subject and a second subject that is a different type from that of the first subject, the first subject and the second subject being present within the predetermined area, and controls the second storage to store the first subject and first metadata of the first subject as a part of a first list and store the second subject and second metadata of the second subject as a part of a second list when the operation to the second operation image is detected.