Projection device, projection method and projection program

• US 10,459,578 B2
• Filed: 09/28/2018
• Issued: 10/29/2019
• Est. Priority Date: 03/30/2011
• Status: Active Grant

• Current Assignee: Sony Group Corp.
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mizunuma, Hiroyuki, Yamano, Ikuo, Kasahara, Shunichi, Miyashita, Ken, Yamamoto, Kazuyuki
• Primary Examiner(s): Davis, David D
• Application Number:
  US16/146,132
• Publication Number:
  US 20190034034A1
• Time in Patent Office: 396 Days
• Field of Search: None
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback
• CPC Class Codes: H05K 999/99 dummy group

Abstract

According to an illustrative embodiment, an information processing apparatus is provided. The apparatus is used for processing a first image projected toward a target. The apparatus includes a processing unit for detecting that an object exists between a projector unit and the target, wherein when an object exists between the projector unit and the target, the apparatus determines an area of the object and generates a modified first image, based on the area of the object, for projection toward the target.

Claims

1. An information processing apparatus comprising:

a processor configured to;

output a first image superimposed on first portion of a three-dimensional space;

acquire a first result of detection of a first user operation with a user'"'"'s hand;

output a second image at a position associated with the first user operation based on the first result of detection, the second image being associated with the first image and superimposed on a second portion of the three-dimensional space;

acquire a second result of detection of a second user operation with the user'"'"'s other hand, the second user operation being associated with the position of the second image; and

control a change to the second image based on the second result of detection.

2. The apparatus of claim 1, wherein the first user operation is associated with designation of a portion of the first image, whereby the second image includes the designated portion of the first image.

3. The apparatus of claim 2, wherein the portion of the first image designated by the first object is a text string, and wherein the second image is a text box containing the text string.

4. The apparatus of claim 1, wherein the first user operation is associated with designation of a portion of the first image, wherein the second image is a new image associated with the designated portion of the first image but not included in the first image.

5. The apparatus of claim 4, wherein the portion of the first image designated by the first user operation is a hyperlink, wherein the second image is a link-destination page image associated with the hyperlink.

6. The apparatus of claim 4, wherein the portion of the first image designated by the first user operation is an icon, wherein the second image is a menu associated with the icon.

7. The apparatus of claim 1, wherein at least a portion of the second image is included in the first image.

8. The apparatus of claim 1, wherein the processor is configured to output the second image overlaying the user'"'"'s hand.

9. The apparatus of claim 1, wherein the first image includes one or more thumbnail images.

10. The apparatus of claim 9, wherein each of the one or more thumbnail images corresponds to a respective application.

11. The apparatus of claim 10, wherein the second image indicates a content of an application corresponding to a thumbnail image of the first image.

12. The apparatus of claim 1, wherein the second image indicates a content associated with an application.

13. The apparatus of claim 1, wherein the first user operation is a drag operation.

14. The apparatus of claim 1, wherein the second user operation is a tap operation.

15. The apparatus of claim 1, wherein the processor is configured to control the change to the second image in accordance with a result of detection of the user'"'"'s other hand designating a portion of the second image.

16. The apparatus of claim 1, wherein, when the position at which the second image is outputted overlaps the first image, the processor is configured to make the second image visible over the first image.

17. The apparatus of claim 1, wherein the processor is further configured to:

determine which of a user'"'"'s hands is acquired by the first result of detection or by the second result of detection; and

control the output or change to the first or second image in accordance with which of a user'"'"'s hands is acquired.

18. The apparatus of claim 1, wherein each of the first image and the second image is superimposed on its respective portion of the three-dimensional space by projection.

19. The apparatus of claim 1, wherein the first portion and second portion of the three-dimensional space fully overlap, partially overlap, or do not overlap.