Information processing apparatus, stereoscopic display method, and program

• US 10,349,034 B2
• Filed: 09/23/2016
• Issued: 07/09/2019
• Est. Priority Date: 11/11/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Noda, Takuro
• Primary Examiner(s): Williams, Jeffery A
• Application Number:
  US15/274,534
• Publication Number:
  US 20170013249A1
• Time in Patent Office: 1,019 Days
• Field of Search: 348 43
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/183 On-screen display [OSD] information, e.g. subtitles or menus
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

An apparatus and method provide logic for processing information. In one implementation, an apparatus may include a determination unit configured to determine a first spatial position of a portion of an operating tool disposed within a threshold distance of a surface of the determination unit. The first spatial position may be determined relative to the determination unit surface in a depth direction. The apparatus may also include a control unit configured to generate a first signal to display a stereoscopic image to a user at a first display position. The first display position may be disposed within a predetermined distance of the first spatial position.

Claims

1. An information processing apparatus, comprising:

circuitry configured to

control display of an image to be stereoscopically perceivable by a user,

detect proximity between a portion of an operating tool of the user and a display surface,

receive an operation of the operating tool,

determine a location of the received operation,

determine a depth of the received operation based on the detected proximity between the portion of the operating tool and the display surface,

adjust display of the image based on the determined location and the determined depth of the received operation, and

control display of the image such that the user perceives the operation tool portion as writing in front or in back of the displayed image.

2. The information processing apparatus of claim 1, wherein the location of operation coincides with a position upon the display surface at which the image is displayed.

3. The information processing apparatus of claim 1, wherein the operating tool is a finger of the user.

4. The information processing apparatus of claim 1, wherein, in response to the determination of the location of operation, the circuitry further is configured to define a display position of displaying the image as being coincident with the display surface in the depth direction.

5. The information processing apparatus of claim 1, wherein the circuitry is further configured to control display of the image such that the user perceives the operating tool portion to contact the displayed image.

6. The information processing apparatus of claim 1, wherein the circuitry is further configured to

receive, from the user, information indicative of a display position of the image, and

define the display position of the image, based on at least the received information.

7. The information processing apparatus of claim 6, wherein the circuitry is further configured to detect a gesture of the user.

8. The information processing apparatus of claim 7, wherein the circuitry is further configured to define the display position based on at least the detected gesture.

9. The information processing apparatus of claim 6, wherein the circuitry is further configured to determine a proximity position of the operating tool portion disposed within a threshold distance of the display surface.

10. The information processing apparatus of claim 9, wherein the circuitry is further configured to define the display position based on the proximity position, the display position being defined relative to the display surface in the depth direction.

11. The information processing apparatus of claim 10, wherein the circuitry is further configured to determine a successive proximity position of the operating tool portion disposed within the threshold distance, the determination of the successive proximity position being in response to a motion of the operating tool in the depth direction.

12. The information processing apparatus of claim 11, wherein the circuitry is further configured to

determine a successive display position of the image based on at least the display position of the image and the successive proximity position of the operating tool portion;

and

generate a signal to display the image at the successive display position.

13. The information processing apparatus of claim 1, further comprising a display unit configured to display the image at a display position.

14. The information processing apparatus of claim 13, wherein the display unit comprises the display surface.

15. The information processing apparatus of claim 1, wherein the circuitry controls display of a plurality of images to each be stereoscopically perceivable by the user at respective display positions.

16. The information processing apparatus of claim 15, wherein the plurality of images are displayed as being overlapping with each other.

17. The information processing apparatus of claim 1, wherein the circuitry is further configured to append or edit the stereoscopically perceivable image based on the operation of the portion of the operating tool.

18. A computer-implemented method for displaying images, the method comprising:

displaying an image to be stereoscopically perceivable by a user;

detecting proximity between a portion of an operating tool of the user and a display surface;

receiving an operation of the operating tool;

determining a location of the received operation;

determining a depth of the received operation based on the detected proximity between the portion of the operating tool and the display surface;

adjusting display of the image based on the determined location and the determined depth of the received operation; and

controlling display of the image such that the user perceives the operation tool portion as writing in front or in back of the displayed image.

19. A tangible, non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer cause the computer to execute a method, the method comprising:

displaying an image to be stereoscopically perceivable by a user;

detecting proximity between a portion of an operating tool of the user and a display surface;

receiving an operation of the operating tool;

determining a location of the received operation;

determining a depth of the received operation based on the detected proximity between the portion of the operating tool and the display surface;

adjusting display of the image based on the determined location and the determined depth of the received operation; and

controlling display of the image such that the user perceives the operation tool portion as writing in front or in back of the displayed image.