Spatial image display apparatus and spatial image display method

• US 10,372,268 B2
• Filed: 07/21/2015
• Issued: 08/06/2019
• Est. Priority Date: 07/21/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tachibana, Makoto, Ito, Tsuyoshi
• Primary Examiner(s): Patel, Nitin
• Assistant Examiner(s): Bogale, Amen
• Application Number:
  US14/805,007
• Publication Number:
  US 20170024082A1
• Time in Patent Office: 1,477 Days
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

An spatial image display apparatus and method for displaying a spatial image in an aerial space, sensing an object traversing the spatial image, calculating the position of the object'"'"'s effective centroid, and performing an input operation is disclosed. The spatial image display apparatus detects distances from the object'"'"'s surface thrust into the aerial display to more precisely determine the position on the spatial image at which the user intends to indicate.

Claims

1. A spatial image display apparatus, comprising:

a fog generator configured to generate fog that flows along a display plane in an aerial space;

a spatial image display device configured to emit visible light into the fog to form a spatial image in the display plane;

a sensor configured to generate a signal corresponding to a position of an object traversing the spatial image; and

circuitry configured to;

receive the signal, and

determine the position of the object with respect to the display plane according to a spatial distance variation and a programmable timing tolerance, wherein the spatial distance variation and the programmable timing tolerance are set so that the circuitry determines the position of the object even if the object experiences a predetermined amount of shaking;

wherein a detection of the object traversing the display plane outside of the spatial image and opposite of a pseudo-physical button is considered a unique input command.

2. The spatial image display apparatus of claim 1, wherein

the spatial image display device further comprises:

a display device configured to emit the visible light; and

an imaging optical system reflecting the visible light into the aerial space, and

the circuitry is configured to calculate a position of an effective centroid of the object.

3. The spatial image display apparatus of claim 2, wherein the circuitry is further configured to calculate the position of the effective centroid of the object based on a lesser of:

a maximum length of the object in a x direction; and

a maximum length of the object in a y direction.

4. The spatial image display apparatus of claim 2, wherein the circuitry further comprises a timer configured to record timing of the signal to indicate an operation command.

5. The spatial image display apparatus of claim 2, wherein the circuitry further comprises:

a receiver configured to perform an analog-to-digital conversion on the signal;

a position analyzer configured to generate the position of the effective centroid of the object;

a main controller;

a memory configured to store executable code and data; and

a display controller configured to generate the visible light.

6. The spatial image display apparatus of claim 1, further comprising a pseudo-physical button.

7. The spatial image display apparatus of claim 1, wherein

the sensor further comprises a plurality of light ray emitters and detectors arranged along the display plane,

each light ray emitter emits light rays parallel and adjacent to the display plane,

the signal corresponds to an intensity detected by each of the detectors of the light rays reflecting off the object traversing the display plane, and

the signal corresponds to a distance between the object and the sensor.

8. The spatial image display apparatus of claim 1, further comprising a notebook computer.

9. A method comprising:

generating fog that flows along a display plane in an aerial space;

emitting a visible light into the fog to form a spatial image in the display plane;

detecting a position, of an object traversing the spatial image, according to a spatial distance variation and a programmable timing tolerance;

calculating an effective centroid position of the object based on the detected position; and

identifying an input command based on the effective centroid position, wherein

the spatial distance variation and the programmable timing tolerance are set so that the position of the object is detected even if the object experiences a predetermined amount of shaking;

wherein a detection of the object traversing the display plane outside of the spatial image and opposite of a pseudo-physical button is considered a unique input command.

10. The method of claim 9, wherein a detection of more than one object is considered a unique input command.

11. The method of claim 9, wherein a timing of the object traversing the display plane outside of the spatial image is considered a unique input command.

12. The method of claim 9, wherein the effective centroid position is calculated based on a lesser of:

a maximum length of the object in a x direction; and

a maximum length of the object in a y direction.

13. The method of claim 9, wherein

the visible light is emitted by a plurality of light ray emitters and detectors arranged along the display plane, and

the method further comprises:

detecting, by the detectors, intensity values of the light rays reflecting off the object traversing the display plane; and

calculating the effective centroid position according to the intensity values.

14. A non-transitory computer-readable medium storing computer executable instructions which, when executed by an information processing apparatus, causes the information processing apparatus to:

control a fog generator to generate fog that flows along a display plane in an aerial space;

control a spatial image display device to emit a visible light into the fog to form a spatial image in the display plane;

calculate an effective centroid position of an object traversing the spatial image based on a position of the object, the position of the object being detected according to a spatial distance variation and a programmable timing tolerance; and

identify an input command based on the effective centroid position, wherein

the spatial distance variation and the programmable timing tolerance are set so that the effective centroid position of the object is calculated even if the object experiences a predetermined amount of shaking;

wherein a detection of the object traversing the display plane outside of the spatial image and opposite of a pseudo-physical button is considered a unique input command.

15. The non-transitory computer-readable medium of claim 14, wherein the information processing apparatus is further caused to:

identify the input command based on an amount of time the object is sensed traversing the display plane.

16. The non-transitory computer-readable medium of claim 14, wherein the information processing apparatus is further caused to:

calculate a change in the position of the effective centroid of the object; and

identify the input command based on the change in a predetermined amount of time.

17. The non-transitory computer-readable medium of claim 14, wherein the information processing apparatus is further caused to:

calculate effective centroid positions of more than one object traversing the display plane based on detected positions of the objects; and

identify the input command based on the effective centroid positions of each object.

18. The non-transitory computer-readable medium of claim 14, wherein the effective centroid position is calculated based on a lesser of:

a maximum length of the object in a x direction; and

a maximum length of the object in a y direction.

19. The non-transitory computer-readable medium of claim 14, wherein

the visible light is emitted by a plurality of light ray emitters and detectors arranged along the display plane, and

the information processing apparatus is further caused to:

detecting, by the detectors, intensity values of the light rays reflecting off the object traversing the display plane; and

calculating the effective centroid position according to the intensity values.