Method and apparatus for user interface communication with an image manipulator

• US 8,902,225 B2
• Filed: 10/18/2012
• Issued: 12/02/2014
• Est. Priority Date: 10/31/2007
• Status: Expired due to Fees

• Current Assignee: Genedics, LLC
• Original Assignee: Genedics, LLC
• Inventors: Merritt, Edward, Fein, Gene S., Merritt, Eli A. S.
• Primary Examiner(s): BROOME, SAID A
• Application Number:
  US13/654,752
• Publication Number:
  US 20130038528A1
• Time in Patent Office: 775 Days
• Field of Search: None
• US Class Current: 345/419
• CPC Class Codes: G03H 1/2249 Holobject properties
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A system, and method for use thereof, for image manipulation. The system may generate an original image in a three dimensional coordinate system. A sensing system may sense a user interaction with the image. The sensed user interaction may be correlated with the three dimensional coordinate system. The correlated user interaction may be used to project an updated image, where the updated image may be a distorted version of the original image. The image distortion may be in the form of a twisting, bending, cutting, displacement, or squeezing. The system may be used for interconnecting or communicating between two or more components connected to an interconnection medium (e.g., a bus) within a single computer or digital data processing system.

Claims

1. A user interface method, the method comprising:

obtaining a projector display of an initial image;

using one or more sensors coupled to a computer processor, sensing a user interaction with the displayed initial image, the user interaction being in a three dimensional coordinate system, and said sensing being based on quadrilateral angle navigation that determines a sensing point position within the three dimensional coordinate system, wherein an original image is displayed from a certain point in space preconfigured to match specific points in the quadrilateral angle navigation, and the certain point in space is matched to space location of the user interaction to determine the sensing point, said sensing resulting in each sensor providing coordinate information to the computer processor enabling the computer processor to correlate with the original image in the three dimensional coordinate system;

in the computer processor, correlating the sensed user interaction with the three dimensional coordinate system and responsively manipulating the initial image resulting in an updated image based on the correlated user interaction; and

from the computer processor through a projector, projecting the resulting updated image, the updated image being equivalent to the initial image manipulated by a distortion in three dimensional space.

2. The method of claim 1 wherein the initial image and/or the resulting updated image is a holographic image.

3. The method of claim 1 wherein sensing includes using laser sensors to geometrically identify a position within the three dimensional coordinate system.

4. The method of claim 3 wherein using laser sensors to geometrically identify includes using laser sensors to triangulate and/or quadrilate a position within the three dimensional coordinate system.

5. The method of claim 1 wherein the distortion is any one or combination of:

twisting, bending, cutting, displacement, and squeezing the initial image.

6. The method of claim 1 further comprising selecting a distortion based on at least one indicator.

7. The method of claim 2 wherein projecting the resulting updated image further includes selecting a pre-recorded interference pattern based on the correlated data.

8. The method of claim 2 wherein projecting the resulting updated image further includes generating an interference pattern based on the correlated data.

17. The method of claim 1 wherein sensing includes touch point sensing, thermal sensing, audio sensing, motion sensing, voice recognition sensing, retinal scan sensing, or fingerprint match sensing, wherein sensing geometrically identifies a position within the three dimensional coordinate system.

18. The method of claim 1 wherein projecting the resulting updated image is real-time and continuous.

19. The method of claim 1 wherein projecting the resulting updated image is performed using multiple projection devices simultaneously.

9. A user interface system, comprising:

a projecting unit rendering a display of an initial image;

at least one sensor configured to sense a user interaction with the displayed initial image, the user interaction being in a three dimensional coordinate system and sensing being based on quadrilateral angle navigation within the three dimensional coordinate system, wherein an original image is displayed from a certain point in space preconfigured to match specific points in the quadrilateral angle navigation, and the certain point in space is matched to space location of the user interaction to determine the sensing point, said sensing resulting in each sensor providing coordinate information to the computer processor enabling the computer processor to correlate with the original image in the three dimensional coordinate system; and

a correlation unit configured to correlate the sensed user interaction with the three dimensional coordinate system and correlate the three dimensional coordinate system with the initial image in a manner implementing a manipulation of the initial image based on the correlated user interaction;

wherein the projecting unit is responsive to the correlation unit and configured to project an updated image resulting from the manipulation of the initial image, the updated image being equivalent to the initial image manipulated by a distortion in three dimensional space.

10. The system of claim 9 wherein the initial image and/or the updated image is a holographic image.

11. The system of claim 9 wherein the at least one sensor is a laser sensor configured to geometrically identify a position within the three dimensional coordinate system.

12. The system of claim 11 wherein the at least one sensor is further configured to triangulate and/or quadrilate a position within the three dimensional coordinate system.

13. The system of claim 9 wherein the distortion is any one or combination of:

twisting, bending, cutting, displacement, and squeezing of the initial image.

14. The system of claim 13 wherein the correlation unit is further configured to select the distortion based on at least one indicator.

15. The system of claim 10 wherein the projecting unit is further configured to project the updated image by selecting a pre-recorded interference pattern based on the correlated data.

16. The system of claim 10 wherein the projecting unit is further configured to project the updated image by projecting a generated interference pattern based on the correlated data.