Method and apparatus for user interface communication with an image manipulator

• US 8,319,773 B2
• Filed: 03/16/2011
• Issued: 11/27/2012
• Est. Priority Date: 10/31/2007
• Status: Expired due to Fees

• Current Assignee: Genedics, LLC
• Original Assignee: Edward Merritt, Eli A.S. Merritt, Gene S. Fein
• Inventors: Fein, Gene S., Merritt, Eli A. S., Merritt, Edward
• Primary Examiner(s): BROOME, SAID A
• Application Number:
  US13/049,684
• Publication Number:
  US 20120038547A1
• Time in Patent Office: 622 Days
• Field of Search: None
• US Class Current: 345/419
• CPC Class Codes: G03H 1/2249 Holobject properties
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A system, and method for use thereof, for image manipulation. The system may generate an original image in a three dimensional coordinate system. A sensing system may sense a user interaction with the image. The sensed user interaction may be correlated with the three dimensional coordinate system. The correlated user interaction may be used to project an updated image, where the updated image may be a distorted version of the original image. The image distortion may be in the form of a twisting, bending, cutting, displacement, or squeezing. The system may be used for interconnecting or communicating between two or more components connected to an interconnection medium (e.g., a bus) within a single computer or digital data processing system.

Claims

1. A method of manipulating an original image through a user interface, the method comprising:

using one or more sensors coupled to a computer processor, sensing a user interaction with the original image in a three dimensional coordinate system, said sensing being based on quadrilateral angle navigation that determines a touch point position within the three dimensional coordinate system, wherein the original image is displayed from a certain point in space preconfigured to match specific points in the quadrilateral angle navigation and the certain point in space is matched to space location of the user interaction to determine the touch point, said sensing resulting in each sensor providing coordinate information to the computer processor enabling the computer processor to correlate with the original image in the three dimensional coordinate system;

in the computer processor, correlating the sensed user interaction with the three dimensional coordinate system; and

from the computer processor through a projector, projecting an updated image based on the correlated user interaction, the updated image being equivalent to the original image manipulated by a distortion.

2. The method of claim 1 wherein the original image and/or the updated image is a holographic image.

3. The method of claim 1 wherein sensing includes using laser sensors to geometrically identify a position within the three dimensional coordinate system.

4. The method of claim 3 wherein using laser sensors to geometrically identify includes using laser sensors to triangulate and/or quadrilate a position within the three dimensional coordinate system.

5. The method of claim 1 wherein the distortion is any one or combination of:

twisting, bending, cutting, displacement, and squeezing.

6. The method of claim 1 further comprising selecting a distortion based on at least one indicator.

7. The method of claim 2 wherein projecting the updated image further includes selecting a pre-recorded interference pattern based on the correlated data.

8. The method of claim 2 wherein projecting the updated image further includes generating an interference pattern based on the correlated data.

9. A user interface system for manipulating an original image, the system comprising:

at least one sensor configured to sense, based on quadrilateral angle navigation to determine a touch point position within a three dimensional coordinate system, a user interaction with the image in the three dimensional coordinate system, wherein the original image is displayed from a certain point in space preconfigured to match specific points in the quadrilateral angle navigation, and the certain point in space is matched to space location of the user interaction to determine the touch point, each sensor providing coordinate information to a computer processor enabling the computer processor to correlate with the original image in the three-dimensional coordinate system;

a correlation unit executed by the computer processor and configured to correlate the sensed user interaction with the three dimensional coordinate system; and

a projecting unit responsive to the correlation unit and configured to project an updated image based on the correlated user interaction, the updated image being equivalent to the original image manipulated by a distortion.

10. The system of claim 9 wherein the original image and/or the updated image is a holographic image.

11. The system of claim 9 wherein the at least one sensor is a laser sensor configured to geometrically identify a position within the three dimensional coordinate system.

12. The system of claim 11 wherein the at least one sensor is further configured to triangulate and/or quadrilate a position within the three dimensional coordinate system,

13. The system of claim 9 wherein the distortion is any one or combination of:

twisting, bending, cutting, displacement, and squeezing.

14. The system of claim 13 wherein the correlation unit is further configured to select the distortion based on at least one indicator.

15. The system of claim 10 wherein the projecting unit is further configured to project the updated image by selecting a pre-recorded interference pattern based on the correlated data.

16. The system of claim 10 wherein the projecting unit is further configured to project the updated image by projecting a generated interference pattern based on the correlated data.

17. A non-transient computer program product having a computer program stored thereon, the computer program defined by instructions which, when executed by a processor, cause the processor to:

sense a user interaction with the original image in a three dimensional coordinate system, said sensing being based on quadrilateral angle navigation to determine a touch point position within the three dimensional coordinate system, wherein the original image is displayed from a certain point in space preconfigured to match specific points in the quadrilateral angle navigation, and the certain point in space is matched to space location of the user interaction to determine the touch point, said sensing resulting in providing coordinate information to the processor such that the processor correlates the original image with the three-dimensional coordinate system;

correlate the sensed user interaction with the three dimensional coordinate system; and

project an updated image based on the correlated user interaction, the updated image being equivalent to the original image manipulated by a distortion.

18. The program of claim 17 wherein the original image and/or the updated image is a holographic image.

19. The program of claim 17 wherein the instructions to sense a user interaction further include:

use laser sensors to geometrically identify a position within the three dimensional coordinate system.

20. The program of claim 17 wherein the instructions further include:

use laser sensors to triangulate and/or quadrilate a position within the three dimensional coordinate system.

21. The program of claim 17 wherein the distortion is any one of:

twisting, bending, cutting, displacement, and squeezing.

22. The program of claim 21 wherein the instructions to correlate further include:

select the distortion based on at least one indicator.

23. The method of claim 18 wherein the instructions to project the updated image further include:

select a pre-recorded interference pattern based on the correlated data.

24. The method of claim 18 wherein the instructions to project the updated image further include:

generate an interference pattern based on the correlated data.

25. A user interface system for manipulating an original image, the system comprising:

means to sense a user interaction with the original image in a three dimensional coordinate system, said means to sense being based on quadrilateral angle navigation to determine a touch point position within the three dimensional coordinate system, wherein the original image is displayed from a certain point in space preconfigured to match specific points in the quadrilateral angle navigation, and the certain point in space is matched to space location of the user interaction to determine the touch point, said sensing means providing coordinate information enabling correlation of the original image with the three dimensional coordinate system;

means to correlate the sensed user interaction with the three dimensional coordinate system using the coordinate information provided by said sensing means; and

means to project an updated image based on the correlated user interaction, the updated image being equivalent to the original image manipulated by a distortion.