Method and Apparatus for User Interface in Electronic Devices With Visual Display Units

• US 20090109174A1
• Filed: 10/30/2007
• Published: 04/30/2009
• Est. Priority Date: 10/30/2007
• Status: Abandoned Application

• Current Assignee: Fimed Properties AG LLC (Intellectual Ventures LLC)
• Original Assignee: Fimed Properties AG LLC (Intellectual Ventures LLC)
• Inventors: Merritt, Edward, Fein, Gene S.
• Application Number:
  US11/928,235
• Publication Number:
  US 20090109174A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: H04N 9/3141 Constructional details thereof details not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A system for a 3-D user interface comprises: one or more 3-D projectors configured to display an image of all or one or more parts of a first electronic device in a 3-D coordinate system; one or more sensors configured to sense user interaction with the image and to provide user interaction information; and a processor configured (i) to receive the user interaction information from the one or more sensors; (ii) to correlate the user interaction with the image; and (iii) to operate a second electronic device in a manner responsive to a correlation of the user interaction with the image, wherein the first electronic device has a visual display unit and the image comprises an image of all or one or more parts of the visual display unit of the first electronic device. A method for providing a 3-D user interface comprises: generating an image of all or one or more parts of a first electronic device in a 3-D coordinate system; sensing user interaction with the image; correlating the user interaction with the image; and operating a second electronic device in a manner responsive to a correlation of the user interaction with the image, wherein the first electronic device has a visual display unit and the image comprises an image of all or one or more parts of the visual display unit of the first electronic device. Computer readable program codes related to the system and the method of the present invention are also described herein.

Claims

1. A system for a 3 dimensional (3-D) user interface, the system comprising:

one or more 3-D projectors configured to display an image of all or one or more parts of a first electronic device in a 3-D coordinate system;

one or more sensors configured to sense user interaction with the image and to provide user interaction information; and

a processor configured (i) to receive the user interaction information from the one or more sensors;

(ii) to correlate the user interaction with the image; and

(iii) to operate a second electronic device in a manner responsive to a correlation of the user interaction with the image,

wherein the first electronic device has a visual display unit and the image comprises an image of all or one or more parts of the visual display unit of the first electronic device.

2. The system of claim 1, further comprising a communications port coupled to the processor and configured to provide communications interface with a computer system.

3. The system of claim 1, wherein the first electronic device and the second electronic device are the same.

4. The system of claim 1, wherein the first electronic device comprises any of computers, telephones, televisions, calculators and other devices having at least one visual display unit.

5. The system of claim 1, wherein the image of all or one or more parts of the first electronic device is a holograph.

6. The system of claim 1, wherein the user interaction with the image comprises movement of the user relative to the image, or any sound produced by the user, or both.

7. The system of claim 1, wherein the one or more sensors comprise any one or combination of location sensors, motion sensors, light sensors and sound sensors.

8. The system of claim 7, wherein the location sensors comprise laser sensors configured to geometrically identify a position within the 3-D coordinate system.

9. The system of claim 7, wherein the light sensors comprise any one or combination of photovoltaic sensors, image sensors and photo-electric light sensors.

10. The system of claim 7, wherein the sound sensors comprise microphones.

11. The system of claim 1, wherein the processor is further configured (iv) to provide one or more indications responsive to the correlation of the user interaction with the image;

and (v) to display at least one of the provided indications in the image of all or one or more parts of the visual display unit of the first electronic device.

12. A method for providing a 3 dimensional (3-D) user interface, the method comprising:

generating an image of all or one or more parts of a first electronic device in a 3-D coordinate system;

sensing user interaction with the image;

correlating the user interaction with the image; and

operating a second electronic device in a manner responsive to a correlation of the user interaction with the image,

wherein the first electronic device has a visual display unit and the image comprises an image of all or one or more parts of the visual display unit of the first electronic device.

13. The method of claim 12, wherein the first electronic device and the second electronic device are the same.

14. The method of claim 12, wherein the first electronic device comprises any of computers, telephones, televisions, calculators and other devices having at least one visual display unit.

15. The method of claim 12, wherein the image of all or one or more parts of the first electronic device is a holograph.

16. The method of claim 12, wherein the user interaction with the image comprises movement of the user relative to the image, or any sound produced by the user, or both.

17. The method of claim 12, wherein sensing comprises using one or more laser sensors to geometrically identify a position within the 3-D coordinate system.

18. The method of claim 17, wherein using one or more laser sensors to geometrically identify a position within the 3-D coordinate system comprises using laser sensors to triangulate or quadrilate the position within the 3-D coordinate system.

19. The method of claim 12, wherein sensing comprises using a sound sensor to identify an audio input from the user.

20. The method of claim 12, further comprising providing one or more indications responsive to the correlation of the user interaction with the image, and displaying at least one of the provided indications in the image of all or one or more parts of the visual display unit of the first electronic device.

21. The method of claim 20, further comprising providing at least one of the provided indications to a device on a network, wherein the indications provided to the device on the network are the same as or different from the indications displayed in the image of all or one or more parts of the visual display unit of the first electronic device.

22. A computer readable medium having computer readable program codes embodied therein for causing a computer to provide a 3 dimensional (3-D) user interface, the computer readable program codes causing the computer to:

generate an image of all or one or more parts of a first electronic device in a 3-D coordinate system;

sense user interaction with the image;

correlate the user interaction with the image; and

operate a second electronic device in a manner responsive to a correlation of the user interaction with the image,

wherein the first electronic device has a visual display unit and the image comprises an image of all or one or more parts of the visual display unit of the first electronic device.

23. The computer readable medium of claim 22, wherein the first electronic device and the second electronic device are the same.

24. The computer readable medium of claim 22, wherein the computer readable program codes further cause the computer to provide one or more indications responsive to the correlation of the user interaction with the image, and to display at least one of the provided indications in the image of all or one or more parts of the visual display unit of the first electronic device.

25. The computer readable medium of claim 24, wherein the computer readable program codes further cause the computer to provide at least one of the provided indications to a device on a network, wherein the indications provided to the device on the network are the same as or different from the indications displayed in the image of all or one or more parts of the visual display unit of the first electronic device.