Digital, data, and multimedia user interface with a keyboard

• US 8,212,768 B2
• Filed: 10/31/2007
• Issued: 07/03/2012
• Est. Priority Date: 10/31/2007
• Status: Active Grant

• Current Assignee: F Poszat Hu LLC (Intellectual Ventures LLC)
• Original Assignee: Fimed Properties AG LLC (Intellectual Ventures LLC)
• Inventors: Fein, Gene S., Merritt, Edward
• Primary Examiner(s): Lao, Lun-Yi
• Assistant Examiner(s): MERKOULOVA, OLGA VLADIMIROVNA
• Application Number:
  US11/932,731
• Publication Number:
  US 20090109176A1
• Time in Patent Office: 1,707 Days
• Field of Search: 345/168, 345/156, 345/157, 345/169, 345/173, 345/419, 715/848, 715/852, 715/710, 715/780, 715/789, 715/811, 715/816
• US Class Current: 345/156
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2249 Holobject properties
• CPC Class Codes: G03H 1/26 Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2227/02 Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]

Abstract

A system and corresponding method for providing a 3-dimensional (3-D) user interface to display images in a 3-D coordinate system. The 3-D interface generates and displays one type of holographic keyboard in response to a user'"'"'s desired selection. The holographic keyboard provides versatility and ergonomic benefits to the user. Sensors are configured to sense user interaction within the 3-D coordinate system, so that a processor may receive user interaction information from the sensors. The sensors are able to provide information to the processor that enables the processor to correlate user interaction with images in the 3-D coordinate system. The system may be used for interconnecting or communicating between two or more components connected to an interconnection medium (e.g., a bus) within a single computer or digital data processing system.

Claims

1. A system, comprising:

a database configured to store data related to a plurality of types of holographic keyboards;

a 3-dimensional (3-D) projector;

a processor coupled with the database and the 3-D projector and configured to;

receive a selection of a type of holographic keyboard, the type being one of the plurality of types of holographic keyboards;

control the 3-D projector to generate and display a holographic keyboard of the selected type of holographic keyboard in a 3-D coordinate system, wherein the type of holographic keyboard is selected based on sensed user interaction with the holographic keyboard or based on sensed user interaction with a physical user interface; and

control the 3-D projector to generate a holographic user interface that presents a plurality of application icons in holographic format, wherein the application icons in holographic format are presented based on user pattern of use, including presentation in an order of priority that is representative of changes in user use habits according to day, time, and date; and

a plurality of sensors configured to sense user interaction with the holographic keyboard;

wherein the processor is further coupled with the plurality of sensors and is further configured to;

determine, based on information received from at least one sensor of the plurality of sensors, that an object approaches a key of the holographic keyboard; and

control the 3-D projector to enlarge the key based on determination that the object approaches the key.

2. The system of claim 1, wherein the 3-D projector is configured to display the holographic keyboard on a surface.

3. The system of claim 1, wherein the 3-D projector is configured to display the holographic keyboard in air.

4. The system of claim 1, wherein the plurality of sensors are configured to sense user interaction with the key of the holographic keyboard upon a user placing a finger through or upon the key.

5. The system of claim 1, further comprising:

a first communications port; and

a computer including;

a second communications port communicatively coupled with the first communications port; and

the database.

6. The system of claim 1 wherein the plurality of sensors are photo voltaic sensors.

7. The system of claim 1 wherein the plurality of sensors are image sensors.

8. The system of claim 1 wherein the plurality of sensors are photo electric light sensors.

9. The system of claim 1 wherein the plurality of sensors are laser sensors.

10. The system of claim 1, wherein the processor is further configured to receive an indication of the selection based on information received from one or more sensors of the plurality of sensors.

11. The system of claim 1, further comprising a sound sensor system configured to receive a user'"'"'s voice as input.

12. A method, comprising:

receiving a selection of a type of holographic keyboard;

accessing, based on said receiving, data related to the selected type of holographic keyboard from a database storing data related to the type of holographic keyboard;

generating and displaying, based on said accessing, a holographic keyboard of the type of holographic keyboard in a 3-D coordinate system;

generating a holographic user interface that presents a plurality of application icons in holographic format, wherein the application icons in holographic format are presented based on user pattern of use, including presentation in an order of priority that is representative of changes in user use habits according to day, time, and date;

sensing user interaction with the holographic keyboard;

determining that an object approaches a key of the holographic keyboard; and

enlarging the key based on said determining that the object approaches the key.

13. The method of claim 12, further comprising:

generating a path with a sensor;

wherein said sensing user interaction is based upon interception of the path.

14. The method of claim 12, wherein said generating and displaying the holographic comprises displaying the holographic keyboard on a surface.

15. The method of claim 12, wherein said generating and displaying the holographic keyboard comprises displaying the holographic keyboard in air.

16. The method of claim 12, wherein said sensing user interaction includes using laser sensors to geometrically identify a position within the 3-D coordinate system.

17. The method of claim 16, wherein said using laser sensors to geometrically identify includes using laser sensors to triangulate a position within the 3-D coordinate system.

18. The method of claim 16, wherein said using laser sensors to geometrically identify includes using laser sensors to quadrilate a position within the 3-D coordinate system.

19. A non-transitory computer-readable medium having computer readable program codes embodied therein that, if executed, cause a computer to:

generate and display a holographic keyboard in a 3-D coordinate system;

generate a holographic user interface that presents a plurality of application icons in holographic format, wherein the application icons in holographic format are presented based on user pattern of use, including presentation in an order of priority that is representative of changes in user use habits according to day, time, and date;

sense user interaction with the holographic keyboard;

determine that an object approaches a key of the holographic keyboard; and

enlarge the key based on said determining that the object approaches the key.

20. The non-transitory computer-readable medium of claim 19, wherein the computer-readable program codes, if executed, further cause the computer to:

receive a selection of a type of holographic keyboard to display based on sensed user interaction with the holographic keyboard.

21. The non-transitory computer-readable medium of claim 19, wherein the computer-readable program codes, if executed, further cause the computer to:

receive a selection of a type of holographic keyboard to display based on sensed user interaction with a physical user interface.

22. A system, comprising:

a 3-dimensional (3-D) projector configured to display a holographic keyboard in a 3-D coordinate system and configured to display a holographic user interface that presents a plurality of application icons in holographic format, wherein the application icons in holographic format are presented based on user pattern of use, including presentation in an order of priority that is representative of changes in user use habits according to day, time, and date;

a plurality of sensors configured to sense user interaction with the holographic keyboard; and

a processor coupled with the plurality of sensors and the 3-D projector and configured to;

determine, based on information received from at least one sensor of the plurality of sensors, that an object approaches a key of the holographic keyboard; and

control the 3-D projector to enlarge the key based on determination that the object approaches the key.

23. The system of claim 22, wherein the 3-D projector is configured to display the holographic keyboard on a surface.

24. The system of claim 22, wherein the 3-D projector is configured to display the holographic keyboard in air.

25. The system of claim 22 wherein the plurality of sensors are photo voltaic sensors, image sensors, photo electric light sensors, or laser sensors.