USER INTERFACE USING HOLOGRAM AND METHOD THEREOF

• US 20110191707A1
• Filed: 08/23/2010
• Published: 08/04/2011
• Est. Priority Date: 01/29/2010
• Status: Abandoned Application

• Current Assignee: Pantech Co. Ltd. (Pantech Incorporated)
• Original Assignee: Pantech Co. Ltd. (Pantech Incorporated)
• Inventors: WON, Gi Seop, AHN, Soo Been, HAN, Eui Seok, LIM, Hyung Yeon, KIM, Eung Bong, JUNG, Chan Sung, LIM, Hyun Keun, LEE, Han Gweon, KIM, Ki Jung
• Application Number:
  US12/861,510
• Publication Number:
  US 20110191707A1
• Time in Patent Office: Days
• US Class Current: 715/765
• CPC Class Codes: B60K 2360/29 Holographic features
• CPC Class Codes: B60K 2370/29 Holographic features
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2001/226 Virtual or real
• CPC Class Codes: G03H 2210/62 Moving object
• CPC Class Codes: G03H 2227/02 Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/046 by electromagnetic means
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A user interface using a hologram includes a memory unit to store information on a shape, a function, a position, and a movement pattern for a virtual object; a hologram output unit to project a hologram display area and to display the virtual object in the projected hologram display area; a real object sensing unit to sense a real object in the hologram display area and to generate information on a position and a movement pattern of the real object; a contact recognizing unit to determine the positions and the movement patterns of the respective virtual object and the real object to recognize a contact between the virtual object and the real object; and a control unit to determine whether the recognized contact between the virtual object and the real object corresponds to an input for selecting the virtual object.

Claims

1. A user interface, comprising:

a memory unit to store information on a shape, a function, a position, and a movement pattern for a virtual object;

a hologram output unit to project a hologram display area and to display the virtual object in the projected hologram display area;

a real object sensing unit to sense a real object in the hologram display area and to generate information on a position and a movement pattern of the real object;

a contact recognizing unit to determine the positions and the movement patterns of the respective virtual object and the real object in the hologram display area according to the information on the position and the movement pattern of the real object generated by the real object sensing unit, and the information stored in the memory unit to recognize a contact between the virtual object and the real object; and

a control unit to determine whether the recognized contact between the virtual object and the real object corresponds to an input for selecting the virtual object.

2. The user interface of claim 1, wherein the control unit searches for the information stored in the memory unit to determine a function of the virtual object that comes in contact with the real object and determines that an instruction for executing the determined function is inputted if it is determined that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object.

3. The user interface of claim 1, wherein, if it is determined that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object, the control unit controls the hologram output unit to change a color or a shape of the virtual object that comes in contact with the real object.

4. The user interface of claim 1, wherein, if the control unit determines that the contact between the virtual object and the real object corresponds an input for canceling the selection, the control unit controls the hologram output unit to change a color or a shape of the virtual object that comes in contact with the real object.

5. The user interface of claim 1, wherein, if the control unit determines that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object, the control unit traces the movement of the real object in the hologram display area according to the information on the movement pattern of the real object generated by the real object sensing unit, and controls the hologram output unit to move the virtual object that comes in contact with the real object corresponding to the movement of the real object.

6. The user interface of claim 1, wherein, if the real object comes in contact with the virtual object for longer than a reference time, the control unit determines that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object.

7. The user interface of claim 1, wherein, if a plurality of the real objects come in contact with a plurality of markers of the virtual object, the control unit determines that the contact between the virtual object and the plurality of the real objects corresponds to the input for selecting the virtual object.

8. The user interface of claim 1, wherein, if the control unit determines that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object, the control unit traces the movement of the real object in the hologram display area according to the information on the movement pattern of the real object generated by the real object sensing unit, and if the real object that comes in contact with the virtual object is out of a range sensed by the real object sensing unit, the control unit determines that the input for selecting the virtual object is cancelled.

9. The user interface of claim 1, wherein, if the control unit determines that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object, the control unit traces the movement of the real object in the hologram display area according to the information on the movement pattern of the real object generated by the real object sensing unit, and if the contact of one of the plurality of the real objects is released from one of the plurality of markers with which the plurality of the real objects comes in contact, the control unit determines that the input for selecting the virtual object is cancelled.

10. The user interface of claim 1, wherein the control unit controls the hologram output unit to rotate the virtual object in response to a rotational movement of the real object that comes in contact with the virtual object or to drag the virtual object in response to the movement position of the real object based on the movement of the real object that comes in contact with the virtual object, and determines that an instruction for executing a specified function is inputted or that an instruction for canceling the execution of the specified function is inputted.

11. The user interface of claim 1, wherein, if the virtual object is rotated at an angle in a direction, if the virtual object is dragged to a position at which a virtual object for providing an executing function or a canceling function is displayed, if the virtual object for providing the executing function or the canceling function is dragged to a position at which a virtual object to be executed or cancelled is displayed, or if the movement pattern of the real object corresponds to a specified movement pattern, the control unit recognizes that the instruction for executing a specified function is inputted or that the instruction for canceling the execution of the specified function is inputted.

12. The user interface of claim 11, wherein, if it is determined that the instruction for executing the specified function is inputted or the instruction for canceling the execution of the specified function is inputted, the control unit controls the hologram output unit to change a color or a shape of the hologram display area or the virtual object displayed in the hologram display area.

13. The user interface of claim 1, further comprising a tactile sense providing unit to radiate an acoustic wave to provide an acoustic radiation pressure to the hologram display area.

14. The user interface of claim 1, wherein the real object sensing unit determines a three-dimensional position coordinate of the real object in the hologram display area, generates information on the position of the real object using the determined three-dimensional position coordinate, calculates a vector value according to a change in the position of the real object according to a change in the three-dimensional position coordinate of the real object, and generates information on the movement pattern of the real object according to the calculated vector value.

15. The user interface of claim 14, wherein the real object sensing unit determines the three-dimensional coordinate of the real object in the hologram display area according to one of a capacitive touch screen method, an infrared (IR) touch screen method, an electromagnetic resonance (EMR) digitizer method, or an image recognizing method.

16. The user interface of claim 14, wherein the real object transmits a wireless signal.

17. The user interface of claim 16, wherein the real object sensing unit comprises a communication unit to communicate with the real object, and

wherein the real object sensing unit receives the wireless signal transmitted from the real object through the communication unit, determines a distance to the real object according a reception intensity of the received wireless signal, and determines the three-dimensional coordinate of the real object according to the determined distance from the real object and a reception direction of the received wireless signal.

18. A user interface, comprising:

a memory unit to store information on a shape, a function, a position and a movement pattern for a virtual object;

a hologram output unit to project a hologram display area and to display a virtual object in the projected hologram display area;

a communication unit to receive a wireless signal transmitted from a real object that transmits the wireless signal, the wireless signal containing information;

a real object sensing unit to receive the wireless signal from the communication unit, to extract the information contained in the wireless signal, and to generate information on a position and a movement pattern of the real object in the hologram display area according to the wireless signal;

a contact recognizing unit to determine the positions and the movement patterns of the respective virtual object and the real object in the hologram display area according to the information on the position and the movement pattern of the real object generated by the real object sensing unit, and the information stored in the memory unit to recognize a contact between the virtual object and the real object; and

a control unit to determine a function of the real object that comes in contact with the virtual object according to the information of the real object extracted by the real object sensing unit.

19. The user interface of claim 18, wherein, if the control unit determines that the contact between the virtual object and the real object corresponds to an input for selecting the virtual object or an input for canceling the selection, the control unit controls the hologram output unit to change a color or a shape of the virtual object that comes in contact with the real object.

20. The user interface of claim 18, wherein, if the control unit determines that the contact between the virtual object and the real object corresponds to the input for selecting the virtual object, the control unit traces the movement of the real object in the hologram display area according to the information on the movement pattern of the real object generated by the real object sensing unit, and controls the hologram output unit to move the virtual object that comes in contact with the real object corresponding to the movement of the real object.

21. The user interface of claim 18, wherein, if the control unit determines that an instruction for executing a specified function is inputted through the contact between the virtual object and the real object or that an instruction for canceling the execution of the specified function is inputted through the contact between the virtual object and the real object, the control unit controls the hologram output unit to change a color or a shape of the hologram display area or the virtual object displayed in the hologram display area.

22. The user interface of claim 18, further comprising a tactile sense providing unit to radiate an acoustic wave to provide an acoustic radiation pressure to the hologram display area.

23. The user interface of claim 18, wherein the real object sensing unit receives the wireless signal transmitted from the real object from the communication unit, the real object sensing unit determines a distance to the real object according to the reception intensity of the received wireless signal, determines the three-dimensional position coordinate of the real object according to the determined distance to the real object and the reception direction of the wireless signal, generates information on the position of the real object according to the determined three-dimensional position coordinate, calculates a vector value according to a change in the position of the real object according to a change in the three-dimensional position coordinate of the real object according to the change in the position of the real object, and generates information on the movement pattern of the real object according to the calculated vector value.

24. A user interface, comprising:

a memory unit to store information on a virtual object;

a hologram output unit to project the virtual object in a hologram display area;

a real object sensing unit to sense a real object in the hologram display area;

a contact recognizing unit to determine a contact between the real object and the virtual object according to the information on the virtual object and information on the sensed real object; and

a control unit to determine whether the recognized contact corresponds to an input for selecting the virtual object.

25. A method for a user interface, the method comprising:

displaying a virtual object in a hologram display area;

determining if a contact between a real object and the virtual object occurs;

determining if the contact between the real object and the virtual object corresponds to an input for selecting the virtual object;

moving the selected virtual object according to a movement of the real object; and

executing a function corresponding to the selected virtual object according to the movement of the selected virtual object.

26. A method for a user interface, the method comprising:

displaying a virtual object in a hologram display area;

determining if a contact between a real object and the virtual object occurs;

determining a function of the real object if the contact occurs; and

executing the function of the real object with respect to the virtual object.

27. The method of claim 26, wherein determining the function of the real object comprises receiving a signal transmitted from the real object.