Method for suspension sensing in interactive display, method for processing suspension sensing image, and proximity sensing apparatus

• US 9,965,028 B2
• Filed: 04/06/2011
• Issued: 05/08/2018
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yoo, Byung In, Park, Du Sik, Choi, Chang Kyu
• Primary Examiner(s): Sherman, Stephen
• Assistant Examiner(s): MATTHEWS, ANDRE L
• Application Number:
  US13/081,126
• Publication Number:
  US 20110248918A1
• Time in Patent Office: 2,589 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

Provided is a method for proximity sensing in an interactive display and a method of processing a proximity sensing image. The method for proximity-sensing may include suspending, in a three-dimensional (3D) space, at least one hand of a user to manipulate at least one of a viewpoint of the user and a position of a virtual object displayed on a screen, and changing the virtual object by manipulating at least one of the position of the virtual object and the viewpoint of the user based on the suspending.

Claims

1. A method for proximity-sensing in an interactive display, the method comprising:

sensing coordinates (x1, y1) of a position touched by a hand of a user, while the other hand of the user is suspended;

sensing coordinates (x2, y2, z2) of a position where the other hand is suspended, while the position is touched by the hand of the user;

sensing a rotation direction (rx, ry, rz) by a suspension of the other hand, while the position is touched by the hand of the user;

determining a virtual object to be manipulated in a UI displayed on a screen, based on the coordinates (x1, y1);

calculating a movement speed and a movement acceleration speed of the other hand, based on the coordinates (x2, y2, z2);

calculating a movement speed of the virtual object, based on the movement speed and the movement acceleration speed;

calculating a rotation speed and a rotation acceleration speed of the other hand using the rotation direction (rx, ry, rz);

calculating a rotation speed of the virtual object based on the rotation speed and the rotation acceleration speed;

applying the movement speed of the virtual object to create a movement effect of the virtual object; and

applying the rotation speed of the virtual object to create a rotation effect of the virtual object.

2. The method of claim 1, wherein the suspension comprises a two dimensional (2D) slap gesture to suspend the other hand of the user in a desired direction of a vertical direction and a horizontal direction to change the virtual object in the desired direction of the vertical direction and the horizontal direction.

3. The method of claim 1, wherein the virtual object is a surface of a hexahedron User Interface (UI), and is transformed to another surface of the hexahedron UI in a suspension direction.

4. The method of claim 1, wherein the suspension comprises a 3D suspension gesture of moving the other hand of the user from a position in a 3D space to another position in a 3D space or to rotate the other hand of the user in the 3D position to thereby change the at least one of the position of the virtual object and the viewpoint of the user.

5. The method of claim 4, wherein the 3D suspension gesture comprises a 3D movement gesture to move the virtual object from the other 3D position to a corresponding position.

6. The method of claim 4, wherein, when the virtual object is a 3D passage, the 3D suspension gesture includes a forward movement gesture of moving the other hand of the user towards the screen and a backward movement gesture to move the other hand of the user away from the screen.

7. The method of claim 1, wherein the suspension comprises a 3D six degrees of freedom (DOF) suspension gesture of moving the other hand of the user from a current position in a 3D space to another position in the 3D position, and to rotate the other hand of the user.

8. A non-transitory computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform the method of claim 1.

9. The method of claim 1, further comprising:

calculating a scene change speed of the UI based on the movement speed and the movement acceleration speed; and

applying the scene change speed to a special effect for scene change.

10. The method of claim 9, wherein the special effect comprises a motion blur effect for scene change.

11. A proximity-sensing apparatus used with an interactive display, the proximity-sensing apparatus comprising:

a suspension sensor configured to;

sense coordinates (x1, y1) of a position touched by a hand of a user, while the other hand of the user is suspended,

sense coordinates (x2, y2, z2) of a position where the other hand is suspended, while the position is touched by the hand of the user, and

sense a rotation direction (rx, ry, rz) by a suspension of the other hand, while the position is touched by the hand of the user;

a suspension image processing unit configured to;

determine a virtual object to be manipulated in a UI displayed on a screen, based on the coordinates (x1, y1),

calculate a movement speed and a movement acceleration speed of the other hand, based on the coordinates (x2, y2, z2),

calculate a movement speed of the virtual object, based on the movement speed and the movement acceleration speed,

calculate a rotation speed and a rotation acceleration speed of the other hand using the rotation direction (rx, ry, rz), and

calculate a rotation speed of the virtual object based on the rotation speed and the rotation acceleration speed; and

a user interface processing unit configured to;

apply the movement speed of the virtual object to create a movement effect of the virtual object, and

apply the rotation speed of the virtual object to create a rotation effect of the virtual object.