Method of controlling virtual object or view point on two dimensional interactive display

• US 9,836,146 B2
• Filed: 09/03/2014
• Issued: 12/05/2017
• Est. Priority Date: 12/10/2008
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yoo, Byung In, Choi, Chang Kyu
• Primary Examiner(s): Lu, Hua
• Application Number:
  US14/476,146
• Publication Number:
  US 20140375587A1
• Time in Patent Office: 1,189 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method of controlling a viewpoint of a user or a virtual object on a two-dimensional (2D) interactive display is provided. The method may convert a user input to at least 6 degrees of freedom (DOF) structured data according to a number of touch points, a movement direction thereof, and a rotation direction thereof. Any one of the virtual object and the viewpoint of the user may be determined as a manipulation target based on a location of the touch point.

Claims

1. A method of controlling a manipulation target, the method comprising:

determining whether a distance between two touch points is less than a predetermined value;

pairing the two touch points when the distance between the two touch points is less than the predetermined value; and

controlling the manipulation target based on the paired touch points, wherein the controlling comprises converting a user input by the paired touch points to at least one of a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a three-dimensional (3D) space comprising the X axis, the Y axis, and the Z axis; and

determining, as the manipulation target, any one of a virtual object and a viewpoint of the user, based on the paired touch points, wherein the virtual object is determined as the manipulation target when a location of the paired touch points exists in a region corresponding to the virtual object, and the viewpoint of the user is determined as the manipulation target when the location of the paired touch points exists in a region corresponding to a background.

2. The method of claim 1, wherein the controlling comprises:

controlling the manipulation target based on at least one of a movement direction of the paired touch points and a rotation direction of the paired touch points.

3. The method of claim 1, further comprising:

in case that a number of touch points by a user input is at least two, verifying the two touch points most adjacent to each other among the at least two touch points.

4. The method of claim 1, wherein the controlling comprises:

applying a video effect or an audio effect to the manipulation target.

5. The method of claim 1, further comprising:

displaying a virtual manipulation medium as a user interface to manipulate a virtual object, displayed on a screen, or a viewpoint of the user,

wherein the virtual manipulation medium is displayed in a region including the virtual object when the virtual object is determined as the manipulation target, and

wherein the virtual manipulation medium is displayed in a region excluding the virtual object when the viewpoint of the user is determined as the manipulation target.

6. The method of claim 5, wherein, the displayed virtual manipulation medium has a spherical form which has a diameter which is determined by the distance between the two touch points, and the displayed virtual medium includes display of three-dimensional (3D) coordinate axes.

7. The method of claim 1 implemented by at least one processor, wherein a non-transitory computer-readable recording media storing program instructions is configured to control the at least one processor.

8. An apparatus of controlling a manipulation target, the apparatus comprising:

a sensor configured to recognize two touch points; and

a controller configured to;

determine whether a distance between the two touch points is less than a predetermined value;

pair the two touch points when the distance between the two touch points is less than the predetermined value;

control the manipulation target based on the paired touch points;

convert a user input by the paired touch points to at least one of a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a three-dimensional (3D) space comprising the X axis, the Y axis, and the Z axis; and

determine, as the manipulation target, any one of a virtual object and a viewpoint of the user, based on the paired touch points,

wherein the virtual object is determined as the manipulation target when a location of the paired touch points exists in a region corresponding to the virtual object, and the viewpoint of the user is determined as the manipulation target when the location of the paired touch points exists in a region corresponding to a background.

9. The apparatus of claim 8, wherein the controller is further configured to:

control the manipulation target based on at least one of a movement direction of the paired touch points and a rotation direction of the paired touch points.

10. The apparatus of claim 8, wherein the controller is further configured to:

in case that a number of touch points by a user input is at least two, verify the two touch points most adjacent to each other among the at least two touch points.

11. The apparatus of claim 8, wherein the controller is further configured to:

apply a video effect or an audio effect to the manipulation target.

12. The apparatus of claim 8, further comprising:

a screen configured to display a virtual manipulation medium as a user interface to manipulate a virtual object, displayed on the screen, or a viewpoint of the user,

wherein the virtual manipulation medium is displayed in a region including the virtual object when the virtual object is determined as the manipulation target, and

wherein the virtual manipulation medium is displayed in a region excluding the virtual object when the viewpoint of the user is determined as the manipulation target.

13. The apparatus of claim 12, wherein, the displayed virtual manipulation medium has a spherical form which has a diameter which is determined by the distance between the two touch points, and the displayed virtual medium includes display of three-dimensional (3D) coordinate axes.