Method of controlling virtual object or view point on two dimensional interactive display

• US 20100146389A1
• Filed: 05/07/2009
• Published: 06/10/2010
• Est. Priority Date: 12/10/2008
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Chang Kyu, Yoo, Byung In
• Granted Patent: US 8,839,136 B2
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method of controlling a viewpoint of a user or a virtual object on a two-dimensional (2D) interactive display is provided. The method may convert a user input to at least 6 degrees of freedom (DOF) structured data according to a number of touch points, a movement direction thereof, and a rotation direction thereof. Any one of the virtual object and the viewpoint of the user may be determined as a manipulation target based on a location of the touch point.

Claims

1. A method of controlling a virtual object or a viewpoint of a user on a two-dimensional (2D) interactive display, the method comprising:

displaying a virtual manipulation medium as a user interface to manipulate the virtual object, displayed on a screen, or the viewpoint of the user;

determining, as a manipulation target, any one of the virtual object and the viewpoint of the user, based on a touch point by a user input;

converting the user input to at least 6 degrees of freedom (DOF) structured data according to a number of touch points, a movement direction thereof, and a rotation direction thereof; and

controlling the manipulation target using the at least 6DOF structured data.

2. The method of claim 1, wherein the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a three-dimensional (3D) space comprising the X axis, the Y axis, and the Z axis.

3. The method of claim 1, wherein the converting of the user input comprises comparing the number of touch points with a predetermined particular value to convert the user input to the at least 6DOF structured data.

4. The method of claim 1, wherein, when the number of touch points is at least two, the converting of the user input comprises pairing the at least two touch points and converting the user input to the at least 6DOF structured data according to a movement direction of the paired at least two touch points and a rotation direction thereof.

5. The method of claim 1, wherein the controlling of the manipulation target comprises applying a video effect or an audio effect to the manipulation target that is any one of the virtual object and the viewpoint of the user.

6. The method of claim 1, wherein the displaying of the virtual manipulation medium comprises displaying the virtual manipulation medium in any one of a region including the virtual object and a region excluding the virtual object, depending on whether the virtual object is determined as the manipulation target or the viewpoint of the user is determined as the manipulation target.

7. The method of claim 1, wherein the determining of the manipulation target comprises determining, as the manipulation target, any one of the virtual object and the viewpoint of the user, based on whether a location of the touch point exists in a region including the virtual object.

14. A computer-readable recording media storing program instructions to control at least one processor to implement the method of claim 1.

8. A method of processing multi-touch structured data, the method comprising:

receiving, from a multi-touch driver, the multi-touch structured data that is associated with a user input via a virtual manipulation medium;

extracting, from the multi-touch structured data, a number of touch points, a movement direction thereof, a location thereof, and a rotation direction thereof; and

converting the multi-touch structured data to at least 6 degrees of freedom (6DOF) structured data, based on the number of touch points, the movement direction thereof, the location thereof, and the rotation direction thereof.

9. The method of claim 8, wherein the converting of the multi-touch structured data comprises comparing the number of touch points with a predetermined particular value to convert the multi-touch structured data to the at least 6DOF structured data.

10. The method of claim 8, wherein the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a 3D space comprising of the X axis, the Y axis, and the Z axis.

11. A method of processing a virtual manipulation medium that is used to control a virtual object or a viewpoint of a user on an interactive display, the method comprising:

receiving, from a user input via the virtual manipulation object, at least 6 degrees of freedom (6DOF) structured data, wherein the at least 6DOF structured data is generated based on a number of touch points, a movement direction thereof, a location thereof, and a rotation direction thereof;

determining, as a manipulation target, any one of the virtual object, displayed on a screen, and the viewpoint of the user, based on the location of the touch point;

displaying, as a user interface, the virtual manipulation medium in any one of a region including the virtual object and a region excluding the virtual object, depending on whether the virtual object is determined as the manipulation target or the viewpoint of the user is determined as the manipulation target; and

applying a video effect or an audio effect to the manipulation target that is any one of the virtual object and the viewpoint of the user.

12. The method of claim 11, wherein the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a 3D space comprising the X axis, the Y axis, and the Z axis.

13. The method of claim 11, wherein the determining of the manipulation target comprises determining the manipulation target depending on whether a corresponding touch point exists on the virtual object.