APPARATUS FOR OBTAINING VIRTUAL 3D OBJECT INFORMATION WITHOUT REQUIRING POINTER

• US 20150135144A1
• Filed: 04/22/2013
• Published: 05/14/2015
• Est. Priority Date: 04/23/2012
• Status: Abandoned Application

• Current Assignee: Vtouch Co Ltd
• Original Assignee: Vtouch Co Ltd
• Inventors: Kim, Seok-Joong
• Application Number:
  US14/396,384
• Publication Number:
  US 20150135144A1
• Time in Patent Office: Days
• US Class Current: 715/850
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Abstract

Disclosed is an apparatus for obtaining 3D virtual object information which includes a 3D coordinates calculation portion for calculating 3D coordinates data for a body of a user to extract first space coordinates and second space coordinates from the calculated 3D coordinates data, a touch location calculation portion for calculating virtual object contact point coordinates for the surface of the virtual object building on the 3D map information that is met by a line connecting the first space coordinates and the second space coordinates extracted from the 3D coordinates calculation portion; and a space location matching portion for extracting virtual object (location) belonging to the virtual object contact point coordinates data calculated from the touch location calculation portion, and providing the extracted corresponding information of the virtual object to a display portion of a user'"'"'s terminal or the apparatus for obtaining the 3D virtual object information.

Claims

1. An apparatus for obtaining 3D virtual object information without requiring a pointer, comprising:

a 3D coordinates calculation portion for calculating 3D coordinates data for a body of a user to extract first space coordinates and second space coordinates from the calculated 3D coordinates data;

a touch location calculation portion for calculating virtual object contact point coordinates for the surface of the virtual object building on the 3D map information that is met by a line connecting the first space coordinates and the second space coordinates extracted from the 3D coordinates calculation portion, by matching 3D map information and location information from GPS with the first space coordinates and the second space coordinates extracted from the 3D coordinates calculation portion; and

a space location matching portion for extracting virtual object (location) belonging to the virtual object contact point coordinates data calculated from the touch location calculation portion, and providing the extracted corresponding information of the virtual object to a display portion of a user'"'"'s terminal or the apparatus for obtaining the 3D virtual object information.

2. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the 3D map information is stored on external servers providing 3D geographic information which are connected to wired or wireless networks.

3. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the 3D map information is stored in the 3D virtual object information obtaining apparatus.

4. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the 3D coordinate calculation portion calculates the 3D coordinates data by using a Time of Flight.

5. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the 3D coordinates calculation portion includes an image obtaining portion, configured with at least two image sensors disposed at locations different from each other, for capturing the body of the user at angles different from each other;

and a space coordinates calculation portion for calculating the 3D coordinate data for the body of the user using the optical triangulation scheme based on the image, captured at the angles different from each other, received from the image obtaining portion.

6. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the 3D coordinates calculation portion obtains the 3D coordinates data by a method for projecting coded pattern images to the user and processing images of the scene projected with structured light.

7. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 6, wherein the 3D coordinates calculation portion includes alighting assembly, configured with alight source and a diffuser, for projecting speckle patterns to the body of the user, an image obtaining port ion, configured with an image sensor and a lens, for capturing the speckle patterns for the body of the user projected from the lighting assembly, and a space coordinate calculation portion for calculating the 3D coordinates data for the body of the user based on the speckle patterns captured from the image obtaining portion.

8. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 6, wherein the 3D coordinates calculation portions are at least two or more and are configured to be disposed at the locations different from each other.

9. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the first space coordinates is any one of the 3D coordinates of the tip of any one of the user'"'"'s fingers or the tip of the pointer grasped by the user and the second space coordinates is the 3D coordinates for the midpoint of any one of the user'"'"'s eyes.

10. The apparatus for obtaining the 3D virtual object information without requiring a pointer according to claim 1, wherein the first space coordinates are the 3D coordinates for the tips of at least two of the user'"'"'s fingers, and the second space coordinates is the 3D coordinates for the midpoint of any one of the user'"'"'s eyes.