Apparatus and method for controlling 3D image

• US 9,207,756 B2
• Filed: 08/14/2012
• Issued: 12/08/2015
• Est. Priority Date: 12/30/2011
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yi, Kwon Ju, Suh, Sung Joo, Park, Du Sik, Yoo, Byung In, Choi, Chang Kyu
• Primary Examiner(s): Siddiqui, Md Saiful A
• Application Number:
  US13/585,258
• Publication Number:
  US 20130169594A1
• Time in Patent Office: 1,211 Days
• Field of Search: 345156-157, 345173-174, 348/77, 715/850
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

An apparatus and method for controlling a 3-dimensional (3D) image using a virtual tool are provided. The apparatus may detect a user object that controls the 3D image, and determine a target virtual tool matching movement of the user object. In addition, the apparatus may display the determined target virtual tool along with the 3D image.

Claims

1. A 3-dimensional (3D) image control apparatus comprising:

a sensing unit to detect a user object to control a 3D image using one of a plurality of virtual tools;

a processor to determine a target virtual tool based on detection of 3D spatial coordinates of the user object and to determine a peripheral space adjoining the 3D image based on 3D spatial coordinates of the 3D image and the 3D spatial coordinates of the user object obtained by detecting the user object; and

a displaying unit to display the target virtual tool in the determined peripheral space adjoining the 3D image, along with the 3D image,

wherein the processor is further configured to determine a gesture of the user object based on the 3D spatial coordinates of the user object and a shape of the user object, to determine a virtual tool matching the gesture of the user object among the plurality of virtual tools, and to determine the determined virtual tool as the target virtual tool.

2. The 3D image control apparatus of claim 1, wherein the displaying unit displays the plurality of virtual tools in the peripheral space adjoining the 3D image determined based on spatial coordinates of the user object obtained by the detection of the user object and based on spatial coordinates of the 3D image.

3. The 3D image control apparatus of claim 1, wherein the sensing unit obtains spatial coordinates of the user object and a shape of the user object by detecting the user object.

4. The 3D image control apparatus of claim 3, wherein the processor determines movement of the user object based on the spatial coordinates and the shape of the user object obtained by the sensing unit.

5. The 3D image control apparatus of claim 4, wherein the processor determines an execution tool matching the movement of the user object among execution tools displayed around the 3D image, and determines the target virtual tool as a virtual tool that corresponds to the execution tool matching the movement of the user object.

6. The 3D image control apparatus of claim 1, wherein the sensing unit is disposed on at least one of a bezel of the displaying unit and a lower portion of the displaying unit.

7. The 3D image control apparatus of claim 1, wherein the displaying unit displays virtual tools comprising different attributes according to a type of the virtual tool set for the 3D image.

8. The 3D image control apparatus of claim 1, wherein the sensing unit detects the user object using at least one of a camera, an ultrasonic scanner, a laser scanner, and a sensor array.

9. A 3-dimensional (3D) image control method comprising:

detecting, using a sensor, a user object to control a 3D image using one of a plurality of virtual tools;

determining, using a processor, a target virtual tool based on detection of 3D spatial coordinates of the user object;

determining, using the processor, a peripheral space adjoining the 3D image based on 3D spatial coordinates of the 3D image and the 3D spatial coordinates of the user object obtained by detecting the user object; and

displaying, using a display apparatus, the target virtual tool in the determined peripheral space adjoining the 3D image, along with the 3D image,

wherein the determining comprises;

determining gesture of the user object based on the 3D spatial coordinates of the user object and a shape of the user object;

determining a virtual tool matching the gesture of the user object among the plurality of virtual tools; and

determining, the determined virtual tool as the target virtual tool.

10. The 3D image control method of claim 9, wherein the displaying displays the plurality of virtual tools in the peripheral space adjoining the 3D image determined based on spatial coordinates of the user object obtained by the detection of the user object and based on spatial coordinates of the 3D image.

11. The 3D image control method of claim 9, wherein the detecting obtains spatial coordinates of the user object and a shape of the user object by detecting the user object.

12. The 3D image control method of claim 11, wherein the determining determines movement of the user object based on the spatial coordinates and the shape of the user object.

13. The 3D image control method of claim 12, wherein the determining comprises:

determining an execution tool matching the movement of the user object among execution tools displayed around the 3D image; and

determining the target virtual tool as a virtual tool that corresponds to the execution tool matching the movement of the user object.

14. The 3D image control method of claim 9, wherein the displaying displays virtual tools comprising different attributes according to a type of the virtual tool set for the 3D image.

15. The 3D image control method of claim 9, wherein the sensor to detect the user object comprises at least one of a camera, an ultrasonic scanner, a laser scanner, and a sensor array.

16. A non-transitory computer readable recording medium storing a program to cause a computer to implement the method of claim 9.

17. A 3-dimensional (3D) image control apparatus comprising:

a displaying unit to display a 3D image;

a sensing unit to detect a movement of a user object to control a 3D image using one of a plurality of virtual tools;

a processor to determine a peripheral space adjoining the 3D image based on 3D spatial coordinates of the 3D image and the 3D spatial coordinates of the user object obtained by the sensing unit; and

wherein in the displaying unit displays the plurality of virtual tools in the determined peripheral space adjoining the 3D image,

wherein the processor is further configured to determine a gesture of the user object based on the 3D spatial coordinates of the user object and a shape of the user object, to determine a virtual tool matching the gesture of the user object among the plurality of virtual tools, and to determine the determined virtual tool as the target virtual tool,

wherein the target virtual tool is displayed along with the 3D image on the displaying unit.

18. The 3D image control apparatus of claim 17, wherein the displaying unit displays a target virtual tool, from among the plurality of virtual tools, concurrently with the 3D image,

wherein the target virtual tool is determined from among the plurality of virtual tools based on the movement of the user object detected by the sensing unit.

19. The 3D image control apparatus of claim 17, wherein the sensing unit determines the movement of the user object based on spatial coordinates and a shape of the user object.

20. A 3-dimensional (3D) image control method comprising:

displaying a 3D image on a display apparatus;

detecting, using a sensor, a movement of a user object to control the 3D image using one of a plurality of virtual tools;

determining, using a processor, a peripheral space adjoining the 3D image based on 3D spatial coordinates of the 3D image and detected 3D spatial coordinates of the user object to control a 3D image using one of the plurality of virtual tools;

determining, using the processor, a target virtual tool based on detection of 3D spatial coordinates of the user object; and

displaying, on the display apparatus, the target virtual tool for controlling the display of the 3D image in the peripheral space adjoining the 3D image,

wherein the determining comprises;

determining a gesture of the user object based on the spatial coordinates of the user object and a shape of the user object;

determining, a virtual tool matching the gesture of the user object among the plurality of virtual tools; and

determining the determined virtual tool as the target virtual tool.