Three-dimensional display device and user interfacing method therefor

• US 10,180,766 B2
• Filed: 03/06/2013
• Issued: 01/15/2019
• Est. Priority Date: 10/30/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Hyun Jeong, Han, Jae Joon, Park, Joonah, Lee, Yu Jin
• Primary Examiner(s): Pillai, Namitha
• Application Number:
  US14/439,148
• Publication Number:
  US 20150293666A1
• Time in Patent Office: 2,141 Days
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00

Abstract

A three-dimensional display device and a user interfacing method therefor are disclosed. The three-dimensional display device according to one embodiment comprises: a display unit for displaying a three-dimensional virtual object; a user input signal generation unit for generating a user input signal by detecting a handling object for handling an operation of the three-dimensional virtual object in a three-dimensional space matched with the three-dimensional virtual object; and a control unit for controlling the operation of the three-dimensional virtual object according to the user input signal.

Claims

1. A three-dimensional (3D) display device, comprising:

a display configured to display a 3D virtual object;

a user input signal generator configured to generate a user input signal by detecting a manipulating object for manipulating an operation of the 3D virtual object in a 3D space matched with the 3D virtual object, the manipulating object physically located in the 3D space, the user input signal generator including

a detection sensor configured to detect the manipulating object in the 3D space, and

a marker recognizer configured to recognize a marker physically located on a surface of the manipulating object in response to detection of the manipulating object in the 3D space, the recognizing detects a particular pattern physically located on the surface of the manipulating object from the marker and determines that the particular pattern corresponds to information associated with the manipulating object,

the user input signal generator further configured to

acquire the information associated with the manipulating object based on recognizing the marker located on the manipulating object, and

generate the user input signal such that the user input signal includes the information associated with the manipulating object; and

a controller configured to control the operation of the 3D virtual object according to the user input signal.

2. The 3D display device of claim 1, wherein the user input signal generator is configured to generate the user input signal based on tracking x, y, z coordinate information in the 3D space along a contact and a movement of the manipulating object when the manipulation object is detected in the 3D space.

3. The 3D display device of claim 2, wherein the controller is configured to control the operation of the 3D virtual object such that the operation of the 3D virtual object corresponds to the x, y, z coordinate information based on applying the x, y, z coordinate information included in the user input signal to the 3D virtual object matched with the 3D space.

4. The 3D display device of claim 1, wherein the controller is configured to control the operation of the 3D virtual object to display the information associated with the manipulating object in the user input signal or to transmit the information associated with the manipulating object to another display device.

5. The 3D display device of claim 1, wherein

the user input signal generator includes a camera configured to generate a manipulating object image based on photographing the manipulating object when the manipulating object is detected in the 3D space, and

the user input signal generator is configured to generate the user input signal such that the user input signal includes the manipulating object image.

6. The 3D display device of claim 5, wherein the controller is configured to control the operation of the 3D virtual object to display the manipulating object image included in the user input signal.

7. The 3D display device of claim 5, wherein the controller is configured to

control the operation of the 3D virtual object to verify a representative pixel value based on analyzing the manipulating object image included in the user input signal, and

display the 3D virtual object based on applying the representative pixel value to the 3D virtual object.

8. The 3D display device of claim 5, wherein the controller is configured to

control the operation of the 3D virtual object to generate shape information associated with the manipulating object based on the manipulating object image included in the user input signal, and

display the shape information associated with the manipulating object.

9. The 3D display device of claim 1, wherein the user input signal generator is configured to

link the manipulating object and content, and to generate the user input signal as a signal including the manipulating object and the content, when the manipulating object is detected in the 3D space during an execution of the content.

10. The 3D display device of claim 9, wherein the controller is configured to store the manipulating object and the content included in the user input signal.

11. The 3D display device of claim 10, wherein the user input signal generator is configured to read the content linked to the manipulating object and to generate the user input signal such that the user input signal is associated with executing the content when the manipulating object is detected again in the 3D space.

12. The 3D display device of claim 1, wherein the user input signal generator is configured to detect, as the manipulating object, at least one of a user body, an object, and a portable device having a communication function in the 3D space.

13. The 3D display device of claim 12, wherein

the user input signal generator includes a communicator configured to communicate with the portable device, and

the user input signal generator is configured to receive content selected in advance in the portable device through the communicator and to generate the user input signal as a signal including the content when the portable device is detected in the 3D space.

14. The 3D display device of claim 13, wherein the controller is configured to control the operation of the 3D virtual object to execute the content comprised in the user input signal.

15. The 3D display device of claim 1, wherein

the particular pattern physically located on the surface of the manipulating object is a barcode physically located on the surface of the manipulating object, the barcode corresponding to information associated with the manipulating object.

16. The 3D display device of claim 1, wherein

the information associated with the manipulating object, acquired based on recognizing the marker located on the manipulating object, includes at least one instance of information of

a provider associated with the manipulating object,

a 2D or 3D game,

a created date associated with the manipulating object,

an online sales location associated with the manipulating object,

an offline sales location associated with the manipulating object, and

a price associated with the manipulating object.