DISPLAY APPARATUS, POINTING APPARATUS, POINTING SYSTEM AND CONTROL METHODS THEREOF

• US 20160364016A1
• Filed: 03/08/2016
• Published: 12/15/2016
• Est. Priority Date: 06/09/2015
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: YOON, Seung-il, YUN, Hyun-kyu
• Application Number:
  US15/063,803
• Publication Number:
  US 20160364016A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A display apparatus is provided. The display apparatus includes at least one speaker configured to output a sound signal; a display configured to display a pointing object; communication circuitry configured to communicate with a pointing apparatus for controlling a movement state of the pointing object, the pointing apparatus comprising a microphone to sense the sound signal; and a processor configured to display the pointing object at a reference position determined based on an oriented direction of the pointing apparatus determined based on information of time at which the pointing apparatus senses the sound signal, after a trigger signal for setting the reference position of the pointing object on a screen of the display is received from the pointing apparatus.

Claims

1. A display apparatus comprising:

at least one speaker configured to output a sound signal;

a display configured to display a pointing object;

communication circuitry configured to communicate with a pointing apparatus to control a movement state of the pointing object, the pointing apparatus comprising a microphone to sense the sound signal; and

a processor configured to display the pointing object at a reference position determined based on an oriented direction of the pointing apparatus determined based on information of time including a time at which the pointing apparatus senses the sound signal after a trigger signal for setting the reference position of the pointing object on a screen of the display is received by the display apparatus from the pointing apparatus.

2. The display apparatus as claimed in claim 1, wherein the display apparatus includes a first speaker configured to output a first sound signal and a second speaker spaced apart from the first speaker by a preset distance and configured to output a second sound signal different from the first sound signal, and

the processor is configured to receive, from the pointing apparatus, information of time at which the first sound signal and the second sound signal are each sensed by the microphone of the pointing apparatus, and to determine the oriented direction of the pointing apparatus based on a difference of the sensed times of the first sound signal and the second sound signal determined based on the information of time.

3. The display apparatus as claimed in claim 2, wherein the processor is configured to determine a horizontal position of the pointing apparatus based on the difference of the sensed times, to determine a horizontal oriented direction corresponding to the determined horizontal position of the pointing apparatus, and to determine a vertical oriented direction of the pointing apparatus based on motion information of the pointing apparatus sensed by a sensor included in the pointing apparatus.

4. The display apparatus as claimed in claim 2, wherein the information of time is a record file in which the first sound signal and the second sound signal are each recorded, or information of time at which the first sound signal and the second sound signal are each sensed.

5. The display apparatus as claimed in claim 1, wherein the pointing apparatus includes a first microphone and a second microphone, the first and second microphones being spaced apart from each other by a preset distance, and

the processor is configured to receive, from the pointing apparatus, information of time at which the sound signal is sensed by the first microphone and the second microphone, respectively, and to determine the oriented direction of the pointing apparatus based on a difference of the sensed times of the first microphone and the second microphone determined based on the information of time.

6. The display apparatus as claimed in claim 5, wherein the processor is configured to determine a horizontal angle of the pointing apparatus based on the difference of the sensed times, to determine a horizontal oriented direction corresponding to the determined horizontal angle of the pointing apparatus, and to determine a vertical oriented direction of the pointing apparatus based on motion information of the pointing apparatus sensed by a sensor included in the pointing apparatus.

7. The display apparatus as claimed in claim 1, wherein the display apparatus includes a first speaker configured to output a first sound signal and a second speaker spaced apart from the first speaker by a preset distance and configured to output a second sound signal different from the first sound signal,

the pointing apparatus includes a first microphone and a second microphone spaced apart from each other by a preset distance, and

the processor is configured to receive, from the pointing apparatus, first information of time at which the first sound signal and the second sound signal are each sensed by any one of the first microphone and the second microphone, to receive second information of time at which any one of the first sound signal and the second sound signal is sensed by the first microphone and the second microphone, respectively, and to determine the oriented direction of the pointing apparatus based on a difference of the sensed times determined based on the first information of time and the second information of time.

8. The display apparatus as claimed in claim 7, wherein the processor is configured to determine a horizontal position and a horizontal angle of the pointing apparatus based on the difference of the sensed times, to determine a horizontal oriented direction corresponding to the determined horizontal position and horizontal angle of the pointing apparatus, and to determine a vertical oriented direction of the pointing apparatus based on motion information of the pointing apparatus sensed by a sensor included in the pointing apparatus.

9. The display apparatus as claimed in claim 1, wherein when a signal corresponding to a magnitude and a direction of a motion of the pointing apparatus is received from the pointing apparatus after the pointing object is displayed at the reference position, the processor is configured to move the pointing object to a position corresponding to the magnitude and the direction of the motion.

10. A pointing apparatus comprising:

communication circuitry configured to communicate with a display apparatus displaying a pointing object on a screen, the display apparatus comprising at least one speaker to output a sound signal;

a microphone configured to sense a sound signal from the display apparatus; and

a processor configured to determine an oriented direction based on information of time at which the sound signal from the display apparatus is sensed, to determine a reference position of the pointing object based on the oriented direction, and to transmit a control signal allowing the pointing object to be displayed at the reference position.

11. The pointing apparatus as claimed in claim 10, wherein the display apparatus includes a first speaker configured to output a first sound signal and a second speaker spaced apart from the first speaker by a preset distance and configured to output a second sound signal different from the first sound signal, and

the processor is configured to determine a difference of the sensed times of the first sound signal and the second sound signal abased on information of time at which the first sound signal and the second sound signal are each sensed by the microphone, and to determine an oriented direction based on the difference of the sensed times.

12. The pointing apparatus as claimed in claim 11, further comprising at least one of:

an acceleration sensor and a gyro sensor, and

the processor is configured to determine a horizontal position based on the difference of the sensed times, to determine a horizontal oriented direction corresponding to the determined horizontal position, and to determine a vertical oriented direction based on motion information sensed by at least one of the acceleration sensor and the gyro sensor.

13. A method of controlling a display apparatus, comprising:

receiving a trigger signal from a pointing apparatus for setting a reference position on a screen, the pointing apparatus including a microphone for sensing a sound signal;

outputting the sound signal through at least one speaker;

receiving, from the pointing apparatus, information of time at which the sound signal is sensed by the pointing apparatus;

determining an oriented direction of the pointing apparatus based on the information of time;

determining the reference position based on the oriented direction of the pointing apparatus; and

displaying a pointing object at the reference position.

14. The method as claimed in claim 13, wherein in the operation of outputting the sound signal, a first sound signal is output through a first speaker and a second sound signal different from the first sound signal is output through a second speaker, the second speaker being spaced apart from the first speaker by a preset distance,

in the operation of receiving the information of time, information of time at which the first sound signal and the second sound signal are each sensed by the microphone of the pointing apparatus is received from the pointing apparatus, and

in the operation of determining the oriented direction, the oriented direction of the pointing apparatus is determined based on a difference of the sensed times of the first sound signal and the second sound signal determined based on the information of time.

15. The method as claimed in claim 14, wherein the operation of determining the oriented direction includes:

determining a horizontal oriented direction corresponding to a horizontal position of the pointing apparatus determined based on the difference of the sensed times; and

determining a vertical oriented direction of the pointing apparatus based on motion information of the pointing apparatus sensed by a sensor included in the pointing apparatus.

16. The method as claimed in claim 14, wherein the information of time includes a record file in which the first sound signal and the second sound signal are each recorded, or information of time at which the first sound signal and the second sound signal are each sensed.

17. The method as claimed in claim 13, wherein the pointing apparatus includes a first microphone and a second microphone, the first microphone and the second microphone being spaced apart from each other by a preset distance,

in the operation of receiving the information of time, information of time at which the sound signal is sensed by the first microphone and the second microphone, respectively, is received from the pointing apparatus, and

in the operation of determining the oriented direction, the oriented direction of the pointing apparatus is determined based on a difference of the sensed times of the first microphone and the second microphone determined based on the information of time.

18. The method as claimed in claim 17, wherein the operation of determining the oriented direction includes:

determining a horizontal oriented direction corresponding to a horizontal angle of the pointing apparatus determined based on the difference of the sensed times; and

determining a vertical oriented direction of the pointing apparatus based on motion information of the pointing apparatus sensed by a sensor included in the pointing apparatus.