DISPLAY APPARATUS, REMOTE CONTROLLING APPARATUS AND CONTROL METHOD THEREOF

• US 20130342454A1
• Filed: 01/30/2013
• Published: 12/26/2013
• Est. Priority Date: 06/20/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: CHOI, Eun-Seok, CHOI, Sang-on, OH, Jung-yeob, WOO, Suk-young, JUNG, Han-chul
• Granted Patent: US 9,223,416 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

A remote controlling apparatus, a display apparatus and a controlling method are provided. The remote controlling apparatus for selecting one of a plurality of operating modes of an external device being operable between a pointing mode and a gesture mode, associated with the remote controlling apparatus, includes an output unit for outputting information regarding the remote controlling apparatus to the external device, a detection unit for detecting motion of the remote controlling apparatus, a motion information generating unit for generating motion information based on the detected motion of the remote controlling apparatus, an operation mode change unit for providing information regarding an operation mode, for changing the operation mode of the external device being operable between the pointing mode and the gesture mode, and wherein the information regarding the remote controlling apparatus comprise the information regarding the operating mode, and the motion information generated by the motion information generating unit.

Claims

1. A remote controlling apparatus for providing remote control signals for an external display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, comprising:

a signal output unit for outputting the remote control signals to the external display apparatus which provides a user interface screen;

a detection unit for detecting motion of the remote controlling apparatus;

an input unit comprising a first button unit and a second button unit, the first button unit being used for receiving a user command for selecting one of the pointing mode and the gesture mode in the operation mode of the external display apparatus, and the second button unit being used for receiving a user command for selecting an pointing object displayed in the user interface screen; and

a control unit for controlling the signal output unit to output information regarding the detected motion and information regarding the user command for selecting one of the pointing mode and the gesture mode, when the user command via the first button unit is input,

wherein the pointing mode is a mode for controlling movement of the pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus detected by the detection unit, and the gesture mode is a mode for controlling display state of the user interface screen according to a predefined gesture of the remote controlling apparatus.

2. The remote controlling apparatus of claim 1, wherein, during a time interval in which the information regarding the user command for selecting one of the pointing mode and the gesture mode is not received from the remote controlling apparatus, the external display apparatus remains in the pointing mode as a default mode, and

during a time interval in which the information regarding the user command for selecting one of the pointing mode and the gesture mode is continuously received from the remote controlling apparatus, the external display apparatus transitions to and remains in the gesture mode as a non-default mode.

3. The remote controlling apparatus of claim 2, wherein the control unit controls the signal output unit to output the information regarding the user command for selecting one of the pointing mode and the gesture mode continuously while the first button unit is being pressed, and not to output the information regarding the user command for selecting one of the pointing mode and the gesture mode when the pressed first button unit is released.

4. The remote controlling apparatus of claim 1, wherein the detection unit comprises at least one of an accelerometer, an angular velocity sensor, and a magnetometer.

5. A display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, controlled by a remote controlling apparatus which provides remote control signals, comprising:

a receiving unit for receiving the remote control signals comprising information regarding a motion of the remote controlling apparatus, information regarding a user command for selecting one of the pointing mode and the gesture mode, and information regarding an item selection from the remote controlling apparatus;

a display unit for displaying a user interface screen having a pointing object which performs an indicating function on the user interface screen; and

a control unit for controlling to select one of the pointing mode and the gesture mode based on the information regarding the user command for selecting one of the pointing mode and the gesture mode received from the remote controlling apparatus,

wherein the pointing mode is a mode for controlling movement of the pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus detected by the detection unit, and the gesture mode is a mode for controlling display state of the user interface screen according to a predefined gesture of the remote controlling apparatus.

6. The display apparatus of claim 5, wherein the display unit displays the pointing object of which a shape is changed according to the operation mode.

7. The display apparatus of claim 5, wherein the control unit determines the operation mode of the display apparatus as the pointing mode while the receiving unit does not receive the information regarding the user command for selecting one of the pointing mode and the gesture mode, and

the control unit determines the operation mode of the display apparatus as the gesture mode while the receiving unit receives the information regarding the user command for selecting one of the pointing mode and the gesture mode.

8. The display apparatus of claim 5, wherein, when the operation mode of the display apparatus is the pointing mode, a menu item included the user interface screen is selected based on the information regarding a motion of the remote controlling apparatus and the information regarding an item selection received from the remote controlling apparatus.

9. The display apparatus of claim 6, wherein the control unit controls to display the pointing object by changing at least one of a shape, a color, a size, a location, and a direction according to an input manipulation state on the user interface screen.

10. The display apparatus of claim 6, wherein the pointing object is a hand-shaped pointer, and

the control unit controls to display the hand-shaped pointer by changing into a pointing type, a palm type, or a grip type based on a possible manipulation of flicking, zoom in/out, and panning, on the user interface screen.

11. A display system comprising a remote controlling apparatus which provides remote control signals and a display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, controlled by the remote controlling apparatus, comprising:

the remote controlling apparatus for outputting the remote control signals comprising information regarding a motion of the remote controlling apparatus, information regarding a user command for selecting one of the pointing mode and the gesture mode, and information regarding an item selection

the display apparatus comprising;

a receiving unit for receiving the remote control signals comprising information regarding a motion of the remote controlling apparatus, information regarding a user command for selecting one of the pointing mode and the gesture mode, and information regarding an item selection from the remote controlling apparatus;

a display unit for displaying a user interface screen having a pointing object which performs an indicating function on the user interface screen; and

a control unit for controlling to select one of the pointing mode and the gesture mode based on the information regarding the user command for selecting one of the pointing mode and the gesture mode received from the remote controlling apparatus,

wherein the pointing mode is a mode for controlling movement of the pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus detected by the detection unit, and the gesture mode is a mode for controlling display state of the user interface screen according to a predefined gesture of the remote controlling apparatus.

12. The display system of claim 11, wherein, during a time interval in which the information regarding the user command for selecting one of the pointing mode and the gesture mode is not received from the remote controlling apparatus, the display apparatus is configured to remain in the pointing mode as a default mode, and

during a time interval in which the information regarding the user command for selecting one of the pointing mode and the gesture mode is continuously received from the remote controlling apparatus, the display apparatus is configured to transition and remain in the gesture mode as a non-default mode.

13. The display system of claim 12, wherein remote controlling apparatus comprises:

a signal output unit for outputting the remote control signals to the display apparatus;

an input unit having a first button for receiving the user command for selecting one of the pointing mode and the gesture mode; and

a control unit configured to control the signal output unit to output the information regarding the user command for selecting one of the pointing mode and the gesture mode continuously while the first button unit is being pressed, and not to output the information regarding the user command for selecting one of the pointing mode and the gesture mode when the pressed first button unit is released.

14. A control method of a remote controlling apparatus for providing remote control signals for an external display apparatus having a plurality operation modes comprising a pointing mode and a gesture mode, comprising:

detecting motion of the remote controlling apparatus;

outputting information regarding the detected motion and information regarding a user command for selecting one of the pointing mode and the gesture mode, when the user command for selecting one of the pointing mode and the gesture mode in the operation mode of the external display apparatus is input,

wherein the pointing mode is a mode for controlling movement of a pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus, and the gesture mode is a mode for controlling display state of the user interface screen according to a predefined gesture of the remote controlling apparatus.

15. A control method of a display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, controlled by a remote controlling apparatus which provides remote control signals, comprising:

displaying a user interface screen having a pointing object for performing an indicating function;

receiving the remote control signals comprising information regarding a motion of the remote controlling apparatus and information regarding a user command for selecting one of the pointing mode and the gesture mode from the remote controlling apparatus; and

selecting one of the pointing mode and the gesture mode based on the information regarding the user command for selecting one of the pointing mode and the gesture mode received from the remote controlling apparatus.