Display apparatus, remote controlling apparatus and control method thereof

• US 8,988,342 B2
• Filed: 03/15/2013
• Issued: 03/24/2015
• Est. Priority Date: 06/20/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Eun-seok, Choi, Sang-on, Oh, Jung-yeob, Woo, Suk-young, Jung, Han-chul
• Primary Examiner(s): MARINELLI, PATRICK
• Application Number:
  US13/838,015
• Publication Number:
  US 20130342455A1
• Time in Patent Office: 739 Days
• Field of Search: 345156-183, 178 1801- 2004
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

A remote controlling apparatus, a display apparatus and a controlling method are provided. The remote controlling apparatus for selecting one of a plurality of operating modes of an external device being operable between a pointing mode and a gesture mode, associated with the remote controlling apparatus, includes an output unit for outputting information regarding the remote controlling apparatus to the external device, a detection unit for detecting motion of the remote controlling apparatus, a motion information generating unit for generating motion information based on the detected motion of the remote controlling apparatus, an operation mode change unit for providing information regarding an operation mode, for changing the operation mode of the external device being operable between the pointing mode and the gesture mode, and wherein the information regarding the remote controlling apparatus comprise the information regarding the operating mode, and the motion information generated by the motion information generating unit.

Claims

1. A remote controlling apparatus for providing remote control signals for an external display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, comprising:

a signal output unit for outputting the remote control signals to the external display apparatus which provides a user interface screen;

a detection unit for detecting motion of the remote controlling apparatus;

an input unit comprising a first button unit and a second button unit, the first button unit being used for receiving a user command for selecting one of the pointing mode and the gesture mode in the operation mode of the external display apparatus, the second button unit being used for receiving a user command for selecting an object displayed in the user interface screen, and a combination of the first button unit and the second button unit being used for receiving a user command for enabling a predetermined type of manipulation and displaying a graphical user interface; and

a control unit for controlling the signal output unit to output information regarding the detected motion and information regarding the user command for selecting one of the pointing mode and the gesture mode, when the user command via the first button unit is input,

wherein the pointing mode is a mode for controlling a movement of the pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus detected by the detection unit, and the gesture mode is a mode for controlling a display state of the user interface screen according to a predefined gesture of the remote controlling apparatus,

wherein the control unit controls the signal output unit to output continuously the information regarding the user command for selecting one of the pointing mode and the gesture mode according to whether or not there is press manipulation of the first button unit,

wherein the control unit controls the signal output unit to control the user interface screen to display one of a plurality of different guide graphical user interfaces, that surround the pointing object, for a flicking manipulation, a zoom in/out manipulation, and a panning manipulation when in the gesture mode,

wherein the plurality of different guide graphical user interfaces indicates a direction to perform the predefined gesture of the remote controlling apparatus, and

wherein the pointing object changes to one of a plurality of different shapes when the predetermined type of manipulation is the flicking manipulation, the zoom in/out manipulation, and the panning manipulation.

2. The remote controlling apparatus of claim 1, wherein, during a time interval in which the information regarding the user command for selecting one of the pointing mode and the gesture mode is not received from the remote controlling apparatus, the external display apparatus remains in the pointing mode as a default mode, and

during a time interval in which the information regarding the user command for selecting one of the pointing mode and the gesture mode is continuously received from the remote controlling apparatus, the external display apparatus transitions to and remains in the gesture mode as a non-default mode.

3. The remote controlling apparatus of claim 2, wherein the control unit controls the signal output unit to output the information regarding the user command for selecting one of the pointing mode and the gesture mode continuously while the first button unit is being pressed, and not to output the information regarding the user command for selecting one of the pointing mode and the gesture mode when the pressed first button unit is released.

4. The remote controlling apparatus of claim 1, wherein the detection unit comprises at least one of an accelerometer, an angular velocity sensor, and a magnetometer.

5. The remote controlling apparatus of claim 1, wherein when the user rotates the remote controlling apparatus while pressing the first button unit and the second button unit, a displayed content is panned.

6. A display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, controlled by a remote controlling apparatus which provides remote control signals, comprising:

a receiving unit for receiving the remote control signals comprising information regarding a motion of the remote controlling apparatus, information regarding a user command for selecting one of the pointing mode and the gesture mode, and information regarding an item selection from the remote controlling apparatus;

a display unit for displaying a user interface screen having a pointing object which performs an indicating function on the user interface screen; and

a control unit for controlling to select one of the pointing mode and the gesture mode based on the information regarding the user command for selecting one of the pointing mode and the gesture mode received from the remote controlling apparatus,

wherein the pointing mode is a mode for controlling movement of the pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus detected by a detection unit, and the gesture mode is a mode for controlling display state of the user interface screen according to a predefined gesture of the remote controlling apparatus,

wherein the control unit determines the operation mode of the display apparatus according to whether or not reception of the information regarding the user command for selecting one of the pointing mode and the gesture mode output continuously by press manipulation of a predetermined button unit equipped with the remote control apparatus, and determines enabling a predetermined type of manipulation and displaying a graphical user interface based on a user command enabling a combination of a first button unit and a second button unit of the remote control apparatus,

wherein the control unit controls the display unit to display, on the user interface screen, one of a plurality of different guide graphical user interfaces, that surround the pointing object, for a flicking manipulation, a zoom in/out manipulation, and a panning manipulation when in the gesture mode,

wherein the plurality of different guide graphical user interfaces indicates a direction to perform the predefined gesture of the remote controlling apparatus, and

wherein the pointing object changes to one of a plurality of different app when the predetermined type of manipulation is the flicking manipulation, the zoom in/out manipulation, and the panning manipulation.

7. The display apparatus of claim 6, wherein, when the operation mode of the display apparatus is the pointing mode, a menu item, included in the user interface screen, is selected based on the information regarding a motion of the remote controlling apparatus and the information regarding an item selection received from the remote controlling apparatus.

8. The display apparatus of claim 6, wherein the pointing object is a hand-shaped pointer when in the pointing mode, and the plurality of different shapes comprises a pointing type, a palm type, and a grip type.

9. The display apparatus of claim 6, wherein when the user rotates the remote controlling apparatus while pressing the first button unit and the second button unit, a displayed content displayed is panned.

10. The display apparatus of claim 6, wherein the plurality of different guide graphical user interfaces comprises a first set of arrows for the flicking manipulation, a second set of arrows for the zoom in/out manipulation, and a third set of arrows for the panning manipulation.

11. A control method of a remote controlling apparatus for providing remote control signals for an external display apparatus having a plurality operation modes comprising a pointing mode and a gesture mode, comprising:

detecting motion of the remote controlling apparatus;

outputting information regarding the detected motion and information regarding a user command for selecting one of the pointing mode and the gesture mode, when the user command for selecting one of the pointing mode and the gesture mode in the operation mode of the external display apparatus is input; and

enabling a predetermined type of manipulation and displaying a graphical user interface based on a user command enabling a combination of a first button unit and a second button unit of the remote controlling apparatus,

wherein the pointing mode is a mode for controlling movement of a pointing object displayed on the user interface screen according to the motion of the remote controlling apparatus, and the gesture mode is a mode for controlling display state of the user interface screen according to a predefined gesture of the remote controlling apparatus,

wherein the outputting outputs continuously the information regarding the user command for selecting one of the pointing mode and the gesture mode according to whether or not there is press manipulation of a first button unit,

wherein the outputting outputs a signal to control the external display apparatus to display, on the user interface screen, one of a plurality of different guide graphical user interfaces, that surround the pointing object, for a flicking manipulation, a zoom in/out manipulation, and a panning manipulation when in the gesture mode,

wherein the plurality of different guide graphical user interfaces indicates a direction to perform the predefined gesture of the remote controlling apparatus, and

wherein the pointing object changes to one of a plurality of different shapes when the predetermined type of manipulation is the flicking manipulation, the zoom in/out manipulation, and the panning manipulation.

12. The control method of claim 11, further comprising panning a displayed content when the user rotates the remote controlling apparatus while pressing the first button unit and the second button unit.

13. A control method of a display apparatus having a plurality of operation modes comprising a pointing mode and a gesture mode, controlled by a remote controlling apparatus which provides remote control signals, comprising:

displaying a user interface screen having a pointing object for performing an indicating function;

receiving the remote control signals comprising information regarding a motion of the remote controlling apparatus and information regarding a user command for selecting one of the pointing mode and the gesture mode from the remote controlling apparatus;

selecting one of the pointing mode and the gesture mode based on the information regarding the user command for selecting one of the pointing mode and the gesture mode received from the remote controlling apparatus; and

enabling a predetermined type of manipulation and displaying a graphical user interface based on a user command enabling combination of a first button unit and a second button unit of the remote controlling apparatus,

wherein the selecting determines the operation mode of the display apparatus according to whether or not reception of the information regarding the user command for selecting one of the pointing mode and the gesture mode output continuously by press manipulation of a predetermined button unit equipped with the remote controlling apparatus,

wherein the displaying includes displaying, on the user interface screen, one of a plurality of different guide graphical user interfaces, that surround the pointing object, for a flicking manipulation, a zoom in/out manipulation, and a panning manipulation when in the gesture mode,

wherein the plurality of different guide graphical user interfaces indicates a direction to perform the predefined gesture of the remote controlling apparatus, and

wherein the pointing object changes to one of a plurality of different shapes when the predetermined type of manipulation is the flicking manipulation, the zoom in/out manipulation, and the panning manipulation.

14. The control method of claim 13, wherein the displaying the plurality of different guide graphical user interfaces comprises displaying a first set of arrows for the flicking manipulation, displaying a second set of arrows for the zoom in/out manipulation, and displaying a third set of arrows for the panning manipulation.

15. The control method of claim 13, further comprising panning a displayed content when the user rotates the remote controlling apparatus while pressing the first button unit and the second button unit.