Display apparatus, remote controlling apparatus and control method thereof

• US 9,223,416 B2
• Filed: 01/30/2013
• Issued: 12/29/2015
• Est. Priority Date: 06/20/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Eun-seok, Choi, Sang-on, Oh, Jung-yeob, Woo, Suk-young, Jung, Han-chul
• Primary Examiner(s): MARINELLI, PATRICK
• Application Number:
  US13/754,176
• Publication Number:
  US 20130342454A1
• Time in Patent Office: 1,063 Days
• Field of Search: 345156-184, 178 1801- 2004
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

A remote controlling apparatus, a display apparatus and a controlling method are provided. The remote controlling apparatus for selecting one of a plurality of operating modes of an external device being operable between a pointing mode and a gesture mode, associated with the remote controlling apparatus, includes an output unit for outputting information regarding the remote controlling apparatus to the external device, a detection unit for detecting motion of the remote controlling apparatus, a motion information generating unit for generating motion information based on the detected motion of the remote controlling apparatus, an operation mode change unit for providing information regarding an operation mode, for changing the operation mode of the external device being operable between the pointing mode and the gesture mode, and wherein the information regarding the remote controlling apparatus comprise the information regarding the operating mode, and the motion information generated by the motion information generating unit.

Claims

1. A display system comprising:

a remote controlling apparatus configured to control a selection of an operation mode based on a user command; and

a display apparatus configured to communicate with the remote controlling apparatus and to display a user interface screen having a pointing object, and to have a pointing operation mode for controlling a movement of the pointing object displayed on the user interface screen according to a motion of the remote controlling apparatus and a gesture operation mode, for controlling the display apparatus according to a predefined gesture of the remote controlling apparatus, which are controlled by the remote controlling apparatus,

wherein the remote controlling apparatus causes the user interface screen to display one of a plurality of different guide graphical user interfaces that surround the pointing object, each of the plurality of different guide graphical user interfaces corresponds to one a plurality of manipulations and indicates a direction to perform the predefined gesture of the remote controlling apparatus when in a gesture mode, and

wherein the pointing object changes to one of a plurality of different shapes response to predetermined movements of the remote controlling apparatus in order to perform one of the plurality of manipulations.

2. The display system of claim 1, wherein, during a time interval in which information regarding the selecting one of the pointing operation mode and the gesture operation mode is not received from the remote controlling apparatus, the display apparatus is configured to remain in the pointing operation mode as a default mode, and

during a time interval in which information regarding the selecting one of the pointing operation mode and the gesture operation mode is continuously received from the remote controlling apparatus, the display apparatus is configured to transition and remain in the gesture operation mode as a non-default mode.

3. The display system of claim 2, wherein the remote controlling apparatus:

is configured to control output the information regarding the selecting of one of the pointing operation mode and the gesture operation mode continuously while a first button unit is being pressed, and not to output the information regarding the selecting of one of the pointing operation mode and the gesture operation mode when the pressed first button unit is released.

4. The display system of claim 1, wherein a first pointing object is displayed in response to a flicking movement of the remote controlling apparatus, a second pointing object is displayed in response to a forward and a backward movement of the remote controlling apparatus, and

a third pointing object is displayed in response to a panning movement of the remote controlling apparatus.

5. The display system of claim 4, wherein the displayed first pointing object is changed in both displayed shape and movement in response to the flicking movement of the remote controlling apparatus.

6. The display system of claim 4, wherein the displayed second pointing object is changed in size in response to the forward and the backward movement of the remote controlling apparatus.

7. The display system of claim 1, wherein, when in the gesture mode, the user interface screen is configured to change a display of menu screen or UI page.

8. The display system of claim 1, wherein, when in the gesture mode, the user interface screen is configured to change a displayed content.

9. The display system of claim 1, wherein at least one of the changes to one of a plurality of different shapes graphically illustrates a change in hand angle of a user of the remote controlling apparatus.

10. A remote controlling apparatus for a display apparatus, the remote controlling apparatus comprising:

a control unit configured to control a selection of a pointing mode, for controlling a movement of a pointing object displayed on a user interface screen of the display apparatus according to a motion of the remote controlling apparatus, and a gesture mode, for changing a display screen according to a predefined gesture of the remote controlling apparatus, based on an user input,

an output unit configured to output information regarding the user selection of one of the pointing mode and the gesture mode,

wherein the control unit causes the display screen to display one of a plurality of different guide graphical user interfaces that surround the pointing object, each of the plurality of different guide graphical user interfaces corresponds to one a plurality of manipulations and indicates a direction to perform the predefined gesture of the remote controlling apparatus when in a gesture, and

wherein the pointing object changes to one of a plurality of different shapes in response to predetermined movements of the remote controlling apparatus in order to perform one of the plurality of manipulations.

11. The remote controlling apparatus of claim 10, wherein a first pointing object is displayed in response to a flicking movement of the remote controlling apparatus, a second pointing object is displayed in response to a forward and a backward movement of the remote controlling apparatus, and

a third pointing object is displayed in response to a panning movement of the remote controlling apparatus.

12. The remote controlling apparatus of claim 11, wherein the displayed first pointing object is changed in both displayed shape and movement in response to the flicking movement of the remote controlling apparatus.

13. The remote controlling apparatus of claim 12, wherein the displayed second pointing object is changed in size in response to the forward and the backward movement of the remote controlling apparatus.

14. The remote controlling apparatus of claim 10, wherein, when in the gesture mode, the display screen is configured to change a display of menu screen or UI page.

15. The remote controlling apparatus of claim 10, wherein, when in the gesture mode, the display screen is configured to change a displayed content.

16. The remote controlling apparatus of claim 10, wherein the at least one of the changes to one of a plurality of different shapes graphically illustrates a change in hand angle of a user of the remote controlling apparatus.

17. A display apparatus comprising:

a receiving unit configured to communicate with a remote controlling apparatus;

a display unit configured to display a user interface screen having a pointing object;

a control unit configured to operate in a pointing operation mode, for controlling a movement of the pointing object displayed on the user interface screen according to a motion of the remote controlling apparatus, and in a gesture operation mode, for controlling the display apparatus according to a predefined gesture of the remote controlling apparatus,

wherein the control unit causes the display screen to display one of a plurality of different guide graphical user interfaces that surround the pointing object, each of the plurality of different guide graphical user interfaces corresponds to one a plurality of manipulations and indicates a direction to perform the predefined gesture of the remote controlling apparatus when in a gesture mode,

wherein the pointing object changes to one of a plurality of different shapes in response to predetermined movements of the remote controlling apparatus in order to perform one of the plurality of manipulations.