Gesture-based remote control

• US 8,593,576 B2
• Filed: 10/15/2009
• Issued: 11/26/2013
• Est. Priority Date: 10/15/2009
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Friedman, Lee G.
• Primary Examiner(s): Mehmood, Jennifer
• Assistant Examiner(s): ALAM, MIRZA F
• Application Number:
  US12/579,602
• Publication Number:
  US 20110090407A1
• Time in Patent Office: 1,503 Days
• Field of Search: 340/825.22, 340/825.25, 340/825.69, 340/825.24, 340/825.71, 340/539.16, 340/539.19, 340/541, 340/567, 340/10.1, 340/5.1, 340/3.1, 340/12.78, 382/115, 382/118, 382/181, 382/203, 382/288, 348/734, 348/211.99, 348/211.1, 348/77, 345/156, 345/157, 345/121, 345/123, 345/127, 345/341, 345/339, 345/7, 345/973, 345/158, 345/173, 345/159
• US Class Current: 348/734
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control

Abstract

A method and system for operating a remote-controlled device using a gesture-enabled remote control (RC) includes activating a communication link between the RC and the remote-controlled device. The remote-controlled device may implement a remote control context accommodating gesture commands generated by the RC. The RC may enable a user to generate gesture commands by performing gesture motions with the RC. Command data corresponding to gesture commands, along with selection commands from selection control inputs on the RC, may be sent to the remote-controlled device.

Claims

1. A remote control method, comprising:

responsive to detecting user assertion of a gesture enable input, activating a gesture sensor of a remote control to transition the remote control to a gesture enabled state;

sensing a gesture motion of the remote control;

converting the gesture motion into a gesture command executable by a remote-controlled device;

transmitting the gesture command to the remote-controlled device; and

responsive to detecting assertion of a selection control element of the remote control, sending selection command data corresponding to the selection input to the remote-controlled device;

wherein converting the gesture motion occurs within a remote control context of the remote-controlled device, and wherein the gesture command sent to the remote-controlled device depends on the remote control context along with the recorded gesture motion; and

wherein the remote controlled device supports gesture motion contexts selected from a group of contexts including;

a volume control context, and further wherein the corresponding gesture motion includes one of the following;

a single up or down movement of the remote control, a plurality of downward movements of the remote control, and a plurality of upward movements of the remote control, and further wherein the corresponding gesture commands includes instructions to increase the volume, decrease the volume, mute the volume, or return the volume to a previous state; and

a channel control context, and further wherein the corresponding gesture motion includes at least one up or down movement of the remote control, and further wherein the corresponding gesture commands includes instructions to change the channel.

2. The method of claim 1, wherein the sensed gesture motion includes translation of the remote control.

3. The method of claim 1, wherein the sensed gesture motion includes rotation of the remote control.

4. The method of claim 1, wherein said sensing further comprises:

determining a spatial acceleration of the remote control.

5. The method of claim 1, further comprising:

sending a message to the remote-controlled device; and

receiving an acknowledgement from the remote-controlled device.

6. The method of claim 1, wherein said receiving the selection input is responsive to a menu display on the remote-controlled device.

7. The method of claim 1, wherein said activating of said gesture sensor is responsive to a signal received from a source external to the remote control.

13. The method of claim 1, wherein the group of context includes:

a list navigation context, wherein the corresponding gesture motion includes one of the following;

a single up or down movement of the remote control, a plurality of downward movements of the remote control, a plurality of upward movements of the remote control, a single sweep left or right of the remote control, a plurality of rightward movements of the remote control, a plurality of leftward movements of the remote control, an inward or outward movement of the remote control, a clockwise rotation of the remote control, and a counter-clockwise rotation of the remote control, and further wherein the corresponding gesture commands includes instructions to scroll upward through a list of available options, to scroll downward through the list of available options, to scroll a selected number of rows within the available options, to change a page of the available options, to move to a next selection within the available options, or to move to a previous selection within the available option;

a content playback context, wherein the corresponding gesture motion includes one of the following;

a single sweep left or right of the remote control, a plurality of rightward movements of the remote control, and a plurality of leftward movements of the remote control, and further wherein the corresponding gesture commands includes instructions to scroll through a digital video recorder timeline, to playback the content, to fast forward through the content, to rewind the content, and to move to a place in the content associated with a designated time; and

a content viewing context, wherein the corresponding gesture motion is a diagonal movement of the remote control, and further wherein the corresponding gesture commands includes instructions to display a list of available options or hide a list of available options.

8. A remote control, comprising:

a processor;

a wireless transceiver;

a motion detector; and

memory media accessible to the processor, including processor-executable instructions that, when executed by the processor, cause the processor to perform operations including;

activating a motion detector responsive to user assertion of a trigger control element of the remote control;

establishing a communication channel between the remote control and a remote-controlled device using the wireless transceiver;

when a motion detector enable signal is asserted, recording a gesture motion of the remote control using the motion detector;

converting the recorded gesture motion into a gesture command executable by a remote-controlled device;

sending command data corresponding to the gesture command to the remote-controlled device;

receiving a selection input generated by assertion of a selection control element; and

sending selection command data corresponding to the selection input to the remote-controlled devices;

wherein recording the gesture motion occurs within a remote control context of the remote-controlled device, and wherein the gesture command sent to the remote-controlled device depends on the remote control context along with the recorded gesture motion; and

wherein the remote controlled device supports gesture motion contexts selected from a group of contexts including;

a volume control context, and further wherein the corresponding gesture motion includes one of the following;

a single up or down movement of the remote control, a plurality of downward movements of the remote control, and a plurality of upward movements of the remote control, and further wherein the corresponding gesture commands includes instructions to increase the volume, decrease the volume, mute the volume, or return the volume to a previous state; and

a channel control context, and further wherein the corresponding gesture motion includes at least one up or down movement of the remote control, and further wherein the corresponding gesture commands includes instructions to change the channel.

9. The remote control of claim 8, wherein the gesture motion results from at least one of:

translation of the remote control and rotation of the remote control.

10. The remote control of claim 8, wherein the operations include:

determining a spatial acceleration of the remote control; and

receiving the asserted motion detector enable signal from a source external to the remote control.

11. The remote control of claim 8, further comprising

a selection control element;

a trigger control element; and

wherein the operations include;

receiving a selection input generated by the selection control element;

sending selection command data corresponding to the selection input to the remote-controlled device; and

asserting the motion detector enable signal when the trigger control element is activated.

12. The remote control of claim 8, further comprising:

an audio output element; and

wherein the operations include;

outputting at least one audio signal using the audio output element, wherein the output of the at least one audio signal occurs when an output audio signal event occurs, and further wherein the output audio signal event is select from one of the following events;

a gesture motion is recorded, the motion detector signal is asserted; and

when the remote-controlled device acknowledges execution of a command associated with command data received by the remote control.

14. The remote control of claim 8, wherein the group of context includes:

a list navigation context, wherein the corresponding gesture motion includes one of the following;

a single up or down movement of the remote control, a plurality of downward movements of the remote control, a plurality of upward movements of the remote control, a single sweep left or right of the remote control, a plurality of rightward movements of the remote control, a plurality of leftward movements of the remote control, an inward or outward movement of the remote control, a clockwise rotation of the remote control, and a counter-clockwise rotation of the remote control, and further wherein the corresponding gesture commands includes instructions to scroll upward through a list of available options, to scroll downward through the list of available options, to scroll a selected number of rows within the available options, to change a page of the available options, to move to a next selection within the available options, or to move to a previous selection within the available option;

a content playback context, wherein the corresponding gesture motion includes one of the following;

a single sweep left or right of the remote control, a plurality of rightward movements of the remote control, and a plurality of leftward movements of the remote control, and further wherein the corresponding gesture commands includes instructions to scroll through a digital video recorder timeline, to playback the content, to fast forward through the content, to rewind the content, and to move to a place in the content associated with a designated time; and

a content viewing context, wherein the corresponding gesture motion is a diagonal movement of the remote control, and further wherein the corresponding gesture commands includes instructions to display a list of available options or hide a list of available options.

15. A non-transitory computer readable medium, including processor-executable instructions that, when executed by a processor, cause the processor to perform operations including:

activating a motion detector responsive to user assertion of a trigger control element of the remote control;

establishing a communication channel between the remote control and a remote-controlled device using the wireless transceiver;

when a motion detector enable signal is asserted, recording a gesture motion of the remote control using the motion detector;

converting the recorded gesture motion into a gesture command executable by a remote-controlled device;

sending command data corresponding to the gesture command to the remote-controlled device;

receiving a selection input generated by assertion of a selection control element; and

sending selection command data corresponding to the selection input to the remote-controlled device;

wherein recording the gesture motion occurs within a remote control context of the remote-controlled device, and wherein the gesture command sent to the remote-controlled device depends on the remote control context along with the recorded gesture motion; and

wherein the remote controlled device supports gesture motion contexts selected from a group of contexts including;

a volume control context, and further wherein the corresponding gesture motion includes one of the following;

a single up or down movement of the remote control, a plurality of downward movements of the remote control, and a plurality of upward movements of the remote control, and further wherein the corresponding gesture commands includes instructions to increase the volume, decrease the volume, mute the volume, or return the volume to a previous state; and

a channel control context, and further wherein the corresponding gesture motion includes at least one up or down movement of the remote control, and further wherein the corresponding gesture commands includes instructions to change the channel.

16. The non-transitory computer readable medium of claim 15, wherein the operations include:

receiving selection command data from the remote control corresponding to a selection command received at the remote control; and

executing the selection command.

17. The non-transitory computer readable medium of claim 16, wherein the operations include:

outputting a multimedia signal in response to receiving the selection command data.