Method and system to control a non-gesture controlled device using gesture interactions with a gesture controlled device

• US 8,542,320 B2
• Filed: 06/17/2010
• Issued: 09/24/2013
• Est. Priority Date: 06/17/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Berestov, Alexander, Masli, Hans
• Primary Examiner(s): Lee, Michael
• Application Number:
  US12/817,528
• Publication Number:
  US 20110310298A1
• Time in Patent Office: 1,195 Days
• Field of Search: 348/563, 348/734, 348/552, 348/553, 345156-158, 715/863
• US Class Current: 348/552
• CPC Class Codes: H04N 21/4112 having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/43635 HDMI
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

A television set. The television set includes a display, a gesture detector, a transceiver, a processor, and a memory component. The display is operable to render images. The gesture detector is operable to detect gesture interactions, e.g., initiation of gesture control operation. The transceiver is operable to communicate with an electronic device that is separate from the television set. The processor is operable to cause the transceiver to send a request message to the electronic device. The request message is a request to receive a graphical user interface (GUI) of the electronic device for rendering on the display. The transceiver receives the GUI of the electronic device responsive to the request message. The processor generates a command message responsive to gesture interaction with the GUI of the electronic device. The command message is operable to control an operation of the electronic device and is transmitted to the electronic device.

Claims

1. A television set comprising:

a display for rendering images;

a gesture detector operable to detect a user performed gesture control operations;

a transceiver operable to communicate with an electronic device separate from said television set; and

a processor operable to render a graphical user interface (GUI) specific to said electronic device on said display and operable to allow gesture controlled interaction of said GUI responsive to said gesture detector, and wherein said processor is further operable to generate a command message responsive to gesture interactions with said GUI, wherein said command message is operable to be communicated by said transceiver to said electronic device to control an operation of said electronic device, wherein said processor is further operable to, responsive to a determination by the processor based on signals from the gesture detector that a person has input a predetermined gesture, cause said transceiver to send a request message to said electronic device, wherein said request message is a request to receive a graphical user interface (GUI) of said electronic device.

2. The television set as described in claim 1 further comprising:

a memory component operable to store said GUI of said electronic device.

3. The television set as described in claim 1, wherein said transceiver receives said GUI of said electronic device responsive to said request message.

4. The television set as described in claim 1, wherein said processor is operable to cause said transceiver to send said command message to said electronic device.

5. The television set as described in claim 4, wherein said transceiver is operable to receive a response message from said electronic device responsive to said command message.

6. The television set as described in claim 1, wherein said transceiver comprises a wireless radio frequency component.

7. The television set as described in claim 1, wherein said gesture detector comprises:

a camera for accepting said gesture interactions; and

gesture recognition logic operable to process said gesture interactions.

8. A method of controlling a non-gesture controlled device via gesture interaction with a gesture controlled device, said method comprising:

said gesture controlled device detecting user performed gestures;

the gesture controlled device receiving a first gesture and determining whether the first gesture matches a first predetermined gesture indicating a desire to control a specific device;

the gesture controlled device, responsive to a determination that the first gesture matches the first predetermined gesture and that the specific device indicated by the first gesture is the non gesture control device, sending a request to the non gesture control device for a graphical user interface (GUI);

said gesture controlled device rendering graphical user interface (GUI) of the non-gesture controlled device for gesture interactions thereof responsive to said user performed gestures; and

said gesture controlled device generating a command signal responsive to gesture interactions with said GUI, wherein said command signal is operable to be communicated to said non-gesture controlled device to control an operation of said non-gesture controlled device.

9. The method as described in claim 8 further comprising:

said gesture controlled device sending said command signal to said non-gesture controlled device.

10. The method as described in claim 8 further comprising:

said gesture controlled device storing said GUI of said non-gesture controlled device.

11. The method as described in claim 8 further comprising:

said gesture controlled device receiving a response message from said non-gesture controlled device responsive to said command signal.

12. The method as described in claim 8, wherein said gesture controlled device is a television set.

13. The method as described in claim 8, wherein said non-gesture controlled device is a set-top-box.

14. An electronic device comprising:

a gesture recognition system comprising a camera and a gesture recognition logic unit, said gesture recognition system operable to detect recognized gestures based on user performed gesture actions;

a display;

a memory device;

a processor operable to receive said recognized gestures from said gesture recognition system, said processor operable to recognize a gesture indicating a desired to control using gestures an external device and responsive to recognizing the gesture indicating a desire to control the external device, sending a request to the external device to provide a graphical user interface (GUI), the processor being further operable to display the graphical user interface pertinent from the external device and operable to allow gesture-controlled interactions with said graphical user interface based on said recognized gestures; and

a transmitter, responsive to said processor, for transmitting a command for controlling said external device based on said gesture-controlled interactions.

15. An electronic device as described in claim 14 wherein said external device is an audio/video source device and wherein said transmitter is a wireless transmitter.

16. An electronic device as described in claim 15 wherein said audio/video source is a set-top-box and wherein said wireless transmitter is a radio frequency transmitter.

17. An electronic device as described in claim 15 further comprising a receiver operable for receiving said graphical user interface from said external device responsive to a first recognized gesture.

18. An electronic device as described in claim 17 wherein said receiver is further operable to receive a response indicating from said external device indicating that said external device received said command.