Touch-sensitive wireless device and on screen display for remotely controlling a system

• US 9,105,180 B2
• Filed: 09/04/2009
• Issued: 08/11/2015
• Est. Priority Date: 09/04/2008
• Status: Active Grant

• Current Assignee: Savant Systems, LLC
• Original Assignee: Savant Systems, LLC
• Inventors: McKinley, David, Perry, Chris
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): Yang, Nan-Ying
• Application Number:
  US12/921,710
• Publication Number:
  US 20110007018A1
• Time in Patent Office: 2,167 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/21 Programming remote control devices via third means
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/92 Universal remote control
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

A touch-sensitive wireless device, such as a wireless telephone or wireless multimedia player, in conjunction with an interactive on screen display, effectively remotely controls a programmable multimedia controller or other system. User gestures, button presses or other touches to or movements of the touch-sensitive wireless device are effectively converted to information that is wirelessly transmitted to the programmable multimedia controller. Once received by the programmable multimedia controller, such information is processed and effectively translated so as to control the operation of the controller.

Claims

1. A multimedia system capable of being remotely controlled by a wireless telephone comprising:

a programmable multimedia controller which includes a general purpose computer and at least one video output module, said programmable multimedia controller coupled to a plurality of devices, including one or more lighting devices, automatic shade or blind devices, heating ventilation and air conditioning (HVAC) devices or security devices;

at least one television coupled to said at least one video output module, responsive to said programmable multimedia controller for showing a plurality of interactive on screen displays, at least one of said interactive on screen displays including a plurality of icons that are each at a respective position within a menu structure and that are movable within said menu structure, and selectable by a user to control one or more programmable services supported by said programmable multimedia controller;

a wireless telephone separate from said at least one television and said programmable multimedia controller, said wireless telephone including an accelerometer and a touch-sensitive display operable by a user to interact with said interactive on screen displays shown on said at least one television; and

a virtual remote server configured to receive information from said wireless telephone indicating said accelerometer of said wireless telephone has generated an output signifying movement of said wireless telephone and to map said movement to a corresponding rotation of said plurality of icons among said positions in said menu structure in said interactive on screen display currently being shown on said at least one television separate from said wireless telephone such that in response to said movement a first icon that was initially at a particular position in said menu structure is no longer disposed at said particular position, and a second icon that was initially not at said particular position is disposed at said particular position, and to receive information from said wireless telephone indicating a user action signifying a selection has been detected by said touch sensitive display of said wireless telephone, and to map said user action signifying a selection to selection of said second icon at said particular position in said menu structure, wherein selection of at least one icon causes said programmable multimedia controller to issue one or more commands to said one or more lighting devices, automatic shade or blind devices, HVAC devices or security devices for controlling a given one of said one or more programmable services.

2. The multimedia system as in claim 1 wherein one or more of said plurality of interactive on screen displays includes one or more icons whose assigned functionality dynamically changes depending upon which one of said one or more programmable services said user is controlling.

3. The multimedia system as in claim 1 wherein one or more of said plurality of interactive on screen displays includes one or more icons whose assigned functionality dynamically changes depending upon a menu level to which said user has navigated.

4. The multimedia system as in claim 1 wherein said wireless telephone is configured to wirelessly transmit said information indicating said accelerometer has generated an output signifying movement and said selection has been detected by said touch sensitive display to said programmable multimedia controller.

5. The multimedia system as in claim 1 wherein said touch-sensitive display is configured to display one or more buttons each of which enables said user to gain access to a predetermined one of said programmable services.

6. A multimedia system capable of being remotely controlled by a wireless multimedia player comprising:

a programmable multimedia controller including a general purpose computer and at least one video output module, said programmable multimedia controller coupled to a plurality of devices, including one or more lighting devices, automatic shade or blind devices, heating ventilation and air conditioning (HVAC) devices or security devices;

at least one television coupled to said at least one video output module, responsive to said programmable multimedia controller for showing a plurality of interactive on screen displays, at least one of said interactive on screen displays including a plurality of icons that are each at a respective position within a menu structure and that are movable within said menu structure and selectable by a user to control one or more programmable services supported by said programmable multimedia controller;

a wireless multimedia player separate from said at least one television and said programmable multimedia controller, said wireless multimedia player including an accelerometer and a touch-sensitive display operable by a user to interact with said interactive on screen displays shown on said at least one television; and

a virtual remote server configured to receive information from said wireless multimedia player indicating said accelerometer of said wireless multimedia player has generated an output signifying movement of said wireless multimedia player and to map said movement to a corresponding rotation of said plurality of icons among said positions in said menu structure in said interactive on screen display currently being shown on said at least one television separate from said wireless multimedia player, and to receive information from said wireless multimedia player indicating a user action signifying a selection has been detected by said touch sensitive display of said wireless multimedia player, and to map said user action signifying a selection to selection of an icon at a particular position in said interactive on screen display, wherein selection of said icon at said particular position causes said programmable multimedia controller to issue one or more commands to said one or more lighting devices, automatic shade or blind devices, HVAC devices or security devices for controlling a given one of said one or more programmable services.

7. The multimedia system as in claim 6 wherein one or more of said plurality of interactive on screen displays includes one or more icons whose assigned functionality dynamically changes depending upon which one of said one or more programmable services said user is controlling.

8. The multimedia system as in claim 6 wherein one or more of said plurality of interactive on screen displays includes one or more icons whose assigned functionality dynamically changes depending upon a menu level to which said user has navigated.

9. The multimedia system as in claim 6 wherein said wireless multimedia player is configured to, wirelessly transmit said information indicating said accelerometer has generated an output signifying movement and said selection has been detected by said touch sensitive display to said programmable multimedia controller.

10. The multimedia system as in claim 6 wherein said touch-sensitive display is configured to display one or more buttons each of which enables said user to gain access to a predetermined one of said programmable services.

11. A method for remotely controlling a multimedia system using a wireless device comprising the steps of:

coupling at least one television to a programmable multimedia controller which controls audio/video (A/V) devices and at least lighting devices, automatic shade or blind devices, heating ventilation and air conditioning (HVAC) devices or security devices, to provide a plurality of programmable services;

registering the wireless device separate from said at least one television and said programmable multimedia controller with a server associated with the programmable multimedia controller;

showing a plurality of interactive on screen displays on said at least one television, at least one of said interactive on screen displays including a plurality of icons that are each at a respective position within a menu structure and that are rotatable among said positions within said menu structure, and that are selectable by a user, at least one icon selectable to control one or more of said lighting devices, automatic shade or blind devices, HVAC devices or security devices to provide to provide a programmable service;

detecting movement of said wireless device and a user action signifying a selection on said wireless device, said wireless device configured to communicate with said programmable multimedia controller and including an accelerometer for detecting said movement and a touch-sensitive display for detecting said selection, said wireless device being a wireless telephone or a wireless multimedia player;

receiving information at said programmable multimedia controller from said wireless device indicating said movement and said selection; and

mapping, by said programmable multimedia controller, said movement to a corresponding rotation of said plurality of icons among said positions in said menu structure an interactive on screen display currently being shown on said at least one television separate from said wireless device, such that in response to said movement a first icon that was initially at a center position is no longer disposed at said center position in said menu structure, and a second icon that was initially not at said center position is disposed at said center position in said menu structure, and mapping said selection to selection of an icon at said particular position in said menu structure.

12. The method as in claim 11 wherein one or more of said plurality of interactive on screen displays includes one or more icons whose assigned functionality dynamically changes depending upon which one of said plurality of programmable services said user is controlling.

13. The method as in claim 11 wherein one or more of said plurality of interactive on screen displays includes one or more icons whose assigned functionality dynamically changes depending upon a menu level to which said user has navigated.

14. The method as in claim 11 wherein said wireless device wirelessly transmits said information indicating said accelerometer has generated an output signifying movement and said selection has been detected by said touch sensitive display to said programmable multimedia controller.

15. The method as in claim 11 wherein said touch-sensitive display displays one or more buttons each of which enables said user to gain access to a predetermined one of said programmable services.

16. The method as in claim 11 wherein said wireless device is a wireless telephone.

17. The method as in claim 11 wherein said wireless device is a wireless multimedia player.

18. The method as in claim 14, wherein said programmable multimedia controller receives a command indication message and recognizes it as a control command or request and responds by issuing a send command message.

19. The method as in claim 18 further comprising:

upon receiving an interactive command at said wireless device, issuing a command request to the programmable multimedia controller, which in turn replies with a command confirmation returning data to the wireless device.

20. The method as in claim 14 wherein said information indicating said selection has been detected by said touch sensitive display describes that the user has pressed a button or made a gesture on said touch sensitive display.

21. A method for remotely controlling a multimedia system using a wireless telephone comprising the steps of:

registering said wireless telephone with a server associated with the programmable multimedia controller of said multimedia system, said programmable multimedia controller configured to control audio/video (A/V) devices and at least lighting devices, automatic shade or blind devices, heating ventilation and air conditioning (HVAC) devices or security devices of said multimedia system;

showing an interactive on screen display on a television coupled to said programmable multimedia controller, said interactive on screen display including a plurality of icons that are each at a respective position within a menu structure and that are movable among the positions within said menu structure, and are selectable by a user;

detecting a movement of a wireless telephone separate from said at least one television and said programmable multimedia controller, said movement detected by an accelerometer of said wireless telephone;

mapping said movement to a corresponding movement of said plurality of icons among positions in said interactive on screen display shown on said television, such that in response to said movement a first icon that was initially at a center position is no longer disposed at said center position in said menu structure, and a second icon that was initially not at said center position is disposed at said center position in said menu structure;

detecting a user action signifying a selection on a touch sensitive display of said wireless telephone; and

mapping said user action signifying a selection on said touch sensitive display of said wireless telephone to selection of said second icon at said center position in said menu structure, wherein selection of said second icon causes said programmable multimedia controller to issue one or more commands for controlling one or more of said lighting devices, automatic shade or blind devices, HVAC devices or security devices of said multimedia system.

22. The method of claim 21, further comprising:

receiving information from said wireless telephone indicating said movement detected by said accelerometer of said wireless telephone at said programmable multimedia controller by way of a WIFI network; and

receiving information from said wireless telephone indicating said user action signifying said selection on said touch sensitive display of said wireless telephone at said programmable multimedia controller by way of said WIFI network.