Touchpad-enabled remote controller and user interaction methods

• US 7,889,175 B2
• Filed: 10/24/2007
• Issued: 02/15/2011
• Est. Priority Date: 06/28/2007
• Status: Expired due to Fees

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Yamauchi, Masaki, Rigazio, Luca, Kryze, David, Morin, Philippe
• Primary Examiner(s): Sherman; Stephen G
• Application Number:
  US11/977,348
• Publication Number:
  US 20090002217A1
• Time in Patent Office: 1,210 Days
• Field of Search: 345/156, 345/158, 345/168, 345/169, 345/173
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device

Abstract

The handheld case of the remote control unit includes at least one touchpad, and other sensors, such as acceleration sensors, case perimeter sensors, pressure sensors, RF signal sensors. These sensors provide a rich array of sensory inputs that are classified by a pattern recognizer to generate control commands for both the consumer electronic equipment and the remote control unit itself. A power management system to conserve unit battery power is also responsive to the pattern recognizer to allow intelligent power management control. The control system uses the display of the consumer electronic equipment to provide instructions to the user, and the behavior of the remote control system uses what is displayed on the display as context information for pattern recognition.

Claims

1. A remote control system for consumer electronic equipment having a display screen, comprising:

a control circuit coupled to said consumer electronic equipment for controlling operation thereof;

a remote control unit having a handheld case and plurality of sensors disposed within said case, including;

(a) at least one touchpad responsive to manipulation by a user'"'"'s fingers;

(b) at least acceleration sensor responsive to movement of the remote control unit;

(c) a case perimeter sensor that discriminates which parts of the case are in contact with the user'"'"'s body;

(d) at least one pressure sensor responsive to pressing forces upon a predetermined region of the touchpad; and

(e) an RF signal sensor responsive to radio frequency signals transmitted from said control circuit;

said remote control unit being configured to produce a sensory input message containing information extracted from said plurality of sensors;

a pattern recognizer receptive of said sensory input message;

said pattern recognizer including a trained model adaptable through interaction with the user and configured to classify the received sensory input message according to a predetermined recognition scheme to generate message meaning data;

said pattern recognizer being further configured to classify the received sensory input message based on context information extracted from knowledge of what is being displayed on the display screen of the electronic equipment;

control logic responsive to said message meaning data to generate at least one command that is communicated to said control circuit;

wherein said remote control unit includes power management system and wherein said control logic generates at least one command that is communicated to said power management system to alter power management system behavior based on said message meaning data; and

wherein said control circuit having memory for storing control system operation information and wherein said control circuit selectively provides said operation information to the consumer electronic equipment for presentation to the user wherein said control circuit selectively provides said operation information to the consumer electronic equipment in accordance with the message meaning data generated by said pattern recognizer;

wherein said power management system performs;

placing of said plurality of sensors included in said remote control unit, into a sleep mode;

detecting movement of said remote control unit by waking said acceleration sensor up in the sleep mode;

determining whether or not said remote control unit is held by the user, by waking said case perimeter sensor up when the movement of said remote control unit is detected; and

releasing the sleep mode when the detecting detects that said remote control unit is held by the user.

2. The remote control system of claim 1,

wherein said power management system releases the sleep mode, by waking said at least one touchpad up and then waking said RF signal sensor up, when the detecting detects that said remote control unit is held by the user.

3. A remote control system for consumer electronic equipment having a display screen, comprising:

a control circuit coupled to said consumer electronic equipment for controlling operation thereof;

a remote control unit having a handheld case and plurality of sensors disposed within said case, including;

(a) at least one touchpad responsive to manipulation by a user'"'"'s fingers; and

(b) at least one additional sensor selected from the group consisting of;

(1) acceleration sensors responsive to movement of the remote control unit;

(2) case perimeter sensors that discriminates which parts of the case are in contact with the user'"'"'s body;

(3) pressure sensors responsive to pressing forces upon a predetermined region of the touchpad; and

(4) RF signal sensors responsive to radio frequency signals transmitted from said control circuit;

said remote control unit being configured to produce a sensory input message containing information extracted from said plurality of sensors;

a pattern recognizer receptive of said sensory input message;

said pattern recognizer being configured to classify the received sensory input message according to a predetermined recognition scheme to generate message meaning data;

said pattern recognizer being further configured to classify the received sensory input message based on context information extracted from knowledge of what is being displayed on the display screen of the electronic equipment;

control logic responsive to said message meaning data to generate at least one command that is communicated to said control circuit;

wherein said touchpad is divided into plural separate regions of interaction, such that each region of interaction is interpreted to have a different meaning by said pattern recognizer;

wherein said at least one additional sensor comprises a case orientation sensor capable of differentiating between portrait orientation and landscape orientation; and

wherein said regions of interaction are remapped onto different locations within the touchpad based on case orientation;

wherein said at least one additional sensor further comprises the at least one acceleration sensor and at least one of the case perimeter sensors,

said pattern recognizer redefines a zone of interaction, by interpreting how the user is holding said remote control unit based on information extracted from said at least one additional sensor.

4. The remote control system of claim 3,

wherein said pattern recognizer interprets whether the user is holding said remote control unit with one hand or with two hands.