Apparatus for remotely controlling another apparatus and having self-orientating capability

• US 8,823,645 B2
• Filed: 12/28/2010
• Issued: 09/02/2014
• Est. Priority Date: 12/28/2010
• Status: Active Grant

• Current Assignee: Sovereign Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Syed, Zia, Rigazio, Luca, Yun, Tiffany, Kryze, David
• Primary Examiner(s): SPAR, ILANA L
• Application Number:
  US12/979,790
• Publication Number:
  US 20120162073A1
• Time in Patent Office: 1,344 Days
• Field of Search: 345156-184, 178 1801- 2004
• US Class Current: 345/158
• CPC Class Codes: G06F 1/266 Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
• CPC Class Codes: G06F 1/3259 Power saving in cursor control device, e.g. mouse, joystick, trackball
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: H02J 7/342 The other DC source being a battery actively interacting with the first one, i.e. battery to battery charging with circuits for polarity protection H02J7/0034
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A remote control apparatus for communicating with a target device includes: a sensing portion for sensing points of user contact with the apparatus, user gestures, and an acceleration value of the apparatus; a transmitting device for sending signals representative of user commands to the target device; a controller; and a memory including instructions for configuring the controller to perform a self-orientation process based upon at least one of the acceleration value and the points of user contact to determine a forward direction of a plane of operation for defining the user gestures. An axis of the determined plane of operation substantially intersects the apparatus at any angle.

Claims

1. An apparatus for communicating with a target device comprising:

a sensing portion for sensing points of user contact with the apparatus, user gestures, and an acceleration value of the apparatus;

a transmitting device for sending signals representative of user commands to the target device;

a controller;

a memory including instructions for configuring the controller to;

perform a self-orientation process based upon at least one of the acceleration value and the points of user contact to determine a forward direction of a plane of operation for defining the user gestures, wherein an axis of the determined plane of operation can substantially intersect the apparatus at all angles;

determine if the user gesture is an absolute-type gesture or a relative-type gesture;

determine a direction of the absolute-type gesture; and

interpret the absolute-type gesture and relative-type gesture as user commands,

wherein the relative-type gesture includes rotation of the apparatus.

2. The apparatus of claim 1, further comprising:

a casing including a top portion, a wall portion and a bottom portion, the casing permitting signals to be transmitted substantially along the axis of the plane of operation,

wherein the plane of operation is on one of the top portion, the wall portion and the bottom portion.

3. The apparatus of claim 2, further comprising:

a magnetic portion disposed on at least a portion of one of the wall portion, the top portion and the bottom portion of the casing to permit the apparatus to be attached with another magnetic surface.

4. The apparatus of claim 2, wherein:

the sensing portion includes a touch sensor layer disposed on a portion of at least one of the wall portion, the top portion and the bottom portion for receiving the user gestures; and

the controller is further configured to interpret the user gestures and generate the signals representative of the user commands based upon the interpreted user gestures.

5. The apparatus of claim 4, wherein:

the touch sensor layer has a flexible surface with a selectively variable shape;

the sensing portion includes an actuation sensing component for sensing actuation activity associated with the shape in the touch sensor layer; and

the flexible surface and actuation sensing component interact to provide both input and output to a user of the apparatus.

6. The apparatus of claim 1, wherein the sensing portion includes a touch sensor layer disposed on a portion of at least one of the wall portion, the top portion and the bottom portion for receiving the user gestures.

7. The apparatus of claim 1, further comprising:

elevation units that adjust a physical shape of an input and output surface area,

wherein the controller is further configured to adjusts particular ones of the elevation units.

8. The apparatus of claim 1, further comprising:

a power management unit;

an antenna portion coupled to the power management unit, the antenna portion configured to receive power from a base device.

9. The apparatus of claim 8, wherein the power management unit is configured to recharge a rechargeable power source utilizing the received power.

10. The apparatus of claim 8, wherein the antenna portion includes a radio frequency antenna for receiving the power by radio frequency communication.

11. The apparatus of claim 8, wherein the antenna portion includes a coil antenna or a capacitive plate antenna for receiving the power by magnetic coupling or capacitive coupling.

12. The apparatus of claim 1, wherein:

the sensing portion senses if the apparatus is within a predetermined distance of a base device or the target device; and

the controller is further configured to generate a signal representative of an identification of the apparatus to be transmitted by the transmitting device to the base device or the target device when the apparatus is within the predetermined distance.

13. The apparatus of claim 1, wherein:

the sensing portion is further for sensing if the apparatus is within a predetermined distance of a base device or the target device;

the transmitting device includes an antenna portion; and

the controller is further configured to control the transmitting device to transmit to the base device or the target device a signal including characteristics particular to the antenna portion as an identification of the apparatus when the apparatus is within the predetermined distance.

14. The apparatus of claim 1, further comprising:

a receiving device for receiving a request to associate the apparatus with a base device or the target device,

wherein the controller is further configured to generate a signal representative of an identification of the apparatus to be transmitted by the transmitting device to the base device or the target device when the apparatus receives the request.

15. The apparatus of claim 1, further comprising:

a user input portion for receiving a request to associate the apparatus with a base device or the target device;

wherein the controller is further configured to generate a signal representative of an identification of the apparatus to be transmitted by the transmitting device to the base device or the target device when the apparatus receives the request.

16. The apparatus of claim 1, wherein:

the sensing portion senses motion characteristics associated with a user of the apparatus; and

the controller is further configured to generate a signal representative of the motion characteristics to be transmitted by the transmitting device to a base device or the target device.

17. The apparatus of claim 16,

wherein the sensed motion characteristics include data represented in the time domain,

the controller is further configured to shift the data represented in the time domain to be data represented in the frequency domain, and to extract low-dimensional data with high discriminating properties from the data represented in the frequency domain to generate the signal representative of the motions characteristics.

18. The apparatus of claim 16, wherein the sensed motion characteristics include one of a user tremor pattern and a user movement range.

19. The apparatus of claim 16, further comprising:

a receiving device for receiving a request for sensor information related to the user from a base device;

wherein the controller is further configured to generate the signal representative of the motion characteristics upon receiving the request.

20. The apparatus of claim 1, wherein the controller is further configured to store in the memory a gesture motion history while the apparatus is within a predetermined distance of the target device, and to generate a signal representative of the gesture motion history to be transmitted by the transmitting device to a base device or the target device, wherein the predetermined distance is a range in which the target device can receive the user commands from the apparatus.

21. The apparatus of claim 1, wherein the controller is further configured to generate a signal representative of the points of user contact to be transmitted by the transmitting device to a base device.

22. The apparatus of claim 1, further comprising:

a receiving device for receiving a user feedback request from another device;

a user feedback device for providing user feedback,

wherein the controller is further configured to control the user feedback device to provide the user feedback when the receiving device receives the user feedback request.

23. An apparatus comprising:

a sensing portion for sensing points of user contact with the apparatus and an acceleration value of the apparatus;

a controller; and

a memory including instructions for configuring the controller to;

classify the points of user contact into a holding pattern;

perform a self-orientation process based upon the acceleration value and the holding pattern to define a forward direction of user gestures, wherein the forward direction can be fixed along any angle with the apparatus;

determine if the user gesture is an absolute-type gesture or a relative-type gesture, wherein the relative-type gesture includes rotation of the apparatus.

24. The apparatus of claim 23, wherein:

the sensing portion includes a touch sensor layer disposed on a portion of at least one of the wall portion, the top portion and the bottom portion for detecting the user gestures;

the controller is further configured to;

determine a direction of the absolute-type gesture; and

interpret the absolute-type gesture and relative-type gesture to generate signals representative of the user commands; and

the apparatus further includes a transmitting device for sending the signals representative of user commands to a target device.

25. The apparatus of claim 24, wherein:

wherein the touch sensor layer has a flexible surface with a selectively variable shape;

wherein the sensing portion includes an actuation sensing component for sensing actuation activity associated with the shape in the touch sensor layer; and

wherein the flexible surface and actuation sensing component interact to provide both input and output to a user of the apparatus.

26. The apparatus of claim 23, further comprising:

a flexible surface with a selectively variable shape; and

an actuation sensing component for sensing actuation activity associated with the shape in the surface;

wherein the flexible surface and actuation sensing component interact to provide both input and output to a user of the apparatus.

27. The apparatus of claim 23, further comprising:

a power management unit;

an antenna portion coupled to the power management unit, the antenna portion configured to receive power from a base device.

28. The apparatus of claim 27, wherein the power management unit is configured to recharge a rechargeable power source utilizing the received power.

29. The apparatus of claim 23, wherein:

the sensing portion senses if the apparatus is within a predetermined distance of a base device; and

the controller is further configured to generate a signal representative of an identification of the apparatus to be transmitted by the transmitting device to the base device when the apparatus is within the predetermined distance.

30. The apparatus of claim 23, further comprising:

a receiving device for receiving a request to associate the apparatus with a base device;

wherein the controller is further configured to generate a signal representative of an identification of the apparatus to be transmitted by the transmitting device to the base device when the apparatus receives the request.

31. The apparatus of claim 23, wherein:

the controller is further configured to generate a signal representative of characteristics associated with a user of the apparatus to be transmitted by the transmitting device to a base device,

the sensed characteristics include one of a user tremor pattern, a user movement range, a gesture motion history and the points of user contact.

32. The apparatus of claim 23, further comprising:

a receiving device for receiving a user feedback request from another device;

a user feedback device for providing user feedback,

wherein the controller is further configured to control the user feedback device to provide the user feedback when the receiving device receives the user feedback request.

33. An apparatus comprising:

an accelerometer for determining an acceleration value associated with the apparatus;

a gyroscope for measuring angular rotation associated with the apparatus to provide an orientation value;

a touch sensor for sensing points of user contact with the apparatus;

a classification device for classifying the points of user contact into a holding pattern; and

a self-orientation determination device for determining a plane of operation defining user gestures based upon the acceleration value, orientation value and the holding pattern, wherein the plane of operation can be rotatable at all angles of the apparatus, and is on one of a wall portion, a top portion and a bottom portion of the apparatus.

34. The apparatus of claim 33, wherein the touch sensor is disposed on a portion of at least one of the wall portion, the top portion and the bottom portion of the apparatus for detecting the user gestures, the user gestures are performed on the touch sensor, and the apparatus further includes:

a gesture type determining device for determining if the user gesture is an absolute-type gesture or a relative-type gesture;

a gesture direction determination device for determining a direction of the absolute-type gesture; and

a gesture interpretation device for interpreting the absolute-type gesture and relative-type gesture as user commands,

wherein the relative-type gesture includes rotation of the apparatus.

35. The apparatus of claim 34, further comprising:

a magnetic portion disposed on a portion of one of the wall portion, top portion and bottom portion to permit the apparatus to be attached with another magnetic surface.

36. The apparatus of claim 34, further comprising a transmitting device for sending signals representative of the user commands to a target device.

37. The apparatus of claim 33, wherein:

the touch sensor layer has a flexible surface with a selectively variable shape;

the sensing portion includes an actuation sensing component for sensing actuation activity associated with the shape in the touch sensor layer; and

the flexible surface and actuation sensing component interact to provide both input and output to a user of the apparatus.

38. The apparatus of claim 33, further comprising:

a flexible surface with a selectively variable shape; and

an actuation sensing component for sensing actuation activity associated with the shape in the surface;

wherein the flexible surface and actuation sensing component interact to provide both input and output to a user of the system.

39. The apparatus of claim 33, further comprising:

a power management unit;

an antenna portion coupled to the power management unit, the antenna portion configured to receive power from a base device.

40. The apparatus of claim 39, wherein the power management unit is configured to recharge a rechargeable power source utilizing the received power.

41. The apparatus of claim 33, further comprising:

a sensing portion for sensing if the apparatus is within a predetermined distance of a base device;

a controller configured to generate a signal representative of an identification of the apparatus; and

a transmitting device for transmitting the signal representative of the identification of the apparatus to the base device when the apparatus is within the predetermined distance.

42. The apparatus of claim 33, further comprising:

a receiving device for receiving a request to associate the apparatus with a base device;

a controller configured to generate a signal representative of an identification of the apparatus; and

a transmitter for transmitting the signal representative of the identification to the base device in response to the request.

43. The apparatus of claim 33, further comprising:

a controller configured to generate a signal representative of characteristics associated with a user of the apparatus; and

a transmitter for transmitting the signal representative of the characteristics to a base device,

wherein the sensed characteristics include one of a user tremor pattern, a user movement range, a gesture motion history and the points of user contact.

44. The apparatus of claim 33, further comprising:

a receiving device for receiving a user feedback request from another device;

a user feedback device for providing user feedback in response to the user feedback request.

45. A system comprising a remote control device for remotely controlling a target device, wherein:

the target device comprises;

an interface for receiving signals representative of user commands wirelessly from the remote control device; and

a controller for executing instructions based upon the user commands;

the remote control device comprises;

a sensing portion for sensing points of user contact with the apparatus, user gestures, and an acceleration value of the remote control device;

a transmitting device for sending the signals representative of the user commands to the target device;

a controller;

a memory including instructions for configuring the controller to;

classify the points of user contact into a holding pattern; and

perform a self-orientation process based upon at least one of the acceleration value and the holding pattern to determine a forward direction of a plane of operation for defining the user gestures, and to interpret the user gestures as the user commands;

wherein an axis of the determined plane of operation can substantially intersect the remote control device at all angles,

wherein the controller of the remote control device is further configured to;

determine if the user gesture is an absolute-type gesture or a relative-type gesture;

determine a direction of the absolute-type gesture; and

interpret the absolute-type gesture and relative-type gesture as the user commands, wherein the relative-type gesture includes rotation of the remote control device.

46. The system of claim 45, wherein the plane of operation is on one of the top portion, the wall portion and the bottom portion of a casing of the remote control device, the user gestures are performed on the one of the top portion, the wall portion and the bottom portion.

47. The system of claim 45, further comprising:

a base device;

wherein the remote control device further comprises;

a power management unit; and

an antenna portion coupled to the power management unit, the antenna portion configured to receive power from the base device.

48. The system of claim 45, further comprising:

a base device;

wherein the sensing portion of the remote control device senses if the remote control device is within a predetermined distance of the base device;

the controller is configured to generate a signal representative of an identification of the remote control device; and

the transmitting device transmits the signal representative of the identification to the base device when the remote control device is within the predetermined distance.

49. The system of claim 45, further comprising a base device:

wherein the remote control device further includes a receiving device for receiving a request to associate the remote control device with the base device;

the controller is configured to generate a signal representative of an identification of the remote control device; and

the transmitting device transmits the signal representative of the identification to the base device in response to the request.

50. A method of remotely communicating user commands from a first apparatus to a target apparatus based upon user gestures input at the first apparatus, the method comprising:

sensing points of user contact with the first apparatus and an acceleration value of the first apparatus;

classify the points of user contact into a holding pattern;

determining a forward direction of a plane of operation based upon at least one of the acceleration value and the holding pattern, wherein the plane of operation defines an input space for the user gestures and the plane of operation can substantially intersect the first apparatus at all angles;

interpreting the user gestures into the user commands; and

transmitting signals representative of the user commands to the target apparatus,

wherein the interpreting the user gestures into the user commands further comprises;

determining if the user gesture is an absolute-type gesture or a relative-type gesture including rotation of the first apparatus;

determining a direction of the absolute-type gesture; and

interpreting the absolute-type gesture and relative-type gesture as the user commands.

51. The method of claim 50, further comprising:

determining if the first apparatus is within a predetermined distance of a base device;

generating a signal representative of an identification of the first apparatus; and

transmitting the signal representative of the identification to the base device when the first apparatus is within the predetermined distance.

52. The method of claim 50, further comprising:

receiving a user feedback request from the target device; and

providing user feedback upon receiving the user feedback request.

53. The method of claim 50, further comprising:

determining motion characteristics associated with a user of the first apparatus; and

generating a signal representative of the motion characteristics; and

transmitting the signal to the target apparatus.

54. The method of claim 53, wherein the determined motion characteristics include one of a user tremor pattern and a user movement range.

55. The method of claim 53, further comprising:

receiving a request for sensor information related to the user; and

generating the signal representative of the motion characteristics upon receiving the request.