Portable electronic device having a sensor arrangement for gesture recognition

• US 9,569,002 B2
• Filed: 12/17/2010
• Issued: 02/14/2017
• Est. Priority Date: 12/17/2010
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Walker, David Ryan
• Primary Examiner(s): CHOWDHURY, AFROZA Y
• Application Number:
  US12/971,223
• Publication Number:
  US 20120154288A1
• Time in Patent Office: 2,251 Days
• Field of Search: 345/156, 345/169, 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1628 Carrying enclosures containing additional elements, e.g. case for a laptop and a printer
• CPC Class Codes: G06F 1/1677 for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
• CPC Class Codes: G06F 1/1681 Details related solely to hinges hinge details related to the transmission of signals or power are classified in G06F1/1683
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks

Abstract

The present disclosure provides a portable electronic device having a sensor arrangement for gesture recognition and a method for gesture recognition. In accordance with one example embodiment, the portable electronic device comprises: a processor; a flexible housing including a magnet; a magnetic sensor connected to the processor which monitors a magnetic field generated by the magnet.

Claims

1. A portable electronic device, comprising:

a processor;

a rigid case including a rigid upper body and a rigid lower body;

an elastomeric hinge connecting the rigid upper body and the rigid lower body, wherein the elastomeric hinge permits rotational, stretching, bending and twisting movement of the rigid lower body and the rigid upper body relative to each other;

a plurality of magnets embedded in the elastomeric hinge such that the elastomeric hinge permits movement of the magnet in three dimensions relative to the rigid case in response to deformation of the elastomeric hinge by rotating, stretching, bending and twisting;

a plurality of magnetic sensors carried by the rigid case in the rigid lower body and the rigid upper body and connected to the processor, each magnet sensor being adapted to sense a magnetic field generated by the magnets;

wherein the processor is configured for;

identifying a change in the magnetic field which matches one of the at least one predetermined gesture recognition criterion associated with deformation of the elastomeric hinge, the predetermined gesture recognition criterion including a change in the magnetic field corresponding to movement of the magnet relative to the rigid housing, the movement of the magnet corresponding to a stretch gesture, a bend gesture, a twist gesture or a positional gesture; and

registering an input event in response to the identifying.

2. The portable electronic device of claim 1 wherein the rigid upper body includes a display connected to the processor and the rigid lower body includes a keyboard connected to the processor.

3. The portable electronic device of claim 1 wherein the elastomeric hinge permits rotational movement of the rigid lower body and the rigid upper body relative to each other about the elastomeric hinge within a range between a fully opened position and a fully closed position.

4. The portable electronic device of claim 1 wherein the elastomeric hinge permits stretching movement of the rigid lower body and the rigid upper body relative to each other between at least a fully opened position and an extended position relative to the fully opened position.

5. The portable electronic device of claim 1 wherein the elastomeric hinge permits bending movement of the rigid lower body and the rigid upper body relative to each other between at least a fully opened position and a rotated position relative to the fully opened position.

6. The portable electronic device of claim 1 wherein the plurality of magnets and plurality of magnetic sensors are located in a common plane.

7. The portable electronic device of claim 6 wherein each magnetic sensor is adapted to sense the magnetic field generated by a particular magnet or magnets in the plurality of magnets.

8. The portable electronic device of claim 7 wherein each magnetic sensor is adapted to sense the particular magnet or magnets in the plurality of magnets by appropriate selection of the shape, orientation and/or polarity of the particular magnet or magnets.

9. The portable electronic device of claim 7 wherein each magnetic sensor is a Hall Effect sensor.

10. The portable electronic device of claim 1 wherein the elastomeric skin is formed from one of urethane, neoprene or silicone rubber.

11. A portable electronic device, comprising:

a processor;

a fixed-body rigid case which carries the processor, the rigid case having a front, back, top, bottom and left side and right side;

a display connected to the processor and located in the front of the rigid case;

a keyboard connected to the processor and located in the front of the rigid case;

a removable elastomeric skin which covers the back, top, bottom, left side and right side of the fixed-body rigid case and exposes the front of the rigid case and the display and keyboard located therein, wherein the elastomeric skin is resiliently compressible so that it is locally compresses from a reference state to a compressed state in response to a compressive force, and wherein the elastomeric skin returns from the compressed state to the reference state unaided when the compressive force is removed due to the elasticity of the elastomeric skin;

a plurality of magnets embedded within the elastomeric skin so as to move in response to changes between the reference state and the compressed state caused by squeezing of the elastomeric skin;

a plurality of magnetic sensors carried by the fixed-body rigid case along the left and right sides and connected to the processor, each magnet sensor being adapted to sense the magnetic field generated by one or more magnets in the plurality of magnets;

wherein the processor is configured for;

identifying a change in the magnetic field which matches one of the at least one predetermined gesture recognition criterion associated with deformation of the elastomeric skin, the predetermined gesture recognition criterion including a change in the magnetic field corresponding to a directional movement of the magnet, the directional movement of the magnet corresponding to a squeeze gesture or a positional gesture; and

registering an input event in response to the identifying.

12. The portable electronic device of claim 11 wherein the plurality of magnets and plurality of magnetic sensors are located in a common plane.

13. The portable electronic device of claim 11 wherein the elastomeric skin is formed from one of urethane, neoprene or silicone rubber.

14. The portable electronic device of claim 11 wherein the magnets are of different sizes.

15. The portable electronic device of claim 11 wherein the magnets are of different magnetic strengths.

16. A method for gesture recognition on a portable electronic device, the method comprising:

detecting by a magnetic sensor carried by a rigid case of the portable electronic device a magnetic field of a magnet embedded in an elastomeric hinge connecting the rigid upper body and the rigid lower body, wherein the elastomeric hinge permits rotational, stretching, bending and twisting movement of the rigid lower body and the rigid upper body relative to each other, wherein the elastomeric hinge permits movement of the magnet in three dimensions relative to the rigid case in response to deformation of the elastomeric hinge by rotating, stretching, bending and twisting;

identifying by a processor of the portable electronic device a change in the magnetic field which matches a predetermined gesture recognition criterion associated with deformation of the elastomeric hinge, the predetermined gesture recognition criterion including a change in the magnetic field corresponding to movement of the magnet relative to the rigid housing, the movement of the magnet corresponding to a stretch gesture, a bend gesture, a twist gesture or a positional gesture; and

registering an input event in response to the identifying.

17. The method of claim 16 wherein the identifying comprises:

determining a directional vector representing the change in the magnetic field;

determining whether the determined directional vector matches a predetermined directional vector representing a gesture;

identifying the gesture when the determined directional vector matches the predetermined directional vector.

18. The method of claim 16 wherein the predetermined criterion is the magnetic field exceeding a threshold value.

19. A method for gesture recognition on a portable electronic device, comprising:

detecting by a magnetic sensor carried by a fixed-body rigid case of the portable electronic device a magnetic field of a magnet embedded in a removable elastomeric skin, wherein the rigid case has a front, back, top, bottom and left side and right side, and wherein the removable elastomeric skin covers the back, top, bottom, left side and right side of the fixed-body rigid case and exposes the front of the rigid case and a display and QWERTY keyboard located therein,

wherein the elastomeric skin is resiliently compressible so that it is locally compresses from a reference state to a compressed state in response to a compressive force, and wherein the elastomeric skin returns from the compressed state to the reference state unaided when the compressive force is removed due to the elasticity of the elastomeric skin,

wherein a plurality of magnets are embedded within the elastomeric skin so as to move in response to changes between the reference state and the compressed state caused by squeezing of the elastomeric skin;

identifying by a processor of the portable electronic device;

a change in the magnetic field which matches a predetermined gesture recognition criterion associated with deformation of the elastomeric skin, the predetermined gesture recognition criterion including a change in the magnetic field corresponding to a directional movement of the magnet, the directional movement of the magnet corresponding to a squeeze gesture or a positional gesture; and

registering an input event in response to the identifying.