Electronic Device with Touchless User Interface

• US 20150205358A1
• Filed: 01/20/2014
• Published: 07/23/2015
• Est. Priority Date: 01/20/2014
• Status: Abandoned Application

• Current Assignee: William James Lyren
• Original Assignee: William James Lyren
• Inventors: Lyren, Philip Scott
• Application Number:
  US14/158,866
• Publication Number:
  US 20150205358A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An electronic device determines a tap from a finger of a user toward a surface of an electronic device while the surface is face-down and not visible to the user. A touchless user interface activates clicks on objects displayed with the electronic device.

Claims

1. A non-transitory computer readable storage medium storing instructions that cause a handheld portable electronic device (HPED) to execute a method, comprising:

display a cursor and an object on a display that is located on a first side of a body of the HPED;

sense repetitive circular movements of a finger of a user holding the HPED while the finger is hidden under the body and not visible to the user and is located next to but not touching a second side of the HPED that is opposite to the first side when the first side is visible to the user and the second side is not visible to the user; and

move the cursor along the display in response to the repetitive circular movements of the finger next to but not touching the second side when the first side is visible to the user and the second side is not visible to the user.

2. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

provide a three dimensional zone that extends outwardly from a surface of the HPED such that an area inside of the zone provides a touchless user interface to communicate with the HPED;

increase an intensity of color of the zone when the finger of the user physically enters the zone to communicate with the HPED via a touchless user interface;

decrease the intensity of the color of the zone when the finger of the user physically leaves the zone.

3. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

sense a tap from the finger at a first location on the second side when the first side is visible to the user and the second side is not visible to the user;

sense a drag of the finger from the first location on the second side to a second location on the second side when the first side is visible to the user and the second side is not visible to the user;

sense removal of the finger at the second location when the first side is visible to the user and the second side is not visible to the user;

activate a click of the cursor on the display on the first side at a location that is oppositely disposed the second location on the second side in response to sensing removal of the finger at the second location.

4. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

sense a hand of the user gripping the HPED with fingers at locations along a perimeter of the body;

save on and off activation of a touchless user interface that controls the cursor at the locations where the fingers touch along the perimeter of the body;

activate the touchless user interface in response to sensing the fingers of the user at the locations along the perimeter of the body.

5. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

sense a thumb above the display and an index finger below the display such that the index finger is directly below the thumb with the cursor appearing on the display between the thumb and the index finger such that a line perpendicular to the display extends through the thumb, the cursor, and the index finger;

move the cursor along the display in response to sensing simultaneous movements of the thumb and the index finger such that the cursor remains between the thumb and the index finger along the line that extends through the thumb, the cursor, and the index finger.

6. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

sense the finger drawing a shape through space adjacent to the second side without the finger touching the second side when the first side is visible to the user and the second side is not visible to the user;

determine a software application that is associated with the shape drawn through the space;

open the software application in response to sensing the finger drawing the shape through the space adjacent to the second side and without touching the second side when the first side is visible to the user and the second side is not visible to the user, wherein the user decides what configuration to draw through space as the shape.

7. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

sense the finger moving through space adjacent to the second side and without touching the second side when the first side is visible to the user and the second side and the finger are not visible to the user;

execute a drag and drop operation on the object in response to the finger moving through the space adjacent to the second side and without touching the second side when the first side is visible to the user and the second side and the finger are not visible to the user.

8. The non-transitory computer readable storage medium storing instructions of claim 1 further to cause the handheld portable electronic device to execute the method comprising:

activate the display on the first side and deactivate a second display on the second side in response to sensing that the first side is face-up and visible to the user and the second side is face-down and not visible to the user;

sense a flipping of the HPED such that the second side is face-up and visible to the user and first side is face-down and not visible to the user;

activate the second display on the second side and deactivate the display on the first side in response to sensing the flipping of the HPED such that the second side is face-up and visible to the user and first side is face-down and not visible to the user.

9. A handheld portable electronic device (HPED), comprising:

a body that has a rectangular shape with a first side and a second side oppositely disposed from the first side;

a sensor that senses a finger of a user with respect to a location on the second side when the finger is proximate to but not touching the location on the second side and that senses movement of the finger towards the location on the second side while the first side is face-up and visible to the user and the second side is face-down and not visible to the user;

a display that is located on the first side, that displays an object, and that displays a cursor at a location that is oppositely disposed from and directly over the location of the finger on the second side while the finger is proximate to but not touching the location on the second side; and

a processor that communicates with the sensor and with the display and that activates, in response to the sensor sensing movement of the finger toward the location on the second side, a click on the object on the display such that the click activates on the object without the finger touching the second side while the first side and display are face-up and visible to a user and the second side is face-down and not visible to the user.

10. The handheld portable electronic device of claim 9 further comprising:

a touchless user interface that extends outwardly from the first side to form a three dimensional zone with a cubic shape that receives gestures from the finger to instruct the HPED, wherein the display displays an image of the three dimensional zone and a location of the finger in the image of the three dimensional zone when the finger is physically located in the three dimensional zone that extends outwardly from the first side.

11. The handheld portable electronic device of claim 9, wherein the sensor senses movement of the finger along a distance that is parallel to the second side while the finger is proximate to but not touching the second side and while the first side and display are face-up and visible to a user and the second side is face-down and not visible to the user, and wherein the processor communicates with the display to move the cursor on the display along a distance that is equal to the distance that the finger moved parallel to the second side while the first side and display are face-up and visible to a user and the second side is face-down and not visible to the user.

12. The handheld portable electronic device of claim 9 further comprising:

a second sensor that senses the finger of the user with respect to the first side when the finger is proximate to but not touching a location on the first side and that senses movement of the finger towards the location on the first side while the second side is face-up and visible to the user and the first side is face-down and not visible to the user;

a second display that is located on the second side, that displays the object, and that displays the cursor at a location that is oppositely disposed from and directly over the location of the finger on the first side while the finger is proximate to but not touching the location on the first side; and

wherein the processor communicates with the second sensor and with the second display and that activates, in response to the second sensor sensing movement of the finger toward the location on the first side, a second click on the object on the second display such that the second click activates on the object without the finger touching the first side while the second side and the second display are face-up and visible to a user and the first side and the display are face-down and not visible to the user.

13. The handheld portable electronic device of claim 9 further comprising:

a second display that is located on the second side;

wherein the display on the first side activates to display a configuration of icons and the second display on the second side de-activates to black screen while the first side and the display are face-up and visible to the user and the second side and the second display are face-down and not visible to the user; and

wherein the second display on the second side activates to display the configuration of icons and the display on the first side de-activates to black screen after the HPED is flipped such that the second side and the second display are face-up and visible to the user and the first side and the display are face-down and not visible to the user.

14. The handheld portable electronic device of claim 9 further comprising:

a biometric sensor that examines a fingerprint on the finger in order to authenticate an identity of the user every time the finger moves with respect to the second side to control the cursor on the display when the finger is proximate to but not touching the second side.

15. A method, comprising:

displaying an object on a display located at a first surface of a handheld portable electronic device (HPED);

sensing, by the HPED, a tap from a finger of a user at a first location on a second surface that is oppositely disposed from the first surface while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user;

sensing, by the HPED, drag movement of the finger along the second surface from the first location to a second location that is oppositely disposed from and directly under the object on the display while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user;

sensing, by the HPED, removal of the finger from second surface at the second location upon completion of the drag movement while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user; and

activating, by the HPED, a click on the object on the display in response to sensing removal of the finger from second surface at the second location upon completion of the drag movement.

16. The method of claim 15 further comprising:

sensing repetitive motion of the finger along a looped path in space that begins at a first point above the second surface, proceeds a distance parallel to the second surface to a second point, moves away from the second surface to third point, and moves toward the second surface to loop back to the first point while the finger is proximate to but not touching the second surface and while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user;

moving a cursor on the display a distance that equals the distance between the first point and second point times a number of repetitive motions of the finger along the looped path while the finger is proximate to but not touching the second surface and while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user.

17. The method of claim 15 further comprising:

sensing a first hand of the user with fingers in a predetermined configuration while the first hand is located away from a body of the HPED and not touching the body of the HPED;

activating a touchless user interface in response to sensing the first hand of the user with the fingers in the predetermined configuration while the first hand is located away from the body of the HPED and not touching the body of the HPED;

sensing a second hand of the user moving to instruct the HPED via the touchless user interface while the first hand of the user and the fingers remain in the predetermined configuration while the first hand is located away from the body of the HPED and not touching the body of the HPED;

wherein the touchless user interface remains active while the first hand of the user and the fingers remain in the predetermined configuration while the first hand is located away from the body of the HPED and not touching the body of the HPED.

18. The method of claim 15 further comprising:

sensing movement of the finger along a Z-axis toward the HPED;

initiating a click on an object in response to sensing movement of the finger along the Z-axis toward the HPED;

sensing movement of the finger along the Z-axis away from the HPED;

initiating a release of the click on the object in response to sensing movement of the finger along the Z-axis away from the HPED.

19. The method of claim 15 further comprising:

sensing a hand holding the HPED at a designated location along a perimeter of a body of the HPED;

activating touchless movement and touchless clicking of a cursor on the display in response to sensing the hand holding the HPED at the designated location along the perimeter of the body of the HPED;

sensing removal of the hand holding the HPED at the designated location along the perimeter of the body of the HPED;

de-activating the touchless movement and the touchless clicking of the cursor in response to sensing removal of the hand holding the HPED at the designated location along the perimeter of the body of the HPED.

20. The method of claim 15 further comprising:

sensing movement of the finger along a curved path that is parallel to the second surface while the finger is proximate to but not touching the second surface and while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user;

moving a cursor on the display along a curved path that emulates the curved path of the finger to the second surface while the finger is proximate to but not touching the second surface and while the first surface and display are face-up and visible to the user and the second surface is face-down and not visible to the user.