Combined tap sequence and camera based user interface

• US 8,797,274 B2
• Filed: 11/30/2008
• Issued: 08/05/2014
• Est. Priority Date: 11/30/2008
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Challener, David C., Rutledge, James S., Yang, Jinping
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): MARINELLI, PATRICK
• Application Number:
  US12/325,257
• Publication Number:
  US 20100134421A1
• Time in Patent Office: 2,074 Days
• Field of Search: 345156-184, 345/104
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

The invention includes a method, apparatus, and program storage device for providing a combined tap sequence and camera based user interface. The invention provides, among other features, an apparatus comprising: an accelerometer; a laser light generating module; wherein the laser light generating module provides a plane of laser light over a surface coupled to the accelerometer; at least one camera; at least one processor; and a memory; wherein the memory stores instructions, executable by the at least one processor, enabling the apparatus to ascertain an occurrence of an input event utilizing inputs from the accelerometer and a location of the input event utilizing inputs from the at least one camera.

Claims

1. An apparatus comprising:

an accelerometer;

a laser light generating module;

wherein the laser light generating module provides a plane of laser light over a surface coupled to the accelerometer;

at least one camera;

at least one processor; and

a memory;

wherein the memory stores instructions executable by the at least one processor to;

ascertain an occurrence of an input event utilizing inputs from the accelerometer and a location of the input event utilizing inputs from the at least one camera;

determine a tap sequence of the input event using the accelerometer;

determine the input event has occurred at a predetermined sub-location within the surface using the at least one camera; and

utilize both occurrence of the tap sequence of the input event detected by the accelerometer and the predetermined sub-location detected by the at least one camera to execute a function associated with the tap sequence of the input event at the predetermined sub-location;

wherein the input event is detected as occurring at a location other than a location of a conventional keyboard and a touch pad.

2. The apparatus according to claim 1, wherein the inputs from the at least one camera comprise X, Y coordinates of an interruption of the plane of laser light.

3. The apparatus according to claim 1, wherein the instructions are further executable by the at least one processor to, upon detecting the tap sequence, execute a program application associated with the tap sequence of the input event at the predetermined sub-location.

4. The apparatus according to claim 3, wherein the program application is an Internet browser application.

5. The apparatus according to claim 1, wherein the instructions are further executable by the at least one processor to toggle to a virtual mode upon detecting the tap sequence of the input event at the predetermined sub-location.

6. The apparatus according to claim 5, wherein the the predetermined sub-location of the surface is a palm rest.

7. The apparatus according to claim 1, wherein the instructions further comprise:

instructions for designating a predetermined area of the surface; and

instructions for, responsive to receipt of combined inputs in the predetermined area in the form of tap input as detected by an accelerometer and location input, associated with the tap input and as detected by the at least one camera, switching to a virtual mode in which tap sequence input is accepted to execute functions on the apparatus if provided within the predetermined area of the surface.

8. The apparatus of claim 1, wherein the input event is detected by the camera as occurring within a palm rest.

9. A method comprising:

providing a plane of laser light over a surface coupled to an accelerometer;

ascertaining an occurrence of an input event utilizing inputs from the accelerometer;

ascertaining a location of the input event utilizing inputs from at least one camera;

determining a tap sequence of the input event using the accelerometer;

determining the input event has occurred at a predetermined sub-location within the surface using the at least one camera; and

utilizing both occurrence of the tap sequence of the input event detected by the accelerometer and the predetermined sub-location detected by the at least one camera to execute a function associated with the tap sequence of the input event at the predetermined sub-location;

wherein the input event is detected as occurring at a location other than a location of a conventional keyboard and a touch pad.

10. The method according to claim 9, wherein the inputs from the at least one camera comprise X, Y coordinates of an interruption of the plane of laser light.

11. The method according to claim 10, further comprising:

upon detecting the tap sequence, executing a program application associated with the tap sequence of the input event at the predetermined sub-location.

12. The method according to claim 11, wherein the program application is an Internet browser application.

13. The method according to claim 10, further comprising:

upon detecting the tap sequence of the input event at the predetermined sub-location, toggling to a virtual mode.

14. The method according to claim 13, wherein the predetermined sub-location of the surface is a palm rest.

15. A non-transitory program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to:

provide a plane of laser light over a surface coupled to an accelerometer;

ascertain an occurrence of an input event utilizing inputs from the accelerometer;

ascertain a location of the input event utilizing inputs from at least one camera;

determine a tap sequence of the input event using the accelerometer;

determine the input event has occurred at a predetermined sub-location within the surface using the at least one camera; and

utilizing utilize both occurrence of the tap sequence of the input event detected by the accelerometer and the predetermined sub-location input detected by the at least one camera to execute a function associated with the tap sequence of input event at the predetermined sub-location;

wherein the input event is detected as occurring at a location other than a location of a conventional keyboard and a touch pad.