Light-based proximity detection system and user interface

• US 8,643,628 B1
• Filed: 01/02/2013
• Issued: 02/04/2014
• Est. Priority Date: 10/14/2012
• Status: Active Grant

• Current Assignee: Neonode, Inc.
• Original Assignee: Neonode, Inc.
• Inventors: Eriksson, Thomas, Holmgren, Stefan
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Patel, Premal
• Application Number:
  US13/732,456
• Time in Patent Office: 398 Days
• Field of Search: 345156-179, 715/786
• US Class Current: 345/175
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An electronic device, including a housing, a display mounted in the housing, a plurality of proximity sensors mounted in the housing near the edges of the display and directed outward from the display, for detecting presence of an object outside the display and near the edges of the display, and a processor mounted in the housing and coupled with the display and with the proximity sensors, for operating the device responsive to user activation of elements of a graphical user interface (GUI), the GUI including a displayed portion that is rendered by the processor on the display, and a virtual non-displayed portion that extends beyond the edges of the display, wherein the processor operates the device responsive to user activation of elements of the virtual portion of the GUI, based on the proximity sensors detecting presence of an object in the non-displayed portion of the GUI.

Claims

1. An electronic device, comprising:

a housing;

a display mounted in said housing;

a plurality of proximity sensors mounted in said housing near the edges of said display and directed outward from said display, for detecting presence of an object in an open space outside said display and near the edges of said display; and

a processor mounted in said housing and coupled with said display and with said proximity sensors, for operating the device responsive to user activation of elements of a graphical user interface (GUI), each GUI element being associated with an operation performed by the processor, the GUI comprising a layout of the GUI elements that is larger that said display, each GUI element corresponding to a location within the layout, the layout comprising;

a displayed portion that is rendered by the processor on said display; and

a virtual non-displayed portion in the open space that extends beyond the edges of said display,

wherein said processor pans said layout to move some of said GUI elements into the displayed portion and to move others of said GUI elements into the virtual non-displayed portion, and wherein, responsive to said proximity sensors detecting location of the object in the open space outside of said display, said processor maps a location within the virtual non-displayed portion of said layout to the detected location, and performs the operation associated with the GUI element corresponding to the mapped location.

2. The electronic device of claim 1 wherein said displayed portion of said layout comprises a portion of one of said GUI elements, and the virtual non-displayed portion of said layout comprises the remainder of the GUI element, and wherein said processor performs the operation associated with such GUI element when said processor maps the location of the remainder of the GUI element within said layout to the location of the object in the open space outside of said display that is detected by said proximity sensors.

3. The electronic device of claim 1 wherein said virtual non-displayed portion of said layout comprises an entire GUI element.

4. The electronic device of claim 1 wherein said display comprises a touch screen, and wherein said processor performs the operation associated with one of said GUI elements in said displayed portion of said layout responsive to said touch screen detecting the object touching the location corresponding to such GUI element in said displayed portion of said layout.

5. The electronic device of claim 4 wherein said processor pans said layout responsive to user input from said touch screen.

6. The electronic device of claim 4, wherein said processor performs a specific operation responsive to (i) said proximity sensors detecting presence of the object at a location corresponding to a first GUI element in said virtual non-displayed portion of said layout, and (ii) said touch screen simultaneously detecting a second object touching a second GUI element in said displayed portion of said layout.

7. The electronic device of claim 1 wherein the device comprises a music player, wherein said GUI elements comprise musical elements that are associated with operations that produce different sounds.

8. The electronic device of claim 1, wherein said processor zooms said layout to move some of said GUI elements from the display portion into the virtual non-displayed portion.

9. An electronic device that simulates a racing car game, comprising:

a housing;

a display mounted in said housing;

a plurality of proximity sensors mounted in said housing and directed outward from said housing, for detecting presence of an object in an open space outside said housing and near the edges of said housing; and

a processor mounted in said housing and coupled with said proximity sensors, for operating the device responsive to said proximity sensors detecting a movement of the object, conforming to an arc-shaped gesture partially circumscribing the housing, in the open space, wherein the device simulates a racing car game on said display, wherein the arc-shaped gesture conforms to steering of a virtual steering wheel located on a circle in the open space surrounding said housing, and wherein said processor simulates steering a racing car responsive to the movement of the object.

10. The electronic device of claim 9 wherein the arc-shaped gesture partially circumscribes at least two adjacent edges of said housing.

11. The electronic device of claim 9, wherein, responsive to said proximity sensors detecting three-dimensional movement of the object opposite a first edge of said housing, said processor manipulates an application control rendered on said display in a three-dimensional virtual space mapped to the application.

12. The electronic device of claim 9, wherein said processor simulates the steering responsive to said proximity sensors detecting two concurrent ones of the movement, conforming to steering of the virtual steering wheel with two hands.

13. An electronic device that simulates a shooting game, comprising:

a housing;

a display mounted in said housing;

a plurality of proximity sensors mounted in said housing and directed outward from said housing, for detecting presence of an object in an open space outside said housing and near the edges of said housing; and

a processor mounted in said housing and coupled with said proximity sensors, for operating the device responsive to said proximity sensors detecting a movement of the object, conforming to an arc-shaped gesture partially circumscribing the housing, in the open space, wherein, responsive to said proximity sensors detecting three-dimensional movement of the object opposite a first edge of said housing, said processor manipulates a weapon rendered on said display in a three-dimensional virtual space mapped to the shooting game.

14. The electronic device of claim 13, wherein, responsive to said proximity sensors detecting three-dimensional movement of the object opposite a second edge of said housing, different than the first edge, said processor moves a shooting avatar within the three-dimensional virtual space.

15. The electronic device of claim 14, wherein different locations opposite a third edge of said housing, different than the first and second edges, correspond to different weapons, and wherein, responsive to said proximity sensors detecting the object at a location opposite the third edge, said processor maps a weapon to the detected location, and replaces the current weapon with the mapped weapon.

16. A music player, comprising:

a housing;

a display comprising a touch screen mounted in said housing;

a plurality of proximity sensors mounted in said housing and directed outward from said housing, for detecting presence of an object in an open space outside said housing and near the edges of said housing; and

a processor mounted in said housing and coupled with said proximity sensors, for operating the device responsive to said proximity sensors detecting a movement of the object, conforming to an arc-shaped gesture partially circumscribing the housing, in the open space, wherein, responsive to said proximity sensors detecting the movement, said processor adjusts tempo, volume, bass or treble for a song currently being played by said music player, and wherein said display renders a turntable control, and wherein said processor advances the current song responsive to glide gestures on the turntable control.