Proximity detector in handheld device

• US 10,042,418 B2
• Filed: 11/14/2013
• Issued: 08/07/2018
• Est. Priority Date: 07/30/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Hotelling, Steve P., Huppi, Brian Q., Strickon, Joshua A., Kerr, Duncan Robert, Chaudhri, Imran, Christie, Greg, Ive, Jonathan P., Kennedy, Peter J., Fadell, Anthony M., Robbin, Jeffrey L.
• Primary Examiner(s): ABDUL-ALI, OMAR R
• Application Number:
  US14/080,116
• Publication Number:
  US 20140074426A1
• Time in Patent Office: 1,727 Days
• CPC Class Codes: G01B 21/16 for measuring distance of clearance between spaced objects
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Proximity based systems and methods that are implemented on an electronic device are disclosed. The method includes sensing an object spaced away and in close proximity to the electronic device. The method also includes performing an action in the electronic device when an object is sensed.

Claims

1. A proximity detection system, comprising:

a touch sensitive surface;

a display;

one or more proximity sensors configured for generating one or more proximity sensing fields above the touch sensitive surface; and

a processor communicatively coupled to the one or more proximity sensors, the processor capable of

receiving one or more proximity inputs from the one or more proximity sensors,

detecting a plurality of objects hovering above the touch sensitive surface,

displaying, on the display, one or more graphical user interface (GUI) elements, wherein displaying the one or more GUI elements comprises;

displaying, on the display, a first GUI element having a first element type based on a first location of at least one of the plurality of hovering objects;

detecting movement of the at least one of the plurality of hovering objects from the first location to a second location; and

in response to detecting the movement;

ceasing display of the first GUI element; and

displaying, on the display, a second GUI element having a second element type based on the second location,

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface, and

determining an operation to be performed in accordance with the identified gesture.

2. The proximity detection system of claim 1, the processor further capable of determining movement of one or more of the plurality of objects hovering above the touch sensitive surface.

3. The proximity detection system of claim 1, the processor further capable of displaying a third graphical user interface (GUI) element upon identification of the gesture.

4. The proximity detection system of claim 1, wherein the operation to be performed in accordance with the identified gesture is an operation associated with at least one of the one or more GUI elements.

5. The proximity detection system of claim 1, wherein at least one of the plurality of objects hovering above the touch sensitive surface is a finger.

6. The proximity detection system of claim 1, wherein the plurality of objects hovering above the touch sensitive surface includes a first finger from a first hand and a second finger from a second hand.

7. The proximity detection system of claim 1, wherein identifying the gesture from the detected plurality of objects hovering above the touch sensitive surface includes determining time of occurrences of each of the one or more proximity inputs.

8. The proximity detection system of claim 1, wherein detecting a plurality of objects hovering above the touch sensitive surface includes detection along three axial components with respect to the touch sensitive surface.

9. The proximity detection system of claim 1, wherein the processor is further capable of displaying, on the display, an image and changing the displayed image based on a movement of the identified gesture.

10. The proximity detection system of claim 9, wherein changing the displayed image includes at least one of rotating, panning or zooming of the displayed image.

11. A proximity detection system, comprising:

a touch sensitive surface;

a display;

one or more proximity sensors configured for generating one or more proximity sensing fields above the touch sensitive surface; and

a processor communicatively coupled to the one or more proximity sensors, the processor capable of

receiving one or more proximity inputs from the one or more proximity sensors,

detecting a plurality of objects hovering above the touch sensitive surface,

displaying, on the display, a plurality of graphical user interface (GUI) elements upon detection of the plurality of objects hovering above the touch sensitive surface,

determining an element type associated with each of the plurality of GUI elements based on a location of a corresponding one of the plurality of objects hovering above the touch sensitive surface,

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface, and

determining an operation to be performed in accordance with the identified gesture.

12. A proximity detection system, comprising:

a touch sensitive surface;

one or more proximity sensors configured for generating one or more proximity sensing fields above the touch sensitive surface; and

a processor communicatively coupled to the one or more proximity sensors, the processor capable of

receiving one or more proximity inputs from the one or more proximity sensors,

detecting a plurality of objects hovering above the touch sensitive surface, wherein each of the plurality of objects hovering above the touch sensitive surface corresponds to a finger of a first hand,

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface,

determining a first operation to be performed in accordance with the identified gesture,

receiving one or more touch inputs by a second hand from the touch sensitive surface,

identifying a combined proximity and touch gesture from the received one or more touch inputs and the detected plurality of hovering objects, and

determining a second operation to be performed in accordance with the identified combined gesture.

13. A method comprising:

detecting a plurality of objects hovering above a touch sensitive surface;

displaying, on a display, one or more graphical user interface (GUI) elements, wherein displaying the one or more GUI elements further comprises;

displaying, on the display, a first GUI having a first element type based on a first location of at least one of the plurality of hovering objects;

detecting movement of the at least one of the plurality of hovering objects from the first location to a second location; and

in response to detecting the movement;

ceasing display of the first GUI element; and

displaying, on the display, a second GUI element having a second element type based on the second location;

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface; and

determining an operation to be performed in accordance with the identified gesture.

14. The method of claim 13, further comprising determining movement of one or more of the plurality of objects hovering above the touch sensitive surface.

15. The method of claim 13, further comprising displaying a third graphical user interface (GUI) element upon identification of the gesture.

16. The method of claim 13, wherein the operation to be performed in accordance with the identified gesture is an operation associated with at least one of the one or more GUI elements.

17. The method of claim 13, wherein the plurality of objects hovering above the touch sensitive surface includes a first finger from a first hand and a second finger from a second hand.

18. The method of claim 13, wherein identifying the gesture from the detected plurality of objects hovering above the touch sensitive surface further comprises determining time of occurrences of each of the one or more proximity inputs.

19. The method of claim 13, further comprising displaying, on the display, an image and changing the displayed image based on a movement of the identified gesture.

20. The method of claim 19, wherein changing the displayed image includes at least one of rotating, panning or zooming of the displayed image.

21. A non-transitory computer readable medium, the computer readable medium containing instructions, that, when executed by a processor, perform a method comprising:

detecting a plurality of objects hovering above a touch sensitive surface;

displaying, on a display, one or more graphical user interface (GUI) elements, wherein displaying the one or more GUI elements further comprises;

displaying, on the display, a first GUI having a first element type based on a first location of at least one of the plurality of hovering objects;

detecting movement of the at least one of the plurality of hovering objects from the first location to a second location; and

in response to detecting the movement;

ceasing display of the first GUI element; and

displaying, on the display, a second GUI element having a second element type based on the second location;

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface; and

determining an operation to be performed in accordance with the identified gesture.

22. The non-transitory computer readable medium of claim 21, wherein the method further comprises determining movement of one or more of the plurality of objects hovering above the touch sensitive surface.

23. The non-transitory computer readable medium of claim 21, wherein the method further comprises displaying a third graphical user interface (GUI) element upon identification of the gesture.

24. The non-transitory computer readable medium of claim 21, wherein the operation to be performed in accordance with the identified gesture is an operation associated with at least one of the one or more GUI elements.

25. The non-transitory computer readable medium of claim 21, wherein the plurality of objects hovering above the touch sensitive surface includes a first finger from a first hand and a second finger from a second hand.

26. The non-transitory computer readable medium of claim 21, wherein identifying the gesture from the detected plurality of objects hovering above the touch sensitive surface further comprises determining time of occurrences of each of the one or more proximity inputs.

27. The non-transitory computer readable medium of claim 21, wherein the method further comprises displaying, on the display, an image and changing the displayed image based on a movement of the identified gesture.

28. The non-transitory computer readable medium of claim 27, wherein changing the displayed image includes at least one of rotating, panning or zooming of the displayed image.

29. A method comprising:

detecting a plurality of objects hovering above a touch sensitive surface,

displaying, on a display, a plurality of graphical user interface (GUI) elements upon detection of the plurality of objects hovering above the touch sensitive surface;

determining an element type associated with each of the plurality of GUI elements based on a location of a corresponding one of the plurality of objects hovering above the touch sensitive surface;

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface; and

determining an operation to be performed in accordance with the identified gesture.

30. A method comprising:

detecting a plurality of objects hovering above a touch sensitive surface, wherein each of the plurality of objects hovering above the touch sensitive surface corresponds to a finger of a first hand,

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface,

determining a first operation to be performed in accordance with the identified gesture,

receiving one or more touch inputs by a second hand from the touch sensitive surface,

identifying a combined proximity and touch gesture from the received one or more touch inputs and the detected plurality of hovering objects, and

determining a second operation to be performed in accordance with the identified combined gesture.

31. A non-transitory computer readable medium, the computer readable medium containing instructions, that, when executed by a processor, perform a method comprising:

detecting a plurality of objects hovering above a touch sensitive surface,

displaying, on a display, a plurality of graphical user interface (GUI) elements upon detection of the plurality of objects hovering above the touch sensitive surface;

determining an element type associated with each of the plurality of GUI elements based on a location of a corresponding one of the plurality of objects hovering above the touch sensitive surface;

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface; and

determining an operation to be performed in accordance with the identified gesture.

32. A non-transitory computer readable medium, the computer readable medium containing instructions, that, when executed by a processor, perform a method comprising:

detecting a plurality of objects hovering above a touch sensitive surface, wherein each of the plurality of objects hovering above the touch sensitive surface corresponds to a finger of a first hand,

identifying a gesture from the detected plurality of objects hovering above the touch sensitive surface,

determining a first operation to be performed in accordance with the identified gesture,

receiving one or more touch inputs by a second hand from the touch sensitive surface,

identifying a combined proximity and touch gesture from the received one or more touch inputs and the detected plurality of hovering objects, and

determining a second operation to be performed in accordance with the identified combined gesture.