Method, apparatus and computer program product for input detection

• US 10,185,543 B2
• Filed: 12/08/2015
• Issued: 01/22/2019
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Vilermo, Miikka, Ozcan, Koray
• Primary Examiner(s): Abdin, Shaheda
• Application Number:
  US14/962,233
• Publication Number:
  US 20160188291A1
• Time in Patent Office: 1,141 Days
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

In an example embodiment, a method, apparatus and computer program product are provided. The method includes determining one or more operating conditions of a device. A selection of a mode of operation of the device from at least a first mode and a second mode is facilitated based on the one or more operating conditions of the device. In the first mode, the device is configured to detect an operation input received from an audio source based on two or more audio sensors of the device. In the second mode, the device is configured to detect the operation input based on at least one of the two or more audio sensors and at least one non-audio sensor of the device.

Claims

1. A method comprising:

determining one or more operating conditions of a device by comparing an ambient noise level detected by at least one audio sensor of the device with a predetermined threshold level of noise; and

facilitating selection of a mode of operation of the device from at least a first mode and a second mode based on the one or more operating conditions of the device,

wherein in the first mode, the device is configured to detect an operation input from an audio source based on two or more audio sensors of the device, and

wherein in the second mode, the device is configured to detect the operation input based on at least one non-audio sensor of the device.

2. The method as claimed in claim 1, wherein the one or more operating conditions are determined based on an orientation of the device relative to the audio source.

3. A method as claimed in claim 1, wherein in the second mode, the device is configured to detect the operation input based on a touch detected by a touch sensor of the device.

4. A method as claimed in claim 1 wherein in the second mode, the method further comprises comparing a motion level of the device to a predetermined threshold level of motion and, in an instance in which the motion level of the device satisfies the predetermined level of motion, detecting the operation input based on a hover action detected by a hover sensor of the device.

5. A method as claimed in claim 4 wherein facilitating selection of the mode of operation comprises causing a message to be displayed and, in response to the message, receiving a hover motion indicating that the device should switch to the second mode and detect the operation input based on the hover action.

6. A method comprising:

determining one or more operating conditions of a device; and

facilitating selection of a mode of operation of the device from at least a first mode and a second mode based on the one or more operating conditions of the device,

wherein in the first mode, the device is configured to detect an operation input from an audio source based on two or more audio sensors of the device, and

wherein in the second mode, the device is configured to detect the operation input based on at least one non-audio sensor of the device,

wherein the one or more operating conditions are determined based on an orientation of the device relative to the audio source,

wherein determining the one or more operating conditions based on the orientation of the device relative to the audio source comprises;

determining whether a time delay between times of arrival of the operation input at the two or more audio sensors of the device corresponds to one direction from among a set of predetermined directions, the time delay being determined based on the orientation of the device relative to the audio source, and the operation input being a command.

7. The method as claimed in claim 6, wherein the time delay being determined based on the orientation of the device relative to the audio source comprises determining positions or locations of the two or more audio sensors of the device relative to the audio source.

8. A method as claimed in claim 6, wherein in the second mode, the device is configured to detect the operation input based on a touch detected by a touch sensor of the device.

9. A method as claimed in claim 6 wherein in the second mode, the method further comprises comparing a motion level of the device to a predetermined threshold level of motion and, in an instance in which the motion level of the device satisfies the predetermined level of motion, detecting the operation input based on a hover action detected by a hover sensor of the device.

10. A method as claimed in claim 9 wherein facilitating selection of the mode of operation comprises causing a message to be displayed and, in response to the message, receiving a hover motion indicating that the device should switch to the second mode and detect the operation input based on the hover action.

11. A method comprising:

determining one or more operating conditions of a device, wherein the one or more operating conditions are determined based on environmental conditions associated with the device, and wherein determining the one or more operating conditions based on the environmental conditions comprises comparing a motion level associated with the device with a predetermined threshold level of motion; and

facilitating selection of a mode of operation of the device from at least a first mode and a second mode based on the one or more operating conditions of the device,

wherein in the first mode, the device is configured to detect an operation input from an audio source based on two or more audio sensors of the device, and

wherein in the second mode, the device is configured to detect the operation input based on at least one non-audio sensor of the device,

wherein facilitating the selection of the mode of operation comprises performing one of;

facilitating the selection of the first mode on determining the motion level associated with the device being less than the predetermined threshold level of motion;

or

facilitating the selection of the second mode on determining the motion level associated with the device being greater than or equal to the predetermined threshold level of motion.

12. A method as claimed in claim 11, wherein in the second mode, the device is configured to detect the operation input based on a touch detected by a touch sensor of the device.

13. A method as claimed in claim 11 wherein in the second mode and in an instance in which the motion level of the device is greater than the predetermined threshold level of motion, the method further comprises detecting the operation input based on a hover action detected by a hover sensor of the device.

14. A method as claimed in claim 13 wherein facilitating selection of the mode of operation further comprises causing a message to be displayed and, in response to the message, receiving a hover motion indicating that the device should switch to the second mode and detect the operation input based on the hover action.

15. A method as claimed in claim 11, wherein the one or more operating conditions are determined based on an orientation of the device relative to the audio source.

16. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to;

determine one or more operating conditions of a device by comparing an ambient noise level detected by at least one audio sensor of the device with a predetermined threshold level of noise; and

facilitate selection of a mode of operation of the device from at least a first mode and a second mode based on the one or more operating conditions of the device,

wherein in the first mode, the device is configured to detect an operation input from an audio source based on two or more audio sensors of the device, and

wherein in the second mode, the device is configured to detect the operation input based on at least one non-audio sensor of the device.

17. The apparatus as claimed in claim 16, wherein the apparatus is further caused at least in part to determine the one or more operating conditions based on an orientation of the device relative to the audio source.

18. The apparatus as claimed in claim 16, wherein the apparatus is further caused at least in part to determine the time delay based on the orientation of the device relative to the audio source by determining positions or locations of the two or more audio sensors of the device relative to the audio source.

19. An apparatus as claimed in claim 16, wherein in the second mode, the device is configured to detect the operation input based on a touch detected by a touch sensor of the device.

20. An apparatus as claimed in claim 16 wherein in the second mode, the apparatus is further caused to compare a motion level of the device to a predetermined threshold level of motion and, in an instance in which the motion level of the device satisfies the predetermined level of motion, to detect the operation input based on a hover action detected by a hover sensor of the device.

21. An apparatus as claimed in claim 20 wherein the apparatus is caused to facilitate selection of the mode of operation by causing a message to be displayed and, in response to the message, receiving a hover motion indicating that the device should switch to the second mode and detect the operation input based on the hover action.

22. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to;

determine one or more operating conditions of a device; and

facilitate selection of a mode of operation of the device from at least a first mode and a second mode based on the one or more operating conditions of the device,

wherein in the first mode, the device is configured to detect an operation input from an audio source based on two or more audio sensors of the device, and

wherein in the second mode, the device is configured to detect the operation input from the audio source based on at least one non-audio sensor of the device,

wherein the apparatus is further caused at least in part to determine the one or more operating conditions based on an orientation of the device relative to the audio source,

wherein to determine the one or more operating conditions based on the orientation of the device relative to the audio source, the apparatus is further caused at least in part to;

determine whether a time delay between times of arrival of the operation input at the two or more audio sensors of the device corresponds to one direction from among a set of predetermined directions, the time delay being determined based on the orientation of the device relative to the audio source, and the operation input being a command.

23. An apparatus as claimed in claim 22, wherein in the second mode, the device is configured to detect the operation input based on a touch detected by a touch sensor of the device.

24. An apparatus as claimed in claim 22 wherein in the second mode, the apparatus is further caused to compare a motion level of the device to a predetermined threshold level of motion and, in an instance in which the motion level of the device satisfies the predetermined level of motion, to detect the operation input based on a hover action detected by a hover sensor of the device.

25. An apparatus as claimed in claim 24 wherein the apparatus is caused to facilitate selection of the mode of operation by causing a message to be displayed and, in response to the message, receiving a hover motion indicating that the device should switch to the second mode and detect the operation input based on the hover action.

26. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to;

determine one or more operating conditions of a device, wherein the one or more operating conditions are determined based on environmental conditions associated with the device by comparing a motion level associated with the device with a predetermined threshold level of motion; and

facilitate selection of a mode of operation of the device from at least a first mode and a second mode based on the one or more operating conditions of the device,

wherein in the first mode, the device is configured to detect an operation input from an audio source based on two or more audio sensors of the device, and

wherein in the second mode, the device is configured to detect the operation input based on at least one non-audio sensor of the device,

wherein the apparatus is caused to facilitate the selection of the mode of operation by performing one of;

facilitating the selection of the first mode on determining the motion level associated with the device being less than the predetermined threshold level of motion;

or

facilitating the selection of the second mode on determining the motion level associated with the device being greater than or equal to the predetermined threshold level of motion.

27. An apparatus as claimed in claim 26, wherein in the second mode, the device is configured to detect the operation input based on a touch detected by a touch sensor of the device.

28. An apparatus as claimed in claim 26 wherein in the second mode and in an instance in which the motion level of the device is greater than the predetermined threshold level of motion, the apparatus is further caused to detect the operation input based on a hover action detected by a hover sensor of the device.

29. An apparatus as claimed in claim 28 wherein the apparatus is further caused to facilitate selection of the mode of operation by causing a message to be displayed and, in response to the message, receiving a hover motion indicating that the device should switch to the second mode and detect the operation input based on the hover action.

30. An apparatus as claimed in claim 26, wherein the one or more operating conditions are determined based on an orientation of the device relative to the audio source.