Hierarchical Networked Command Recognition

• US 20170032783A1
• Filed: 07/01/2016
• Published: 02/02/2017
• Est. Priority Date: 04/01/2015
• Status: Abandoned Application

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Lord, Robert W., Lord, Richard T.
• Application Number:
  US15/200,817
• Publication Number:
  US 20170032783A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/22 Microcontrol or microprogram arrangements
• CPC Class Codes: G06F 9/30 Arrangements for executing machine instructions, e.g. instruction decode for executing microinstructions G06F9/22
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

Systems, methods, computer-readable storage mediums including computer-readable instructions and/or circuitry for generating deceptive indicia profiles may implement operations including, but not limited to: receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device; attempting to identify one or more spoken words or gestures based on the one or more signals; selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification; interpreting, by the selected at least one processing entity, one or more user commands based on the one or more spoken words or gestures; and generating one or more device control instructions based on the one or more user commands.

Claims

1. A system comprising:

circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device;

circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals;

circuitry for selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification;

circuitry for interpreting, by the selected at least one processing entity, one or more user commands based on the one or more spoken words or gestures; and

circuitry for generating one or more device control instructions based on the one or more user commands.

2. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from at least one of an audio input device or a video input device.

3. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from at least one of a light switch, a sensor, a control panel, a television, a remote control, a thermostat, an appliance, or a computing device.

4. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a mobile device.

5. The system of claim 4, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a mobile device includes:

circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from at least one of a mobile phone, a tablet, a laptop, or a wearable device.

6. The system of claim 4, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a mobile device includes:

circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from an automobile.

7. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving data indicative of one or more audio signals from a network connected device.

8. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving data indicative of one or more video signals from a network connected device.

9. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving data indicative of one or more physiological sensor signals from a network connected device.

10. The system of claim 1, wherein the circuitry for receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device includes:

circuitry for receiving data indicative of one or more motion sensor signals from a network connected device.

11. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more commands comprising spoken words or gestures based at least in part on recognizing speech associated with the one or more signals.

12. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify a spoken language based on the one or more signals.

14. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more spoken phrases based on the one or more signals.

15. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more commands comprising spoken words or gestures based at least in part on recognizing gestures associated with the one or more signals.

16. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more gestures based on the one or more signals.

17. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more spoken words or gestures associated with a device vocabulary based on the one or more signals.

18. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more spoken words or gestures associated with a shared device vocabulary stored on the network-connected device based on the one or more signals.

19. The system of claim 1, wherein the circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more spoken words or gestures associated with a system vocabulary stored on the network-connected device based on the one or more signals.

20. The system of claim 1, wherein the attempting to identify one or more spoken words or gestures based on the one or more signals includes:

circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals using an adaptive learning technique.

21. The system of claim 20, wherein the attempting to identify one or more spoken words or gestures based on the one or more signals using an adaptive learning technique includes:

circuitry for attempting to identify one or more spoken words or gestures based on the one or more signals using feedback.

23. The system of claim 1, wherein the circuitry for selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification includes:

circuitry for selecting, from a plurality of processing entities, at least one processing entity from at least one of the network-connected device, one or more controllers on a network common with the network-connected device, or a remotely-hosted controller for interpreting the one or more signals based on a result of the attempted identification.

24. The system of claim 1, wherein the circuitry for selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification includes:

circuitry for selecting, from a plurality of processing entities, a single processing entity for interpreting the one or more signals based on a result of the attempted identification.

25. The system of claim 1, wherein the circuitry for selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification includes:

circuitry for selecting, from a plurality of processing entities, two or more distinct processing entities for interpreting the one or more signals based on a result of the attempted identification.

26. The system of claim 1, wherein the circuitry for selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification includes:

circuitry for generating a processing entity metric; and

circuitry for selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification based on the processing entity metric.

27. The system of claim 26, wherein the circuitry for generating a processing entity metric includes:

circuitry for generating a processing entity metric based on a quantity of the identified one or more spoken words or gestures associated with a device vocabulary.

31. The system of claim 26, wherein the circuitry for generating a processing entity metric includes:

circuitry for generating a processing entity metric based on a quality of the one or more signals.

34. The system of claim 26, wherein the circuitry for generating a processing entity metric includes:

circuitry for generating a processing entity metric based on at least one of hardware or software resources available to each of the plurality of processing entities.

38. The system of claim 26, wherein the circuitry for generating a processing entity metric includes:

circuitry for generating a processing entity metric based on network availability to each of the plurality of processing entities.

40. The system of claim 26, wherein the circuitry for generating a processing entity metric includes:

circuitry for generating a processing entity metric based on one or more contextual attributes.

41. The system of claim 40, wherein the circuitry for generating a processing entity metric based on one or more contextual attributes includes:

circuitry for generating a processing entity metric based on an identity of at least one user associated with the one or more signals.

42. The system of claim 40, wherein the circuitry for generating a processing entity metric based on one or more contextual attributes includes:

circuitry for generating a processing entity metric based on an identity of an input device on which at least one of the one or more signals is received.

50. The system of claim 1, wherein the circuitry for generating one or more device control instructions based on the one or more user commands includes:

circuitry for generating at least one of a verbal response, a visual response, or a control instruction based on the one or more user commands.

51. The system of claim 1, wherein the circuitry for generating one or more device control instructions based on the one or more user commands includes:

circuitry for identifying one or more target devices for the one or more device control instructions.

53. The system of claim 1, wherein the circuitry for generating one or more device control instructions based on the one or more user commands includes:

circuitry for transmitting the one or more device control instructions to one or more target devices.

57. The system of claim 1, wherein the circuitry for generating one or more device control instructions based on the one or more user commands includes:

circuitry for generating one or more device control instructions based on one or more contextual attributes.

58. The system of claim 57, wherein the circuitry for generating one or more device control instructions based on one or more contextual attributes includes:

circuitry for generating one or more device control instructions based on a time of day.

59. The system of claim 57, wherein the circuitry for generating one or more device control instructions based on one or more contextual attributes includes:

circuitry for generating one or more device control instructions based on an identity of at least one user associated with the one or more signals.

60. The system of claim 57, wherein the circuitry for generating one or more device control instructions based on one or more contextual attributes includes:

circuitry for generating one or more device control instructions based on a location of at least one user associated with the one or more signals.

65. The system of claim 57, wherein the circuitry for generating one or more device control instructions based on one or more contextual attributes includes:

circuitry for generating one or more device control instructions based on a location of at least one of the network-connected device or a target device.

70. The system of claim 57, wherein the circuitry for generating one or more device control instructions based on one or more contextual attributes includes:

circuitry for generating one or more device control instructions based on one or more sensor signals available to the system.

71. The system of claim 57, wherein the circuitry for generating one or more device control instructions based on one or more contextual attributes includes:

circuitry for generating one or more device control instructions based on one or more rules.

13. (canceled)

22. (canceled)

28. (canceled)

29. (canceled)

30. (canceled)

32. (canceled)

33. (canceled)

35. (canceled)

36. (canceled)

37. (canceled)

39. (canceled)

43. (canceled)

44. (canceled)

45. (canceled)

46. (canceled)

47. (canceled)

48. (canceled)

49. (canceled)

52. (canceled)

54. (canceled)

55. (canceled)

56. (canceled)

61. (canceled)

62. (canceled)

63. (canceled)

64. (canceled)

66. (canceled)

67. (canceled)

68. (canceled)

69. (canceled)

72. (canceled)

73. (canceled)

74. (canceled)

75. (canceled)

76. (canceled)

77. (canceled)

78. (canceled)

79. A method comprising:

receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device;

attempting to identify one or more spoken words or gestures based on the one or more signals;

selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification;

interpreting, by the selected at least one processing entity, one or more user commands based on the one or more spoken words or gestures; and

generating one or more device control instructions based on the one or more user commands.

80. A computer-readable medium comprising computer-readable instructions for executing a computer implemented method, the method comprising:

receiving one or more signals indicative of at least one of speech or one or more gestures from a network-connected device;

attempting to identify one or more spoken words or gestures based on the one or more signals;

selecting, from a plurality of processing entities, at least one processing entity for interpreting the one or more signals based on a result of the attempted identification;

interpreting, by the selected at least one processing entity, one or more user commands based on the one or more spoken words or gestures; and

generating one or more device control instructions based on the one or more user commands.