Observation platform using structured communications with external devices and systems

• US 10,069,781 B2
• Filed: 09/29/2015
• Issued: 09/04/2018
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: Theatro Labs Inc.
• Original Assignee: Theatro Labs Inc.
• Inventors: Kumar, Ravi Shankar, VanBuskirk, Guy R., Lucy, Steven M., Cheedella, Shiva, Kumar, S B, Kiran, Manjunath, Ashok Donthe
• Primary Examiner(s): Jacobs, Lashonda
• Application Number:
  US14/869,167
• Publication Number:
  US 20170093952A1
• Time in Patent Office: 1,071 Days
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders
• CPC Class Codes: H04L 51/18 Commands or executable codes
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 4/20 Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

Methods and systems for using an observation platform with an external device are disclosed. A signal is received from a first communication device at a second communication device associated with a computer system. Context information is derived from the signal at the computer system from, a speech to text analysis of the audible source, a policy implemented in the computer system by a controlling enterprise, and inferences calculated by a combination of text analysis, and secondary information contained in the signal. An action is determined to take place at an external device or user device based on the context information, wherein the external device is one of a plurality of external devices and is networked to the second communication device or a plurality of devices. A second signal is sent to the external device to instruct the device to take the action.

Claims

1. A method for using an observation platform with an external device, comprising:

receiving a signal from a first communication device at a second communication device associated with a computer system wherein a first characteristic of said signal corresponds to an audible source proximate to said first communication device and a second characteristic of said signal corresponds to information indicative of a geographic position of said first communication device;

deriving context information from said signal at said computer system from, at least in part, a speech to text analysis of said audible source, a policy implemented in said computer system by a controlling enterprise, and inferences calculated by a combination of policy, text analysis, and secondary information contained in said signal;

determining an action to take place at an external device based on said context information, wherein said external device is one of a plurality of external devices and is networked to said second communication device; and

sending a second signal to said external device to instruct said device to take said action.

2. The method as recited in claim 1 wherein said action is executed by said external device.

3. The method as recited in claim 1 wherein said context and policy information is used to identify which of said plurality of external devices said action is to place at.

4. The method as recited in claim 1 wherein said first communication device comprises a user interface with only one button for sending said communication as said signal, wherein said only one button is a virtual button or a physical button.

5. The method as recited in claim 1 wherein said first communication device is an application that communicates through the Internet that an action is required by one or more users within the observation platform.

6. The method as recited in claim 1 wherein said first communication device is an external device that uses said context and policy to issue instructions to one or a plurality of said external device(s).

7. The method as recited in claim 1 wherein said context information is pulled from said computer system by the external device.

8. The method as recited in claim 6 wherein said computer system pulls information from said first communication device or a user of said first communication device.

9. The method as recited in claim 1 wherein said sending said second signal is sent to more than one of said plurality of external devices.

10. The method as recited in claim 1 wherein said external device is operated by a third party.

11. The method as recited in claim 1 wherein said external device employs communication through the internet via a uniform resource locator (URL) and standard internet protocols.

12. The method as recited in claim 1 wherein said external device employs communications methods selected from the group of communications methods consisting of:

Bluetooth, low-energy Bluetooth (BLE), ZigBee, radio wave, cell phone signals, and WiFi comprising all standard 802.x devices.

13. A non-transitory computer-usable storage medium having instructions embodied therein that when executed cause a computer system to perform a method for using an observation platform with an external device, said method comprising:

receiving a signal from a first communication device at a second communication device associated with a computer system wherein a first characteristic of said signal corresponds to an audible source proximate to said first communication device and a second characteristic of said signal corresponds to information indicative of a geographic position of said first communication device;

deriving context information from said signal at said computer system from, at least in part, a speech to text analysis of said audible source, a policy implemented in said computer system by a controlling enterprise, and inferences calculated by a combination of text analysis, and secondary information contained in said signal;

determining an action to take place at an external device based on said context information, wherein said external device is one of a plurality of external devices and is networked to said second communication device; and

sending a second signal to said external device to instruct said device to take said action.

14. A method for using an observation platform with an external device, comprising:

receiving external device information from an external device at a computer system, wherein said external device is one of a plurality of external devices networked to said computer system;

determining, at said computer system, which user communication device of a plurality of user communication devices to send at least a portion of said external device information to, based on deriving context information from said external device information and analyzing said context information in view of a policy implemented in said computer system by a controlling enterprise;

generating, at said computer system, a message for said user communication device based at least in part on said portion of said external device information; and

relaying said message to said user communication device such that said message causes audio to be played at said user communication device.

15. The method as recited in claim 14, further comprising:

receiving a signal with an audible speech response to said message at said computer system from said user communication device.

16. The method as recited in claim 15, further comprising:

sending an instruction to said external device from said computer system based on said audible response wherein said instruction is to control a feature of said external device.

17. The method as recited in claim 16 wherein said instruction is sent to a plurality of external devices.

18. The method as recited in claim 14, further comprising:

converting a machine generated signal from said external device into an audible message played to a selected user or users as determined by context and policy.

19. The method as recited in claim 14 wherein said message is informational, requiring no response;

is a request for action, encouraging a response;

or mandatory, requiring a response from a user.

20. The method as recited in claim 14 wherein said message is sent to a plurality of user communication devices.

21. The method as recited in claim 14 wherein said message is an alert to said user that attention is needed at a specific geographic location or with a specific talent set as determined by user context.

22. The method as recited in claim 14 wherein said determining selects said user communication device from among said plurality of user communication devices because said user communication device is geographically the closest to said external device.

23. The method as recited in claim 14 wherein said determining selects said user communication device from among said plurality of user communication devices based on engaged status, available status, role, current location and/or past movement history.

24. The method as recited in claim 14 wherein said external device is a button located in a kiosk that a customer presses when in need of assistance.

25. The method as recited in claim 14 wherein said external device is an image capturing device and said context information derives data from image processing techniques regarding movements of people in images or video.

26. The method as recited in claim 14 wherein said external device is operated by a third party.

27. The method as recited in claim 14 wherein said external device employs communications methods selected from the group of communications methods consisting of:

Bluetooth, Bluetooth Low Energy (BLE), ZigBee, radio wave, cell phone signals, and WiFi comprising all 802.x standards.

28. The method as recited in claim 14 wherein said external device employs communication through the internet via a uniform resource locator (URL) and standard internet protocols.

29. The method as recited in claim 14 wherein said external device comprises a proximity detection sensor.

30. The method as recited in claim 14 wherein said external device comprises a proximity detection system comprising a stationary beacon that causes a mobile device to contact said external device when said mobile device is within proximity of said external device wherein said mobile device is associated with a user.

31. The method as recited in claim 14 wherein said external device comprises a proximity detection system such that when a beacon in said user communication device is in proximity to a mobile device, said mobile device is trigged to contact said external device.

32. The method of claim 31 wherein said external device sends a message to said user communication device regarding an identity of a user associated with said mobile device and additional information as determined by said external device.

33. The method as recited in claim 14 wherein said external device information is a failure alarm.

34. The method as recited in claim 14 wherein said external device information is an audible alert requiring an acknowledgment to pull a product from a shelf based on a purchase made online that is to be picked up in store.

35. A non-transitory computer-usable storage medium having instructions embodied therein that when executed cause a computer system to perform a method for using an observation platform with an external device, said method comprising:

receiving external device information from an external device at a computer system, wherein said external device is one of a plurality of external devices networked to said computer system;

determining, at said computer system, which user communication device of a plurality of user communication devices to send at least a portion of said external device information to, based on deriving context information from said external device information and analyzing said context information in view of a policy implemented in said computer system by a controlling enterprise;

generating, at said computer system, a message for said user communication device based at least in part on said portion of said external device information; and

relaying said message to said user communication device such that said message causes audio to be played at said user communication device.