SYSTEM FOR CONTENT RECOGNITION AND RESPONSE ACTION

• US 20170282383A1
• Filed: 03/29/2017
• Published: 10/05/2017
• Est. Priority Date: 04/04/2016
• Status: Active Application

• Current Assignee: Sphero Inc.
• Original Assignee: Sphero Inc.
• Inventors: Blakely, John, Carroll, Jon, Earwood, Corey, Dorris, Brandon, Williams, Adam, Rhodes, David
• Application Number:
  US15/473,376
• Publication Number:
  US 20170282383A1
• Time in Patent Office: Days
• CPC Class Codes: B25J 11/0005 Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
• CPC Class Codes: B25J 13/003 by means of an audio-responsive input audible safety signals B25J19/061
• CPC Class Codes: B25J 19/026 Acoustical sensing devices
• CPC Class Codes: B25J 5/00 Manipulators mounted on wheels or on carriages B25J1/00 takes precedence; programme-controlled manipulators B25J9/00 ; vehicle aspects B60, B62, e.g. remote-controlled steering for motor vehicles B62D1/24; control of position of vehicles G05D1/00
• CPC Class Codes: B25J 9/1694 characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A system can use a microphone to detect audio content from a content source, and analyze the audio content to determine whether the audio content corresponds to a respective portion of a stored content file. The system can then identify a response action correlated to the respective portion of the content file, and generate control commands to cause a robotic device to perform the response action.

Claims

1. A mobile computing device comprising:

a microphone;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, causes the mobile computing device to;

using the microphone, detect audio content from a content source;

analyze the audio content to determine that the audio content corresponds to a respective portion of a stored content file;

identify a response action correlated to the respective portion;

generate control commands to cause a robotic device to perform the response action; and

transmit the control commands to the robotic device for execution.

2. The mobile computing device of claim 1, wherein analyzing the audio content comprises comparing the audio content to one or more stored audio fingerprints.

3. The mobile computing device of claim 2, wherein the one or more stored audio fingerprints are associated with information about the audio input, wherein the information about the audio input comprises one or more of:

a song name;

a film name; and

a particular scene in a film.

4. The mobile computing device of claim 2, wherein identifying a response action comprises identifying an audio signature corresponding to a particular segment of audio content associated with the audio content.

5. The mobile computing device of claim 2, wherein identifying a response action further comprises performing a lookup in at least one response log to determine a response action, wherein the lookup is performed by comparing the audio content to a plurality of audio signatures stored in the at least one response log.

6. The mobile computing device of claim 5, wherein the response log is stored on the mobile computing device.

7. The mobile computing device of claim 5, wherein the response log is stored on a remote computing device, and wherein the mobile computing device communicates with the remote computing device via a network.

8. The mobile computing device of claim 1, wherein the content source comprises at least one of:

a television;

a gaming system; and

an audio system.

9. A robotic device comprising:

a plurality of actuators operable on a number of controllable features;

a microphone;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, causes the mobile computing device to;

using the microphone, detect audio content from a content source;

analyze the audio content to determine that the audio content corresponds to a respective portion of a stored content file;

identify a response action correlated to the respective portion;

generate control commands to cause a robotic device to perform the response action; and

execute the control commands on the plurality of actuators to perform the response action.

10. The robotic device of claim 9, wherein the control commands are generated based at least upon the response action.

11. The robotic device of claim 9, wherein the response action comprises at least one of:

performing gesture;

playing an audio response;

displaying a visual response;

dancing to a song; and

providing conversational audio.

12. The robotic device of claim 9, wherein analyzing the audio content comprises comparing the audio content to one or more stored audio fingerprints.

13. The robotic device of claim 12, wherein identifying a response action further comprises performing a lookup in at least one response log to determine a response action, wherein the lookup is performed by comparing the audio content to a plurality of audio signatures stored in the at least one response log.

14. The robotic device of claim 13, wherein the response log is stored on the robotic device.

15. The robotic device of claim 13, wherein the response log is stored on a remote computing device, and wherein the robotic device communicates with the remote computing device.

16. A method comprising:

detecting audio content from a content source;

analyze the audio content to determine that the audio content corresponds to a respective portion of a stored content file;

identify a response action correlated to the respective portion;

generate control commands to cause a robotic device to perform the response action; and

transmit the control commands to the robotic device for execution.

17. The method of claim 16, wherein analyzing the audio content comprises comparing the audio content to one or more stored audio fingerprints.

18. The method of claim 17, wherein the one or more stored audio fingerprints are associated with information about the audio input, wherein the information about the audio input comprises one or more of:

a song name;

a film name; and

a particular scene.

19. The method of claim 16, wherein identifying a response action comprises identifying an audio signature corresponding to a particular segment of audio content associated with the audio content.

20. The method of claim 19, wherein identifying a response action further comprises performing a lookup in at least one response log to determine a response action, wherein the lookup is performed by comparing the audio content to a plurality of audio signatures stored in the at least one response log.