Multiple-media performance mechanism

• US 10,311,292 B2
• Filed: 10/26/2015
• Issued: 06/04/2019
• Est. Priority Date: 10/24/2014
• Status: Active Grant

• Current Assignee: Guy Jonathan James Rackham
• Original Assignee: Guy Jonathan James Rackham
• Inventors: Rackham, Guy Jonathan James
• Primary Examiner(s): Bost, Dwayne D
• Assistant Examiner(s): Tsai, Tsung Yin
• Application Number:
  US14/922,694
• Publication Number:
  US 20160117838A1
• Time in Patent Office: 1,317 Days
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Embodiments of a system and method are disclosed for adjusting the execution of a multi-media performance in response to a live performance. Embodiments track and receive data regarding elements of the live performance, analyze the live performance data, determine the pace of the live performance, and use this data to appropriately execute elements of the accompanying multi-media performance. Some embodiments may perform this analysis and adjustment automatically. Certain embodiments may use voice detection devices, motion detection devices and musical detection devices to track the live performance. The live performance may be analyzed in relation to an electronic script, which may contain instructions related to the execution of the multi-media elements.

Claims

1. A computer-implemented method for controlling a multi-media performance, the method comprising:

tracking a live performance activity, wherein one or more performance tracking devices track the live performance activity by monitoring one or more threads included in the live performance activity;

receiving live performance activity data output from the one or more performance tracking devices;

analyzing the received live performance activity data;

determining pace of the live performance activity based on the received live performance activity data and an electronic script that defines confluences between the live performance activity and the multi-media performance of at least one multi-media device; and

adjusting timing of execution of the multi-media performance of the at least one multi-media device based on the pace of the live performance activity.

2. The method of claim 1, further comprising analyzing the electronic script.

3. The method of claim 2, wherein the adjusting the timing includes combining data from the analyzing the electronic script and performance tracking devices in order to adjust the timing of the execution of the at least one multi-media device.

4. The method of claim 1, wherein the performance is paced over an extended period of time in order to detect a more general behavior pattern.

5. The method of claim 1, further comprising using analysis of the live performance activity data to determine a desired multi-media response.

6. The method of claim 1, wherein the one or more performance tracking devices include a vocal recognition device.

7. The method of claim 6, wherein the tracking a live performance activity includes using vocal recognition device.

8. The method of claim 1, wherein the tracking includes combining data from a plurality of performance tracking devices to determine the pace of the live performance activity.

9. The method of claim 1 wherein the method further includes displaying a scrolling electronic script on a monitor and the adjusting includes slowing down a speed at which the electronic script is scrolled.

10. The method of claim 1, wherein the analyzing the live performance activity data includes setting a threshold that ensures the timing of the at least one multi-media device is not adjusted outside of a predetermined range.

11. The method of claim 1, wherein the one or more threads included in the live performance activity include one or more selected from the group consisting of dialogue against intended script, score of music, beat of music, blocking of performers, and movements of performers.

12. The method of claim 1, wherein said determining the pace of the live performance activity comprises mapping the live performance activity data to a default pace of the electronic script.

13. The method of claim 1, wherein the electronic script defines how streams of the live performance activity and the multi-media performance combine to create overall multi-media presentation experience.

14. A system for controlling elements of a multi-media performance in response to a live performance, the system comprising:

at least one multi-media device;

at least one electronic script that defines confluences between the live performance and multi-media performance of the at least one multi-media device;

at least one performance tracking device that tracks the live performance by monitoring one or more threads included in the live performance, wherein the at least one performance tracking device outputs live performance data;

at least one device controller capable of triggering multi-media performance elements; and

a processor operably connected to the at least one performance tracking device and at least one multi-media device, wherein the processor receives the live performance data from the at least one performance tracking device, and determines pace of the live performance based on the received live performance data and the at least one electronic script, and wherein the processor is capable of adjusting execution of the multi-media performance elements based on the pace of the live performance.

15. The system of claim 14, wherein the at least one performance tracking device comprises a voice recognition device, facial recognition device, motion detection device or music detection device.

16. The system of claim 14, wherein the multi-media performance elements comprise stage lighting, musical tracks, sound effects, visual effects, wind machines, or smoke machines.

17. The system of claim 14, wherein the processor analyzes the live performance data, and sets a threshold that ensures the timing of the at least one multi-media device is not adjusted outside of a predetermined range.

18. The system of claim 14, wherein the one or more threads included in the live performance include one or more selected from the group consisting of dialogue against intended script, score of music, beat of music, blocking of performers, and movements of performers.

19. The system of claim 14, wherein the processor maps the live performance data to a default pace of the at least one electronic script to determine the pace of the live performance.

20. The system of claim 14, wherein the electronic script defines how streams of the live performance and the multi-media performance combine to create overall multi-media presentation experience.