Enriched video for a technical computing environment

• US 9,729,843 B1
• Filed: 03/14/2013
• Issued: 08/08/2017
• Est. Priority Date: 03/16/2007
• Status: Active Grant

• Current Assignee: The MathWorks, Inc.
• Original Assignee: The MathWorks, Inc.
• Inventors: Simoneau, Matthew J., Gulley, Edward W., Torgerson, Jay R., Grace, Andrew C., Mosterman, Pieter J.
• Primary Examiner(s): Bloomquist, Keith
• Application Number:
  US13/827,887
• Time in Patent Office: 1,608 Days
• Field of Search: None
• CPC Class Codes: G06F 16/74 Browsing; Visualisation therefor end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic program guides, H04N21/472
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G09B 19/0053 Computers, e.g. programming
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: H04N 9/8715 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

A device receives a video file with technical computing environment information, and the video file displays interaction with a technical computing environment. The device plays the video file, and receives the technical computing environment information from the video file when the video file is playing. The device provides the technical computing device information to a local technical computing environment associated with the device.

Claims

1. A method comprising:

receiving, by one or more processors and over a time period, display images associated with a technical computing environment;

receiving, by the one or more processors and over the time period, inputs associated with the technical computing environment;

generating, by the one or more processors, an enriched video file that includes a video filed generated based on the display images and the inputs;

each input, of the inputs, being associated with a respective display image, of the display images,

the enriched video file including code that enables each input to be obtained, by the one or more processors or other one or more processors, and each input being obtainable while the respective display image is displayed during playback of the enriched video file,

each input obtained being processable by the technical computing environment or a local technical computing environment on the other one or more processors during the playback of the enriched video file; and

storing or providing, by the one or more processors, the enriched video file to the one or more processors or the other one or more processors.

2. The method of claim 1, further comprising:

receiving a script file; and

combining the video file, the inputs, and the script file to generate the enriched video file.

3. The method of claim 1, where the display images include one or more of:

code created using the technical computing environment,

a workspace associated with the technical computing environment, or

a model generated with the technical computing environment.

4. The method of claim 1, where the inputs include one or more of:

code input to the technical computing environment,

information programmatically added to the video file, or

an identifier associated with one or more of the display images.

5. One or more non-transitory computer-readable media storing instructions, the instructions comprising:

one or more instructions that, when executed by a processor of a device, cause the processor to;

receive, over a time period, display images associated with a technical computing environment,

receive, over the time period, inputs associated with the technical computing environment,

generate an enriched video file that includes a video file generated based on the display images and the inputs,

each input, of the inputs, being associated with a respective display image, of the display images,

the enriched video file including code that enables each input to be obtained, by the processor or another processor, and each input being obtainable while the respective display image is displayed during playback of the enriched video file,

each input obtained being processable by the technical computing environment or a local technical computing environment on the other processor during the playback of the enriched video file, and

store or provide the enriched video file to the processor or the other processor.

6. The one or more non-transitory computer-readable media of claim 5, further comprising:

one or more instructions that, when executed by the processor, cause the processor to;

receive a script file, and

combine the video file, the inputs, and the script file to generate the enriched video file.

7. The one or more non-transitory computer-readable media of claim 5, where the display images include one or more of:

code created using the technical computing environment,

a workspace associated with the technical computing environment, or

a model generated with the technical computing environment.

8. The one or more non-transitory computer-readable media of claim 5, where the inputs include one or more of:

code input to the technical computing environment,

information programmatically added to the video file, or

an identifier associated with one or more of the display images.

9. A device comprising:

a memory storing instructions; and

a processor to execute one or more of the instructions to;

receive, over a time period, display images associated with a technical computing environment,

receive, over the time period, inputs associated with the technical computing environment,

generate an enriched video file that includes a video file generated based on the display images and the inputs,

each input, of the inputs, being associated with a respective display image, of the display images,

the enriched video file including code that enables each input to be obtained, by the processor or another processor, and each input being obtainable while the respective display image is displayed during playback of the enriched video file,

each input obtained being processable by the technical computing environment or a local technical computing environment on the other processor during the playback of the enriched video file, and

store or provide the enriched video file to the processor or the other processor.

10. The device of claim 9, where the processor is further to:

receive a script file; and

combine the video file, the inputs, and the script file to generate the enriched video file.

11. The device of claim 9, where the display images include one or more of:

code created using the technical computing environment,

a workspace associated with the technical computing environment, or

a model generated with the technical computing environment.

12. The device of claim 9, where the inputs include one or more of:

code input to the technical computing environment,

information programmatically added to the video file, or

an identifier associated with one or more of the display images.

13. The device of claim 9, where the processor is further to:

receive additional inputs to be added to the video file,

where the enriched video file further includes the additional inputs.

14. The device of claim 9, where the processor is further to:

delete an input from the enriched video file.

15. A method comprising:

receiving, by one or more processors, an enriched video file,

the enriched video file comprising;

display images of a display associated with a technical computing environment, and

inputs associated with the technical computing environment,

each input, of the inputs, being associated with a respective display image, of the display images,

the inputs comprising a command, code, or other information generated by the technical computing environment; and

performing, by the one or more processors or one or more different processors, playback of the enriched video file,

the performing comprising

displaying the display images, and

during the displaying, communicating the inputs to the technical computing environment or another technical computing environment local to the one or more different processors for the technical computing environment or the other technical computing environment to process the inputs.

16. The method of claim 15, where the display images include one or more of:

code created using the technical computing environment,

a workspace associated with the technical computing environment, or

a model generated with the technical computing environment.

17. The method of claim 15, where the inputs include the command generated by the technical computing environment.

18. The method of claim 15, where the inputs include the code generated by the technical computing environment.

19. The method of claim 15, further comprising:

deleting an input from the enriched video file;

or

receiving additional inputs to be added to the enriched video file and adding the additional inputs to the enriched video file.

20. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors, cause the one or more processors to;

receive an enriched video file,

the enriched video file comprising;

display images of a display associated with a technical computing environment, and

inputs associated with the technical computing environment,

each input, of the inputs, being associated with a respective display image, of the display images,

the inputs comprising a command, code, or other information generated by the technical computing environment; and

perform, or cause one or more different processors to perform, playback of the enriched video file,

where the one or more instructions cause the one or more processors or the one or more different processors, when performing playback, to;

display the display images, and

during the display, communicate the inputs to the technical computing environment or another technical computing environment local to the one or more different processors for the technical computing environment or the other technical computing environment to process the inputs.

21. The non-transitory computer-readable medium of claim 20, where the display images include one or more of:

code created using the technical computing environment,

a workspace associated with the technical computing environment, or

a model generated with the technical computing environment.

22. The non-transitory computer-readable medium of claim 20, where the inputs include the command generated by the technical computing environment.

23. The non-transitory computer-readable medium of claim 20, where the inputs include the code generated by the technical computing environment.

24. The non-transitory computer-readable medium of claim 20, where the instructions further cause the one or more processors to:

delete an input from the enriched video file;

or

receive additional inputs to be added to the enriched video file and add the additional inputs to the enriched video file.

25. A device comprising:

one or more processors to;

receive an enriched video file,

the enriched video file comprising;

display images of a display associated with a technical computing environment, and

inputs associated with the technical computing environment,

each input, of the inputs, being associated with a respective display image, of the display images,

the inputs comprising a command, code, or other information generated by the technical computing environment; and

perform, or cause one or more different processors to perform, playback of the enriched video file,

where the one or more processors, when performing playback, are to;

display the display images, and

during the display, communicate the inputs to the technical computing environment or another technical computing environment local to the one or more different processors for the technical computing environment or the other technical computing environment to process the inputs.

26. The device of claim 25, where the display images include one or more of:

code created using the technical computing environment, a workspace associated with the technical computing environment, or a model generated with the technical computing environment.

27. The device of claim 25, where the inputs include the command generated by the technical computing environment.

28. The device of claim 25, where the inputs include the code generated by the technical computing environment.

29. The device of claim 25, where the one or more processors are further to:

delete an input from the enriched video file;

or

receive additional inputs to be added to the enriched video file and add the additional inputs to the enriched video file.