Automatic tracking, recording, and teleprompting device using multimedia stream with video and digital slide

• US 9,699,431 B2
• Filed: 08/20/2013
• Issued: 07/04/2017
• Est. Priority Date: 02/10/2010
• Status: Expired due to Fees

• Current Assignee: Swivl, Inc.
• Original Assignee: Swivl, Inc.
• Inventors: Steinberg, Eran, Lamb, Brian Whitney, Tetelbaum, Vladimir
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): SUH, JOSEPH JINWOO
• Application Number:
  US13/971,767
• Publication Number:
  US 20130336628A1
• Time in Patent Office: 1,414 Days
• CPC Class Codes: G01S 17/66 Tracking systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831
• CPC Class Codes: H04N 9/79 Processing of colour television signals in connection with recording

Abstract

One variation of a method for monitoring an object during a presentation, includes: initiating capture of a video with a camera defining a field of view, the camera arranged on a first side of a mobile computing device supported on a base device; generating a position signal defining a position of the remote device relative to the camera; in response to wirelessly receiving a first input selection from the remote device, indexing through digital slide content rendered on a display arranged on the first side of the mobile computing device; in response wirelessly receiving sensor data from a remote device coupled to the object, generating an event tag including a timestamp; and generating a multimedia stream including the video, the position signal data, digital slide content, the first input selection, and the event tag.

Claims

1. A method for monitoring an object during a presentation, comprising:

initiating capture of a video with a camera defining a field of view, the camera arranged on a first side of a mobile computing device supported on a base device;

generating a position signal defining a position of the remote device relative to the camera;

in response to wirelessly receiving a first input selection from the remote device, indexing through digital slide content rendered on a display arranged on the first side of the mobile computing device;

in response wirelessly receiving sensor data from a remote device coupled to the object, generating an event tag comprising a timestamp; and

generating a multimedia stream comprising the video, the position signal data, digital slide content, the first input selection, and the event tag;

wherein indexing through the digital slide content comprises indexing through slides of a digital slide deck, wirelessly broadcasting a slide change command in response to receiving the first input selection from the remote device and storing the first input selection as a slide number of a digital slide deck and associated timestamp relative to the video.

2. The method of claim 1, wherein generating the position signal comprises outputting the position signal to an actuator within the base device to adjust an orientation of the mobile computing device to maintain the remote object within the field of view of the camera throughout the video.

3. The method of claim 1, wherein generating the multimedia stream comprises

initiating the multimedia stream in response to initiation of the video;

accessing a production preference of a user;

inserting a portion of the video into the multimedia stream according to the production preference and the position signal;

inserting digital slide content into the multimedia stream for a period of time after the portion of the video based on the production preference and the first input selection; and

inserting a searchable marker into the multimedia stream based on the event tag.

4. The method of claim 3, further comprising downloading a textual question from an audience member through a computer network during the presentation, rendering the textual question on the display, and insetting text of the textual question over a frame of the video in the multimedia stream.

5. The method of claim 4, wherein insetting the textual question over the frame of the video in the multimedia stream comprises insetting text of the textual question over a frame corresponding to the timestamp.

6. The method of claim 1, further comprising wirelessly receiving an audio signal from the remote device, wherein generating the multimedia stream comprises generating a default composite audio-video stream comprising segments of the video, the audio signal, and the digital slide content substantially in real-time during the presentation.

7. The method of claim 6, further comprising uploading the default composite audio-video stream, the video, the audio signal, and the digital slide content to a computer network and modifying durations of segments of the video and durations of digital slide content within the default composite audio-video stream according to a user input.

8. The method of claim 1, further comprising initiating capture of a second video with a second camera arranged on a second side of a mobile computing device opposite the first side and recording a second audio signal through the mobile computing device, wherein generating the multimedia stream comprises generating the multimedia stream that further comprises the second video and the second audio signal.

9. A method for producing multimedia video presentations comprising:

receiving a video recorded through a camera within a mobile computing device during a period of time;

receiving an input selection entered into the remote device during the period of time;

receiving sensor data from the remote device during the period of time;

initiating a multimedia stream;

accessing a production preference of a user;

inserting a frame of the video into a visual component of the multimedia stream according to the production preference and the sensor data;

inserting digital slide content into the visual component of the multimedia stream based on the production preference, the input selection, and the sensor data;

generating an event tag into the multimedia stream based on the sensor data; and

inserting an event tag into the multimedia stream based on the sensor data and a corresponding timestamp;

wherein receiving sensor data from the remote device comprises receiving motion data of the remote device during the period of time, wherein inserting the frame of the video into the multimedia stream comprises cropping the frame in the video further based on the motion data of the remote device.

10. The method of claim 9, wherein cropping the frame in the video comprises zooming into a portion of the frame in response to a decrease in amplitude of an acceleration signal within the motion data.

11. The method of claim 9, wherein inserting digital slide content into the visual component of the multimedia stream comprises indexing to a subsequent slide in a slide deck and inserting the subsequent slide into the visual component of the multimedia stream for a period of time according to the production preference.

12. The method of claim 9, further comprising receiving an audio signal recorded through the remote device during the period of time, receiving a second video recorded through a second camera within the mobile computing device during the period of time, inserting a frame of the second video corresponding to a particular time into the visual component of the multimedia stream based on the sensor data, and inserting a portion of the audio signal into an audio component of the multimedia stream.

13. The method of claim 12, further comprising receiving a second audio signal recorded through the mobile computing device during the period of time and inserting a portion of the second audio signal into the audio component of the multimedia stream based on a noise amplitude of the second audio signal that exceeds a noise amplitude of the first signal by a threshold amplitude.

14. The method of claim 12, further comprising outputting the multimedia stream as a default composite audio-video stream within a multimedia file, the multimedia file comprising the video, the audio signal, the first input selection, the second input selection, and the position signal.

15. The method of claim 14, further comprising uploading the multimedia stream to a computer network and modifying durations of segments of the video and digital slide content within the default composite audio-video stream according to the production preferences.

16. The method of claim 9, wherein inserting the event tag into the multimedia stream comprises receiving a second input selection from the remote device, correlating the second input selection with a marker type within a set of available marker types, and inserting the marker of the marker type into the multimedia stream at a time corresponding to an elapsed time after a start time of the multimedia stream and a timestamp of the second input selection.

17. The method of claim 9, further comprising receiving a textual question from an audience member over a computer network and insetting text of the textual question over a frame of the video in the multimedia stream.