Enhanced video interaction for a user interface of a telepresence network
First Claim
1. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of generating pre-session video loops, the method comprising:
- receiving, at a telepresence device, an indication to navigate to an indicated location;
adjusting a camera on the telepresence device to identify one or more areas of interest at the indicated location;
sequentially targeting each area of interest with the camera;
recording video of each area of interest for a predetermined time period; and
transmitting the recorded video to a remotely located control device, wherein the one or more areas of interest contain an object selected from the group consisting of a patient'"'"'s face, an EKG monitor, a chart, and a fluid bag.
10 Assignments
0 Petitions
Accused Products
Abstract
A telepresence device may relay video, audio, and/or measurement data to a user operating a control device. A user interface may permit the user to quickly view and/or understand temporally and/or spatially disparate information. The telepresence device may pre-gather looped video of spatially disparate areas in an environment. A temporal control mechanism may start video playback at a desired point in a current or historical video segment. Notations may be associated with time spans in a video and recalled by capturing an image similar to a frame in the time span of the video. An area of interest may be selected and video containing the area of interest may be automatically found. Situational data may be recorded and used to recall video segments of interest. The telepresence device may synchronize video playback and movement. A series of videos may be recorded at predetermined time intervals to capture visually trending information.
-
Citations
33 Claims
-
1. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of generating pre-session video loops, the method comprising:
-
receiving, at a telepresence device, an indication to navigate to an indicated location; adjusting a camera on the telepresence device to identify one or more areas of interest at the indicated location; sequentially targeting each area of interest with the camera; recording video of each area of interest for a predetermined time period; and transmitting the recorded video to a remotely located control device, wherein the one or more areas of interest contain an object selected from the group consisting of a patient'"'"'s face, an EKG monitor, a chart, and a fluid bag. - View Dependent Claims (2, 3)
-
-
4. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of providing segmented temporal video control of video received from a telepresence device, the method comprising:
-
receiving streaming video from the telepresence device; determining a plurality of video segments corresponding to a plurality of telepresence device activities; displaying a first video segment associated with a first telepresence device activity to a user; providing a temporal control mechanism to the user permitting the user to select a first playback point within the first video segment; receiving an indication of a desired time span from the user, wherein none of the plurality of determined video segments wholly correspond to the desired time span; determining a desired video segment corresponding to the desired time span; and displaying the desired video segment to the user. - View Dependent Claims (5, 6)
-
-
7. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of annotating video segments received from a telepresence device, the method comprising:
-
receiving streaming video from the telepresence device; displaying a video segment from the streaming video to a user; receiving an indication of a desired time span from the user; receiving an annotation corresponding to the desired time span from the user; storing the received annotation in association with the desired time span; and displaying an interactive indication in a location corresponding to the desired time span, wherein the user may access the received annotation using the interactive indication; receiving a drawn object to be overlaid on the video segment during the desired time span; and displaying the drawn object overlaid on the video segment when the desired time span is displayed. - View Dependent Claims (8, 9)
-
-
10. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of recalling annotations based on a captured image, the method comprising:
-
receiving video from a telepresence device; receiving an annotation from a first user corresponding to a frame in the video; storing first location data corresponding to the frame; storing the annotation; receiving an image from a second device at a later time; identifying second location data corresponding to the image; retrieving the first location data and the annotation; and displaying at least a portion of the annotation if the second location data is within a predetermined threshold of the first location data, wherein the first location data comprises at least one data element selected from the group consisting of a room number, a position of the telepresence device, an orientation of the telepresence device, a camera tilt, a camera pan, a camera zoom, and a set of image descriptors, and wherein the first location data corresponds to the frame in the video. - View Dependent Claims (11, 12, 13)
-
-
14. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of spatially searching video, the method comprising:
-
receiving the video from a telepresence device; storing the video; receiving an indication of a spatial area of interest in a frame of the video from a user; identifying one or more video segments from the stored video containing the spatial area of interest; and providing indications of the one or more video segments to the user, wherein identifying one or more video segments comprises comparing the spatial area of interest to the stored video using an algorithm selected from the group consisting of a pattern-matching algorithm and an inverse kinematics algorithm. - View Dependent Claims (15, 16)
-
-
17. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of contextually searching video from a telepresence device, the method comprising:
-
receiving the video from the telepresence device; storing the video; storing situational data for each of a plurality of video segments; receiving an indication of a situation of interest from a user; identifying one or more matching video segments corresponding to the situation of interest; and providing indications of the one or more matching video segments to the user, wherein the situational data comprises at least one data element selected from the group consisting of a patient name, a procedure being performed, and a remote practitioner operating the telepresence device. - View Dependent Claims (18, 19)
-
-
20. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of synchronized location and video replay, the method comprising:
-
storing a plurality of video segments recorded by a telepresence device; storing corresponding location data for each of the plurality of video segments; navigating the telepresence device to a first location; and playing a first video segment corresponding to the first location while the telepresence device is at the first location, wherein the telepresence device is a mobile robot. - View Dependent Claims (21, 22, 23)
-
-
24. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of monitoring visible trends, the method comprising:
-
visiting a predetermined location with a telepresence device at predetermined time intervals; scanning the predetermined location for one or more predetermined areas of interest; recording video of each area of interest during each visit for a predetermined time period; and transmitting the recorded video to a storage device, wherein scanning the predetermined location comprises identifying an object of interest using at least one algorithm selected from the group consisting of scale-invariant feature transform (SIFT), speeded up robust features (SURF), and oriented features from accelerated segment test and rotated binary robust independent elementary features (ORB). - View Dependent Claims (25, 26)
-
-
27. A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of reorienting an object in a video, the method comprising:
-
communicatively connecting a control device to a telepresence device; selectively displaying a video feed from the telepresence device in a video panel on an electronic display of the control device;
receiving a zoom request associated with a selected portion of the video feed;magnifying the selected portion of the video feed; identifying informational content within the magnified selected portion of the video feed that is misaligned with respect to the orientation of the video feed; and digitally aligning the informational content with respect to the orientation of the video feed, wherein identifying informational content comprises identifying informational content selected from the group consisting of written or printed information on a document, information displayed on an electronic display, text, a chart, and an image. - View Dependent Claims (28, 29, 30, 31, 32, 33)
-
Specification