GRAPHICAL USER INTERFACES INCLUDING TOUCHPAD DRIVING INTERFACES FOR TELEMEDICINE DEVICES

• US 20160283685A1
• Filed: 05/13/2016
• Published: 09/29/2016
• Est. Priority Date: 05/22/2012
• Status: Active Grant

• Current Assignee: iRobot Corporation, Jonata Sub Two, Inc. (Teladoc Health, Inc.), Teladoc Health, Inc.
• Original Assignee: iRobot Corporation, Touch Technologies Incorporated
• Inventors: Jordan, Charles S., Young, Andy, Ng, Mei Sheng, Lurie, Yair, Lai, Fuji, Wright, Timothy C., Herzog, Cody, Whitney, Blair, Rizzi, Bill, Ballantyne, James, Wang, Yulun, Wong, Cheuk Wah, Kearns, Justin, Taka, Orjeta, Karandikar, Ramchandra
• Granted Patent: US 10,061,896 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 50/22 Social work or social welfare, e.g. community support activities or counselling services
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

Claims

1. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

selectively displaying a video feed from the remote presence device in a video panel on an electronic display of the electronic device;

selectively displaying patient information simultaneously with the live video feed;

receiving a navigation input that forms at least part of an intended navigation path of the remote presence device;

displaying at least a portion of the intended navigation path of the remote presence device overlaid on the live video feed;

transforming the navigation input into navigation instructions that are interpretable by the remote presence device; and

transmitting the navigation instructions associated with the navigation input to the remote presence device.

2. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a toolbar comprising at least one selectable setting function associated with at least one of the electronic device and the remote presence device.

3. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a plurality of destination locations within a healthcare facility;

receiving a selection of one of the plurality of destination locations within the healthcare facility as the navigation input; and

transmitting the navigation instructions associated with the selected destination location to the remote presence device.

4. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a map of a healthcare facility associated with the remote presence device, and

wherein the navigation input is provided with respect to the map.

5. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

receiving a selection of an avatar to visually represent the operator of the electronic device; and

transmitting the selected avatar to the remote presence device.

6. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively overlaying a plurality of directional icons on the live video feed within the video panel, and

wherein receiving a navigation input comprises at least one of;

receiving a selection of a left directional icon to move the remote presence device to the left relative to the live video feed; and

receiving a selection of a right directional icon to move the remote presence device to the right relative to the live video feed;

receiving a selection of a reverse directional icon to move the remote presence device in reverse relative to the live video feed; and

receiving a selection of a forward directional icon to move the remote presence device forward relative to the live video feed.

7. The non-transitory computer-readable storage medium of claim 6, wherein the navigation instructions associated with a selection of the reverse directional icon are configured to orient the live video feed from the remote presence device in the direction of movement, independent of a direction the remote presence device is facing.

8. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a selection of navigational modes, including at least one of;

a cursor pointer mode configured to allow an operator to provide a navigation input relative to the live video feed via an on-screen cursor;

a head mode configured to allow an operator to provide a navigation input for controlling only the movement of a head portion of the remote presence device;

a laser pointer mode configured to allow an operator to provide a navigation input relative to the live video feed by controlling the location of a simulated on-screen illumination point;

a map drive mode configured to allow an operator to provide a navigation input relative to a displayed map;

a click drive mode configured to allow an operator to provide a navigation input relative to the live video feed by selecting a location within the live video feed; and

a drag-drive mode configured to allow an operator to provide a navigation input relative to the live video feed by defining a navigational path within the live video feed; and

receiving a selection of a navigational mode.

9. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a plurality of patient identifiers, wherein each patient identifier is associated with a location within a healthcare facility;

receiving a selection of one of the plurality of patient identifiers; and

transmitting navigation instructions based on the location within the healthcare facility associated with the selected patient identifier.

10. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

displaying a request for a selection of at least one of a plurality of remote presence devices;

receiving a selection of one of the plurality of remote presence devices;

displaying a request for a selection of at least one of plurality of patients, each of the plurality of patients associated with a location within a healthcare facility;

receiving a selection of one of the plurality of patients; and

communicatively connecting the electronic device to the selected remote presence device, and

wherein receiving the navigation input comprises receiving the location within the healthcare facility associated with the selected patient.

11. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying an avatar representation of the remote telepresence device in an avatar panel on the electronic display of the electronic device.

12. The non-transitory computer-readable storage medium of claim 1, wherein the intended navigation path is overlaid as an arrow on the live video feed.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

selectively displaying a video feed from the remote presence device in a video panel on an electronic display of the electronic device;

selectively displaying patient information simultaneously with the live video feed;

selectively displaying a list of destinations within a healthcare facility;

receiving a navigation input with respect to the displayed list of destinations;

transforming the navigation input into navigation instructions that are interpretable by the remote presence device; and

transmitting the navigation instructions associated with the navigation input to the remote presence device.

14. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

displaying a video feed from the remote telepresence device in a video panel on an electronic display of the electronic device;

displaying a first virtual joystick on the electronic display of the electronic device;

receiving at least one navigation input via the first virtual joystick with respect to the live video feed;

generating a navigation instruction for the remote presence device based on the at least one navigation input;

transmitting the navigation instructions associated with the intended navigation path; and

displaying at least a portion of an intended navigation path of the remote presence device overlaid on the live video feed.

15. The non-transitory computer-readable storage medium of claim 14, wherein the intended navigation path is overlaid as an arrow on the live video feed.

16. The non-transitory computer-readable storage medium of claim 14, wherein the operations further comprise:

displaying a second virtual joystick on the electronic display of the electronic device;

receiving a head movement input via the second virtual joystick with respect to the live video feed; and

transmitting head movement input instructions associated with the head movement input to the remote telepresence device.

17. The non-transitory computer-readable storage medium of claim 14, wherein the first virtual joystick is overlaid on the live video feed within the video panel.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

selectively displaying a video feed from the remote telepresence device in a video panel on an electronic display of the electronic device;

selectively overlaying a plurality of directional icons on the live video feed;

receiving a navigation input in the form of a vector comprising a length and a direction with respect to the live video feed;

displaying an intended navigation path of the remote presence device overlaid on the live video feed, wherein the intended navigation path is based on the received navigation input; and

transmitting navigation instructions associated with the navigation input to the remote telepresence device, wherein the navigation instructions include a velocity corresponding to the length of the vector.

19. The non-transitory computer-readable storage medium of claim 18, wherein the operations further comprise:

displaying a request for a selection of at least one of a plurality of remote presence devices;

receiving a selection of one of the plurality of remote presence devices; and

communicatively connecting the electronic device to the at least one selected remote presence device.

20. The non-transitory computer-readable storage medium of claim 18, wherein the operations further comprise:

selectively displaying patient information simultaneously with the live video feed.