GRAPHICAL USER INTERFACES INCLUDING TOUCHPAD DRIVING INTERFACES FOR TELEMEDICINE DEVICES

• US 20150077502A1
• Filed: 11/21/2014
• Published: 03/19/2015
• Est. Priority Date: 05/22/2012
• Status: Active Grant

• Current Assignee: iRobot Corporation, Jonata Sub Two, Inc. (Teladoc Health, Inc.), Teladoc Health, Inc.
• Original Assignee: iRobot Corporation, Touch Technologies Incorporated
• Inventors: Jordan, Charles S., Lai, Fuji, Wright, Timothy C., Whitney, Blair, Ballantyne, James, Wang, Yulun, Wong, Cheuk Wah, Kearns, Justin, Taka, Orjeta, Young, Andy, Ng, Mei Sheng, Lurie, Yair, Herzog, John Cody, Rizzi, Bill, Karandikar, Ramchandra
• Granted Patent: US 9,361,021 B2
• Time in Patent Office: Days
• US Class Current: 348/14.03
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 50/22 Social work or social welfare, e.g. community support activities or counselling services
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

Claims

1. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

selectively displaying a video feed from the remote telepresence device in a video panel on an electronic display of the electronic device;

selectively displaying patient telemetry data simultaneously with the live video feed;

receiving a navigation input; and

transmitting navigation instructions associated with the navigation input to the remote telepresence device.

3. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a toolbar comprising at least one selectable setting function associated with at least one of the electronic device and the remote presence device.

13. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a plurality of destination locations within a healthcare facility;

receiving a selection of one of the plurality of destination locations within the healthcare facility; and

transmitting navigation instructions associated with the selected destination location to the telepresence device.

18. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a plan view map of a healthcare facility associated with remote presence device, and

wherein the navigation input is provided with respect to the plan view map.

20. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

receiving a selection of an avatar to visually represent the operator of the electronic device; and

transmitting the selected avatar to the remote presence device.

23. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively overlaying a plurality of directional icons on the live video feed within the video panel, and

wherein receiving a navigation input comprises at least one of;

receiving a selection of a left directional icon to move the remote presence device to the left relative to the live video feed; and

receiving a selection of a right directional icon to move the remote presence device to the right relative to the live video feed;

receiving a selection of a reverse directional icon to move the remote presence device in reverse relative to the live video feed; and

receiving a selection of a forward directional icon to move the remote presence device forward relative to the live video feed.

24. The non-transitory computer-readable storage medium of claim 23, wherein the navigation instructions associated with a selection of the reverse directional icon are configured to orient the live video feed from the remote telepresence device in the direction of movement.

26. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a selection of navigational modes, including at least one of;

a cursor pointer mode configured to allow an operator to provide a navigation input relative to the live video feed via an on-screen cursor;

a head mode configured to allow an operator to provide a navigation input for controlling only the movement of a head portion of the remote presence device;

a laser pointer mode configured to allow an operator to provide a navigation input relative to the live video feed by controlling the location of a simulated on-screen illumination point;

a map drive mode configured to allow an operator to provide a navigation input relative to a displayed map;

a click drive mode configured to allow an operator to provide a navigation input relative to the live video feed by selecting a location within the live video feed; and

a drag-drive mode configured to allow an operator to provide a navigation input relative to the live video feed by defining a navigational path within the live video feed; and

receiving a selection of a navigational mode.

27. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a plurality of patient identifiers, wherein each patient identifier is associated with a location within a healthcare facility;

receiving a selection of one of the plurality of patient identifiers; and

transmitting navigation instructions based on the location within the healthcare facility associated with the selected patient identifier.

30. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

displaying a request for a selection of at least one of a plurality of remote presence devices;

receiving a selection of one of the plurality of remote presence devices;

displaying a request for a selection of at least one of plurality of patients, each of the plurality of patients associated with a location within a healthcare facility;

receiving a selection of one of the plurality of patients; and

communicatively connecting the electronic device to the selected remote presence device, and

wherein receiving the navigation input comprises receiving the location within the healthcare facility associated with the selected patient.

33. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying an avatar representation of the remote telepresence device in an avatar panel on the electronic display of the electronic device.

34. The non-transitory computer-readable storage medium of claim 33, wherein the operations further comprise:

displaying the avatar representation of the remote telepresence device so as to convey an intended navigation path with respect to a displayed landing strip.

35. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying an avatar representation of the remote telepresence device overlaid in the live video feed within the video panel.

36. The non-transitory computer-readable storage medium of claim 35, wherein the operations further comprise:

displaying the avatar representation of the remote telepresence device so as to convey an intended navigation path with respect to the live video feed.

40. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

selectively displaying a help screen overlay, wherein the help screen overlay provides information regarding at least one available function currently displayed on the electronic display.

41. The non-transitory computer-readable storage medium of claim 1, wherein the navigation instructions are adjusted based on a latency of the video feed and movement of the remote telepresence device during the latency period.

2. (canceled)

4-12. -12. (canceled)

14-17. -17. (canceled)

19. (canceled)

21. (canceled)

22. (canceled)

25. (canceled)

28. (canceled)

29. (canceled)

31. (canceled)

32. (canceled)

37. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

selectively displaying a video feed from the remote telepresence device in a video panel on an electronic display of the electronic device;

receiving a navigation input; and

transmitting navigation instructions associated with the navigation input to the remote telepresence device;

selectively displaying a first virtual joystick on the electronic display of the electronic device, and

wherein the navigation input is provided via the first virtual joystick with respect to the live video feed.

38. The non-transitory computer-readable storage medium of claim 37, wherein the operations further comprise:

displaying a second virtual joystick on the electronic display of the electronic device;

receiving a head movement input via the second virtual joystick with respect to the live video feed; and

transmitting head movement input instructions associated with the head movement input to the remote telepresence device.

39. The non-transitory computer-readable storage medium of claim 37, wherein the first virtual joystick is overlaid on the live video feed within the video panel.

42. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:

communicatively connecting an electronic device to a remote presence device;

selectively displaying a video feed from the remote telepresence device in a video panel on an electronic display of the electronic device;

selectively overlaying a plurality of directional icons on the live video feed;

receiving a navigation input in the form of a vector comprising a length and a direction with respect to the live video feed;

transmitting navigation instructions associated with the navigation input to the remote telepresence device, wherein the navigation instructions include a velocity corresponding to the length of the vector,

wherein the navigation instructions are adjusted based on a latency of the video feed and movement of the remote telepresence device during the latency period.

53. The non-transitory computer-readable storage medium of claim 42, wherein the operations further comprise:

displaying a request for a selection of at least one of a plurality of remote presence devices;

receiving a selection of one of the plurality of remote presence devices; and

communicatively connecting the electronic device to the at least one selected remote presence device.

61. The non-transitory computer-readable storage medium of claim 42, wherein the operations further comprise:

selectively displaying patient telemetry data simultaneously with the live video feed.

43-52. -52. (canceled)

54-60. -60. (canceled)

62-76. -76. (canceled)