Multi-camera mobile teleconferencing platform

• US 10,259,119 B2
• Filed: 10/27/2015
• Issued: 04/16/2019
• Est. Priority Date: 09/30/2005
• Status: Active Grant

• Current Assignee: Teladoc Health, Inc.
• Original Assignee: Touch Technologies Incorporated
• Inventors: Wang, Yulun, Jordan, Charles S., Pinter, Marco, Southard, Jonathan, Laby, Keith Phillip, Herzog, John Cody
• Primary Examiner(s): Sample, Jonathan L
• Application Number:
  US14/924,453
• Publication Number:
  US 20160046024A1
• Time in Patent Office: 1,267 Days
• Field of Search: 700245-264
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/35 for telesurgery
• CPC Class Codes: A61B 34/70 Manipulators specially adapted for use in surgery
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: B25J 13/006 by means of a wireless system for controlling one or several manipulators
• CPC Class Codes: B25J 13/06 Control stands, e.g. consoles, switchboards
• CPC Class Codes: B25J 19/021 Optical sensing devices
• CPC Class Codes: B25J 5/00 Manipulators mounted on wheels or on carriages B25J1/00 takes precedence; programme-controlled manipulators B25J9/00 ; vehicle aspects B60, B62, e.g. remote-controlled steering for motor vehicles B62D1/24; control of position of vehicles G05D1/00
• CPC Class Codes: B25J 9/1689 Teleoperation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A remote controlled robot system that includes a mobile robot and a remote control station. A user can control movement of the robot from the remote control station. The mobile robot includes a camera system that can capture and transmit to the remote station a zoom image and a non-zoom image. The remote control station includes a monitor that displays a robot view field. The robot view field can display the non-zoom image. The zoom image can be displayed in the robot view field by highlighting an area of the non-zoom field. The remote control station may also store camera locations that allow a user to move the camera system to preset locations.

Claims

1. A teleconferencing system, comprising:

a teleconferencing device including a housing that supports a monitor and a camera system that includes a first camera and a second camera mounted to the housing such that the first camera and the second camera face substantially the same direction, the first camera having a first field of view and the second camera having a second field of view that is different from the first field of view; and

,

a remote station that includes a camera, a monitor, and a graphical user interface function that provides a zoom input, the remote station monitor displays a display user interface including a local view field that displays an image captured by the remote station camera and a remote view field that displays either the image captured by the first camera or the image captured by the second camera, wherein the display user interface switches the remote view field to display either the image captured by the first camera or the image captured by the second camera depending on the zoom input, the remote station monitor displaying only one of the images from the first or second cameras at a time, and wherein the monitor of the teleconferencing device displays the image captured by the remote station camera.

2. The system of claim 1, wherein said graphical user interface function includes specifying a highlighted area within the displayed image.

3. The system of claim 2, wherein specifying the highlighted area is initiated by depressing a mouse.

4. The system of claim 1, wherein said graphical user interface function includes a slide bar.

5. The system of claim 2, wherein said camera system moves to a center of said highlighted area.

6. The system of claim 1, wherein said remote station includes at least one stored camera position.

7. The system of claim 6, wherein said remote station includes a keyboard and said stored camera position is stored by depressing a key on said keyboard.

8. The system of claim 7, wherein said camera system moves in response to said stored camera position in response to said key being depressed.

9. The system of claim 6, wherein said station monitor displays an indication that said stored camera position has been stored.

10. A method for a teleconferencing system including a teleconferencing device that has a housing that supports a monitor and a camera system including a first camera and a second camera mounted to the housing such that the first camera and the second camera face substantially the same direction, the first camera having a first field of view and the second camera having a second field of view that is different from the first field of view, the method comprising:

displaying an image captured by a camera of a remote station in a local view field of a display user interface displayed on a monitor of the remote station;

displaying an image captured by the first camera in a remote view field of the display user interface displayed on the remote station monitor;

switching the remote view field to display an image captured by the second camera in place of the image captured by the first camera in response to a zoom input provided by a user via a graphical user interface function, wherein the remote station monitor displays only one of the images from the first camera or the second camera at a time; and

,

displaying the image captured by the remote station camera on the monitor of the teleconferencing device.

11. The method of claim 10, wherein the image captured by the second camera corresponds to an area specified by highlighting an area within the image captured by the first camera.

12. The method of claim 10, wherein the step of switching the remote view field is responsive to user input received from a mouse.