Systems and methods for controlling robotic stands during videoconference operation

• US 9,615,053 B2
• Filed: 01/09/2015
• Issued: 04/04/2017
• Est. Priority Date: 01/10/2014
• Status: Expired due to Fees

• Current Assignee: Xandex Investments LLC. (Xandex, Inc.)
• Original Assignee: Revolve Robotics, Inc.
• Inventors: Huang, Timothy, Polyakov, Ilya, Rosenthal, Marcus
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US14/593,871
• Publication Number:
  US 20150201160A1
• Time in Patent Office: 816 Days
• Field of Search: 348 1403, 348 1408, 348169, 348722, 348 1405, 348 1409, 3482181, 348 36, 348 65, 348148, 348159, 34820799, 3482113, 3482118, 3482119, 348239, 348376, 381303, 382118, 382103, 382298, 386248, 709205, 713150, 2481763, 354293, 378 62, 378194, 600300, 600424, 21912422, 345420, 700259
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

Systems and methods are disclosed for selecting and orienting a computing device mounted on a robotic stand for videoconferences. For example, a method for operating a robotic stand supporting a computing device is disclosed, which includes displaying, by a display of a remote device, a control interface depicting a physical location that includes a plurality of robotic stands with respective computing devices. The method further includes providing, responsive to a user of the remote device interacting with the control interface, a selection instruction selecting a region of the physical location for viewing with one of the plurality of robotic stands with respective computing devices, and generating, by the control interface, a positioning instruction based on the selected region of the physical location, the positioning instruction configured to orient the robotic stand including the computing device determined to be available to face the region of the physical location.

Claims

1. A method for operating a robotic stand supporting a computing device, the method comprising:

establishing a connection between the computing device, including at least a display and a camera, and a remote device;

displaying, by a display of the remote device, a control interface depicting a conference room that includes a schematic of a conference room table and a plurality of attendee positions;

providing, responsive to a user of the remote device interacting with the control interface, a positioning instruction to orient the robotic stand about at least a pan axis or a tilt axis so that a display and a camera of the computing device faces at least one attendee position, wherein the robotic stand supporting the computing device is physically located in the conference room depicted by the control interface;

transmitting, by the remote device, over a communication network, a signal indicative of the positioning instruction to the computing device; and

transmitting the positioning instruction from the computing device to the robotic stand.

2. The method of claim 1, further comprising:

receiving a first video feed from the camera of the computing device displaying the attendee position selected in accordance with the positioning instructions; and

transmitting a second video feed from a camera of the remote device to be shown on the display of the computing device.

3. The method of claim 1, further comprising:

receiving, responsive to the user of the remote device interacting with the control interface, a configuration instruction to change a shape of the conference room table depicted by the control interface; and

altering the shape of the conference room table depicted by the control interface responsive to the configuration instruction.

4. The method of claim 1, further comprising:

receiving, from a server coupled to the computing device and the remote device, the control interface.

5. The method of claim 1, further comprising:

displaying a plurality of preset locations on the control interface depicting the conference room, wherein the plurality of preset locations correspond with attendee locations around a perimeter of the conference room table depicted by the control interface.

6. The method of claim 1, further comprising:

receiving, from the user of the remote device interacting with the control interface, a preset instruction to scan the conference room for presetting locations of the attendees; and

setting the preset locations on the control interface as the robotic stand scans the conference room depicted by the control interface.

7. The method of claim 1, further comprising:

providing, responsive to an action of the user of the remote device interacting with the control interface, a configuration instruction to manipulate a video projector located in a physical conference room depicted by the control interface; and

transmitting the configuration instruction to the computing device located in the physical conference room.

8. A method of automatically tracking an object during a videoconference with a computing device supported on a robotic stand, the method comprising:

receiving, with the computing device, a command to track the object from a remote device responsive to a user input;

receiving an image from a camera, wherein the camera provides pixel information of the image;

transmitting an electrical signal containing the pixel information of the image to at least one processing unit of the computing device;

responsive to receiving the command to track the object, determining, by the at least one processing unit, a location of a source of the pixel information of the image;

transmitting, via the computing device, a positioning instruction to the robotic stand to orient the robotic stand about at least a pan axis or a tilt axis to aim the computing device at the location of the source of the pixel information of the image; and

rotating the robotic stand based on the positioning instruction without further user interaction.

9. The method of claim 8, wherein rotating the robotic stand about at least one of a pan axis or a tilt axis comprises actuating a rotary actuator associated with the at least one of a pan axis or a tilt axis.

10. The method of claim 9, further comprising generating, by the at least one processing unit, a motion command signal and transmitting the motion command signal to the rotary actuator to actuate the rotary actuator.

11. A method for operation of a robotic stand supporting a computing device, the method comprising:

displaying, by a display of a remote device, a control interface depicting a physical location that includes a plurality of robotic stands with respective computing devices;

providing, responsive to a user of the remote device interacting with the control interface, a selection instruction selecting a region of the physical location for viewing with one of the plurality of robotic stands with respective computing devices, wherein each of the plurality of computing devices at least includes a display and a camera; and

connecting, by the control interface, to at least one of the plurality of robotic stands including a respective computing device, wherein the at least one of the plurality of robotic stands including a respective computing device is selected based at least on proximity to the region of the physical location.

12. The method of claim 11, wherein connecting, by the control interface, to at least one of the plurality of robotic stands including a respective computing device, wherein the at least one of the plurality of robotic stands including a respective computing device is selected based at least on proximity to the region of the physical location comprises:

determining, by the control interface, which of the plurality of robotic stands including a respective computing device in close proximity to the region of the physical location is available; and

transmitting, by the remote device, a connection request over a communications network to the robotic stand including the computing device determined to be available; and

receiving, at the remote device, a video feed from the robotic stand including the computing device determined to be available, the video feed showing the region of the physical location.

13. The method of claim 12, further comprising:

generating, by the control interface, a positioning instruction based on the selected region of the physical location, the positioning instruction configured to orient the robotic stand including the computing device determined to be available to face the region of the physical location; and

transmitting, by the remote device over the communications network, a signal indicative of the positioning instruction to the robotic stand including the computing device determined to be available.

14. The method of claim 11, further comprising:

providing, responsive to a user interacting with the control interface, a selection command selecting one of the plurality of robotic stands including a respective computing device; and

transmitting, by the control interface, the selection command by a communications network to the selected one of the plurality of robotic stands including a respective computing device.

15. The method of claim 12, further comprising:

providing, responsive to the user of the remote device interacting with the control interface, a positioning instruction to orient the selected one of the plurality of robotic stands including a respective computing device about at least a pan axis or a tilt axis so that a display and a camera of the computing device faces a desired region of the physical location; and

transmitting, by the remote device, over a communication network a signal indicative of the positioning instruction to the robotic stand.

16. A method for operation of a robotic stand supporting a computing device, the method comprising:

displaying, on a display of a remote device, a control interface showing a plurality of views available from the robotic stand supporting the computing device;

providing, responsive to a user of the remote device interacting with the control interface, a selection command selecting one of the plurality of views;

transmitting, by the remote device over a communications network, a signal indicative of the selection command to the computing device; and

providing, via the computing device, a positioning instruction to the robotic stand supporting the computing device to orient the robotic stand about at least a pan axis or a tilt axis to provide a view corresponding to the selection command.

17. The method of claim 16, further comprising:

receiving, at the remote device, a video feed from a camera of the computing device showing the selected one of the plurality of views.

18. The method of claim 17, further comprising:

providing, responsive to the user of the remote device interacting with the control interface, a scan command to scan a viewable area of the selected one of the plurality of views for individuals located therein by the robotic stand including the computing device;

transmitting, by the remote device over a communications network, a signal comprising the scan command to the robotic stand including the computing device; and

receiving, by the control interface, a video feed from the robotic stand including the computing device as the scan command is performed, the video feed showing an individual.

19. The method of claim 18, further comprising:

performing, by the remote device, a facial recognition operation to determine the identity of the individual shown in the video feed; and

displaying, by the control interface on the display of the remote device, social media contents attributed to the individual based on the determination of the individual'"'"'s identity.

20. The method of claim 16, further comprising:

displaying, by the remote device, a selection of a plurality of other robotic stands including a computing device located at various locations around a physical area; and

displaying, by the remote device, a status of each of the plurality of other robotic stands including a computing device located at various locations around a physical area.

21. The method of claim 20, further comprising:

providing, responsive to the user interacting with the control interface, a selection command to select one of the plurality of other robotic stands including a computing device located at various locations around a physical area;

prompting the user via the control interface with a password input panel for the user to connect with the selected one of the plurality of other robotic stands including a computing device;

receiving, from the user interacting with the control interface, a password to connect with the selected one of the plurality of other robotic stands including a computing device; and

connecting, using the control interface, the remote device to the selected one of the plurality of other robotic stands including a computing device.