System and method for controlling videoconference with touch screen interface

• US 8,872,879 B2
• Filed: 01/26/2006
• Issued: 10/28/2014
• Est. Priority Date: 01/26/2006
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (HP Inc.)
• Inventors: Saleh, Youssef, Duckworth, Mark, Paripally, Gopal
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US11/307,194
• Publication Number:
  US 20070171273A1
• Time in Patent Office: 3,197 Days
• Field of Search: 348 1401- 1416, 345/173, 345/690, 715/753, 715/755, 715/751
• US Class Current: 348/14.08
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00472 using a pop-up window
• CPC Class Codes: H04N 1/32117 in a separate transmission or protocol signal prior to or subsequent to the image data transmission, e.g. in digital identification signal [DIS], in non standard setup [NSS] or in non standard field [NSF] for mode signalling H04N1/333
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3266 of text or character information, e.g. text accompanying an image H04N2201/3226 takes precedence
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 2201/3278 Transmission
• CPC Class Codes: H04N 7/14 Systems for two-way working H04N7/12, H04N7/173 take precedence
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A videoconferencing system includes a touch screen display device and a videoconferencing unit. The display device displays video data for the videoconference and generates touch data based on user selections relative to the touch screen. The videoconferencing unit is operatively coupled to the touch screen device by a video connection and a data interface connection, for example. The unit establishes and conducts a videoconference with one or more endpoints via a network. The unit sends video data to the display device and receives touch data from the device. The received touch data is used to control operation of the videoconferencing system. The received touch data can be used to initiate a videoconference call, change an operating parameter, change orientation of a camera, initiate a picture-in-picture display, access a menu, access memory, change a source of video data, initiate a whiteboard display, and access a screen of a connected device.

Claims

1. A videoconferencing system for a plurality of sources of video data, comprising:

a touch screen device configured to display video data and generate touch data with a touch sensor,

a tool sensor, associated with a user tool for the touch screen device and generating an indication when the user tool is moved relative to the tool sensor; and

a videoconferencing unit operatively coupled to the touch screen device and the sources of video data, the videoconferencing unit configured to;

establish a videoconference with one or more endpoints via a network,

receive video data from one or more of the sources of video data,

send received video data to the touch screen device for display and to the one or more endpoints via the network,

wherein when the user tool is moved, the videoconferencing unit receives the indication that the user tool has been moved and is configured in response to automatically;

select one of the sources of video data

switch from a current source of video data to the selected source of video data, and

send video data from the selected source to the touch screen device and to the one or more endpoints.

2. The videoconferencing system of claim 1, wherein the system comprises at least one camera capable of at least one of panning, tilting, or zooming;

and wherein the videoconferencing unit is configured to;

send video data received from the at least one camera to the touch screen device for display,

designate at least one area of sent video data as at least one touch control for user selection, the at least one touch control for controlling the pan, tilt, or zoom of the at least one camera,

receive touch data from the touch screen device,

associate received touch data with the at least one touch control, and

control operation of the at least one camera based on the associated touch control.

3. The system of claim 1, wherein the at least one camera comprises a mechanical actuator for panning, tilting, or zooming the at least one camera, and wherein to control operation of the at least one camera based on the associated touch control, the videoconferencing unit is configured to send a control signal to the mechanical actuator.

4. The system of claim 1, wherein the at least one camera comprises an electronic processing capability for panning, tilting, or zooming video data captured by the at least one camera, and wherein to control operation of the at least one camera based on the associated touch control, the videoconferencing unit is configured to send a control signal to the at least one camera to perform the electronic processing capability.

5. The system of claim 1, wherein the at least one camera comprises a far-end camera coupled to one of the endpoints, and wherein to control operation of the far-end camera based on the associated touch control, the videoconferencing unit is configured to send a control signal to the far-end camera via the network.

6. The system of claim 1, wherein the at least one camera comprises panning, tilting, or zooming capabilities that are mechanically actuated or digitally achieved.

7. The system of claim 1, wherein the at least one camera comprises a pan-tilt-zoom camera, and wherein to designate at least one area of sent video data as at least one touch control for user selection, the videoconferencing unit is configured to generate a grid for display in conjunction with video data sent to the touch screen device, the grid having at least one area corresponding to the at least one touch control for controlling the pan, tilt, or zoom of the at least one camera.

8. The system of claim 7, wherein the grid comprises a first pair of areas corresponding to first touch controls for panning the pan-tilt-zoom camera, a second pair of areas corresponding to second touch controls for tilting the pan-tilt-zoom camera, and a third pair of areas corresponding to third touch controls for zooming the pan-tilt-zoom camera.

9. The system of claim 1, wherein the at least one camera comprises first and second cameras, and wherein to control operation of the first and second cameras based on the associated touch control, the videoconferencing unit is configured to:

determine which one of the first and second cameras currently has video data being sent to the touch screen device, and

control operation of the one determined camera based on the associated touch control.

10. The system of claim 1, wherein the first camera comprises a near camera associated with the videoconferencing unit, and wherein the second camera comprises a far-end camera associated with one of the endpoints of the videoconference.

11. The system of claim 1, wherein the sources of video data are selected from the group consisting of a network interface coupled to the one or more endpoints via the network, a camera, a video cassette recorder, a digital versatile disc player, a laptop computer, a personal computer, a programmable controller of visual sources, and an Extended Graphics Array splitter.

12. The system of claim 1, wherein to automatically switch from the current source of video data to the selected source of video data, the videoconferencing unit is configured to:

generate a whiteboard in response to the moved user tool,

receive touch data from the touch screen device,

combine the received touch data as annotation to the whiteboard, and

send the annotated whiteboard to the touch screen device for display and to the one or more endpoints of the videoconference via the network.

13. The system of claim 1, wherein:

the touch screen device comprises a first data interface,

the videoconferencing unit comprises a second data interface coupled to the first data interface, and

the second data interface receives touch data from the first data interface of the touch screen device.

14. The system of claim 13, further comprising:

a computer having a video output and having a data interface coupled to another data interface of the touch screen device; and

an extended graphics array splitter having a video input coupled to the video output of the computer, the splitter having a video output coupled to a video input of the videoconferencing unit and having another video output coupled to another video input of the touch screen device.

15. The system of claim 13, further comprising a visual controller having data interfaces coupled between the first and second data interfaces of the videoconferencing unit and the touch screen device.

16. The system of claim 15, wherein one or more of the sources of video data are coupled to one or more video inputs of the visual controller, and wherein the visual controller comprises one or more video outputs coupled to one or more video inputs of the videoconferencing unit.

17. The system of claim 1, wherein the tool sensor is disposed on a tray of the touch screen and generates the indication when the user tool is picked up from the tray.

18. The system of claim 17, wherein the tool sensor senses at least one of a pen and an eraser as the user tool disposed on the tray.

19. The system of claim 17, wherein the tool sensor comprises an optical sensor disposed on the tray.

20. A videoconferencing system, comprising:

a touch screen device configured to display video data and generate touch data, the touch screen device comprising first and second video inputs and first and second data interfaces, the touch screen device having a user tool and a sensor, the sensor generating an indication when the user tool is moved relative to the sensor;

a computer coupled to the first video input and the first data interface of the touch screen device, the computer having a video output for content; and

a videoconferencing unit coupled to the video output of the computer and coupled to the second video input and the second data interface of the touch screen device, the videoconferencing unit having a network interface establishing a videoconference with one or more endpoints via a network;

wherein in an annotation mode of operation, the computer is configured to;

receive touch data from the touch screen device, and

combine received touch data as annotation to content, and

send annotated content to the touch screen device for display and to the videoconferencing unit,

wherein the videoconferencing system is configured to automatically switch to the annotation mode of operation in response to the indication, and

wherein in the annotation mode of operation, the videoconferencing unit is configured to;

receive annotated content from the computer, and

send received annotated content to the endpoints via the network.

21. The system of claim 20, wherein the content sent from the computer in the annotation mode of operation comprises a whiteboard, a computer screen, an image, or visual media.

22. The system of claim 20, further comprising:

an extended graphics array splitter having a video input coupled to the video output of the computer, the splitter having a video output coupled to a video input of the videoconferencing unit and having another video output coupled to the first video input of the touch screen device.

23. The system of claim 22, further comprising a visual controller having data interfaces coupled between a data interface of the videoconferencing unit and the second data interface of the touch screen device.

24. The system of claim 23, wherein at least one source of video data is coupled to a video input of the visual controller, and wherein the visual controller comprises a video output coupled to a video input of the videoconferencing unit.

25. The system of claim 24, wherein the at least one source of video data is selected from the group consisting of a camera, a video cassette recorder, and a digital versatile disc player.