Controlling videoconference with touch screen interface

• US 8,593,502 B2
• Filed: 01/18/2011
• Issued: 11/26/2013
• Est. Priority Date: 01/26/2006
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Saleh, Youssef, Duckworth, Mark, Paripally, Gopal, Hiller, Everett, Nelson, Britt, Henry, Wallace
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US13/008,280
• Publication Number:
  US 20110234746A1
• Time in Patent Office: 1,043 Days
• Field of Search: 348 1401- 1416, 715/753, 370260-261, 709204-205
• US Class Current: 348/14.03
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 1/00392 Other manual input means, e.g. digitisers or writing tablets
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/00472 using a pop-up window
• CPC Class Codes: H04N 1/00474 outputting a plurality of functional options, e.g. scan, copy or print
• CPC Class Codes: H04N 1/00496 Constructional details of the interface or console not otherwise provided for, e.g. rotating or tilting means
• CPC Class Codes: H04N 1/32117 in a separate transmission or protocol signal prior to or subsequent to the image data transmission, e.g. in digital identification signal [DIS], in non standard setup [NSS] or in non standard field [NSF] for mode signalling H04N1/333
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3266 of text or character information, e.g. text accompanying an image H04N2201/3226 takes precedence
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 2201/3278 Transmission
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A videoconferencing system includes a touch screen display device and a videoconferencing unit. The display device displays video data for the videoconference and generates touch data based on user selections relative to the touch screen. The videoconferencing unit is operatively coupled to the touch screen device by a video connection and a data interface connection, for example. The unit establishes and conducts a videoconference with one or more endpoints via a network. The unit sends video data to the display device and receives touch data from the device. The received touch data is used to control operation of the videoconferencing system. The received touch data can be used to initiate a videoconference call, change an operating parameter, change orientation of a camera, initiate a picture-in-picture display, access a menu, access memory, change a source of video data, initiate a whiteboard display, and access a screen of a connected device.

Claims

1. A videoconferencing apparatus, comprising:

a touch panel generating touch data and having a sensor, the sensor generating a source selection in response to user movement relative thereto; and

a videoconferencing device operatively coupled to the touch panel and to a plurality of sources, the videoconferencing device configured to;

establish a videoconference with at least one endpoint via a network,

send video from at least a first of the sources to the at least one endpoint via the network,

receive the source selection from the touch panel when user movement is made relative to the sensor,

automatically select at least one second of the sources in response to the source selection,

automatically switch from the at least one first source to the at least one second source, and

send video from the at least one second source to the at least one endpoint,

wherein the sources are selected from the group consisting of a network interface coupled to the at least one endpoint via the network, a camera, a video cassette recorder, a digital versatile disc player, a laptop computer, a personal computer, a programmable controller of visual sources, and an Extended Graphics Array splitter.

2. The apparatus of claim 1, wherein the videoconferencing device is configured to send video from one or more of the sources to the touch panel for display.

3. The apparatus of claim 1, wherein to automatically switch, the videoconferencing device is configured to:

generate a whiteboard in response to the source selection,

receive touch data from the touch screen device,

combine the received touch data as annotation to the whiteboard, and

send the annotated whiteboard to the at least one endpoint.

4. The apparatus of claim 3, wherein the videoconferencing device is configured to send the annotated whiteboard to the touch panel for display.

5. The apparatus of claim 1, further comprising a visual controller coupled between the videoconferencing device and the touch panel.

6. The apparatus of claim 5, wherein one or more of the sources are coupled to one or more video inputs of the visual controller, and wherein the visual controller comprises one or more video outputs coupled to one or more video inputs of the videoconferencing device.

7. The apparatus of claim 1, wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the source selection when the user moves the user tool relative thereto.

8. The apparatus of claim 1, wherein the videoconferencing device is configured to control operation of at least one camera using touch data received from the touch panel.

9. The apparatus of claim 8, wherein the at least one camera comprises a near-end camera coupled to the videoconferencing device, and wherein to control operation of the near-end camera based on the associated touch control, the videoconferencing device is configured to send a control signal to the near-end camera.

10. The apparatus of claim 8, wherein the at least one camera comprises a far-end camera coupled to the at least one endpoint, and wherein to control operation of the far-end camera based on the associated touch control, the videoconferencing device is configured to send a control signal to the far-end camera via the network.

11. The apparatus of claim 8, wherein to control operation of the at least one camera, the videoconferencing device is configured to:

send video received from the at least one camera to the touch panel for display;

designate at least one area of the sent video as at least one touch control for user selection, the at least one touch control for controlling pan, tilt, or zoom of the at least one camera;

receive touch data from the touch panel;

associate the received touch data with the at least one touch control; and

control operation of the at least one camera based on the associated touch control.

12. The apparatus of claim 11, wherein the at least one camera comprises a pan-tilt-zoom camera, and wherein to designate at least one area of the sent video as at least one touch control for user selection, the videoconferencing unit is configured to generate a grid for display in conjunction with the video sent to the touch screen device, the grid having at least one area corresponding to the at least one touch control for controlling the pan, tilt, or zoom of the at least one camera.

13. The apparatus of claim 12, wherein the grid comprises a first pair of areas corresponding to first touch controls for panning the pan-tilt-zoom camera, a second pair of areas corresponding to second touch controls for tilting the pan-tilt-zoom camera, and a third pair of areas corresponding to third touch controls for zooming the pan-tilt-zoom camera.

14. The apparatus of claim 1, wherein the touch panel displays a graphical user interface and generates touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

15. The apparatus of claim 14, wherein the separate user interface screens comprise one or more of:

a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, and a sixth screen for scheduling a videoconference.

16. A videoconferencing method, comprising:

establishing a videoconference with at least one endpoint via a network;

sending video from a first of a plurality of sources to the at least one endpoint via the network;

receiving a source selection from a touch panel, the touch panel generating touch data and having a sensor, the sensor generating the source selection when user movement is made relative to the sensor;

automatically selecting at least one second of the sources in response to the source selection;

automatically switching from the at least one first source to the at least one second source; and

sending video from the at least one second source to the at least one endpoint,

wherein the sources are selected from the group consisting of a network interface coupled to the at least one endpoint via the network, a camera, a video cassette recorder, a digital versatile disc player, a laptop computer, a personal computer, a programmable controller of visual sources, and an Extended Graphics Array splitter.

17. The method of claim 16, further comprising sending video from one or more of the sources to the touch panel for display.

18. The method of claim 16, wherein automatically switching from the at least one first source to the at least one second source comprises:

generating a whiteboard in response to the source selection;

receiving touch data from the touch panel; and

combining the received touch data as annotation to the whiteboard for sending to the at least one endpoint.

19. The method of claim 18, further comprising sending the annotated whiteboard to the touch panel for display.

20. The method of claim 16, wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the source selection when the user moves the user tool relative thereto.

21. The method of claim 16, further comprising controlling operation of at least one camera using touch data received from the touch panel.

22. The method of claim 21, wherein controlling the operation of the at least one camera using the touch data received from the touch panel comprises:

sending video received from the at least one camera to the touch panel for display;

designating at least one area of the sent video as at least one touch control for user selection, the at least one touch control for controlling pan, tilt, or zoom of the at least one camera;

receiving the touch data from the touch panel;

associating the received touch data with the at least one touch control; and

controlling the operation of the at least one camera based on the associated touch control.

23. The method of claim 22, wherein designating at least one area of the sent video as at least one touch control for user selection comprises generating a grid for display in conjunction with the video sent to the touch screen device, the grid having at least one area corresponding to the at least one touch control for controlling the pan, tilt, or zoom of the at least one camera.

24. The method of claim 23, wherein the grid comprises a first pair of areas corresponding to first touch controls for panning the pan-tilt-zoom camera, a second pair of areas corresponding to second touch controls for tilting the pan-tilt-zoom camera, and a third pair of areas corresponding to third touch controls for zooming the pan-tilt-zoom camera.

25. The method of claim 16, further comprising displaying a graphical user interface on the touch panel and generating touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

26. The method of claim 25, wherein the separate user interface screens comprise one or more of:

a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, or a sixth screen for scheduling a videoconference.

27. A videoconferencing apparatus, comprising:

a touch panel configured to generate touch data, the touch panel having a sensor generating an indication in response to user movement relative thereto;

a videoconferencing device operatively coupled to the touch panel and configured to;

establish a videoconference with at least one endpoint via a network,

send video from at least one first source to the at least one endpoint via the network,

receive the indication from the touch panel when user movement is made relative to the sensor, and

automatically switch to an annotation mode of operation in response to the indication;

wherein in the annotation mode of operation, the videoconferencing apparatus combines touch data from the touch panel as annotation to content from at least one second source and sends the annotated content to the at least one endpoint via the network and to the touch panel for display.

28. The apparatus of claim 27, wherein the at least one first source is the same as or different from the at least one second source.

29. The apparatus of claim 27, comprising a computer operatively coupled to the videoconferencing device, the computer combining the touch data from the touch panel as annotation to content and sending the annotated content to the videoconferencing device.

30. The apparatus of claim 27, wherein the annotated content sent in the annotation mode of operation comprises a whiteboard, a computer screen, an image, or visual media.

31. The apparatus of claim 27, wherein in the annotation mode of operation, the videoconferencing apparatus is configured to:

generate a whiteboard;

receive touch data from the touch panel;

combine the received touch data as annotation to the whiteboard; and

send the annotated whiteboard to the touch panel and to the at least one endpoint.

32. The apparatus of claim 27, wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the indication when the user moves the user tool relative thereto.

33. The apparatus of claim 27, wherein the videoconferencing device is configured to:

receive another indication from the touch panel when user movement is made relative to the sensor;

automatically select at least one third source in response to the other indication;

automatically switch from the annotated content currently sent to the at least one third source automatically selected; and

send video from the at least one third source to the at least one endpoint.

34. The apparatus of claim 27, wherein the touch panel displays a graphical user interface and generates touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

35. The apparatus of claim 34, wherein the separate user interface screens comprise one or more of:

a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, and a sixth screen for scheduling a videoconference.

36. A videoconferencing method, comprising:

establishing a videoconference with at least one endpoint via a network;

sending video from at least one first source to the at least one endpoint via the network;

receiving an indication from a touch panel configured to display video and generate touch data, the touch panel having a sensor generating the indication when user movement is made relative to the sensor;

automatically switching to an annotation mode of operation in response to the indication;

combining touch data from the touch panel as annotation to content from at least one second source; and

sending the annotated content to the at least one endpoint via the network and to the touch panel for display.

37. The method of claim 36, wherein the at least one first source is the same as or different from the at least one second source.

38. The method of claim 36, wherein the annotated content sent in the annotation mode of operation comprises a whiteboard, a computer screen, an image, or visual media.

39. The method of claim 36, wherein automatically switching to the annotation mode of operation, combining the touch data, and sending the annotated content comprise:

generating a whiteboard;

receiving touch data from the touch panel;

combining the received touch data as annotation to the whiteboard; and

sending the annotated whiteboard to the touch panel and to the at least one endpoint.

40. The method of claim 36, wherein the touch panel comprises a user tool movable relative to the sensor, the sensor generating the indication when the user moves the user tool relative thereto.

41. The method of claim 36, further comprising:

receiving another indication from the touch panel when user movement is made relative to the sensor;

automatically selecting at least one third source in response to the other indication;

automatically switching from the annotated content currently sent to the at least one third source automatically selected; and

sending video from the at least one third source to the at least one endpoint.

42. The method of claim 36, further comprising displaying a graphical user interface on the touch panel and generating touch data in response to user movement relative to the graphical user interface, wherein the graphical user interface includes a plurality of separate user interface screens for conducting the videoconference.

43. The method of claim 42, wherein the separate user interface screens comprise one or more of:

a first screen for initiating the videoconference, a second screen for searching a directory of videoconference participants, a third screen for configuring a source of content for the videoconference, a fourth screen for controlling a camera of the videoconference, a fifth screen for configuring audio of the videoconference, and a sixth screen for scheduling a videoconference.