User experience for conferencing with a touch screen display

• US 9,986,206 B2
• Filed: 03/08/2017
• Issued: 05/29/2018
• Est. Priority Date: 09/20/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Fish, Nathan J., Williams, Robert, Case, Charlie W., Haverty, Chris M., Oehler, Peter R., Hilsdale, Michael C.
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US15/453,278
• Publication Number:
  US 20170180678A1
• Time in Patent Office: 447 Days
• CPC Class Codes: G06F 1/266 Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3215 Monitoring of peripheral devices
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A video conference system includes two cameras placed on opposite sides of a touch screen display. Multimedia processing is performed in order to automatically switch between the cameras and to display items on the touch screen display based on user position or user interactions with the system.

Claims

1. A computer-implemented method of controlling a display on a conferencing system, comprising:

detecting a user position relative to a touch sensitive display screen in the conferencing system;

detecting a user height;

based on the detected user position and the detected user height, selecting a portion of the touch sensitive display screen as a user interface (UI) control display location;

displaying a touch-enable UI control at the UI control display location;

receiving a touch input through the UI control; and

performing an action in the conferencing system based on the touch input.

2. The computer-implemented method of claim 1 and further comprising:

detecting that the user position relative to the touch sensitive display screen has changed to an updated user location; and

performing the steps of identifying a display location and displaying the displayed item, based on the updated user location.

3. The computer-implemented method of claim 1 wherein identifying a display location comprises:

identifying an incoming video display location based on the detected user position, and

displaying an incoming video image at the incoming video display location.

4. The computer-implemented method of claim 1, and further comprising:

determining that a user represented in the incoming video image is currently speaking or is about to speak; and

in response to the determination, modifying the incoming video image.

5. The computer-implemented method of claim 4, wherein modifying the incoming video image comprises:

enlarging the incoming video image.

6. The computer-implemented method of claim 1, and further comprising:

automatically selecting one of first and second cameras associated with the conferencing system to provide outgoing video based on the detected user position.

7. The computer-implemented method of claim 1, and further comprising:

activating a user input mechanism based on the detected user position.

8. An electronic conferencing system comprising:

at least one processor; and

memory storing instructions executable by the at least one processor, wherein the instructions configure the electronic conferencing system to;

detect a user position relative to a touch sensitive display screen in the conferencing system;

detect a user height;

based on the detected user position and the detected user height, select a portion of the touch sensitive display screen as a user interface (UI) control display location;

display a touch-enable UI control at the UI control display location;

receive a touch input through the UI control;

perform an action in the conferencing system based on the touch input.

9. The electronic conferencing system of claim 8, wherein the instructions configure the electronic conferencing system to:

detect that the user position relative to the touch sensitive display screen has changed to an updated user location; and

based on the updated user location,

identify the display location; and

display the displayed item based on the identified display location.

10. The electronic conferencing system of claim 8, wherein the instructions configure the electronic conferencing system to:

identify an incoming video display location based on the detected user position;

display an incoming video image at the incoming video display location.

11. The electronic conferencing system of claim 10, wherein the instructions configure the electronic conferencing system to:

determine that a user represented in the incoming video image is currently speaking or is about to speak; and

in response to the determination, modify the incoming video image.

12. The electronic conferencing system of claim 11, wherein the instructions configure the electronic conferencing system to modify the incoming video image by enlarging the incoming video image.

13. The electronic conferencing system of claim 8, wherein the instructions configure the electronic conferencing system to:

automatically select one of first and second cameras associated with the conferencing system to provide outgoing video based on the detected user position.