In conference display adjustments

• US 8,502,856 B2
• Filed: 06/06/2010
• Issued: 08/06/2013
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Cranfill, Elizabeth C., Lemay, Stephen O., Wu, Hsi-Jung, Zhou, Xiaosong, Abuan, Joe S., Jeong, Hyeonkuk, Garcia, Roberto Jr.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US12/794,768
• Publication Number:
  US 20110249074A1
• Time in Patent Office: 1,157 Days
• Field of Search: 348 1401- 1416, 348/565, 345/173, 715/262
• US Class Current: 348/14.02
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems

Abstract

Some embodiments provide a method for modifying a composite display of a first mobile device that is engaged in a video conference with a second device. The method presents, on the first device, the composite display having a first video captured by the first device and a second video captured by the second device. The method receives, at the first device, an input for modifying the composite display during the video conference. The method modifies the composite display based on the received input.

Claims

1. A non-transitory machine readable medium of a first mobile device, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first mobile device comprising a touch sensitive display screen, a composite display having a first video captured by the first mobile device and a second video captured by a second device that is engaged in a video conference with the first mobile device, the composite display comprising a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video, the inset display being smaller than the main display and overlapping at least a portion of the main display;

receiving, at the first mobile device, an input for modifying the composite display during the video conference by (i) associating a location of the inset display with a location on the touch sensitive display screen that is being contacted, (ii) selecting the inset display in response to the association, (iii) determining that the location of contact on the touch sensitive display screen has moved towards a direction while the contact has been maintained; and

modifying the composite display based on the received input by moving the inset display in the direction of movement.

2. The non-transitory machine computer readable medium of claim 1, wherein the set of instructions for moving the inset display comprises a set of instructions for moving the inset display even after the contact with the display screen has been terminated while the inset has not reached a snap location within the composite display that has been designated as a location in the composite display for placing one end of the inset display.

3. The non-transitory machine readable medium of claim 2, wherein the snap location is a corner of the PIP display.

4. The non-transitory machine readable medium of claim 1, wherein the set of instructions for moving the inset display comprises sets of instructions for:

moving the inset display even after the contact with the display screen has been terminated if the movement of contact location has exceeded a particular amount; and

not moving the inset display after the contact has terminated if the movement of the contact location does not exceed the particular amount.

5. The non-transitory machine readable medium of claim 1, wherein the inset display is moved from a first corner of the PIP display to a second corner of the PIP display.

6. The non-transitory machine readable medium of claim 1

wherein the input is generated when a display screen of the first device rotates, and

wherein the set of instructions for modifying comprises a set of instructions for rotating the composite display.

7. The non-transitory machine readable medium of claim 1,

wherein the set of instructions for receiving the input comprises a set of instructions for receiving a selection of a part of the inset display and a movement of the part, and

wherein the set of instructions for modifying comprises a set of instructions for changing a size of the inset display based on the selection of the part of the inset display and the movement of the part.

8. The non-transitory machine readable medium of claim 7, wherein the movement of the part comprises a movement of the part toward the center of the inset display, and the modification comprises a shrinking of the size of the inset display.

9. The non-transitory machine readable medium of claim 7, wherein the movement of the part comprises a movement of the part away from the center of the inset display, and wherein the modification comprises an enlarging of the size of the inset display.

10. The non-transitory machine readable medium of claim 7, wherein the selected part is a side of the inset display.

11. The non-transitory machine readable medium of claim 7, wherein the selected part is a corner of the inset display.

12. The non-transitory machine readable medium of claim 1,

wherein the set of instructions for modifying comprises a set of instructions for swapping the inset display and the main display such that the inset display shows the second video and the main display shows the first video.

13. The non-transitory machine readable medium of claim 1, wherein the set of instructions for modifying comprises a set of instructions for swapping the location of the first and second videos in the composite display.

14. The non-transitory machine readable medium of claim 1,

wherein the set of instructions for modifying comprises a set of instructions for moving the first video with respect to the composite display.

19. A non-transitory machine readable medium of a first mobile device claim 9, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first mobile device, a composite display having a first video captured by the first mobile device and a second video captured by a second device that is engaged in a video conference with the first mobile device;

receiving, at the first mobile device, an input for modifying the composite display during the video conference, the input generated when a display screen of the first mobile device rotates; and

modifying the composite display based on the received input by rotating the composite display and presenting an animation that shows a rotation of the composite display around an axis that goes through the center of the composite display.

20. The non-transitory machine readable medium of claim 19, wherein the animation comprises a shrinking of the composite display such that the entire composite display is displayed during the rotation of the composite display.

21. The non-transitory machine readable medium of claim 20, wherein at the end of the animation the composite display is expanded to fit an orientation of the display screen.

15. A non-transitory machine readable medium of a first mobile device, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first device, a composite display having a first video captured by the first device and a second video captured by a second device that is engaged in a video conference with the first device;

receiving, at the first device, an input for modifying the composite display during the video conference, the input generated when a display screen of the first device rotates, wherein the display screen of the first device rotatable independently of a body of the first device; and

modifying the composite display based on the received input by rotating the composite display.

16. A non-transitory machine readable medium of a first mobile device, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first mobile device, a composite display having a first video captured by the first mobile device and a second video captured by a second device that is engaged in a video conference with the first mobile device;

receiving, at the first mobile device, an input for modifying the composite display during the video conference, the input generated when a display screen of the first mobile device rotates and the first mobile device rotates; and

modifying the composite display based on the received input by rotating the composite display.

17. The non-transitory machine readable medium of claim 16, wherein the set of instructions for modifying the composite display by rotating the composite display comprises a set of instructions for modifying the composite display by rotating the first video about a first axis and rotating the second video about a second axis different from the first axis.

18. The non-transitory machine readable medium of claim 16, wherein the set of instructions for modifying the composite display by rotating the composite display comprises a set of instructions for modifying the composite display by rotating the composite display in order to maintain the composite display in an upright position.

22. A non-transitory machine readable medium of a first mobile device, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first mobile device, a composite display having a first video captured by the first mobile device and a second video captured by a second device that is engaged in a video conference with the first mobile device;

receiving, at the first mobile device, an input for modifying the composite display during the video conference, the input generated when a display screen of the first mobile device and the first mobile device are rotated in a first direction; and

modifying the composite display based on the received input by rotating the composite display in a second direction that is opposite of the first direction.

23. A non-transitory machine readable medium of a first mobile device, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first mobile device, composite display comprising a picture-in-picture (PIP) display having an inset display showing a first video captured by the first mobile device and a main display showing a second video captured by a second device that is engaged in a video conference with the first mobile device, wherein the inset display is smaller than the main display and overlaps at least a portion of the main display;

receiving, at the first mobile device, an input for modifying the composite display during the video conference, the input generated when a display screen of the first mobile device rotates; and

when the main display and inset display are in a portrait orientation, modifying the composite display based on the received input by rotating the composite display to change the orientation of the inset display to a landscape orientation.

24. The non-transitory machine readable medium of claim 23, wherein the set of instructions for modifying the composite display by rotating the composite display comprises a set of instructions for modifying the composite display by rotating the composite display while maintaining positions of the main display and inset display relative to each other.

25. The non-transitory machine readable medium of claim 23, wherein the program further comprises a set of instructions for when the main display and inset display are in a landscape orientation, modifying the composite display based on the received input by rotating the composite display to change the orientation of the inset display to the portrait orientation.

26. A non-transitory machine readable medium of a first mobile device, the machine readable medium storing a program, said program comprising sets of instructions for:

presenting, on the first mobile device, composite display comprising a picture-in-picture (PIP) display having an inset display showing a first video captured by the first mobile device and a main display showing a second video captured by a second device that is engaged in a video conference with the first mobile device, wherein the inset display is smaller than the main display and overlaps at least a portion of the main display;

receiving, at the first mobile device, an input for modifying the composite display during the video conference, the input generated when a display screen of the first mobile device rotates;

modifying the composite display based on the received input by rotating the composite display;

receiving a notification of a rotation of the second device; and

changing an orientation of the main display from a first orientation to a second orientation.

27. The non-transitory machine readable medium of claim 26, wherein the first orientation is a portrait orientation and the second orientation is a landscape orientation.

28. The non-transitory machine readable medium of claim 26, wherein the first orientation is a landscape orientation and the second orientation is a portrait orientation.