In Conference Display Adjustments

• US 20110249074A1
• Filed: 06/06/2010
• Published: 10/13/2011
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Cranfill, Elizabeth C., Jeong, Hyeonkuk, Wu, Hsi-Jung, Lemay, Stephen O., Garcia, Roberto JR., Zhou, Xiaosong, Abuan, Joe S.
• Granted Patent: US 8,502,856 B2
• Time in Patent Office: Days
• US Class Current: 348/14.02
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems

Abstract

Some embodiments provide a method for modifying a composite display of a first mobile device that is engaged in a video conference with a second device. The method presents, on the first device, the composite display having a first video captured by the first device and a second video captured by the second device. The method receives, at the first device, an input for modifying the composite display during the video conference. The method modifies the composite display based on the received input.

Claims

1. A non-transitory computer readable medium of a first mobile device, the computer readable medium storing a computer program, said computer program comprising sets of instructions for:

presenting, on the first device, a composite display having a first video captured by the first device and a second video captured by a second device that is engaged in a video conference with the first device;

receiving, at the first device, an input for modifying the composite display during the video conference; and

modifying the composite display based on the received input.

2. The computer readable medium of claim 1,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video, the inset display being smaller than the main display and overlapping at least a portion of the main display,

wherein the set of instructions for receiving the input comprises sets of instructions for (i) receiving a selection of the inset display and (ii) receiving an input indicating a direction for moving the inset display, and

wherein the set of instructions for modifying comprises a set of instructions for moving the inset display in the direction of movement.

3. The computer readable medium of claim 1,

wherein the first mobile device comprises a touch sensitive display screen;

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video, the inset display being smaller than the main display and overlapping at least a portion of the main display,

wherein the set of instructions for receiving the input comprises sets of instructions for (i) associating a location of the inset display with a location on the touch sensitive display screen that is being contacted, (ii) selecting the inset display in response to the association, (iii) determining that the location of contact on the touch sensitive display screen has moved while the contact has been maintained, and

wherein the set of instruction for modifying the composite display comprises a set of instruction for moving the inset display in the direction of movement.

4. The computer readable medium of claim 3, wherein the set of instruction for moving the inset display comprises a set of instructions for moving the inset display even after the contact with the screen has been terminated while the inset has not reached a snap location within the composite display that has been designated as a location in the composite display for placing one end of the inset display.

5. The computer readable medium of claim 4, wherein the snap location is a corner of the PIP display.

6. The computer readable medium of claim 3, wherein the set of instruction for moving the inset display comprises sets of instructions for:

moving the inset display even after the contact with the screen has been terminated if the movement of contact location has exceeded a particular amount;

not moving the inset display after the contact has terminated if the movement of the contact location does not exceed the particular amount.

7. The computer readable medium of claim 1,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video, the inset display being smaller than the main display and overlapping at least a portion of the main display,

wherein the set of instructions for receiving the input comprises sets of instructions for (i) receiving a selection of the inset display and (ii) receiving an input indicating a movement the inset display, and

wherein the set of instructions for modifying comprises a set of instructions for moving the inset display.

8. The computer readable medium of claim 1, wherein the inset display is moved from a first corner of the PIP display to a second corner of the PIP display.

9. The computer readable medium of claim 1,

wherein the input is generated when a display screen of the first device rotates, and

wherein the set of instructions for modifying comprises a set of instructions for rotating the composite display.

10. The computer readable medium of claim 9, wherein the screen of the first device is rotatable independently of a body of the first device.

11. The computer readable medium of claim 9, wherein the screen of the first device rotates when the first device rotates.

12. The computer readable medium of claim 9, wherein the set of instructions for rotating the composite display comprises a set of instructions for presenting an animation that shows a rotation of the composite display around an axis that goes through the center of the composite display.

13. The computer readable medium of claim 12, wherein the animation comprises a shrinking of the composite display such that the entire composite display is displayed during the rotation of the composite display.

14. The computer readable medium of claim 13, wherein at the end of the animation the composite display is expanded to fit the orientation of the screen.

15. The computer readable medium of claim 9, wherein the first device'"'"'s screen is rotated in a first direction and the composite display is rotated in a second direction that is opposite of the first direction.

16. The computer readable medium of claim 9,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video,

wherein the inset display is smaller than the main display and overlaps at least a portion of the main display,

wherein when before the rotation the main display and inset display are in a portrait orientation, the set of instructions comprises a set of instructions for changing the orientation of the inset display to a landscape orientation.

17. The computer readable medium of claim 9,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video,

wherein the inset display is smaller than the main display and overlaps at least a portion of the main display,

wherein the computer program further comprises sets of instructions for receiving a notification of a rotation of the second devices, and changing an orientation of the main display from a first orientation to a second orientation.

18. The computer readable medium of claim 1,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video,

wherein the inset display is smaller than the main display and overlaps at least a portion of the main display,

wherein the input is generated when the first device rotates, and

wherein the set of instructions for modifying comprises a set of instructions for rotating the PIP display.

19. The computer readable medium of claim 1,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video,

wherein the inset display is smaller than the main display and overlaps a portion of the main display,

wherein the set of instructions for receiving the input comprising a set of instructions for receiving a selection of a part of the inset display and a movement of the part, and

wherein the set of instructions for modifying comprises a set of instructions for changing the size of the inset display.

20. The computer readable medium of claim 19, wherein the movement of the part comprises a movement of the part toward the center of the inset display, and the modification comprises the shrinking of the size of the inset display.

21. The computer readable medium of claim 19, wherein the movement of the part comprises a movement of the part away from the center of the inset display, and wherein the modification comprises the enlarging of the size of the inset display.

22. The computer readable medium of claim 19, wherein the selected part is a side of the inset display.

23. The computer readable medium of claim 19, wherein the selected part is a corner of the inset display.

24. The computer readable medium of claim 1,

wherein the composite display is a picture-in-picture (PIP) display having an inset display showing the first video and a main display showing the second video,

wherein the inset display is smaller than the main display and overlaps a portion of the main display,

wherein the set of instructions for modifying comprises a set of instructions for swapping the inset display and the main display such that the inset display shows the second video and the main display shows the first video.

25. The computer readable medium of claim 1, wherein the set of instructions for modifying comprises a set of instructions for swapping the location of the first and second videos in the composite display.

26. The computer readable medium of claim 1,

wherein the set of instructions for receiving input comprises a set of instructions for selecting the first video, and

wherein the set of instructions for modifying comprises a set of instructions for moving the first video with respect to the composite display.

27. A computer readable medium storing a computer program for execution by a processor, the computer program for adjusting an operation of a first mobile device in a video conference with a second mobile device, the computer program comprising sets of instructions for:

receiving a video captured by the camera of the second mobile device;

displaying a picture-in-picture display of the video captured by the second device and a video captured by the first device on the first device;

detecting a change in an orientation of the screen of the first mobile device; and

rotating the PIP display on the screen of the first device based on the change in the orientation of the screen of the first device.

28. A computer readable medium storing a computer program for execution by a processor, the computer program for adjusting an operation of a first mobile device in a video conference with a second mobile device, the computer program comprising sets of instructions for:

receiving a video captured by the second mobile device, wherein the video is displayed on a screen of the first mobile device;

generating a display of the video captured by the second mobile device along with another display of a video captured by the first mobile device;

receiving a user input directing one display of the videos to move towards a direction of the screen of the first mobile device;

moving the one display of the videos to another location of the screen of the first mobile device based on the user'"'"'s input.