Switching cameras during a video conference of a multi-camera mobile device

• US 8,451,994 B2
• Filed: 06/06/2010
• Issued: 05/28/2013
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Abuan, Joe S., Jeong, Hyeonkuk, Garcia, Roberto Jr., Wu, Hsi-Jung, Zhou, Xiaosong, Cranfill, Elizabeth C., Normile, James O., Eldred, David A.
• Primary Examiner(s): Kuntz, Curtis
• Assistant Examiner(s): El-Zoobi, Maria
• Application Number:
  US12/794,775
• Publication Number:
  US 20110249078A1
• Time in Patent Office: 1,087 Days
• Field of Search: 455416-418, 709204-206, 37920101-21801, 408 1401- 1408, 408/14.09, 370260-271
• US Class Current: 379/102.01
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems

Abstract

Some embodiments provide a method for conducting a video conference between a first mobile device and a second device. The first mobile device includes first and second cameras. The method selects the first camera for capturing images. The method transmits images captured by the first camera to the second device. The method receives selections of the second camera for capturing images during the video conference. The method terminates the transmission of images captured by the first camera and transmits images captured by the second camera of the first mobile device to the second device during the video conference.

Claims

1. A non-transitory machine-readable medium of a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising sets of instructions for:

selecting the first camera for capturing images;

transmitting images captured by the first camera to the second device;

receiving, during the video conference, selection of the second camera for capturing images;

switching, in response to receiving the selection of the second camera, from transmitting images captured by the first camera to transmitting images captured by the second camera by terminating the transmission of images captured by the first camera and transmitting images captured by the second camera of the first mobile device to the second device; and

displaying an animation to visually indicate the switch from the transmission of images captured by the first camera to the transmission of images captured by the second camera by displaying the images from the first camera on a first side of a virtual viewing pane that appears to rotate out of view while displaying the images from the second camera on a second side of the virtual viewing pane that appears to rotate into view.

2. The non-transitory machine-readable medium of claim 1, wherein the program further comprises a set of instructions for displaying the images captured by a particular camera of the first and second cameras of the first mobile device on a display of the first mobile device when transmitting the images captured by the particular camera to the second device.

3. The non-transitory machine-readable medium of claim 1, wherein the first and second sides of the virtual viewing pane appear to rotate about a vertical axis of the virtual viewing pane.

4. The non-transitory machine-readable medium of claim 1, wherein the program further comprises sets of instructions for:

receiving images captured by a camera of the second device during the video conference; and

displaying the received images captured by the camera of the second device on a display of the first mobile device.

5. The non-transitory machine-readable medium of claim 1, wherein the program further comprises sets of instructions for:

receiving images captured by a camera of the second device during the video conference; and

displaying the received images captured by the camera of the second device on a display of the first mobile device concurrently with images (1) captured by one of the first and second cameras of the first mobile device and (2) transmitted during the video conference to the second device.

6. The non-transitory machine-readable medium of claim 5, wherein the program further comprises a set of instructions for simultaneously displaying a selectable user interface item for directing the first mobile device to switch cameras during the video conference while displaying the images (1) captured by the first camera of the first mobile device and (2) transmitted to the second device.

7. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for selecting the second camera comprises a set of instructions for receiving input through a user interface of the first mobile device to direct the first mobile device to select the second camera.

8. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for selecting the second camera comprises a set of instructions for receiving a request from the second device to switch from the first camera to the second camera.

9. The non-transitory machine-readable medium of claim 8, wherein the first mobile device and the second device exchange control messaging during the video conference and the request from the second device is one of the control messages exchanged during the video conference.

10. A method of defining a program for a first mobile device to conduct a video conference with a second device, said first mobile device comprising first and second cameras, the method comprising:

defining a display area for displaying images that are (1) captured by the first camera of the first mobile device and (2) transmitted to the second device during the video conference; and

defining a selectable user interface (“

UI”

) item for switching between the first and second cameras of the first mobile device during the video conference, wherein when a switch occurs between the cameras, the first mobile device (1) terminates the transmission of images captured by the first camera of the first mobile device, (2) transmits to the second device images captured by the second camera of the first mobile device, and (3) displays an animation to visually indicate a switch from transmitting images captured by the first camera to transmitting images captured by the second camera by displaying the images from the first camera on a first side of a virtual viewing pane that appears to rotate out of view while displaying the images from the second camera on a second side of the virtual viewing pane that appears to rotate into view.

11. The method of claim 10, wherein the display area is further for displaying images received from the second device during the video conference.

12. The method of claim 10, wherein the display area and the selectable UI item are simultaneously displayed during the video conference.

13. The method of claim 10 further comprising defining a network manager for receiving a request from the second device to switch between the first and second cameras of the first mobile device during the video conference.

14. The method of claim 13, wherein the first mobile device and the second device exchange control messaging during the video conference and the request from the second device is one of the control messages exchanged during the video conference.

15. A non-transitory machine-readable medium of a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising sets of instructions for:

selecting the first camera for capturing images;

transmitting images captured by the first camera to the second device;

receiving, during the video conference, a request from the second device to select the second camera; and

displaying, in response to the request, a user interface (UI) item on the first mobile device that when selected accepts the request from the second device and causes (1) a selection of the second camera of the first mobile device for capturing images and (2) termination of the transmission of images captured by the first camera in order to transmit images captured by the second camera of the first mobile device to the second device.

16. The non-transitory machine-readable medium of claim 15, wherein the UI item is a first UI item, wherein the program further comprises a set of instructions for:

displaying, in response to the request, a second UI item on the first mobile device that when selected rejects the request from the second device and causes the first mobile device to continue transmitting images captures by the first camera to the second device instead of transmitting images captured by the second camera of the first mobile device.

21. The non-transitory machine-readable medium of claim 15, wherein the program further comprises a set of instructions for:

receiving a selection of the UI item; and

no longer displaying the UI item on the first mobile device in response to the selection of the UI item.

22. The non-transitory machine-readable medium of claim 21, wherein the request is a first request, wherein the program further comprises a set of instructions for:

receiving, during the video conference, a second request from the second device to select the first camera; and

displaying, in response to the second request, the user interface (UI) item on the first mobile device that when selected accepts the second request from the second device and causes (1) a selection of the first camera of the first mobile device for capturing images and (2) termination of the transmission of images captured by the second camera in order to transmit images captured by the first camera of the first mobile device to the second device.

17. A non-transitory machine-readable medium a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising sets of instructions for:

selecting the first camera for capturing images;

transmitting images captured by the first camera to the second device;

receiving, during the video conference, a request from the second device to select the second camera; and

displaying, in response to the request, a message on the first mobile device indicating that the second device is requesting to switch from transmitting images captures by the first camera of the first mobile device to transmitting images captured by the second camera of the first mobile device and terminating the transmission of images captured by the first camera in order to transmit images captured by the second camera of the first mobile device to the second device.

18. The non-transitory machine-readable medium of claim 17, wherein the program further comprises a set of instructions for:

automatically accepting, in response to the request, the request from the second device, selecting the second camera of the first mobile device for capturing images, and transmitting the images captured by the second camera of the first mobile device to the second device.

19. The non-transitory machine-readable medium of claim 17, wherein the program further comprises sets of instructions for:

receiving, in response to the request, input through the first mobile device for accepting the request from the second device; and

selecting, in response to the input, the second camera of the first mobile device for capturing images and transmitting the images captured by the second camera of the first mobile device to the second device.

20. The non-transitory machine-readable medium of claim 17, wherein the program further comprises sets of instructions for:

receiving, in response to the request, input through the first mobile device for denying the request from the second device; and

continuing, in response to the input, to transmit images captured by the first camera of the first mobile device to the second device.