Switching cameras during a video conference of a multi-camera mobile device

• US 9,055,185 B2
• Filed: 05/07/2013
• Issued: 06/09/2015
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Abuan, Joe S., Eldred, David A., Jeong, Hyeonkuk, Garcia, Roberto Jr., Wu, Hsi-Jung, Zhou, Xiaosong, Cranfill, Elizabeth C., Normile, James O.
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US13/889,261
• Publication Number:
  US 20130265378A1
• Time in Patent Office: 763 Days
• Field of Search: 348/14.02
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems

Abstract

Some embodiments provide a method for conducting a video conference between a first mobile device and a second device. The first mobile device includes first and second cameras. The method selects the first camera for capturing images. The method transmits images captured by the first camera to the second device. The method receives selections of the second camera for capturing images during the video conference. The method terminates the transmission of images captured by the first camera and transmits images captured by the second camera of the first mobile device to the second device during the video conference.

Claims

1. A non-transitory machine-readable medium of a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising sets of instructions for:

selecting the first camera for capturing images;

transmitting images captured by the first camera to the second device;

during the video conference, receiving selection of the second camera for capturing images;

in response to receiving the selection of the second camera, switching from transmitting images captured by the first camera to transmitting images captured by the second camera; and

displaying an animation to visually indicate the switch from the transmission of images captured by the first camera to the transmission of images captured by the second camera, wherein the animation starts by displaying the images captured by the first camera and transitions from displaying the images captured by the first camera to displaying the images captured by the second camera.

2. The non-transitory machine-readable medium of claim 1, wherein the program further comprises a set of instructions for displaying the images captured by any of the first and second cameras of the first mobile device on a display of the first mobile device when transmitting the images captured by the particular camera to the second device.

3. The non-transitory machine-readable medium of claim 1, wherein the animation transitions from displaying the images captured by the first camera to displaying the images captured by the second camera by displaying the images captured by the first camera to appear to rotate out of view while displaying the images captured by the second camera to appear to rotate into view.

4. The non-transitory machine-readable medium of claim 1, wherein the program further comprises sets of instructions for:

receiving images captured by a camera of the second device during the video conference; and

displaying the received images captured by the camera of the second device on a display of the first mobile device.

5. The non-transitory machine-readable medium of claim 1, wherein the program further comprises sets of instructions for:

receiving images captured by a camera of the second device during the video conference; and

displaying the received images captured by the camera of the second device on a display of the first mobile device concurrently with images captured by any of the first and second cameras of the first mobile device that is capturing images that are being transmitted to the second device during the video conference.

6. The non-transitory machine-readable medium of claim 5, wherein the program further comprises a set of instructions for simultaneously displaying a selectable user interface item for directing the first mobile device to switch cameras during the video conference while displaying the images captured and transmitted by the first camera.

7. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for selecting the second camera comprises a set of instructions for receiving input through a user interface of the first mobile device to direct the first mobile device to select the second camera.

8. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for selecting the second camera comprises a set of instructions for receiving a request from the second device to switch from the first camera to the second camera.

9. The non-transitory machine-readable medium of claim 8, wherein the first mobile device and the second device exchange control messages during the video conference and the request from the second device is one of the control messages exchanged during the video conference.

10. A non-transitory machine-readable medium of a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising a graphical user interface (“

GUI”

), the GUI comprising;

a display area for displaying images that are (1) captured by a camera of the first mobile device and (2) transmitted to the second mobile device during a real-time video conference session; and

a selectable user interface (“

UI”

) item for switching between the cameras of the first mobile device during the video conference, wherein when a switch occurs between the cameras, the first mobile device terminates the transmission of images captured by one of the first device'"'"'s cameras and transmits to the second device images captured by the other of the first device'"'"'s camera.

11. The non-transitory machine-readable medium of claim 10, wherein the display area is further for displaying images sent by the second device during the video conference.

12. The non-transitory machine-readable medium of claim 10, wherein the display area and the selectable UI item are simultaneously displayed on a display screen of the first mobile device during the video conference.

13. The non-transitory machine-readable medium of claim 10, wherein the program further comprises a network manager for receiving a request from the second device to switch between the first device'"'"'s cameras during the video conference.

14. The non-transitory machine-readable medium of claim 13, wherein the first mobile device and the second device exchange control messages during the video conference and the request from the second device is one of the control messages exchanged during the video conference.

15. A method of defining a program for a first mobile device to conduct a video conference with a second device, said first mobile device comprising first and second cameras, the method comprising:

defining a display area for displaying images that are (1) captured by the first camera of the first mobile device and (2) transmitted to the second mobile device during a real-time video conference session; and

defining a selectable user interface (“

UI”

) item for switching between the cameras of the first mobile device during the video conference, wherein when a switch occurs between the cameras, the first mobile device displays an animation to visually indicate the switch from transmitting images captured by the first camera to transmitting images captured by the second camera, wherein the animation starts by displaying the images captured by the first camera and transitions from displaying the images captured by the first camera to displaying the images captured by the second camera.

16. The method of claim 15, wherein the display area is further for displaying images sent by the second device during the video conference.

17. The method of claim 15, wherein the display area and the selectable UI item are simultaneously displayed on a display screen of the first mobile device during the video conference.

18. The method of claim 15 further comprising defining a network manager for receiving a request from the second device to switch between the first mobile device'"'"'s cameras during the video conference.

19. The method of claim 18, wherein the first mobile device and the second device exchange control messages during the video conference and the request from the second device is one of the control messages exchanged during the video conference.

20. A non-transitory machine-readable medium of a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising sets of instructions for:

selecting the first camera for capturing images;

transmitting images captured by the first camera to the second device;

during the video conference, receiving a request from the second device to select the second camera; and

in response to the request, terminating the transmission of images captured by the first camera in order to transmit images captured by the second camera of the first mobile device to the second device.

21. The non-transitory machine-readable medium of claim 20, wherein the program further comprises a set of instructions for:

in response to the request, displaying a user interface (UI) item that when selected accepts the request from the second device and causes a selection of the second camera of the first mobile device for capturing images.

22. The non-transitory machine-readable medium of claim 21, wherein the UI item is a first UI item, wherein the program further comprises a set of instructions for:

in response to the request, displaying a second UI item that when selected rejects the request from the second device and causes the first mobile device to continue transmitting images captured by the first camera to the second device instead of transmitting images captured by the second camera of the first mobile device.

23. The non-transitory machine-readable medium of claim 20, wherein the program further comprises a set of instructions for:

in response to the request, automatically accepting the request from the second device and selecting the second camera of the first mobile device for capturing images.

24. The non-transitory machine-readable medium of claim 20, wherein the program further comprises a set of instructions for:

in response to the request, displaying a message indicating that the second device is requesting to switch from transmitting images captured by the first camera of the first mobile device to transmitting images captured by the second camera of the first mobile device.

25. A non-transitory machine-readable medium of a first mobile device that includes first and second cameras, the machine-readable medium storing a program for conducting a video conference between the first mobile device and a second device, the program comprising sets of instructions for:

selecting the first camera for capturing images;

transmitting images captured by the first camera to the second device;

during the video conference, receiving a request from the second device to select the second camera;

in response to the request, switching from capturing images by the first camera to capturing images by the second camera; and

displaying an animation to visually indicate the switch from the capturing of images by the first camera to the capturing of images by the second camera, wherein the animation starts by displaying the images captured by the first camera and transitions from displaying the images captured by the first camera to displaying the images captured by the second camera.

26. The non-transitory machine-readable medium of 25, wherein the program further comprises a set of instructions for:

in response to the request, switching from transmitting images captured by the first camera to transmitting images captured by the second camera by terminating the transmission of images captured by the first camera and transmitting images captured by the second camera of the first mobile device to the second device.

27. The non-transitory machine-readable medium of 25, wherein the animation transitions from displaying the images captured by the first camera to displaying the images captured by the second camera by displaying the images captured by the first camera to appear to rotate out of view while displaying the images captured by the second camera to appear to rotate into view.

28. The non-transitory machine-readable medium of 27, wherein the animation transitions from displaying the images captured by the first camera to displaying the images captured by the second camera further by displaying the images captured by the first camera to appear to rotate out of view about a vertical axis while displaying the images captured by the second camera to appear to rotate into view about the vertical axis.