Dynamic display of video communication data

• US 9,544,540 B2
• Filed: 06/04/2014
• Issued: 01/10/2017
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Zhou, Xiaosong, Wu, Hsi-Jung, Chung, Chris Y., Normile, James O., Abuan, Joe S., Jeong, Hyeonkuk, Yang, Yan, Johar, Gobind, Jansen, Thomas
• Primary Examiner(s): TIEU, BINH KIEN
• Application Number:
  US14/296,348
• Publication Number:
  US 20150358580A1
• Time in Patent Office: 951 Days
• Field of Search: 348/14.01, 348/14.02, 348/14.07, 348/14.08, 348/14.11
• US Class Current: 1/1
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Claims

1. A system, comprising:

an electronic display;

one or more processors;

a memory comprising program instructions that when executed by the one or more processors cause the one or more processors to implement;

a video communication module, configured to implement video communications;

an application module configured to;

provide image data for at least a portion of the electronic display for the application module; and

define one or more display attributes that indicate a display location, relative to the at least the portion of the electronic display for the application module, for video communication data from a module other than the application module, wherein the application module defines the one or more display attributes at runtime;

an audio/video management module, configured to;

receive, via the video communication module, video communication data for display as part of a current video communication;

identify, in response to the current video communication and based on the one or more display attributes defined by the application module at runtime, a display location within the electronic display for the video communication data, wherein the image data for the application module is currently displayed within the electronic display; and

direct display of the video communication data in the determined display location within the electronic display.

2. The system of claim 1, wherein the audio/video management module is further configured to display one or more user interface elements in the determined location within the electronic display.

3. The system of claim 2, wherein the electronic display is a touch-sensitive device, and wherein the video communication module is further configured to:

receive an indication of user input as a touch gesture via the electronic display, wherein the touch gesture initiated within the determined location of the electronic display;

in response receiving the indication of the user input;

pause the current video communication;

resume the current video communication;

or

end the current video communication.

4. The system of claim 1, wherein to direct display of the video communication data in the determined display location within the electronic display, the audio/video management module is configured to:

integrate the video communication data with other display data obtained via the application module into combined data to be displayed in the determined display location within the electronic display.

5. The system of claim 1, wherein the electronic display is a touch-sensitive device, and wherein the audio/video communication module is further configured to:

receive an indication of user input as a touch gesture via the electronic display, wherein the touch gesture is initiated within the determined location of the electronic display, wherein the user input requests a switch to full-screen display mode for the video communication module; and

in response to receipt of the indication of the user input, direct display of the video communication data according to the full-screen display mode of the video communication module within the electronic display.

6. The system of claim 1, wherein the system is a mobile phone.

7. A method, comprising:

performing, by a portable multi-function computing device;

defining, by an application, one or more display attributes that indicate a display location, relative to at least a portion of an electronic display for the application, for video communication data from a second application other than the application, wherein the application defines the one or more display attributes at runtime;

receiving, by a video communication application, video communication data for display as part of a current video communication;

determining, based on the one or more display attributes defined by the application at runtime, a display location for the video communication data within the electronic display currently displaying image data for the application; and

displaying the video communication data in the determined display location within the electronic display.

8. The method of claim 7, further comprising:

detecting a switch in display mode for the video communication, wherein the switch in the display mode is a change from a full-screen display mode to an integration display mode; and

in response to detecting the switch in display mode to the integration display mode, performing said determining the display location and said displaying the video communication data.

9. The method of claim 8, further comprising detecting another switch in the display mode for the video communication, wherein the other switch is a change from the integration display mode to the full-screen display mode for the video communication application, wherein subsequently received video communication data for the video communication is displayed in the full-screen display mode.

10. The method of claim 7, further comprising:

receiving an indication of user input for the current video communication;

in response to receiving the indication of the user input, performing one of;

pausing the current video communication;

resuming the current video communication;

or

ending the current video communication.

11. The method of claim 7 further comprising:

receiving an indication of user input for the current video communication; and

in response to receiving the indication of the user input, displaying one or more user interface elements in the determined location within the electronic display.

12. The method of claim 7, wherein said displaying the video communication data in the determined display location within the electronic display comprises integrating the video communication data with other display data obtained via the application into combined data to be displayed in the determined display location within the electronic display.

13. The method of claim 7,

wherein the current video communication is a group video communication between a plurality of different computing devices including the portable multi-function computing device, wherein the video communication data comprises respective video communication data for each of the plurality of different computing devices;

and

wherein said determining the display location within the electronic display comprises determining a different respective location for the respective video communication data for each of the plurality of different computing devices.

14. A non-transitory, computer-readable storage medium, storing program instructions that when executed by a mobile computing device causes the mobile computing device to implement:

displaying image data within at least a portion of an electronic display for a currently executing application, wherein the currently executing application is configured to define one or more display attributes that indicate a display location, relative to the at least the portion of the electronic display for the currently executing application, for video communication data from a second application other than the currently executing application, and wherein the currently executing application defines the one or more display attributes at runtime;

detecting initiation of a video communication via a video communication application;

in response to receiving video communication data for the video communication;

determining, based on the one or more display attributes defined by the currently executing application at runtime, a display location within the electronic display for the video communication data; and

displaying the video communication data in the determined display location within the electronic display.

15. The non-transitory, computer-readable storage medium of claim 14, wherein the currently executing application is another video communication application different than the video communication application.

16. The non-transitory, computer-readable storage medium of claim 14, wherein the program instructions cause the mobile computing device to further implement:

receiving an indication of user input for a current video communication;

in response to receiving the indication of the user input, performing one of;

pausing the current video communication;

resuming the current video communication;

or

ending the current video communication.

17. The non-transitory, computer-readable storage medium of claim 14, wherein the program instructions cause the mobile computing device to further implement:

receiving an indication of user input to switch a display mode for the video communication application to a full-screen display mode for the video communication application; and

in response to receiving the indication, displaying the video communication data according to the full-screen display mode of the video communication application.

18. The non-transitory, computer-readable storage medium of claim 14, wherein, in said displaying the video communication data in the determined display location within the electronic display, the program instructions cause the mobile computing device to implement:

integrating the video communication data with other display data generated by another application into combined display data to be displayed in the determined display location within the electronic display.

19. The non-transitory, computer-readable storage medium of claim 14, wherein the program instructions further cause the mobile computing device to implement:

detecting a change to the one or more display attributes by the currently executing application;

in response to detecting the change to the one or more display attributes;

determining an updated display location for the video communication data within the electronic display; and

displaying the video communication data in the updated display location within the electronic display.

20. The non-transitory, computer-readable storage medium of claim 14,

wherein the video communication is a group video communication between a plurality of different computing devices including the mobile computing device, wherein the video communication data comprises respective video communication data for each of the plurality of different computing devices;

and

wherein said determining the display location within the electronic display comprises determining a different respective location for the respective video communication data for each of the plurality of different computing devices.