Multi-participant live communication user interface

• US 10,284,812 B1
• Filed: 09/27/2018
• Issued: 05/07/2019
• Est. Priority Date: 05/07/2018
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Van Os, Marcel, Caro, Pablo F., Chang, Jae Woo, Dryer, Allison, Federighi, Craig M., Garcia, Robert, King, Nicholas V., Lemay, Stephen O., Pham, Hoan
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US16/144,572
• Time in Patent Office: 222 Days
• Field of Search: 348 1401- 1416
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/043 using or handling presence information
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04M 1/72439 for image or video messaging
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

An electronic device includes a display, one or more processors, and memory storing one or more programs configured to be executed by the one or more processors. The device can display a messaging user interface of a messaging application. The device can receive first data indicating that a live communication session that is available to three or more participants is active, and in response to receiving the first data, display a notification indicating that the live communication session is active. While displaying the notification indicating that the live communication session is active, the device can receive second data indicating that the live communication session between the three or more participants is no longer active. In response to receiving the second data, the device can cease to display the notification or update the notification to indicate that the live communication session is no longer active.

Claims

1. An electronic device, comprising:

a display;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a messaging user interface of a messaging application, the messaging user interface including a message region that includes a plurality of messages in a message conversation between three or more participants;

receiving first data indicating that a live communication session that is available to the three or more participants is active;

in response to receiving the first data indicating that the live communication session between the three or more participants is active, displaying a notification in the message conversation of the messaging application indicating that the live communication session is active, wherein the message conversation includes representations of a plurality of messages including at least one representation of a message received from one of the three or more participants before the live communication session became available and at least one representation of a message received from one of the three or more participants after the live communication session became available;

while displaying the notification indicating that the live communication session is active in the message conversation of the messaging application, receiving second data indicating that the live communication session between the three or more participants is no longer active; and

in response to receiving the second data indicating that the live communication session between the three or more participants is no longer active, ceasing to display the notification in the message conversation of the messaging application or updating the notification to indicate that the live communication session is no longer active.

2. The electronic device of claim 1, wherein displaying the notification indicating that the live communication session is active includes displaying the notification indicating that the live communication session is active at a first location in the message region, the one or more programs further including instructions for:

moving the notification indicating that the live communication session is active from the first location to a second location in the message region.

3. The electronic device of claim 1, wherein the notification indicating that the live communication session is active includes a live communication join affordance, the one or more programs further including instructions for:

receiving a first user input corresponding to selection of the live communication join affordance; and

in response to receiving the first user input corresponding to selection of the live communication join affordance, joining the live communication session.

4. The electronic device of claim 1, wherein the notification indicating that the live communication session is active is displayed without generating a corresponding audio output, the one or more programs further including instructions for:

receiving reminder data indicating a reminder to join the live communication; and

in response to receiving the reminder data indicating the reminder to join the live communication, generating, via one or more audio output devices of the device, an audio output indicating that the live communication session is active.

5. The electronic device of claim 4, the one or more programs further including instructions for:

further in response to receiving the reminder data indicating the reminder to join the live communication, displaying an indication of a participant in the live communication session that initiated the reminder.

6. The electronic device of claim 4, wherein the audio output indicating that the live communication session is active is different than an audio output associated with a phone call notification and an audio output associated with a message notification.

7. The electronic device of claim 1, wherein the notification indicating that the live communication session is active includes a menu accessing affordance, the one or more programs further including instructions for:

receiving a second user input corresponding to selection of the menu accessing affordance;

in response to receiving the second user input corresponding to selection of the menu accessing affordance, displaying a menu that includes a video joining option and an audio-only option;

while displaying the menu, receiving a third user input;

in accordance with the third user input corresponding to selection of the video joining option, joining the live communication session using audio and video transmitted from the electronic device; and

in accordance with the third user input corresponding to selection of the audio-only joining option, joining the live communication session using audio transmitted from the electronic device, without transmitting video data from the electronic device.

8. The electronic device of claim 1, the one or more programs further including instructions for:

receiving third data indicating that a second live communication session is available between two or more participants;

in accordance with the second live communication session being available between two participants, displaying a first type of notification indicating that the second live communication is active; and

in accordance with the second live communication session being available between three or more participants, displaying a second type of notification, different than the first type of notification, indicating that the second live communication is active.

9. The electronic device of claim 8, wherein displaying the notification of the second type includes:

initially displaying the notification of the second type in a first state; and

transitioning the notification of the second type to a second state.

10. The electronic device of claim 1, the one or more programs further including instructions for:

receiving fourth data indicating that a third live communication session is available; and

in response to receiving the fourth data indicating that the third live communication session is available;

in accordance with a determination that an active application is being displayed, displaying a notification of a third type indicating that the third live communication session is available; and

in accordance with a determination that an active application is not being displayed, displaying a notification of a fourth type indicating that the third live communication session is available.

11. The electronic device of claim 1, the one or more programs further including instructions for:

receiving fifth data indicating that a fourth live communication session is available; and

in response to receiving fifth data indicating that the fourth live communication session is available;

in accordance with a determination that a current context of the electronic device meets alert issuance criteria displaying a notification that the fourth live communication session is available while providing a non-visual notification that the fourth live communication session is available; and

in accordance with a determination that the current context of the electronic device does not meet the alert issuance criteria, displaying the notification that the fourth live communication session is available without providing the non-visual notification that the fourth live communication session is available.

12. The electronic device of claim 11, wherein the alert issuance criteria includes a requirement that the device is locked in order for the alert issuance criteria to be met.

13. The electronic device of claim 11, wherein the alert issuance criteria includes a requirement that the device does not detect the attention of a user on the device in order for the alert issuance criteria to be met.

14. The electronic device of claim 1, wherein the notification includes an indication of the number of participants in the live communication session.

15. The electronic device of claim 1, wherein the notification includes an indication of the participant that performed an action triggering presentation of the notification on the display.

16. The electronic device of claim 1, the one or more programs further including instructions for:

in response to receiving the first data indicating that the live communication session between the three or more participants is active, generating, via one or more audio output devices of the device, a second audio output indicating that the live communication session is active, wherein the second audio output indicating that the live communication session is active is different than an audio output associated with a phone call notification and an audio output associated with a message notification.

17. An non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with display, the one or more programs including instructions for:

displaying a messaging user interface of a messaging application, the messaging user interface including a message region that includes a plurality of messages in a message conversation between three or more participants;

receiving first data indicating that a live communication session that is available to the three or more participants is active;

in response to receiving the first data indicating that the live communication session between the three or more participants is active, displaying a notification in the message conversation of the messaging application indicating that the live communication session is active, wherein the message conversation includes representations of a plurality of messages including at least one representation of a message received from one of the three or more participants before the live communication session became available and at least one representation of a message received from one of the three or more participants after the live communication session became available;

while displaying the notification indicating that the live communication session is active in the message conversation of the messaging application, receiving second data indicating that the live communication session between the three or more participants is no longer active; and

in response to receiving the second data indicating that the live communication session between the three or more participants is no longer active, ceasing to display the notification in the message conversation of the messaging application or updating the notification to indicate that the live communication session is no longer active.

18. The non-transitory computer-readable storage medium of claim 17, wherein displaying the notification indicating that the live communication session is active includes displaying the notification indicating that the live communication session is active at a first location in the message region, the one or more programs further including instructions for:

moving the notification indicating that the live communication session is active from the first location to a second location in the message region.

19. The non-transitory computer-readable storage medium of claim 17, wherein the notification indicating that the live communication session is active includes a live communication join affordance, the one or more programs further including instructions for:

receiving a first user input corresponding to selection of the live communication join affordance; and

in response to receiving the first user input corresponding to selection of the live communication join affordance, joining the live communication session.

20. The non-transitory computer-readable storage medium of claim 17, wherein the notification indicating that the live communication session is active is displayed without generating a corresponding audio output, the one or more programs further including instructions for:

receiving reminder data indicating a reminder to join the live communication; and

in response to receiving the reminder data indicating the reminder to join the live communication, generating, via one or more audio output devices of the device, an audio output indicating that the live communication session is active.

21. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

further in response to receiving the reminder data indicating the reminder to join the live communication, displaying an indication of a participant in the live communication session that initiated the reminder.

22. The non-transitory computer-readable storage medium of claim 20, wherein the audio output indicating that the live communication session is active is different than an audio output associated with a phone call notification and an audio output associated with a message notification.

23. The non-transitory computer-readable storage medium of claim 17, wherein the notification indicating that the live communication session is active includes a menu accessing affordance, the one or more programs further including instructions for:

receiving a second user input corresponding to selection of the menu accessing affordance;

in response to receiving the second user input corresponding to selection of the menu accessing affordance, displaying a menu that includes a video joining option and an audio-only option;

while displaying the menu, receiving a third user input;

in accordance with the third user input corresponding to selection of the video joining option, joining the live communication session using audio and video transmitted from the electronic device; and

in accordance with the third user input corresponding to selection of the audio-only joining option, joining the live communication session using audio transmitted from the electronic device, without transmitting video data from the electronic device.

24. The non-transitory computer-readable storage medium of claim 17, the one or more programs further including instructions for:

receiving third data indicating that a second live communication session is available between two or more participants;

in accordance with the second live communication session being available between two participants, displaying a first type of notification indicating that the second live communication is active; and

in accordance with the second live communication session being available between three or more participants, displaying a second type of notification, different than the first type of notification, indicating that the second live communication is active.

25. The non-transitory computer-readable storage medium of claim 24, wherein displaying the notification of the second type includes:

initially displaying the notification of the second type in a first state; and

transitioning the notification of the second type to a second state.

26. The non-transitory computer-readable storage medium of claim 17, the one or more programs further including instructions for:

receiving fourth data indicating that a third live communication session is available; and

in response to receiving the fourth data indicating that the third live communication session is available;

in accordance with a determination that an active application is being displayed, displaying a notification of a third type indicating that the third live communication session is available; and

in accordance with a determination that an active application is not being displayed, displaying a notification of a fourth type indicating that the third live communication session is available.

27. The non-transitory computer-readable storage medium of claim 17, the one or more programs further including instructions for:

receiving fifth data indicating that a fourth live communication session is available; and

in response to receiving fifth data indicating that the fourth live communication session is available;

in accordance with a determination that a current context of the electronic device meets alert issuance criteria displaying a notification that the fourth live communication session is available while providing a non-visual notification that the fourth live communication session is available; and

in accordance with a determination that the current context of the electronic device does not meet the alert issuance criteria, displaying the notification that the fourth live communication session is available without providing the non-visual notification that the fourth live communication session is available.

28. The non-transitory computer-readable storage medium of claim 27, wherein the alert issuance criteria includes a requirement that the device is locked in order for the alert issuance criteria to be met.

29. The non-transitory computer-readable storage medium of claim 27, wherein the alert issuance criteria includes a requirement that the device does not detect the attention of a user on the device in order for the alert issuance criteria to be met.

30. The non-transitory computer-readable storage medium of claim 17, wherein the notification includes an indication of the number of participants in the live communication session.

31. The non-transitory computer-readable storage medium of claim 17, wherein the notification includes an indication of the participant that performed an action triggering presentation of the notification on the display.

32. The non-transitory computer-readable storage medium of claim 17, the one or more programs further including instructions for:

in response to receiving the first data indicating that the live communication session between the three or more participants is active, generating, via one or more audio output devices of the device, a second audio output indicating that the live communication session is active, wherein the second audio output indicating that the live communication session is active is different than an audio output associated with a phone call notification and an audio output associated with a message notification.

33. A method comprising:

at an electronic device with a display;

displaying a messaging user interface of a messaging application, the messaging user interface including a message region that includes a plurality of messages in a message conversation between three or more participants;

receiving first data indicating that a live communication session that is available to the three or more participants is active;

in response to receiving the first data indicating that the live communication session between the three or more participants is active, displaying a notification in the message conversation of the messaging application indicating that the live communication session is active, wherein the message conversation includes representations of a plurality of messages including at least one representation of a message received from one of the three or more participants before the live communication session became available and at least one representation of a message received from one of the three or more participants after the live communication session became available;

while displaying the notification indicating that the live communication session is active in the message conversation of the messaging application, receiving second data indicating that the live communication session between the three or more participants is no longer active; and

in response to receiving the second data indicating that the live communication session between the three or more participants is no longer active, ceasing to display the notification in the message conversation of the messaging application or updating the notification to indicate that the live communication session is no longer active.

34. The method of claim 33, wherein displaying the notification indicating that the live communication session is active includes displaying the notification indicating that the live communication session is active at a first location in the message region, further comprising:

moving the notification indicating that the live communication session is active from the first location to a second location in the message region.

35. The method of claim 33, wherein the notification indicating that the live communication session is active includes a live communication join affordance, and wherein the method further comprises:

receiving a first user input corresponding to selection of the live communication join affordance; and

in response to receiving the first user input corresponding to selection of the live communication join affordance, joining the live communication session.

36. The method of claim 33, wherein the notification indicating that the live communication session is active is displayed without generating a corresponding audio output, and wherein the method further comprises:

receiving reminder data indicating a reminder to join the live communication; and

in response to receiving the reminder data indicating the reminder to join the live communication, generating, via one or more audio output devices of the device, an audio output indicating that the live communication session is active.

37. The method of claim 36, further comprising:

further in response to receiving the reminder data indicating the reminder to join the live communication, displaying an indication of a participant in the live communication session that initiated the reminder.

38. The method of claim 36, wherein the audio output indicating that the live communication session is active is different than an audio output associated with a phone call notification and an audio output associated with a message notification.

39. The method of claim 33, wherein the notification indicating that the live communication session is active includes a menu accessing affordance, and wherein the method further comprises:

receiving a second user input corresponding to selection of the menu accessing affordance;

in response to receiving the second user input corresponding to selection of the menu accessing affordance, displaying a menu that includes a video joining option and an audio-only option;

while displaying the menu, receiving a third user input;

in accordance with the third user input corresponding to selection of the video joining option, joining the live communication session using audio and video transmitted from the electronic device; and

in accordance with the third user input corresponding to selection of the audio-only joining option, joining the live communication session using audio transmitted from the electronic device, without transmitting video data from the electronic device.

40. The method of claim 33, further comprising:

receiving third data indicating that a second live communication session is available between two or more participants;

in accordance with the second live communication session being available between two participants, displaying a first type of notification indicating that the second live communication is active; and

in accordance with the second live communication session being available between three or more participants, displaying a second type of notification, different than the first type of notification, indicating that the second live communication is active.

41. The method of claim 40, wherein displaying the notification of the second type includes:

initially displaying the notification of the second type in a first state; and

transitioning the notification of the second type to a second state.

42. The method of claim 33, further comprising:

receiving fourth data indicating that a third live communication session is available; and

in response to receiving the fourth data indicating that the third live communication session is available;

in accordance with a determination that an active application is being displayed, displaying a notification of a third type indicating that the third live communication session is available; and

in accordance with a determination that an active application is not being displayed, displaying a notification of a fourth type indicating that the third live communication session is available.

43. The method of claim 33, further comprising:

receiving fifth data indicating that a fourth live communication session is available; and

in response to receiving fifth data indicating that the fourth live communication session is available;

in accordance with a determination that a current context of the electronic device meets alert issuance criteria displaying a notification that the fourth live communication session is available while providing a non-visual notification that the fourth live communication session is available; and

in accordance with a determination that the current context of the electronic device does not meet the alert issuance criteria, displaying the notification that the fourth live communication session is available without providing the non-visual notification that the fourth live communication session is available.

44. The method of claim 43, wherein the alert issuance criteria includes a requirement that the device is locked in order for the alert issuance criteria to be met.

45. The method of claim 43, wherein the alert issuance criteria includes a requirement that the device does not detect the attention of a user on the device in order for the alert issuance criteria to be met.

46. The method of claim 33, wherein the notification includes an indication of the number of participants in the live communication session.

47. The method of claim 33, wherein the notification includes an indication of the participant that performed an action triggering presentation of the notification on the display.

48. The method of claim 33, further comprising:

in response to receiving the first data indicating that the live communication session between the three or more participants is active, generating, via one or more audio output devices of the device, a second audio output indicating that the live communication session is active, wherein the second audio output indicating that the live communication session is active is different than an audio output associated with a phone call notification and an audio output associated with a message notification.