METHOD AND APPARATUS FOR SCROLLING TEXT DISPLAY OF VOICE CALL OR MESSAGE DURING VIDEO DISPLAY SESSION

• US 20120209607A1
• Filed: 04/13/2012
• Published: 08/16/2012
• Est. Priority Date: 08/28/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Garg, Dinesh Kumar, Poddar, Manish
• Granted Patent: US 8,380,515 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/602 for digital sound signals
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method and communication device disclosed includes displaying a video on a display, converting voice audio data to textual data by applying voice-to-text conversion, and displaying the textual data as scrolling text displayed along with the video on the display and either above, below or across the video. The method may further include receiving a voice call indication from a network, providing the voice call indication to a user interface where the voice call indication corresponds to an incoming voice call; and receiving a user input for receiving the voice call and displaying the voice call as scrolling text. In another embodiment, a method includes displaying application related data on a display; converting voice audio data to textual data by applying voice-to-text conversion; converting the textual data to a video format; and displaying the textual data as scrolling text over the application related data on the display.

Claims

1. A method comprising:

receiving video information at a wireless mobile communication device;

running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

providing, by the wireless mobile communication device, a user with an indication of an incoming message, the message having a video portion and an audio portion;

obtaining, by the video application, message text data, wherein obtaining the message text data comprises;

stripping an audio portion of the message; and

providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion; and

continuing to play the video information in the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

2. The method of claim 1, further comprising:

receiving a user input for receiving the message; and

obtaining the message text data in response to receiving the user input.

3. The method of claim 2, further comprising:

detecting that the video information is being displayed on the display; and

diverting the audio portion from an audio logic to the voice-to-text converter, for conversion of the audio portion to the message text data.

4. The method of claim 1, further comprising:

retrieving the audio portion from one of a remote storage or from a memory.

5. The method of claim 1, wherein providing the user with the indication of the incoming message comprises:

producing an audio indication or displaying an icon on the display.

6. A method comprising:

receiving video information at a wireless mobile communication device;

running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

receiving a communication message indication from a network;

providing the communication message indication to a user interface, the communication message indication corresponding to an incoming communication message, the communication message having a video portion and an audio portion;

receiving a user input for receiving the communication message and displaying the audio portion of the communication message as scrolling text on the display;

obtaining, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the communication message; and

providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion; and

in response to the user input, continuing to play the video information on the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

7. A method comprising:

receiving video information at a wireless mobile communication device;

running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

providing, by the wireless mobile communication device, a user with an indication of an incoming message, the message having a video portion and an audio portion;

obtaining, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the message; and

providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion to a video format to create video formatted messaging data, the video formatted messaging data including textual data corresponding to the audio portion; and

continuing to play the video information in the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the video formatted messaging data is scrolled across a portion of the display outside the PiP portion of the display.

8. The method of claim 7, further comprising:

diverting the audio portion from an audio logic to the voice-to-text converter; and

obtaining the message text data from the voice-to-text converter.

9. A wireless mobile communication device comprising:

a display; and

one or more programmable processors or application-specific integrated circuits (ASICs) that execute scrolling text logic operative to;

receive video information at a wireless mobile communication device;

run a video application that displays the video information on the display;

provide a user with an indication of an incoming message, the message having an audio portion and a video portion;

obtain, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the message; and

providing the audio portion to a voice-to-text converter, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion;

convert the message text data to a video format; and

continue to play the video information on the display while the video portion of the incoming message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

10. The communication device of claim 9, wherein the one or more programmable processors or ASICs are further operative to:

detect the video information on the display; and

divert the audio portion from an audio logic to the voice-to-text converter in response to detecting the video information on the display.

11. The communication device of claim 10, wherein the one or more programmable processors or ASICs are further operative to:

receive a user input for receiving the message; and

obtain the message text data in response to receiving the user input.

12. A non-transitory computer readable media comprising:

executable instructions for execution by at least one processor of a wireless mobile communication device, that when executed cause the at least one processor to;

receive video information at the wireless mobile communication device;

run a video application that displays the video information on a display of the wireless mobile communication device;

provide a user with an indication of an incoming message, the message having an audio portion and a video portion;

obtain, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the message; and

providing the audio portion to a voice-to-text converter, the voice-to-text converter converting the audio portion to the message text data by applying a voice-to-text conversion to the audio portion; and

continue to play the video information on the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

13. An apparatus comprising:

means for receiving video information at a wireless mobile communication device;

means for running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

means for providing, by the wireless mobile communication device, a user with an indication of an incoming message, the message having a video portion and an audio portion;

means for obtaining, by the video application, message text data, wherein the means for obtaining the message text data comprises;

means for stripping an audio portion of the message; and

means for providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion; and

means for continuing to play the video information in the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

14. The apparatus of claim 13, further comprising:

means for receiving a user input for receiving the message; and

means for obtaining the message text data in response to receiving the user input.

15. The apparatus of claim 14, further comprising:

means for detecting that the video information is being displayed on the display; and

means for diverting the audio portion from an audio logic to the voice-to-text converter, for conversion of the audio portion to the message text data.

16. The apparatus of claim 13, further comprising:

means for retrieving the audio portion from one of a remote storage or from a memory.

17. The apparatus of claim 13, wherein the means for providing the user with the indication of the incoming message comprises:

means for producing an audio indication or displaying an icon on the display.

18. An apparatus comprising:

means for receiving video information at a wireless mobile communication device;

means for running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

means for receiving a communication message indication from a network;

means for providing the communication message indication to a user interface, the communication message indication corresponding to an incoming communication message, the communication message having a video portion and an audio portion;

means for receiving a user input for receiving the communication message and displaying the audio portion of the communication message as scrolling text on the display;

means for obtaining, by the video application, message text data, wherein the means for obtaining the message text data comprises;

means for stripping the audio portion of the communication message; and

means for providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion; and

means for, in response to the user input, continuing to play the video information on the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

19. An apparatus comprising:

means for receiving video information at a wireless mobile communication device;

means for running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

means for providing, by the wireless mobile communication device, a user with an indication of an incoming message, the message having a video portion and an audio portion;

means for obtaining, by the video application, message text data, wherein the means for obtaining the message text data comprises;

means for stripping the audio portion of the message; and

means for providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion to a video format to create video formatted messaging data, the video formatted messaging data including textual data corresponding to the audio portion; and

means for continuing to play the video information in the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the video formatted messaging data is scrolled across a portion of the display outside the PiP portion of the display.

20. The apparatus of claim 19, further comprising:

means for diverting the audio portion from an audio logic to the voice-to-text converter; and

means for obtaining the message text data from the voice-to-text converter.