Method and apparatus for scrolling text display of voice call or message during video display session

• US 8,180,644 B2
• Filed: 09/17/2008
• Issued: 05/15/2012
• Est. Priority Date: 08/28/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc., Trustees Of The University Of Pennsylvania (University of Pennsylvania)
• Original Assignee: Qualcomm, Inc.
• Inventors: Garg, Dinesh Kumar, Poddar, Manish
• Primary Examiner(s): ALBERTALLI, BRIAN LOUIS
• Application Number:
  US12/211,973
• Publication Number:
  US 20100057466A1
• Time in Patent Office: 1,336 Days
• Field of Search: None
• US Class Current: 704/270
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/602 for digital sound signals
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method and communication device disclosed includes displaying a video on a display, converting voice audio data to textual data by applying voice-to-text conversion, and displaying the textual data as scrolling text displayed along with the video on the display and either above, below or across the video. The method may further include receiving a voice call indication from a network, providing the voice call indication to a user interface where the voice call indication corresponds to an incoming voice call; and receiving a user input for receiving the voice call and displaying the voice call as scrolling text. In another embodiment, a method includes displaying application related data on a display; converting voice audio data to textual data by applying voice-to-text conversion; converting the textual data to a video format; and displaying the textual data as scrolling text over the application related data on said display.

Claims

1. A method comprising:

receiving video information at a wireless mobile communication device, the video information being digital video broadcast (DVB) data received from a video digital broadcasting network;

running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

providing, by the wireless mobile communication device, a user with an indication of an incoming message, the message having a video portion and an audio portion;

obtaining, by the video application, message text data, wherein obtaining the message text data comprises;

stripping an audio portion of the message; and

providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion; and

continuing to play the video information in the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

2. The method of claim 1, further comprising:

receiving a user input for receiving the message; and

obtaining the message text data in response to receiving the user input.

3. The method of claim 2, further comprising:

detecting that the video information is being displayed on the display; and

diverting the audio portion from an audio logic to the voice-to-text converter, for conversion of said audio portion to said message text data.

4. The method of claim 1, further comprising:

retrieving said audio from one of a remote storage or from a memory.

5. The method of claim 1, wherein providing the user with the indication of the incoming message comprises:

producing an audio indication or displaying an icon on said display.

6. A method comprising:

receiving video information at a wireless mobile communication device, the video information being digital video broadcast (DVB) data received from a video digital broadcasting network;

running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

receiving a communication message indication from a network;

providing the communication message indication to a user interface, the communication message indication corresponding to an incoming communication message, the communication message having a video portion and an audio portion;

receiving a user input for receiving the communication message and displaying the audio portion of the communication message as scrolling text on the display;

obtaining, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the communication message; and

providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion; and

in response to the user input, continuing to play the video information on the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.

7. A method comprising:

receiving video information at a wireless mobile communication device, the video information being digital video broadcast (DVB) data received from a video digital broadcasting network;

running, by the wireless mobile communication device, a video application that displays the video information on a display of the wireless mobile communication device;

providing by the wireless mobile communication device, a user with an indication of an incoming message, the message having a video portion and an audio portion;

obtaining, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the message; and

providing the audio portion to a voice-to-text converter at the wireless mobile communication device, the voice-to-text converter converting the audio portion to a video format to create video formatted messaging data, the video formatted messaging data including textual data corresponding to the audio portion; and

continuing to play the video information in the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the video formatted messaging data is scrolled across a portion of the display outside the PiP portion of the display.

8. The method of claim 7, further comprising:

diverting the audio portion from an audio logic to the voice-to-text converter; and

obtaining the message text data from the voice-to-text converter.

9. A wireless mobile communication device comprising:

a display; and

one or more programmable processors or application-specific integrated circuits (ASICs) that execute scrolling text logic operative to;

receive video information at a wireless mobile communication device, the video information being digital video broadcast (DVB) data received from a video digital broadcasting network;

run a video application that displays the video information on the display;

provide a user with an indication of an incoming message, the message having an audio portion and a video portion;

obtain, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the message; and

providing the audio portion to a voice-to-text converter, the voice-to-text converter converting the audio portion of the message to the message text data by applying a voice-to-text conversion to the audio portion;

convert said textual the message text data to a video format; and

continue to play the video information on the display while the video portion of the incoming message is displayed in a picture-in-picture (PiP) portion of the display and while the message text is scrolled across a portion of the display outside the PiP portion of the display.

10. The communication device of claim 9,

wherein the one or more programmable processors or ASICs are further operative to:

detect the video information on the display; and

divert the audio portion from an audio logic to the voice-to-text converter in response to detecting the video information on the display.

11. The communication device of claim 10, wherein the one or more programmable processors or ASICs are further operative to:

receive a user input for receiving the message; and

obtaining the message text data in response to receiving the user input.

12. A non-transitory computer readable media comprising:

executable instructions for execution by at least one processor of a wireless mobile communication device, that when executed cause the at least one processor to;

receive video information at the wireless mobile communication device, the video information being digital video broadcast (DVB) data received from a video digital broadcasting network;

run a video application that displays the video information on a display of the wireless mobile communication device;

provide a user with an indication of an incoming message, the message having an audio portion and a video portion;

obtain, by the video application, message text data, wherein obtaining the message text data comprises;

stripping the audio portion of the message; and

providing the audio portion to a voice-to-text converter, the voice-to-text converter converting the portion to the message text data by applying a voice-to-text conversion to the audio portion; and

continue to play the video information on the display while the video portion of the communication message is displayed in a picture-in-picture (PiP) portion of the display and while the message text data is scrolled across a portion of the display outside the PiP portion of the display.