SMART PHONES OR INTERNET PHONES THAT SUPPORT VOICE ACTIVATED COMMANDS FOR MANAGING AND REPLYING TO E-MAILS

• US 20130109353A1
• Filed: 12/10/2012
• Published: 05/02/2013
• Est. Priority Date: 11/01/2000
• Status: Active Grant

• Current Assignee: Flexiworld Technologies, Inc.
• Original Assignee: Flexiworld Technologies, Inc.
• Inventors: Chang, William Ho, Liu, Christina Ying
• Granted Patent: US 9,383,956 B2
• Time in Patent Office: Days
• US Class Current: 455/411
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/12 Digital output to print unit , e.g. line printer, chain printer
• CPC Class Codes: G06F 3/1206 resulting in increased flexibility in input data format or job format or job type
• CPC Class Codes: G06F 3/1226 Discovery of devices having required properties
• CPC Class Codes: G06F 3/1247 by conversion to printer ready format
• CPC Class Codes: G06F 3/126 Job scheduling, e.g. queuing, determine appropriate device
• CPC Class Codes: G06F 3/1285 Remote printer device, e.g. being remote from client or server
• CPC Class Codes: G06F 3/1292 Mobile client, e.g. wireless printing
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 20/3224 Transactions dependent on location of M-devices
• CPC Class Codes: G06Q 20/3226 Use of secure elements separate from M-devices
• CPC Class Codes: G06Q 20/327 Short range or proximity payments by means of M-devices
• CPC Class Codes: G06Q 20/3278 RFID or NFC payments by means of M-devices
• CPC Class Codes: G06Q 20/4012 Verifying personal identification numbers [PIN]
• CPC Class Codes: G06Q 20/40145 : Biometric identity checks
• CPC Class Codes: G06Q 20/405 : Establishing or using transaction specific rules
• CPC Class Codes: G06Q 2220/00 : Business processing using cryptography postage metering system using cryptography G06Q2250/05
• CPC Class Codes: H04L 12/2805 : Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04L 12/2809 : indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2838 : Distribution of signals within a home automation network, e.g. involving splitting/multiplexing signals to/from different paths adaptations of television systems for transmission by electric cable for domestic distribution H04N7/106; hybrid transport H04L12/6418; home network arrangements specially adapted for distribution of digital video signals H04N7/24
• CPC Class Codes: H04L 2012/2841 : Wireless
• CPC Class Codes: H04L 2012/2849 : Audio/video appliances
• CPC Class Codes: H04L 2012/285 : Generic home appliances, e.g. refrigerators
• CPC Class Codes: H04L 41/0803 : Configuration setting
• CPC Class Codes: H04M 1/2478 : Telephone terminals specially adapted for non-voice services, e.g. email, internet access centralized arrangements where telephones services are combined H04M7/0024; for recording text messages H04M3/5322; for accessing Internet H04M3/4938
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 64/003 : locating network equipment
• CPC Class Codes: H04W 76/10 : Connection setup
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

New Smart Phones with voice activated command functions for replying to e-mails are disclosed and enabled. The Smart Phones may be Internet-Phones and may include a touch sensitive screen, a graphical user interface, a voice communication application, an e-mail application, a messaging application, an Internet browsing application, and applications for playing audio/video content. An operating system of the Smart Phone may provide an application programming interface (API) to support diverse applications. The Smart Phone may further include a microphone for receiving voice commands, and a speaker for outputting sound. In one example, the Smart Phone may reply to an e-mail by simply receiving a user'"'"'s voice commands or by simply receiving a user'"'"'s selection of a reply icon over the touch sensitive screen. In another example, the user may issue voice commands for the Smart Phone to stream, send, play, print, or display digital content at an output device.

Claims

1. A Smart Phone supporting both touch sensitive screen and voice activated command interfaces for interacting with a user, the Smart Phone being an Internet-Phone with access to the Internet and having one or more applications with access to digital content, the Smart Phone further being a mobile and wireless information apparatus, the Smart Phone including each of the following applications installed or pre-installed:

a voice communication application,

a messaging application,

a digital imaging application,

an audio application,

a video application,

a document editing application,

an Internet browsing application, and

operating system software in the Smart Phone supporting an object model or an application programming interface (API) to facilitate at least one of said messaging application, said audio application, said video application, said digital imaging application, said document editing application, and said Internet browsing application interfacing with device management applications in the Smart Phone, and

wherein, the Smart Phone is operable to allow the user to install additional applications associated for running on said operating system software to further expand the functionalities of the Smart Phone;

the Smart Phone further comprising;

a digital camera for taking pictures,

a touch sensitive screen interface for interacting with the user,

a graphical user interface over the touch sensitive screen,

a microphone interface,

a speaker interface for outputting sound to the user,

a voice activated command function for receiving voice commands from the user over the microphone interface,

a processing unit,

a memory or storage unit for storing at least a portion of the digital content, and

a wireless communication unit that includes a radio frequency controller and an antenna for establishing radio frequency wireless communication between the Smart Phone and one or more wireless output controller devices that are distinct devices from the Smart Phone; and

wherein, the Smart Phone further includes an e-mail application, the e-mail application includes;

a graphical user interface, provided by the e-mail application and over the touch sensitive screen, that includes an inbox,

a done icon, provided by the e-mail application, for user selection over the touch sensitive screen,

a reply icon, provided by the e-mail application, for user selection over the touch sensitive screen for replying to an e-mail,

a delete icon, provided by the e-mail application, for user selection over the touch sensitive screen for deleting an e-mail,

a print icon, provided by the e-mail application, for user selection over the touch sensitive screen for printing an e-mail, the e-mail application being further operable to;

access an object model or an application programming interface (API) facilitated by the Smart Phone operating system software included in the Smart Phone for accessing one or more device management utilities and services in the Smart Phone,

pass at least part of the digital content over the object model or the application programming interface (API) provided by the Smart Phone operating system software,

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a done icon,

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a reply icon,

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a delete icon,

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a print icon, and

receive from the user, over the speaker interface and via the voice activated command function, a request to reply to an e-mail;

whereby, the mobile and wireless Smart Phone is operable to support at least two types of interfaces that include (1) voice activated commands from the user over the speaker interface to reply to an e-mail, and (2) a selection of the reply icon over the touch sensitive screen interface to reply to an e-mail.

2. The Smart Phone of claim 1, wherein the e-mail application is further operable to provide to the user, via the touch sensitive screen interface of the Smart Phone, one or more wireless output devices for selection by the user.

3. The Smart Phone of claim 2, wherein the Smart Phone is further operable to:

receive, via the touch sensitive screen interface of the Smart Phone, a selected wireless output device from among the one or more wireless output devices that are provided to the user for selection by the user; and

establish a radio frequency wireless connection from the Smart Phone to the selected wireless output device for transfer of the at least part of the digital content to the selected wireless output device.

4. The Smart Phone of claim 3, wherein the selected wireless output device is at least one of a television, a display device, an audio output device, a printer, or a projector, individually or in any combination.

5. The Smart Phone of claim 1, wherein the Smart Phone further includes an output manager in the Smart Phone for managing transfer of at least part of an e-mail to the one or more wireless output controller devices, the e-mail application being further operable to pass the at least part of an e-mail to the output manager in the Smart Phone, the passing of the at least part of an e-mail being facilitated at least in part by the object model or the application programming interface (API) provided by the Smart Phone operating system software.

6. The Smart Phone of claim 1, wherein Smart Phone is further operable to:

obtain authentication or security information at the Smart Phone; and

establish a restricted radio frequency wireless connection from the Smart Phone to a wireless output device for transfer of at least part of an e-mail to the wireless output device, the wireless output device being a distinct device from the Smart Phone.

7. The Smart Phone of claim 1, wherein the Smart Phone is further operable to interact with the user via the voice activated command function over the speaker interface, the interaction including showing an e-mail from the inbox over the touch sensitive screen interface of the Smart Phone to the user.

8. A method of replying to e-mails from a Smart Phone, the Smart Phone supporting both touch sensitive screen and voice activated command interfaces for interacting with a user, the Smart Phone being an Internet-Phone with access to the Internet and having one or more applications with access to digital content, the Smart Phone further being a mobile and wireless information apparatus, the Smart Phone including each of the following applications installed or pre-installed:

a voice communication application,

a messaging application,

a digital imaging application,

an audio application,

a video application,

a document editing application,

an Internet browsing application, and

operating system software in the Smart Phone supporting an object model or an application programming interface (API) to facilitate at least one of said messaging application, said audio application, said video application, said digital imaging application, said document editing application, and said Internet browsing application interfacing with device management applications in the Smart Phone, and

wherein, the Smart Phone is operable to allow the user to install additional applications associated for running on said operating system software to further expand the functionalities of the Smart Phone;

the Smart Phone further comprising;

an image acquisition application,

a touch sensitive screen interface for interacting with the user,

a graphical user interface over the touch sensitive screen,

a microphone interface,

a speaker interface for outputting sound to the user,

a voice activated command function for receiving voice commands from the user over the microphone interface,

a processing unit,

a memory or storage unit for storing at least a portion of the digital content, and

a wireless communication unit that includes a radio frequency controller and an antenna for establishing radio frequency wireless communication between the Smart Phone and one or more wireless output devices that are distinct devices from the Smart Phone;

wherein, the Smart Phone further includes an e-mail application, the e-mail application includes;

a graphical user interface, provided by the e-mail application and over the touch sensitive screen, that includes an inbox,

a reply icon, provided by the e-mail application, for user selection over the touch sensitive screen for replying to an e-mail,

a delete icon, provided by the e-mail application, for user selection over the touch sensitive screen for deleting an e-mail,

a print icon, provided by the e-mail application, for user selection over the touch sensitive screen for printing an e-mail;

the method comprising;

accessing an object model or an application programming interface (API) facilitated by the Smart Phone operating system software included in the Smart Phone for accessing one or more device management utilities and services in the Smart Phone;

passing at least part of the digital content over the object model or the application programming interface (API) provided by the Smart Phone operating system software;

receiving from the user, via the touch sensitive screen interface of the Smart Phone, selection of a reply icon;

receiving from the user, via the touch sensitive screen interface of the Smart Phone, selection of a delete icon;

receiving from the user, over the speaker interface and via the voice activated command function, a request to reply to an e-mail; and

providing to the user, via the touch sensitive screen interface of the Smart Phone, one or more wireless output devices for selection by the user;

whereby, the mobile and wireless Smart Phone is operable to reply to an e-mail via at least two types of interfaces that include (1) voice activated commands from the user over the speaker interface, and (2) a selection of the reply icon over the touch sensitive screen interface.

9. The method of claim 8, further comprising searching, over a radio frequency wireless communication and through the wireless communication unit of the Smart Phone, for the one or more wireless output devices available for wireless connection.

10. The method of claim 8, further comprising receiving, via the touch sensitive screen interface of the Smart Phone, a selected wireless output device from among the one or more wireless output devices that are provided to the user for selection by the user.

11. The method of claim 10, further comprising:

establishing a radio frequency wireless connection from the Smart Phone to the selected wireless output device for transferring of the at least part of the digital content from the Smart Phone to the selected wireless output device; and

transferring the at least part of the digital content from the Smart Phone to the selected wireless output device over the established radio frequency wireless connection from the Smart Phone to the selected wireless output device.

12. The method of claim 8, wherein the Smart Phone further includes an output manager in the Smart Phone for managing transfer of at least part of an e-mail to the one or more wireless output devices, and the method further comprising passing the at least part of an e-mail to the output manager in the Smart Phone, the passing of the at least part of an e-mail being facilitated, at least in part, by the object model or the application programming interface (API) provided by the Smart Phone operating system software.

13. The method of claim 8, further comprising:

obtaining authentication or security information at the Smart Phone; and

establishing, with the authentication or security information, a restricted radio frequency wireless connection from the Smart Phone to the one or more wireless output devices for transfer of at least part of an e-mail to the one or more wireless output devices.

14. The method of claim 8, further comprising interacting with the user via the voice activated command function over the speaker interface, the interaction including showing an e-mail from the inbox over the touch sensitive screen interface of the Smart Phone to the user.

15. A Smart Phone including Smart Phone software containing a program of commands executable by a processor of the Smart Phone to facilitate replying to an e-mail from the Smart Phone, the Smart Phone supporting both touch sensitive screen and voice activated command interfaces for interacting with a user, the Smart Phone being an Internet-Phone with access to the Internet and having one or more applications with access to digital content, the Smart Phone further being a mobile and wireless information apparatus, the Smart Phone including each of the following applications installed or pre-installed:

a voice communication application,

a messaging application,

a digital imaging application,

an audio application,

a video application,

a document editing application,

an Internet browsing application, and

operating system software in the Smart Phone supporting an object model or an application programming interface (API) to facilitate at least one of said messaging application, said audio application, said video application, said digital imaging application, said document editing application, and said Internet browsing application interfacing with device management applications in the Smart Phone, and

wherein, the Smart Phone is operable to allow the user to install additional applications associated for running on said operating system software to further expand the functionalities of the Smart Phone;

the Smart Phone further comprising;

an image acquisition application,

a digital camera for taking pictures,

a touch sensitive screen interface for interacting with the user,

a graphical user interface over the touch sensitive screen,

a microphone interface,

a speaker interface for outputting sound to the user,

a voice activated command function for receiving voice commands from the user over the microphone interface,

a processing unit,

a memory or storage unit for storing at least a portion of the digital content, and

a wireless communication unit that includes a radio frequency controller and an antenna for establishing radio frequency wireless communication between the Smart Phone and one or more wireless output devices that are distinct devices from the Smart Phone;

wherein, the Smart Phone further includes an e-mail application, the e-mail application includes;

a graphical user interface, provided by the e-mail application and over the touch sensitive screen, that includes an inbox,

a graphical user interface, provided by the e-mail application and over the touch sensitive screen, showing to the user the number of messages that are in the inbox;

a done icon, provided by the e-mail application, for user selection over the touch sensitive screen,

a reply icon, provided by the e-mail application, for user selection over the touch sensitive screen for replying to an e-mail, and

a delete icon, provided by the e-mail application, for user selection over the touch sensitive screen for deleting an e-mail;

the Smart Phone software being further executable by the processor of the Smart Phone to facilitate the Smart Phone to;

access an object model or an application programming interface (API) facilitated by the Smart Phone operating system software included in the Smart Phone for accessing one or more device management utilities and services in the Smart Phone;

pass at least part of the digital content over the object model or the application programming interface (API) provided by the Smart Phone operating system software;

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a done icon;

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a reply icon;

receive from the user, via the touch sensitive screen interface of the Smart Phone, selection of a delete icon; and

receive from the user, over the speaker interface and via the voice activated command function, a request to reply to an e-mail;

wherein, the Smart Phone software is executable by the processor of the Smart Phone to initiate a reply to an e-mail in response to either a voice activated command or selection of a reply icon over the touch sensitive screen interface.

16. The Smart Phone of claim 15, wherein the Smart Phone software is further executable by the processor of the Smart Phone to discover, over a radio frequency wireless communication and through the wireless communication unit of the Smart Phone, the one or more wireless output devices that are available for wireless connection with the Smart Phone.

17. The Smart Phone of claim 15, wherein the Smart Phone software is further executable by the processor of the Smart Phone to receive, via the touch sensitive screen interface of the Smart Phone, a selected wireless output device from among the one or more wireless output devices that are provided to the user over the touch sensitive screen interface for selection by the user.

18. The Smart Phone of claim 17, wherein the Smart Phone software is further executable by the processor of the Smart Phone to:

establish a radio frequency wireless connection from the Smart Phone to the selected wireless output device for transfer of at least part of an e-mail to the selected wireless output device; and

transfer the at least part of an e-mail to the selected wireless output device over the established radio frequency wireless connection from the Smart Phone to the selected wireless output device.

19. The Smart Phone of claim 15, wherein the Smart Phone further includes an output manager in the Smart Phone for managing transfer of at least part of an e-mail to the one or more wireless output devices, the Smart Phone software is further executable by the processor of the Smart Phone to pass the at least part of an e-mail to the output manager in the Smart Phone, the passing of the at least part of an e-mail being facilitated, at least in part, by the object model or the application programming interface (API) provided by the Smart Phone operating system software.

20. The Smart Phone of claim 15, wherein the Smart Phone software is further executable by the processor of the Smart Phone to interact with the user via the voice activated command function over the speaker interface, the interaction including showing an e-mail over the touch sensitive screen interface of the Smart Phone to the user.