Mobile information apparatuses that include a digital camera, a touch sensitive screen interface, support for voice activated commands, and a wireless communication chip or chipset supporting IEEE 802.11

• US 10,860,290 B2
• Filed: 05/17/2019
• Issued: 12/08/2020
• Est. Priority Date: 11/01/2000
• Status: Expired due to Term

• Current Assignee: Flexiworld Technologies, Inc.
• Original Assignee: Flexiworld Technologies, Inc.
• Inventors: Chang, William Ho, Liu, Christina Ying
• Primary Examiner(s): Pollack, Melvin H
• Application Number:
  US16/416,088
• Publication Number:
  US 20190272148A1
• Time in Patent Office: 571 Days
• Field of Search: 709204
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/12 Digital output to print unit , e.g. line printer, chain printer
• CPC Class Codes: G06F 3/1206 resulting in increased flexibility in input data format or job format or job type
• CPC Class Codes: G06F 3/1226 Discovery of devices having required properties
• CPC Class Codes: G06F 3/1247 by conversion to printer ready format
• CPC Class Codes: G06F 3/126 Job scheduling, e.g. queuing, determine appropriate device
• CPC Class Codes: G06F 3/1285 Remote printer device, e.g. being remote from client or server
• CPC Class Codes: G06F 3/1292 Mobile client, e.g. wireless printing
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 20/18 involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 20/3224 Transactions dependent on location of M-devices
• CPC Class Codes: G06Q 20/3226 Use of secure elements separate from M-devices
• CPC Class Codes: G06Q 20/327 Short range or proximity payments by means of M-devices
• CPC Class Codes: G06Q 20/3278 : RFID or NFC payments by means of M-devices
• CPC Class Codes: G06Q 20/4012 : Verifying personal identification numbers [PIN]
• CPC Class Codes: G06Q 20/40145 : Biometric identity checks
• CPC Class Codes: G06Q 20/405 : Establishing or using transaction specific rules
• CPC Class Codes: G06Q 2220/00 : Business processing using cryptography postage metering system using cryptography G06Q2250/05
• CPC Class Codes: G07G 1/0018 : Constructional details, e.g. of drawer, printing means, input means
• CPC Class Codes: H04L 12/2805 : Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04L 12/2809 : indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2838 : Distribution of signals within a home automation network, e.g. involving splitting/multiplexing signals to/from different paths adaptations of television systems for transmission by electric cable for domestic distribution H04N7/106; hybrid transport H04L12/6418; home network arrangements specially adapted for distribution of digital video signals H04N7/24
• CPC Class Codes: H04L 2012/2841 : Wireless
• CPC Class Codes: H04L 2012/2849 : Audio/video appliances
• CPC Class Codes: H04L 2012/285 : Generic home appliances, e.g. refrigerators
• CPC Class Codes: H04L 41/0803 : Configuration setting
• CPC Class Codes: H04M 1/2478 : Telephone terminals specially adapted for non-voice services, e.g. email, internet access centralized arrangements where telephones services are combined H04M7/0024; for recording text messages H04M3/5322; for accessing Internet H04M3/4938
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 64/003 : locating network equipment
• CPC Class Codes: H04W 76/10 : Connection setup
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

Information apparatus specifications that include voice activated command functions are disclosed and enabled. The information apparatus may include a touch sensitive screen, a digital camera, a wireless communication unit, an operating system, a graphical user interface, an e-mail application, an Internet browsing application, and an application for playing audio or video content. The information apparatus operating system supports an application programming interface (API). A user can install additional applications. The information apparatus may further include a microphone and a speaker for interacting via voice commands with the user. In some examples, the user may take a picture with the digital camera included in the information apparatus and transfer or synchronize the picture to a wireless output device. In other examples, the information apparatus may further wirelessly play, print, stream, or mirror digital content, via the touch sensitive screen, to an output device.

Claims

1. An information apparatus supporting both touch sensitive screen interface and voice activated command interface for interacting with a user, the information apparatus being a mobile and wireless information apparatus, the information apparatus including one or more applications with access to digital content, the information apparatus comprising:

a digital capturing device for capturing data, the digital capturing device being at least a digital camera for taking pictures or a video camera for capturing at least video,

a touch sensitive screen,

a graphical user interface over the touch sensitive screen for interacting with the user,

a voice activated command function for receiving voice commands from the user for outputting or playing at least part of the digital content,

one or more processors,

memory or storage storing at least a portion of the digital content, and

one or more wireless communication units that include circuitry, one or more radio frequency controllers for radio frequency wireless communication, and at least one antenna, the one or more wireless communication units being compatible, at least in part, with at least a protocol within IEEE 802.11 wireless standards or within Bluetooth specifications; and

wherein the one or more applications are installed or preinstalled in the information apparatus, the one or more applications include;

an e-mail application,

a digital imaging application,

an audio application,

a video application,

a document editing application, and

an Internet browsing application; and

wherein the information apparatus further includes operating system software supporting an object model or an application programming interface (API) to facilitate operation of the one or more applications included in the information apparatus; and

wherein the information apparatus is operable to allow the user to install additional applications for running on the operating system software to further expand functionalities of the information apparatus; and

wherein the information apparatus is further operable to;

(1) capture, using the digital capturing device included in the information apparatus, the data;

(2) couple, using the one or more wireless communication units of the information apparatus, the information apparatus to a wireless local area network;

(3) wirelessly discover, using the one or more wireless communication units of the information apparatus, one or more wireless output devices that are available in the wireless local area network coupled in (2);

(4) display, on the touch sensitive screen of the information apparatus, one or more items that are related to the one or more wireless output devices that are wirelessly discovered in (3) to be available in the wireless local area network coupled in (2), the one or more wireless output devices being distinct devices from the information apparatus;

(5) receive, from the user and using the touch sensitive screen of the information apparatus, selection of an item, which is related to a selected wireless output device, from among the one or more items that are displayed on the touch sensitive screen in (4) for user selection; and

(6) wirelessly transfer, using the one or more wireless communication units of the information apparatus and over the wireless local area network coupled in (2), from the information apparatus to the wireless output device selected in (5), at least part of the data captured by the digital capturing device of the information apparatus in (1); and

wherein the information apparatus is a mobile and wireless information apparatus that is at least one of a smart phone, an information pad, a digital pad, an ebook, an Internet appliance, or a digital camera, individually or in any combination; and

wherein the wireless transfer of at least part of the data in (6) is based, at least in part, on the information apparatus having received, using the touch sensitive screen of the information apparatus and from the user, the selection of the item related to the selected wireless output device in (5); and

wherein at least part of the data captured by the digital capturing device of the information apparatus in (1) includes image data or video data or audio data.

2. The information apparatus of claim 1, wherein the information apparatus is further operable to:

access, by the one or more applications at the information apparatus, audio digital content;

wirelessly discover, using the one or more wireless communication units of the information apparatus and over short range wireless communication, an audio output device;

display, on the touch sensitive screen of the information apparatus, an item related to the audio output device that is wirelessly discovered by the information apparatus;

receive, from the user and via the touch sensitive screen of the information apparatus, a selection of the item related to the audio output device displayed on the touch sensitive screen of the information apparatus; and

wirelessly transfer or output, using the one or more wireless communication units of the information apparatus and by direct short range wireless communication, at least part of the audio digital content, accessed by the one or more applications of the information apparatus, to or at the audio output device wirelessly discovered by the information apparatus; and

wherein at least one wireless communication unit of the one or more wireless communication units of the information apparatus is further compatible with at least a protocol within Bluetooth specifications for establishing the direct short range wireless communication with the audio output device.

3. The information apparatus of claim 1, wherein at least one wireless communication unit of the one or more wireless communication units of the information apparatus is compatible with at least a protocol within IEEE 802.11 wireless standards for coupling to the wireless local area network in (2), and

wherein the selected wireless output device is at least one of a television device, a sound output device, a music playing device, a display device, a printing device, a projection device, or an output controller externally connectable to a television, individually or in any combination.

4. The information apparatus of claim 3, wherein the wireless output device selected in (5) is a printing device;

and wherein the information apparatus is further operable to;

wirelessly receive, using the one or more wireless communication units of the information apparatus and from the printing device over the wireless local area network coupled in (2), information corresponding to the printing device, the information includes one or more of a name, a brand, a model, capability information, duplex information, color information, language information, or format information, individually or in any combination, related, at least in part, to the printing device;

generate, using, at least in part, the one or more processors of the information apparatus, output data related to the digital content accessed by the one or more applications of the information apparatus, the generated output data is in accordance, at least in part, with the information wirelessly received from the printing device; and

wirelessly transmit, using the one or more wireless communication units of the information apparatus and over the wireless local area network coupled in (2), at least part of the generated output data to the printing device for printing at least part of the digital content accessed by the one or more applications of the information apparatus.

5. The information apparatus of claim 2, wherein the information apparatus is further operable to:

wirelessly discover, using the one or more wireless communication units of the information apparatus, the one or more wireless output devices that are available for service in the wireless local area network coupled in (2), the one or more wireless output devices being distinct devices from the information apparatus;

wirelessly receive, using the one or more wireless communication units of the information apparatus and from the one or more wireless output devices wirelessly discovered by the information apparatus, one or more device dependent attributes corresponding to the one or more wireless output devices, the one or more device dependent attributes include one or more of a name, a make identifier, a model identifier, an output device type identifier, an output data format identifier, or an output device identifier, individually or in any combination; and

display, on the touch sensitive screen of the information apparatus, the one or more items, related to the one or more wireless output devices and corresponding to the one or more device dependent attributes, for user selection.

6. The information apparatus of claim 2, wherein the information apparatus further includes an output manager for managing transfer of at least part of the digital content to the wireless output device selected in (5), the information apparatus being further operable to:

receive, using the touch sensitive screen of the information apparatus, an input from the user to transmit or output at least part of the digital content from the information apparatus;

pass at least part of the digital content from at least one of said e-mail application, said audio application, said digital imaging application, said document editing application, said Internet browsing application, or said video application, individually or in any combination, to the output manager in the information apparatus, the passing of at least part of the digital content being facilitated, at least in part, by the object model or the application programming interface (API) supported by the operating system software included in the information apparatus; and

wirelessly transmit or output, using the one or more wireless communication units of the information apparatus and from the information apparatus to the one or more wireless output devices, at least part of the digital content, which is passed from the one or more applications to the output manager.

7. The information apparatus of claim 1, wherein the information apparatus further comprises:

a microphone interface,

a speaker for outputting sound, and

wherein the information apparatus is further operable to;

wirelessly access, using the one or more wireless communication units of the information apparatus and over the wireless local area network coupled in (2), one or more servers over a network that includes the Internet;

receive, via the voice activated command function of the information apparatus and from the user, a command for outputting or playing the digital content; and

receive, using the one or more wireless communication units of the information apparatus and from the one or more servers, output data related to the digital content.

8. The information apparatus of claim 1, wherein the information apparatus is further operable to obtain authentication information or security information;

and

wherein based, at least in part, on the information apparatus having successfully obtained the authentication information or the security information, the information apparatus is further operable to enable the information apparatus to wirelessly discover or wirelessly access services provided by the wireless output device selected in (5).

9. A method for wirelessly transmitting digital content from an information apparatus to one or more wireless output devices, the information apparatus being a mobile and wireless information apparatus, the information apparatus including one or more applications with access to the digital content, the one or more applications include:

an e-mail application,

a digital imaging application,

an audio application,

a video application,

a document creation application, and

an Internet browsing application; and

operating system software in the information apparatus supporting an object model or an application programming interface (API) to facilitate operations of the one or more applications included in the information apparatus; and

wherein the information apparatus is operable to allow a user of the information apparatus to install additional applications for running on said operating system software to further expand functionalities of the information apparatus;

the information apparatus further comprising;

a digital capturing device for capturing image data or video data,

a touch sensitive screen,

a graphical user interface over the touch sensitive screen for interacting with the user,

a voice activated command function for receiving voice commands from the user for outputting or playing at least part of the digital content,

one or more processors,

memory or storage for storing at least a portion of the digital content, and

wireless communication circuitry that includes at least a radio frequency controller and an antenna for establishing radio frequency wireless communication, the method comprising;

wirelessly discovering, by the information apparatus and over the radio frequency wireless communication and using the wireless communication circuitry of the information apparatus, the one or more wireless output devices that are available, locally, for service, the one or more wireless output devices being distinct devices from the information apparatus;

displaying, on the touch sensitive screen of the information apparatus, information that is related to at least one wireless output device from among the one or more wireless output devices that are wirelessly discovered by the information apparatus, for selection by the user;

receiving, via the touch sensitive screen of the information apparatus and from the user, at least a selection of the information displayed on the touch sensitive screen of the information apparatus, the selection of the information being related to a selected wireless output device from among the one or more wireless output devices that are wirelessly discovered to be available for service; and

wirelessly transferring or outputting, over the radio frequency wireless communication and using the wireless communication circuitry of the information apparatus, at least part of the digital content, which is accessed by the one or more applications, from the information apparatus to the selected wireless output device; and

wherein at least part of the digital content that is accessed from at least one of said e-mail application, said digital imaging application, said audio application, said video application, said document creation application, or said Internet browsing application, individually or in any combination, is wirelessly transferred or outputted from the information apparatus to the selected wireless output device, over the radio frequency wireless communication, based, at least in part, on the information apparatus having received, via the graphical user interface and over the touch sensitive screen of the information apparatus, the selection of the information displayed on the touch sensitive screen of the information apparatus; and

wherein the information apparatus is at least one of a smart phone, an information pad, a digital pad, an ebook, an Internet appliance, or a digital camera, individually or in any combination; and

wherein the method further comprises;

capturing, using the digital capturing device included in the information apparatus, the image data or the video data; and

wirelessly transferring or outputting, using the wireless communication circuitry of the information apparatus, at least part of the image data or the video data, captured by the digital capturing device, from the information apparatus to the selected wireless output device that is wirelessly discovered to be available for service; and

wherein the wireless communication circuitry of the information apparatus includes one or more chips or chipsets that are compatible, at least partly, with at least a protocol within IEEE 802.11 wireless standards or Bluetooth specifications for establishing the radio frequency wireless communication.

10. The method of claim 9, wherein the selected wireless output device is at least one of a music playing device, a sound output device, a video output device, an image display device, a television, a projection device, a printing device, or a controller box connectable externally to a television device, individually or in any combination.

11. The method of claim 9, wherein the information apparatus further includes an image acquisition application for acquisition of digital content and an output manager for managing transfer of at least part of the digital content to the one or more wireless output devices, the method further comprising passing at least part of the digital content from at least one of said image acquisition application, said e-mail application, said digital imaging application, said audio application, said video application, said document creation application, or said Internet browsing application, to the output manager via, at least in part, the object model or the application programming interface (API) supported by said operating system software included in the information apparatus.

12. The method of claim 9, further comprising obtaining authentication information or security information at the information apparatus, and wherein based on the information apparatus having successfully obtained the authentication information or the security information, the method further comprises:

establishing a radio frequency wireless connection from the information apparatus to the selected wireless output device; and

wirelessly transferring, using the wireless communication circuitry of the information apparatus and over the established radio frequency wireless connection, at least part of the digital content accessed by the one or more applications, from the information apparatus to the selected wireless output device.

13. The method of claim 9, further comprising:

coupling, using the wireless communication circuitry of the information apparatus, the information apparatus to a wireless local area network;

wirelessly accessing, using the wireless communication circuitry of the information apparatus and over the coupled wireless local area network, one or more servers over a network that includes the Internet; and

receiving, via the voice activated command function of the information apparatus and from the user, a command for outputting or playing the digital content that is accessible by the one or more applications.

14. The method of claim 9, further comprising:

accessing, by the one or more applications at the information apparatus, audio digital content;

wirelessly discovering, by the information apparatus and using the wireless communication circuitry of the information apparatus and over short range wireless communication, an audio output device;

displaying, on the touch sensitive screen of the information apparatus, an item related to the audio output device that is wirelessly discovered by the information apparatus;

receiving, from the user via the touch sensitive screen of the information apparatus, a selection of the item, related to the audio output device, displayed on the touch sensitive screen of the information apparatus; and

wirelessly transferring or outputting, using the wireless communication circuitry of the information apparatus, over the short range wireless communication, and from the information apparatus, at least part of the audio digital content, accessed by the one or more applications of the information apparatus, to or at the wirelessly discovered audio output device; and

wherein the wireless communication circuitry of the information apparatus includes at least a wireless communication chip or chipset that is further compatible with at least a protocol within Bluetooth specifications for establishing the short range wireless communication with the audio output device.

15. An information apparatus containing software or firmware executable, at least partly, by one or more processors at the information apparatus to facilitate access of digital content and output of the digital content from the information apparatus, the information apparatus being a mobile and wireless information apparatus, and the information apparatus including one or more applications installed or pre-installed, the one or more applications including:

an e-mail application,

a digital imaging application,

an audio application,

a video application, and

an Internet browsing application; and

operating system software in the information apparatus supporting an object model or an application programming interface (API) to facilitate operations of at least one of said e-mail application, said digital imaging application, said audio application, said video application, or said Internet browsing application, individually or in any combination, interfacing with device management applications in the information apparatus; and

wherein, the information apparatus is operable to allow a user of the information apparatus to install additional applications to further expand functionalities of the information apparatus;

the information apparatus further including comprising at least;

a digital camera for taking pictures,

a touch sensitive screen interface for interacting with the user,

a graphical user interface over the touch sensitive screen interface,

a microphone,

a speaker for outputting sound,

a voice activated command function for receiving voice commands from the user of the information apparatus,

memory or storage storing at least a portion of the digital content, and

wireless communication circuitry for establishing radio frequency wireless communication between the information apparatus and one or more wireless output devices, the one or more wireless output devices being distinct devices from the information apparatus; and

wherein the software or the firmware, at the information apparatus, is executable by the one or more processors of the information apparatus to further facilitate the information apparatus to;

(1) couple the information apparatus, using the wireless communication circuitry of the information apparatus, to a wireless local area network, the coupling to the wireless local area network being compliant, at least in part, with at least a protocol within IEEE 802.11 wireless standards;

(2) access, using at least one application from the one or more applications that are installed or pre-installed at the information apparatus, the digital content;

(3) wirelessly discover, using the wireless communication circuitry of the information apparatus, at least one wireless output device from among the one or more wireless output devices that are available in the wireless local area network coupled in (1) for service;

(4) display, on the touch sensitive screen interface of the information apparatus, an item related to the at least one wireless output device that is wirelessly discovered by the information apparatus in (3) to be available in the wireless local area network coupled in (1);

(5) receive, via the touch sensitive screen interface of the information apparatus and from the user, at least an indication of a selection of the item that is related to the at least one wireless output device, which is displayed on the touch sensitive screen interface in (4) for user selection;

(6) wirelessly transfer or output, from the information apparatus and using the wireless communication circuitry of the information apparatus and over the wireless local area network coupled in (1), at least part of the digital content, accessed by the one or more applications in (2), to or at the at least one wireless output device that is wirelessly discovered in (3), to be available in the wireless local area network coupled in (1), the wireless transfer or output of at least part of the digital content being based, at least in part, on the information apparatus having received, via the touch sensitive screen interface of the information apparatus and from the user, at least the indication of the selection of the item related to the wireless output device in (5); and

wherein the information apparatus is a mobile and wireless information apparatus that is at least one of a smart phone, an information pad, a digital pad, an ebook, an Internet appliance, or a digital camera, individually or in any combination; and

wherein the at least one wireless output device is at least one of a television device, a sound output device, a music playing device, a display device, a printing device, a projection device, or an output controller externally connectable to a television, individually or in any combination; and

wherein the software or the firmware is further executable by the one or more processors of the information apparatus to;

(7) receive, via the voice activated command function and from the user, a command to output or to play at least part of the digital content accessed by the one or more applications in (2) at the information apparatus.

16. The information apparatus of claim 15, wherein the wireless communication circuitry of the information apparatus includes one or more wireless communication chips or chipsets that are compliant, at least in part, with at least a protocol within IEEE 802.11 wireless standards or within Bluetooth specifications for establishing the radio frequency wireless communication between the information apparatus and the at least one wireless output device.

17. The information apparatus of claim 16, wherein the software or the firmware is further executable by the one or more processors of the information apparatus to:

take a picture using the digital camera included in the information apparatus;

wirelessly transfer or output outputting, using the wireless communication circuitry of the information apparatus and from the information apparatus, at least part of the picture taken, to the at least one wireless output device that is wirelessly discovered in (3).

18. The information apparatus of claim 15, wherein the software or the firmware is further executable by the one or more processors of the information apparatus to:

access, by the one or more applications at the information apparatus, audio digital content;

wirelessly discover, using the wireless communication circuitry of the information apparatus and via short range wireless communication, an audio output device;

display, on the touch sensitive screen interface of the information apparatus, an item related to the audio output device that is wirelessly discovered by the information apparatus;

receive, from the user via the touch sensitive screen interface of the information apparatus, a selection of the item, related to the audio output device, displayed on the touch sensitive screen interface of the information apparatus; and

wirelessly transfer or output, using the wireless communication circuitry of the information apparatus and over direct short range wireless communication, at least part of the audio digital content, accessed by the one or more applications of the information apparatus, from the information apparatus to or at the wirelessly discovered audio output device; and

wherein the wireless communication circuitry of the information apparatus includes one or more wireless communication chips or chipsets that are compliant, at least in part, with at least a protocol within Bluetooth specifications for establishing a direct short range radio frequency wireless communication between the information apparatus and the audio output device.

19. The information apparatus of claim 16, wherein the software or the firmware is further executable by the one or more processors of the information apparatus to:

wirelessly discover, using the wireless communication circuitry of the information apparatus, the one or more wireless output devices that are available for service in the wireless local area network coupled in (1);

wirelessly receive, using the wireless communication circuitry of the information apparatus and from the one or more wireless output devices that are wirelessly discovered by the information apparatus in (3), one or more device dependent attributes corresponding to the one or more wireless output devices, the one or more device dependent attributes include one or more of a name, an identity, a number, a make identifier, a model identifier, an output device type identifier, an output data format identifier, or an output device identifier, individually or in any combination; and

display, on the touch sensitive screen interface of the information apparatus, one or more items, related to the one or more wireless output devices and corresponding to the one or more device dependent attributes, for user selection.

20. The information apparatus of claim 16, wherein the at least one wireless output device is a printing device;

and wherein the software or the firmware is further executable by the one or more processors of the information apparatus to;

wirelessly receive, using the wireless communication circuitry of the information apparatus and from the printing device over the wireless local area network coupled in (1), device attributes corresponding to the printing device, the device attributes including one or more of capability information, duplex information, color information, language information, or format information, individually or in any combination, related, at least in part, to the printing device;

generate, at the information apparatus, output data related to the digital content accessed by the one or more applications of the information apparatus, the generated output data is in accordance, at least in part, to the device attributes wirelessly received from the printing device; and

wirelessly transmit, using the wireless communication circuitry of the information apparatus and over the wireless local area network coupled in (1), at least part of the generated output data to the printing device for printing at least part of the digital content accessed by the one or more applications of the information apparatus.