Mobile Information Apparatuses That Include A Digital Camera, A Touch Sensitive Screen Interface, Support For Voice Activated Commands, And A Wireless Communication Chip Or Chipset Supporting IEEE 802.11

• US 20190272148A1
• Filed: 05/17/2019
• Published: 09/05/2019
• Est. Priority Date: 11/01/2000
• Status: Active Grant

• Current Assignee: Flexiworld Technologies, Inc.
• Original Assignee: Flexiworld Technologies, Inc.
• Inventors: Chang, William Ho, Liu, Christina Ying
• Granted Patent: US 10,860,290 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/12 Digital output to print unit , e.g. line printer, chain printer
• CPC Class Codes: G06F 3/1206 resulting in increased flexibility in input data format or job format or job type
• CPC Class Codes: G06F 3/1226 Discovery of devices having required properties
• CPC Class Codes: G06F 3/1247 by conversion to printer ready format
• CPC Class Codes: G06F 3/126 Job scheduling, e.g. queuing, determine appropriate device
• CPC Class Codes: G06F 3/1285 Remote printer device, e.g. being remote from client or server
• CPC Class Codes: G06F 3/1292 Mobile client, e.g. wireless printing
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 20/18 involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 20/3224 Transactions dependent on location of M-devices
• CPC Class Codes: G06Q 20/3226 Use of secure elements separate from M-devices
• CPC Class Codes: G06Q 20/327 Short range or proximity payments by means of M-devices
• CPC Class Codes: G06Q 20/3278 : RFID or NFC payments by means of M-devices
• CPC Class Codes: G06Q 20/4012 : Verifying personal identification numbers [PIN]
• CPC Class Codes: G06Q 20/40145 : Biometric identity checks
• CPC Class Codes: G06Q 20/405 : Establishing or using transaction specific rules
• CPC Class Codes: G06Q 2220/00 : Business processing using cryptography postage metering system using cryptography G06Q2250/05
• CPC Class Codes: G07G 1/0018 : Constructional details, e.g. of drawer, printing means, input means
• CPC Class Codes: H04L 12/2805 : Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04L 12/2809 : indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2838 : Distribution of signals within a home automation network, e.g. involving splitting/multiplexing signals to/from different paths adaptations of television systems for transmission by electric cable for domestic distribution H04N7/106; hybrid transport H04L12/6418; home network arrangements specially adapted for distribution of digital video signals H04N7/24
• CPC Class Codes: H04L 2012/2841 : Wireless
• CPC Class Codes: H04L 2012/2849 : Audio/video appliances
• CPC Class Codes: H04L 2012/285 : Generic home appliances, e.g. refrigerators
• CPC Class Codes: H04L 41/0803 : Configuration setting
• CPC Class Codes: H04M 1/2478 : Telephone terminals specially adapted for non-voice services, e.g. email, internet access centralized arrangements where telephones services are combined H04M7/0024; for recording text messages H04M3/5322; for accessing Internet H04M3/4938
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 64/003 : locating network equipment
• CPC Class Codes: H04W 76/10 : Connection setup
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

Information apparatus specifications that include voice activated command functions are disclosed and enabled. The information apparatus may include a touch sensitive screen, a digital camera, a wireless communication unit, an operating system, a graphical user interface, an e-mail application, an Internet browsing application, and an application for playing audio or video content. The information apparatus operating system supports an application programming interface (API). A user can install additional applications. The information apparatus may further include a microphone and a speaker for interacting via voice commands with the user. In some examples, the user may take a picture with the digital camera included in the information apparatus and transfer or synchronize the picture to a wireless output device. In other examples, the information apparatus may further wirelessly play, print, stream, or mirror digital content, via the touch sensitive screen, to an output device.

Claims

1. An information apparatus supporting both touch sensitive screen interface and voice activated command interface for interacting with a user, the information apparatus being a mobile and wireless information apparatus, the information apparatus including one or more applications with access to digital content, the information apparatus including:

a digital capturing device for capturing image data or video data, the digital capturing device being at least a digital camera for taking pictures or a video camera for capturing video;

a touch sensitive screen,

a graphical user interface over the touch sensitive screen for interacting with the user,

a microphone interface,

a speaker for outputting sound,

a voice activated command function for receiving voice commands from the user for outputting or playing at least part of the digital content,

one or more processors,

memory or storage storing at least a portion of the digital content, and

one or more wireless communication units that include circuitry, one or more radio frequency controllers for radio frequency wireless communication, and at least one antenna; and

wherein the one or more applications are installed or preinstalled in the information apparatus, the one or more applications include;

an e-mail application,

a digital imaging application,

an audio application,

a video application,

a document editing application, and

an Internet browsing application; and

wherein the information apparatus further includes operating system software supporting an object model or an application programming interface (API) to facilitate operation of at least one of said e-mail application, said digital imaging application, said audio application, said video application, said document editing application, or said Internet browsing application, individually or in any combination, included in the information apparatus; and

wherein the information apparatus is operable to allow the user to install additional applications for running on the operating system software to further expand functionalities of the information apparatus; and

wherein the information apparatus is further operable to;

receive, via the touch sensitive screen, an input from the user to transmit or output at least part of the digital content from the information apparatus; and

pass at least part of the digital content from at least one of said e-mail application, said digital imaging application, said audio application, said video application, said document editing application, or said Internet browsing application, individually or in any combination, for transmission or output of at least part of the digital content from the information apparatus, the passing of the at least part of the digital content being facilitated, at least in part, by the object model or the application programming interface (API) supported by the operating system software included in the information apparatus; and

wirelessly transmit or output, over the one or more wireless communication units of the information apparatus, at least part of the digital content from the information apparatus;

wherein the information apparatus is further operable to;

capture, using the digital capturing device included in the information apparatus, the image data or the video data;

couple, using the one or more wireless communication units, the information apparatus to a wireless local area network;

provide, on the touch sensitive screen of the information apparatus, one or more items that are related to one or more wireless output devices that are available in the wireless local area network, the one or more wireless output devices being distinct devices from the information apparatus;

receive, from the user and via the touch sensitive screen of the information apparatus, selection of an item related to a selected wireless output device from among the one or more items that were provided on the touch sensitive screen for user selection;

wirelessly transfer, via the one or more wireless communication units and over the wireless local area network to the selected wireless output device, at least part of the image data or the video data taken by the digital capturing device of the information apparatus; and

wherein the information apparatus is a mobile and wireless information apparatus that is at least one of a smart phone, an information pad, a digital pad, an ebook, an Internet appliance, or a digital camera, individually or in any combination; and

wherein the information apparatus is operable to wirelessly transfer at least part of the image data or the video data to the selected wireless output device that is available for service in the wireless local area network based on having received, via the touch sensitive screen of the information apparatus and from the user, selection of the item related to the selected wireless output device.

2. The information apparatus of claim 1, wherein the information apparatus is further operable to:

access, by the one or more applications at the information apparatus, audio digital content;

wirelessly discover, using the one or more wireless communication units and via short range wireless communication, an audio output device;

display, on the touch sensitive screen of the information apparatus, an item related to the audio output device that is wirelessly discovered;

receive, from the user via the touch sensitive screen of the information apparatus, a selection of the item related to the audio output device displayed on the touch sensitive screen; and

wirelessly transfer or output, via the one or more wireless communication units of the information apparatus and by direct short range wireless communication, at least part of the audio digital content, accessed by the one or more applications of the information apparatus, to or at the audio output device wirelessly discovered by the information apparatus; and

wherein at least one wireless communication unit of the one or more wireless communication units of the information apparatus is further compatible with at least a protocol within Bluetooth specifications for establishing the direct short range wireless communication with the audio output device.

3. The information apparatus of claim 1, wherein at least one wireless communication unit of the one or more wireless communication units of the information apparatus is compatible with at least a protocol within IEEE 802.11 standards for coupling to the wireless local area network, and

wherein the selected wireless output device is at least one of a television device, a sound output device, a music playing device, a display device, a printing device, a projection device, or an output controller externally connectable to a television, individually or in any combination.

4. The information apparatus of claim 3, wherein the selected wireless output device is a printing device;

and wherein the information apparatus is further operable to;

wirelessly receive, via the one or more wireless communication units of the information apparatus and from the printing device over the wireless local area network, information corresponding to the printing device, the information includes one or more of a name, a brand, a model, capability information, duplex information, color information, language information, or format information, individually or in any combination, related, at least in part, to the printing device;

generate, at the information apparatus, output data related to the digital content accessed by the one or more applications of the information apparatus, the generated output data is in accordance, at least in part, with the received information from the printing device; and

wirelessly transmit, via the one or more wireless communication units of the information apparatus and over the wireless local area network, at least part of the generated output data to the printing device for printing at least part of the digital content accessed by the one or more applications of the information apparatus.

5. The information apparatus of claim 1, wherein the information apparatus is further operable to:

wirelessly discover, via the one or more wireless communication units, the one or more wireless output devices that are available for service in the wireless local area network, the one or more wireless output devices being distinct devices from the information apparatus;

wirelessly receive, via the one or more wireless communication units and from the one or more wireless output devices wirelessly discovered by the information apparatus, one or more device dependent attributes corresponding to the one or more wireless output devices, the one or more device dependent attributes include one or more of a name, a make identifier, a model identifier, an output device type identifier, an output data format identifier, or an output device identifier, individually or in any combination; and

display, on the touch sensitive screen of the information apparatus, the one or more items, related to the one or more wireless output device and corresponding to the one or more device dependent attributes, for user selection.

6. The information apparatus of claim 1, wherein the information apparatus further includes an output manager for managing transfer of at least part of the digital content to the selected wireless output device, the information apparatus being further operable to pass at least part of the digital content from at least one of said e-mail application, said audio application, said digital imaging application, said document editing application, said Internet browsing application, or said video application, individually or in any combination, to the output manager in the information apparatus, the passing of at least part of the digital content being facilitated, at least in part, by the object model or the application programming interface (API) supported by the operating system software included in the information apparatus.

7. The information apparatus of claim 1, wherein the information apparatus is further operable to:

wirelessly access, using the one or more wireless communication units and via the wireless local area network, one or more servers;

receive, via the voice activated command function from the user, a command for outputting or playing the digital content; and

receive, via the one or more wireless communication units and from the one or more servers, output data related to the digital content.

8. The information apparatus of claim 1, wherein the information apparatus is further operable to obtain authentication information or security information;

and

wherein based, at least in part, on having successfully obtained the authentication information or the security information, the information apparatus is further operable to enable the information apparatus to wirelessly discover or wirelessly access the services provided by the selected wireless output device.

9. A method for wirelessly transmitting digital content from an information apparatus to one or more wireless output devices, the information apparatus being a mobile and wireless information apparatus, the information apparatus including one or more applications with access to the digital content, the one or more applications include:

an e-mail application,

a digital imaging application,

an audio application,

a video application,

a document creation application, and

an Internet browsing application; and

operating system software in the information apparatus supporting an object model or an application programming interface (API) to facilitate operations of at least one of said e-mail application, said digital imaging application, said audio application, said video application, said document creation application, or said Internet browsing application, individually or in any combination, included in the information apparatus; and

wherein the information apparatus is operable to allow a user of the information apparatus to install additional applications for running on said operating system software to further expand functionalities of the information apparatus;

the information apparatus further comprising;

a digital capturing device for capturing image data or video data,

a touch sensitive screen,

a graphical user interface over the touch sensitive screen for interacting with the user,

a voice activated command function for receiving voice commands from the user for outputting or playing at least part of the digital content,

one or more processors,

memory or storage for storing at least a portion of the digital content, and

wireless communication circuitry that includes at least a radio frequency controller and an antenna for establishing radio frequency wireless communication, the method comprising;

wirelessly discovering, over the radio frequency wireless communication and via the wireless communication circuitry, the one or more wireless output devices that are available, locally, for service, the one or more wireless output devices being distinct devices from the information apparatus;

displaying, on the touch sensitive screen of the information apparatus, information that is related to at least one wireless output device from among the one or more wireless output devices that are wirelessly discovered by the information apparatus, for selection by the user;

receiving, via the touch sensitive screen of the information apparatus and from the user, at least a selection of the information displayed on the touch sensitive screen, the selection of the information being related to a selected wireless output device from among the one or more wireless output devices that are wirelessly discovered to be available for service;

wirelessly transferring or outputting, over the radio frequency wireless communication and via the wireless communication circuitry, at least part of the digital content, accessed by the one or more applications, to the selected wireless output device; and

wherein at least part of the digital content that is accessible from at least one of said e-mail application, said digital imaging application, said audio application, said video application, said document creation application, or said Internet browsing application, individually or in any combination, is wirelessly transferred or outputted to the selected wireless output device, over the radio frequency wireless communication, based, at least in part, on the information apparatus having received, via the graphical user interface and over the touch sensitive screen, the selection of the information displayed on the touch sensitive screen of the information apparatus; and

wherein the information apparatus is at least one of a smart phone, an information pad, a digital pad, an ebook, an Internet appliance, or a digital camera, individually or in any combination; and

wherein the method further comprises;

capturing, using the digital capturing device included in the information apparatus, the image data or the video data; and

wirelessly transferring or outputting, via the wireless communication circuitry, at least part of the image data or the video data, captured by the digital capturing device, to the selected wireless output device that is wirelessly discovered to be available for service.

10. The method of claim 9, wherein the selected wireless output device is at least one of a music playing device, a sound output device, a video output device, an image display device, a television, a projection device, a printing device, or a controller box connectable externally to a television device, individually or in any combination;

and wherein the wireless communication circuitry includes one or more chips or chipsets, and wherein the one or more chips or chipsets is compatible, at least partly, with at least a protocol within IEEE 802.11 standards or Bluetooth specifications for establishing the radio frequency wireless communication.

11. The method of claim 9, wherein the information apparatus further includes an image acquisition application for acquisition of digital content and an output manager for managing transfer of at least part of the digital content to the one or more wireless output devices, the method further comprising passing at least part of the digital content from at least one of said image acquisition application, said e-mail application, said digital imaging application, said audio application, said video application, said document creation application, or said Internet browsing application, to the output manager via, at least in part, the object model or the application programming interface (API) supported by said operating system software included in the information apparatus.

12. The method of claim 9, further comprising obtaining authentication information or security information at the information apparatus, and wherein based on having successfully obtained the authentication information or the security information, the method further comprises:

establishing a radio frequency wireless connection from the information apparatus to the selected wireless output device; and

wirelessly transferring, using the wireless communication circuitry and over the radio frequency wireless connection, at least part of the digital content accessed by the one or more applications, to the selected wireless output device.

13. The method of claim 9, further comprising:

coupling, using the wireless communication circuitry, the information apparatus to a wireless local area network;

wirelessly accessing, using the wireless communication circuitry and via the wireless local area network, one or more servers;

receiving, via the voice activated command function from the user, a command for outputting or playing the digital content that is accessible by the one or more applications.

14. The method of claim 9, further comprising:

accessing, by the one or more applications at the information apparatus, audio digital content;

wirelessly discovering, using the one or more wireless communication circuitry and via short range wireless communication, an audio output device;

displaying, on the touch sensitive screen of the information apparatus, an item related to the audio output device that is wirelessly discovered;

receiving, from the user via the touch sensitive screen of the information apparatus, a selection of the item related to the audio output device displayed on the touch sensitive screen; and

wirelessly transferring or outputting, via the one or more wireless communication circuitry of the information apparatus and via the short range wireless communication, at least part of the audio digital content, accessed by the one or more applications of the information apparatus, to or at the wirelessly discovered audio output device; and

wherein the wireless communication circuitry includes at least a wireless communication chip or chipset that is further compatible with at least a protocol within Bluetooth specifications for establishing the short range wireless communication with the audio output device.

15. An information apparatus containing software or firmware executable by one or more processors at the information apparatus to facilitate access of digital content and output of the digital content from the information apparatus, the information apparatus being a mobile and wireless information apparatus, and the information apparatus including one or more applications installed or pre-installed, the one or more applications including:

an e-mail application,

a digital imaging application,

an audio application,

a video application, and

an Internet browsing application; and

operating system software in the information apparatus supporting an object model or an application programming interface (API) to facilitate operations of at least one of said e-mail application, said digital imaging application, said audio application, said video application, or said Internet browsing application, individually or in any combination, interfacing with device management applications in the information apparatus; and

wherein, the information apparatus is operable to allow a user of the information apparatus to install additional applications to further expand the functionalities of the information apparatus;

the information apparatus further including at least;

a digital camera for taking pictures,

a touch sensitive screen interface for interacting with the user,

a graphical user interface over the touch sensitive screen interface,

a microphone,

a speaker for outputting sound to the user,

a voice activated command function for receiving voice commands from the user of the information apparatus,

memory or storage storing at least a portion of the digital content, and

wireless communication circuitry for establishing radio frequency wireless communication between the information apparatus and one or more wireless output devices, the one or more wireless output devices being distinct devices from the information apparatus; and

wherein the software or firmware, at the information apparatus, is executable by the one or more processors of the information apparatus to further facilitate the information apparatus to;

couple the information apparatus, using the wireless communication circuitry, to a wireless local area network;

access, using at least one application from the one or more applications, the digital content;

wirelessly discover, using the wireless communication circuitry, at least one wireless output device from among the one or more wireless output devices that are available in the wireless local area network for service;

display, on the touch sensitive screen interface of the information apparatus, an item related to the at least one wireless output device that was wirelessly discovered, by the information apparatus to be available in the wireless local area network;

receive, via the touch sensitive screen interface of the information apparatus and from the user, at least an indication of a selection of the item related to the at least one wireless output device that is provided on the touch sensitive screen interface for user selection;

pass at least part of the digital content from at least one of said e-mail application, said digital imaging application, said audio application, said video application, or said Internet browsing application, individually or in any combination, for transfer or output of at least part of the digital content from the information apparatus, the passing of the at least part of the digital content being facilitated, at least in part, by the object model or the application programming interface (API) supported by the operating system software included in the information apparatus; and

wirelessly transfer or output, via the wireless communication circuitry of the information apparatus, at least part of the digital content, accessed by the one or more applications, to or at the at least one wireless output device wirelessly that is discovered to be available in the wireless local area network, the wireless transfer or output being based, at least in part, on having received, via the touch sensitive screen interface of the information apparatus and from the user, at least the indication of the selection of the item related to the wireless output device; and

wherein the information apparatus is a mobile and wireless information apparatus that is at least one of a smart phone, an information pad, a digital pad, an ebook, an Internet appliance, or a digital camera, individually or in any combination; and

wherein the at least one wireless output device is at least one of a television device, a sound output device, a music playing device, a display device, a printing device, a projection device, or an output controller externally connectable to a television, individually or in any combination.

16. The information apparatus of claim 15, wherein the wireless communication circuitry of the information apparatus includes one or more wireless communication chips or chipsets that are compliant, at least in part, with at least a protocol within IEEE 802.11 standards or within Bluetooth specifications for establishing the radio frequency wireless communication between the information apparatus and the at least one wireless output device.

17. The information apparatus of claim 16, wherein the software or firmware is further executable by the one or more processors of the information apparatus to:

receive, via the voice activated command function from the user, a command to transmit or output or play at least part of the digital content access by the one or more applications from the information apparatus; and

take a picture, using the digital camera included in the information apparatus;

wirelessly transfer or outputting, via the wireless communication circuitry, at least part of the picture taken, to the at least one wireless output device that is wirelessly discovered to be available for service.

18. The information apparatus of claim 15, wherein the software or firmware is further executable by the one or more processors of the information apparatus to:

access, by the one or more applications at the information apparatus, audio digital content;

wirelessly discover, using the wireless communication circuitry and via short range wireless communication, an audio output device;

display, on the touch sensitive screen of the information apparatus, an item related to the audio output device that is wirelessly discovered;

receive, from the user via the touch sensitive screen of the information apparatus, a selection of the item related to the audio output device displayed on the touch sensitive screen; and

wirelessly transfer or output, via the wireless communication circuitry of the information apparatus and via the direct short range wireless communication, at least part of the audio digital content, accessed by the one or more applications of the information apparatus, to or at the wirelessly discovered audio output device; and

wherein the wireless communication circuitry of the information apparatus includes one or more wireless communication chips or chipsets that are compliant, at least in part, with at least a protocol within Bluetooth specifications for establishing a direct short range radio frequency wireless communication between the information apparatus and the audio output device.

19. The information apparatus of claim 16, wherein the software or firmware is further executable by the one or more processors of the information apparatus to:

wirelessly discover, using the wireless communication circuitry, the one or more wireless output devices that are available for service in the wireless local area network;

wirelessly receive, using the wireless communication circuitry and from the one or more wireless output devices that are wirelessly discovered by the information apparatus, one or more device dependent attributes corresponding to the one or more wireless output devices, the one or more device dependent attributes include one or more of a name, an identity, a number, a make identifier, a model identifier, an output device type identifier, an output data format identifier, or an output device identifier, individually or in any combination; and

display, on the touch sensitive screen of the information apparatus, one or more items, related to the one or more wireless output device and corresponding to the one or more device dependent attributes, for user selection.

20. The information apparatus of claim 16, wherein the at least one wireless output device is a printing device;

and wherein the software or firmware is further executable by the one or more processors of the information apparatus to;

wirelessly receive, via the wireless communication circuitry of the information apparatus and from the printing device over the wireless local area network, device attributes corresponding to the printing device, the device attributes including one or more of capability information, duplex information, color information, language information, or format information, individually or in any combination, related, at least in part, to the printing device;

generate, at the information apparatus, output data related to the digital content accessed by the one or more applications of the information apparatus, the generated output data is in accordance, at least in part, to the received device attributes from the printing device; and

wirelessly transmit, via the wireless communication circuitry of the information apparatus and over the wireless local area network, at least part of the generated output data to the printing device for printing at least part of the digital content received by the one or more applications of the information apparatus.