Intelligent graphics interface in a handheld wireless device

• US 9,134,805 B2
• Filed: 07/02/2012
• Issued: 09/15/2015
• Est. Priority Date: 06/16/2009
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Ferren, Bran, Jasmann, Schawn A., Buck, Morgan J.
• Primary Examiner(s): MANOHARAN, MUTHUSWAMY GANAPATHY
• Application Number:
  US13/539,824
• Publication Number:
  US 20120268405A1
• Time in Patent Office: 1,170 Days
• Field of Search: 370/329, 345/173, 715/802, 715/769, 705/10, 705/14.44, 709/203
• US Class Current: 1/1
• CPC Class Codes: G02B 13/0065 having a beam-folding prism or mirror
• CPC Class Codes: G02B 13/009 having zoom function
• CPC Class Codes: G03B 3/00 Focusing arrangements of general interest for cameras, projectors or printers
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/40 by quorum, i.e. whereby two or more security principals are required
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06K 2207/1011 Aiming
• CPC Class Codes: G06K 7/10811 Focalisation
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/4012 : Verifying personal identification numbers [PIN]
• CPC Class Codes: G06Q 20/40145 : Biometric identity checks
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/165 : using facial parts and geometric relationships
• CPC Class Codes: G06V 40/19 : Sensors therefor
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/45 : Detection of the body part being alive
• CPC Class Codes: H04L 63/083 : using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04M 1/72448 : with means for adapting the functionality of the device according to specific conditions
• CPC Class Codes: H04M 2250/52 : including functional features of a camera
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 : using three or more 2D image sensors
• CPC Class Codes: H04N 23/45 : for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/67 : Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

Various embodiments of the invention may allow applications and information to be clustered together in ways that simplify and automate various tasks. Other embodiments may present a graphical user interface to the user that allows the user to choose from a matrix of information categories and applications that can help provide that information. Still other embodiments may provide different user interface methods based on status awareness.

Claims

1. An apparatus for presenting information, comprising:

a handheld electronic device for operation by a user, the electronic device comprising one or more of a processor, a memory, a radio, and a touchscreen,

wherein the device to create a cluster of related nodes based on a template or status awareness including situation awareness or context awareness and without an intervention from the user, wherein each node of the cluster of related nodes to perform at least one of collect data, exchange data with other nodes of the cluster of related nodes, process data, and share capabilities or perform interrelated actions within or between the nodes of the cluster of related nodes to produce a set of desired information, wherein the device places a major node, indicating a major purpose, from among a plurality of nodes in a center and in communication with at least one sub-node from the cluster of related nodes to display the plurality of related nodes via the touchscreen,

wherein, in response to selecting the one sub-node, the device to place the one sub-node in the center and in communication with other nodes related to the one sub-node to display the one sub-node and the other nodes via a display screen, wherein at least some of the nodes are selected from a list of nodes comprising one or more of a software application, a selection of data, an internal or external service, an input from a sensor, and a communication link,

wherein a plurality of information points retrieves data from one or more of a plurality of information sources and provides it through one or more of the cluster of nodes such that the data pertains to a first subject of interest to the user, wherein the cluster of nodes is dynamically and automatically put together into the cluster for being related to each other based on retrieved data and without having to involve the user, wherein the data to determine putting together of the cluster includes inputs that are not obtainable from a single of the plurality of information sources, wherein the data includes one or more of incomplete data, probabilities, assumptions, and historical behavior, and

wherein the situation awareness pertains to conditions external to the electronic device as determined from sensor inputs provided by one or more sensors of the electronic device, wherein the sensor inputs are based on information relating to the external conditions gathered by the one or more sensors, and wherein the context awareness is based on user contexts including one or more of the user'"'"'s preferences, the user'"'"'s historical activities, the user'"'"'s current activities, and the user'"'"'s speculative activities, wherein the activities include one or more of actions, reactions, and decisions associated with the user.

2. The apparatus of claim 1, wherein the set of desired information is previously identified by the device, wherein the device is further to present the desired information to the user through one or more visual and audible devices,

wherein the device is further to analyze at least one of external priorities without regard for the status awareness, internal priorities based on the status awareness, and probably status of the user based on a combination of possibility analysis and probability analysis, and an assigned confidence factor as compared to a confidence threshold value, wherein at least some of the nodes are to be identified by a user of the electronic device, wherein said determining comprises presenting the nodes on the touchscreen for selection by the user, and

wherein at least some of the nodes are to be identified automatically by the device, using status awareness.

3. The apparatus of claim 1, wherein the cluster of node of a plurality of clusters of nodes is dynamically modified if a change is made to one or more of the nodes that results in different data structure including introducing a second subject causing some of the data associated with one or more nodes to become irrelevant to a first subject, wherein the cluster of nodes being dynamic further includes the plurality of clusters of nodes having one or more clusters of nodes that are in existence temporarily or permanently based on changes in the status awareness of the user as determined from one or more of the plurality of information points.

4. The apparatus of claim 1, wherein the sensor inputs comprise situational analysis of the user'"'"'s actions that impact the external conditions and correspondingly change the information relating to the external conditions, wherein the user'"'"'s actions are observed by the one or more sensors including one or more of a radio, a camera, a microphone, a motion sensor, an orientation sensor, a light sensor, and a temperature sensor.

5. A method of operating a handheld electronic device, comprising:

identifying a set of desired information;

creating a cluster of related nodes based on a template or status awareness including situation awareness or context awareness and without an intervention from the user, wherein each node of the cluster of related nodes to perform at least one of collect data, exchange data with other nodes of the cluster of related nodes, process data, and share capabilities or perform interrelated actions within or between the nodes of the cluster of related nodes to produce the set of desired information;

placing a major node, indicating a major purpose, from among a plurality of nodes in a center and in communication with at least one sub-node from the cluster of related nodes to display the plurality of related nodes via the touchscreen; and

placing, in response to selecting the one sub-node, the one sub-node in the center and in communication with other nodes related to the one sub-node to display the one sub-node and the other nodes via the display screen, wherein said selecting comprises selecting at least some of the nodes from a list of nodes comprising one or more of a software application, a selection of data, an internal or external service, an input from a sensor, and a communication link,

wherein a plurality of information points retrieves data from one or more of a plurality of information sources and provides it through one or more of the cluster of nodes such that the data pertains to a first subject of interest to the user, wherein the cluster of nodes is dynamically and automatically put together into the cluster for being related to each other based on retrieved data and without having to involve the user, wherein the data to determine putting together of the cluster includes inputs that are not obtainable from a single of the plurality of information sources, wherein the data includes one or more of incomplete data, probabilities, assumptions, and historical behavior, and

wherein the situation awareness pertains to conditions external to the electronic device as determined from sensor inputs provided by one or more sensors of the electronic device, wherein the sensor inputs are based on information relating to the external conditions gathered by the one or more sensors, and wherein the context awareness is based on user contexts including one or more of the user'"'"'s preferences, the user'"'"'s historical activities, the user'"'"'s current activities, and the user'"'"'s speculative activities, wherein the activities include one or more of actions, reactions, and decisions associated with the user.

6. The method of claim 5,

wherein the set of desired information is previously identified by the device, wherein the device is further to present the desired information to the user through one or more visual and audible devices,

wherein the device is further to analyze at least one of external priorities without regard for the status awareness, internal priorities based on the status awareness, and probably status of the user based on a combination of possibility analysis and probability analysis, and an assigned confidence factor as compared to a confidence threshold value, and

wherein said selecting comprises selecting at least some of the nodes by a user of the electronic device, wherein said selecting further comprises selecting at least some of the nodes automatically by the device, using status awareness, and wherein said creating comprises presenting the nodes on the touchscreen.

7. The method of claim 5, wherein the cluster of node of a plurality of cluster of nodes is dynamically modified if a change is made to one or more of the nodes that results in different data structure including introducing a second subject causing some of the data associated with one or more nodes to become irrelevant to a first subject, wherein the cluster of nodes being dynamic further includes the plurality of clusters of nodes having one or more clusters of nodes that are in existence temporarily or permanently based on changes in the status awareness of the user as determined from one or more of the plurality of information points.

8. The method of claim 5, wherein the sensor inputs comprise situational analysis of the user'"'"'s actions that impact the external conditions and correspondingly change the information relating to the external conditions, wherein the user'"'"'s actions are observed by the one or more sensors including one or more of a radio, a camera, a microphone, a motion sensor, an orientation sensor, a light sensor, and a temperature sensor.

9. At least one non-transitory computer-readable medium that contains instructions, which when executed by one or more processors result in performing operations comprising:

identifying a set of desired information;

creating a cluster of related nodes based on a template or status awareness including situation awareness or context awareness and without an intervention from the user, wherein each node of the cluster of related nodes to perform at least one of collect data, exchange data with other nodes of the cluster of related nodes, process data, and share capabilities or perform interrelated actions within or between the nodes of the cluster of related nodes to produce the set of desired information;

placing a major node, indicating a major purpose, from among a plurality of nodes in a center and in communication with at least one sub-node from the cluster of related nodes to display the plurality of related nodes via the touchscreen; and

placing, in response to selecting the one sub-node, the one sub-node in the center and in communication with other nodes related to the one sub-node to display the one sub-node and the other nodes via the display screen, wherein said selecting comprises selecting at least some of the nodes from a list of nodes comprising one or more of a software application, a selection of data, an internal or external service, an input from a sensor, and a communication link,

wherein a plurality of information points retrieves data from one or more of a plurality of information sources and provides it through one or more of the cluster of nodes such that the data pertains to a first subject of interest to the user, wherein the cluster of nodes is dynamically and automatically put together into the cluster for being related to each other based on retrieved data and without having to involve the user, wherein the data to determine putting together of the cluster includes inputs that are not obtainable from a single of the plurality of information sources, wherein the data includes one or more of incomplete data, probabilities, assumptions, and historical behavior, and

wherein the situation awareness pertains to conditions external to the electronic device as determined from sensor inputs provided by one or more sensors of the electronic device, wherein the sensor inputs are based on information relating to the external conditions gathered by the one or more sensors, and wherein the context awareness is based on user contexts including one or more of the user'"'"'s preferences, the user'"'"'s historical activities, the user'"'"'s current activities, and the user'"'"'s speculative activities, wherein the activities include one or more of actions, reactions, and decisions associated with the user.

10. The non-transitory computer-readable medium of claim 9, wherein the operations further comprise:

wherein the set of desired information is previously identified by the device, wherein the device is further to present the desired information to the user through one or more visual and audible devices,

wherein the device is further to analyze at least one of external priorities without regard for the status awareness, internal priorities based on the status awareness, and probably status of the user based on a combination of possibility analysis and probability analysis, and an assigned confidence factor as compared to a confidence threshold value, and

wherein said selecting comprises selecting at least some of the nodes by a user of the electronic device, wherein said selecting further comprises selecting at least some of the nodes automatically by the device, using status awareness, and wherein said creating comprises presenting the nodes on the touchscreen.

11. The non-transitory computer-readable medium of claim 9, wherein the cluster of node of a plurality of cluster of nodes is dynamically modified if a change is made to one or more of the nodes that results in different data structure including introducing a second subject causing some of the data associated with one or more nodes to become irrelevant to the first subject, wherein the cluster of nodes being dynamic further includes the plurality of clusters of nodes having one or more clusters of nodes that are in existence temporarily or permanently based on changes in the status awareness of the user as determined from one or more of the plurality of information points.

12. The non-transitory computer-readable medium of claim 9, wherein the sensor inputs comprise situational analysis of the user'"'"'s actions that impact the external conditions and correspondingly change the information relating to the external conditions, wherein the user'"'"'s actions are observed by the one or more sensors including one or more of a radio, a camera, a microphone, a motion sensor, an orientation sensor, a light sensor, and a temperature sensor.