METHOD, APPARATUS AND SYSTEM FOR INTERACTING WITH CONTENT ON WEB BROWSERS

• US 20120166974A1
• Filed: 12/23/2010
• Published: 06/28/2012
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Elford, Christopher L., Tsoi, Howard P.
• Granted Patent: US 9,575,561 B2
• Time in Patent Office: Days
• US Class Current: 715/760
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A method, apparatus and system enable indirect remote interaction with a web browser. In one embodiment, remote user gestures may be captured and processed to determine an action to be taken by the web browser.

Claims

1. A method comprising:

identifying user motions directed at a web browser running on a device, the web browser running a web browser application to display a web page;

identifying the user motions as input gestures;

processing the input gestures to determine a web browser action; and

providing the web browser action to the web browser application.

2. The method according to claim 1 wherein the user motions directed at the web browser further comprise one of a hand motion, eye motion or a body motion of the user.

3. The method according to claim 1 wherein identifying the user motion as the input gestures further comprises determining a movement associated with the input gesture.

4. The method according to claim 3 wherein processing the input gestures to determine the browser action further comprises processing the movement associated with the input gesture to determine a corresponding web browser action.

5. The method according to claim 4 wherein processing the movement associated with the user gesture further comprises:

accessing a gesture library communicatively coupled to the web browser;

identifying the movement within the gesture library; and

selecting the web browser action corresponding to the identified movement within the gesture library.

6. The method according to claim 1 wherein identifying the user motions further comprises one of:

identifying a physical user gesture directed at the web browser application;

or interpreting a visual cue on the web page to determine a logical user gesture.

7. The method according to claim 1 wherein interpreting the visual cue further comprises:

analyzing code for the web page;

identifying one or more actionable areas on the web page; and

replacing the one or more actionable areas with one or more visual cues.

8. A machine-accessible device having stored thereon instructions that, when executed by a machine, cause the machine to:

identify user motions directed at a web browser running on a device, the web browser run a web browser application to display a web page;

identify the user motions as input gestures;

process the input gestures to determine a web browser action; and

provide the web browser action to the web browser application.

9. The machine accessible device in claim 8 further having stored thereon instructions that, when executed by the machine, cause the machine to identify the user motions comprising one of a hand motion, eye motion or a body motion of the user.

10. The machine accessible device in claim 9 further having stored thereon instructions that, when executed by the machine, cause the machine to identify actions corresponding to the user gestures by determining a movement associated with the input gesture.

11. The machine accessible device in claim 10 further having stored thereon instructions that, when executed by the machine, cause the machine to process the input gestures to determine the browser action further by processing the movement associated with the input gesture to determine a corresponding web browser action.

12. The machine accessible device in claim 11 further having stored thereon instructions that, when executed by the machine, cause the machine to:

access a gesture library communicatively coupled to the web browser;

identify the movement within the gesture library; and

select the web browser action corresponding to the identified movement within the gesture library.

13. The machine accessible device in claim 12 further having stored thereon instructions that, when executed by the machine, cause the machine to identifying the user motions by one of:

identifying a physical user gesture directed at the web browser application;

or interpreting a visual cue on the web page to determine a logical user gesture.

14. The machine accessible device in claim 13 further having stored thereon instructions that, when executed by the machine, cause the machine to interpret the visual cue by:

analyzing code for the web page;

identifying one or more actionable areas on the web page; and

replacing the one or more actionable areas with one or more visual cues.

15. A method comprising:

analyzing a web page to determine actionable areas on the web page; and

changing a visual representation of the actionable areas to display a platform specific view of the actionable areas to the user.

16. The method according to claim 15 wherein analyzing a web page further comprises examining code defining the web page to identify actionable areas on the web page.

17. The method according to claim 16 wherein changing the visual representation of the actionable areas to display a platform specific view of the actionable areas to the user further comprises displaying one or more visual cues to represent each of the actionable areas.

18. The method according to claim 17 wherein the visual cues comprise an icon, text and a shrunken portion of the web page.

a. The method according to claim 18 wherein the icon represents a gesture.

19. A machine-accessible device having stored thereon instructions that, when executed by a machine, cause the machine to:

analyze a web page to determine actionable areas on the web page; and

change a visual representation of the actionable areas to display a platform specific view of the actionable areas to the user.

20. The machine-accessible device of claim 20 wherein the instructions, when executed by a machine, further cause the machine to examine code defining the web page to identify actionable areas on the web page.

21. The machine-accessible device of claim 20 wherein the instructions, when executed by a machine, further cause the machine to display one or more visual cues to represent each of the actionable areas.

22. The machine-accessible device of claim 20 wherein the instructions, when executed by a machine, further cause the machine to display visual cues comprising one of an icon, text or a shrunken portion of the web page.

23. The machine-accessible device of claim 20 wherein the instructions, when executed by a machine, further cause the machine to display an icon representing a gesture.