DEVICE AND METHOD FOR SECURE USER INTERFACE GESTURE PROCESSING USING PROCESSOR GRAPHICS

• US 20140096068A1
• Filed: 09/28/2012
• Published: 04/03/2014
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Dewan, Prashant, Chhabra, Siddhartha, Kang, Xiaozhu, Li, Xiaoning, Savagaonkar, Uday R., Durham, David M., Schmitz, Paul S., Goldsmith, Michael A., Martin, Jason
• Granted Patent: US 9,134,878 B2
• Time in Patent Office: Days
• US Class Current: 715/781
• CPC Class Codes: G06F 21/74 operating in dual or compartmented mode, i.e. at least one secure mode
• CPC Class Codes: G06F 21/82 Protecting input, output or interconnection devices
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A device and method for securely rendering content on a gesture-enabled computing device includes initializing a secure execution environment on a processor graphics of the computing device. The computing device transfers view rendering code and associated state data to the secure execution environment. An initial view of the content is rendered by executing the view rendering code in the secure execution environment. A gesture is recognized, and an updated view of the content is rendered in the secure execution environment in response to the gesture. The gesture may include a touch gesture recognized on a touch screen, or a physical gesture of the user recognized by a camera. After the updated view of the content is rendered, the main processor of the computing device may receive updated view data from the secure execution environment.

Claims

1. A computing device to securely render content, the computing device comprising:

a processor graphics to render content for display on a display;

a gesture recognition module to detect a user interface gesture as a function of input data generated by an input device in response to an input received from a user of the computing device;

a secure execution environment management module to (i) initialize a secure execution environment on the processor graphics and (ii) transfer view rendering code and associated state data to the secure execution environment; and

a rendering module established in the secure execution environment of the processor graphics, the rendering module to;

execute the view rendering code to render an initial view of the content on the display; and

render an updated view of the content as a function of the detected user interface gesture, using the view rendering code, to display the updated view of the content on the display.

2. The computing device of claim 1, wherein the secure execution environment of the processor graphics comprises the gesture recognition module.

3. The computing device of claim 1, further comprising a central processing unit, wherein the secure execution environment further comprises a gesture response module to securely transfer updated view data from the secured execution environment to the central processing unit, in response to the central processing unit requesting updated view data.

4. The computing device of claim 1, wherein the input device comprises a touch screen, and wherein the gesture recognition module is to detect a touch gesture as a function of input data generated by the touch screen.

5. The computing device of claim 1, wherein the input device comprises a camera and the gesture recognition module is to detect a physical gesture as a function of data generated by the camera.

6. The computing device of claim 1, wherein the rendering module is to:

render the initial view of the content by executing the view rendering code to render a user interface element on the display; and

render the updated view of the content by executing the view rendering code as a function of the detected user interface gesture to update the user interface element on the display.

7. The computing device of claim 6, further comprising a central processing unit, wherein:

the rendering module is further to adjust a display characteristic of the user interface element as a function of the detected user interface gesture;

the central processing unit is to;

receive second input data from the input device, the second input data being indicative of a user selection of the user interface element,

request updated view data from the secure execution environment, the updated view data indicative of the adjusted display characteristic of the user interface element,

determine the user selection of the user interface element based on the second input data and the updated view data, and

cause the computing device to perform a function based on the user selection; and

the secure execution environment further comprises a gesture response module to securely transfer the updated view data from the secure execution environment to the central processing unit in response to the request for updated view data.

8. A method for securely rendering content on a display of a computing device, the method comprising:

initializing a secure execution environment on a processor graphics of the computing device;

transferring view rendering code and associated state data from a processor core of the computing device to the secure execution environment;

executing the view rendering code in the secure execution environment to render an initial view of the content on the display of the computing device;

detecting a user interface gesture as a function of input data received from an input device of the computing device; and

rendering an updated view of the content as a function of the detected user interface gesture, using the view rendering code executed in the secure execution environment, to display the updated view of the content on the display of the computing device.

9. The method of claim 8, wherein detecting the user interface gesture comprises detecting the user interface gesture in the secure execution environment.

10. The method of claim 8, further comprising securely transferring updated view data from the secured execution environment to the processor core, in response to the processor core requesting updated view data.

11. The method of claim 8, wherein detecting the user interface gesture comprises one of:

detecting a touch gesture as a function of input data received from a touch screen input device of the computing device and detecting a physical gesture as a function of data received from a camera of the computing device.

12. The method of claim 8, wherein:

executing the view rendering code in the secure execution environment to render an initial view of the content comprises executing the view rendering code to display a user interface element on the display of the computing device; and

rendering an updated view of the content as a function of the detected user interface comprises executing the view rendering code as a function of the detected user interface gesture to update the user interface element on the display of the computing device.

13. The method of claim 12, further comprising:

adjusting, in the secure execution environment of the processor graphics, a display characteristic of the user interface element as a function of the detected user interface gesture;

receiving, on the processor core, second input data from the input device of the computing device, the second input data being indicative of a user selection of the user interface element;

requesting, on the processor core, updated view data from the secure execution environment of the processor graphics;

securely transferring the updated view data from the secure execution environment to the processor core in response to requesting the updated view data, the updated view data indicative of the adjusted display characteristic of the user interface element;

determining, on the processor core, the user selection of the user interface element based on the second input data and the updated view data; and

performing, on the computing device, a function based on the user selection.

14. One or more machine readable storage media comprising a plurality of instructions that in response to being executed result in a computing device:

initializing a secure execution environment on a processor graphics of the computing device;

transferring view rendering code and associated state data from a processor core of the computing device to the secure execution environment;

executing the view rendering code in the secure execution environment to render an initial view of the content on the display of the computing device;

detecting a user interface gesture as a function of input data received from an input device of the computing device; and

rendering an updated view of the content as a function of the detected user interface gesture, using the view rendering code executed in the secure execution environment, to display the updated view of the content on the display of the computing device.

15. The machine readable media of claim 14, wherein detecting the user interface gesture comprises detecting the user interface gesture in the secure execution environment.

16. The machine readable storage media of claim 14, further comprising a plurality of instructions that in response to being executed result in the computing device securely transferring updated view data from the secured execution environment to the processor core, in response to the processor core requesting updated view data.

17. The machine readable storage media of claim 14, wherein detecting the user interface gesture comprises detecting a touch gesture as a function of input data received from a touch screen input device of the computing device.

18. The machine readable storage media of claim 14, wherein detecting the user interface gesture comprises detecting a physical gesture as a function of data received from a camera of the computing device.

19. The machine readable storage media of claim 14, wherein:

executing the view rendering code in the secure execution environment to render an initial view of the content comprises executing the view rendering code to display a user interface element on the display of the computing device; and

rendering an updated view of the content as a function of the detected user interface comprises executing the view rendering code as a function of the detected user interface gesture to update the user interface element on the display of the computing device.

20. The machine readable storage media of claim 19, further comprising a plurality of instructions that in response to being executed result in the computing device:

adjusting, in the secure execution environment of the processor graphics, a display characteristic of the user interface element as a function of the detected user interface gesture;

receiving, on the processor core, second input data from the input device of the computing device, the second input data being indicative of a user selection of the user interface element;

requesting, on the processor core, updated view data from the secure execution environment of the processor graphics;

securely transferring the updated view data from the secure execution environment to the processor core in response to requesting the updated view data, the updated view data indicative of the adjusted display characteristic of the user interface element;

determining, on the processor core, the user selection of the user interface element based on the second input data and the updated view data; and

performing, on the computing device, a function based on the user selection.