Inter-context coordination to facilitate synchronized presentation of image content

• US 10,073,583 B2
• Filed: 10/08/2015
• Issued: 09/11/2018
• Est. Priority Date: 10/08/2015
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Wehrman, Ian A., Fitzgerald, John N., Brandt, Joel R., Bache, Jesper Storm, Tristram, David A., Aygun, Barkin
• Primary Examiner(s): Augustine, Nicholas
• Application Number:
  US14/878,369
• Publication Number:
  US 20170102830A1
• Time in Patent Office: 1,069 Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Inter-context coordination to facilitate synchronized presentation of image content is described. In example embodiments, an application includes multiple execution contexts that coordinate handling user interaction with a coordination policy established using an inter-context communication mechanism. The application produces first and second execution contexts that are responsible for user interaction with first and second image content, respectively. Generally, the second execution context provides a stipulation for the coordination policy to indicate which execution context is to handle a response to a given user input event. With an event routing policy, an event routing rule informs the first execution context if a user input event should be routed to the second execution context. With a pixel authorization policy, a pixel authorization grant informs the first execution context of an authorization to manipulate pixels of the second image content in response to a user input event affecting pixels of the first image content.

Claims

1. In a digital medium environment to enable inter-context coordination in a hybrid application, a method implemented by a computing device, the method comprising:

executing, by the computing device, a native process and a web-based process of the hybrid application that share a visual window associated with the hybrid application, the executing including;

receiving, through execution of the native process, an indication of a user input event;

analyzing, through execution of the native process, the indication of the user input event with regard to an event routing policy that includes an event routing rule stipulated by the web-based process;

responsive to the analyzing that the user input event comports with the event routing rule associated with the web-based process;

conveying, by the native process to the web-based process, the indication of the user input event; and

processing the user input event by the web-based process; and

responsive to the analyzing that the user input event does not comport with the event routing rule associated with the web-based process, processing the user input event by the native process.

2. The method as described in claim 1, further comprising:

conveying, by the web-based process to the native process, the event routing rule; and

incorporating, by the native process, the event routing rule as including a criterion specifying a correspondence between user interaction and the web-based process.

3. The method as described in claim 2, wherein the conveying and the incorporating are performed during execution of the hybrid application.

4. The method as described in claim 1, wherein the native process and the web-based process of the hybrid application respectively correspond to logical windows and respective pixels that share the visual window associated with the hybrid application.

5. The method as described in claim 1, wherein:

the visual window is perceptible to the user that includes multiple pixels;

a first logical window that is associated with the visual window and includes first image content as controlled by the native process;

a second logical window that is associated with the visual window and includes second image content as controlled by the web-based processing, the second logical window at least partially overlapping the first logical window; and

the coordination policy is configured to coordinate handling of user interaction by the native and web-based processes to establish at least one stipulation of the web-based process for the coordination policy that is accessible by the native process.

6. The method as described in claim 5, further comprising updating the coordination policy by the web-based process based on a change to the second image content that is displayed via the second logical window, the change made by the web-based process during the execution of the hybrid application.

7. The method as described in claim 5, wherein the coordination policy includes a pixel authorization policy that includes a pixel authorization grant indicative of which of the web-based process or native process is granted authorization to manipulate pixels of the visual window that are affected by a user input event.

8. The method as described in claim 7, wherein the pixel authorization grant comprises at least one of an object-based pixel authorization grant or an area-based pixel authorization grant.

9. The method as described in claim 1, wherein the event routing rule includes at least one of a location-based event routing rule or a key-based event routing rule.

10. In a digital medium environment to enable inter-context coordination in a hybrid application, a computing device comprising:

one or more processors; and

a computer-readable storage medium having stored thereon the hybrid application that, responsive to execution by the one or more processors, causes the one or more processors to execute a native process and a web-based process of the hybrid application that share a visual window associated with the hybrid application, the executing including;

receiving, through execution of the native process, an indication of a user input event;

analyzing, through execution of the native process, the indication of the user input event with regard to an event routing policy that includes an event routing rule stipulated by the web-based process;

responsive to the analyzing that the user input event comports with the event routing rule associated with the web-based process;

conveying, by the native process to the web-based process, the indication of the user input event; and

processing the user input event by the web-based process; and

responsive to the analyzing that the user input event does not comport with the event routing rule associated with the web-based process, processing the user input event by the native process.

11. The computing device as described in claim 10, wherein the executing further comprises:

conveying, by the web-based process to the native process, the event routing rule; and

incorporating, by the native process, the event routing rule as including a criterion specifying a correspondence between user interaction and the web-based process.

12. The computing device as described in claim 11, wherein the conveying and the incorporating are performed during execution of the hybrid application.

13. The computing device as described in claim 10, wherein the native process and the web-based process of the hybrid application respectively correspond to logical windows and respective pixels that share the visual window associated with the hybrid application.

14. The computing device as described in claim 10, wherein:

the visual window is perceptible to the user and that includes multiple pixels;

a first logical window that is associated with the visual window and includes first image content as controlled by the native process;

a second logical window that is associated with the visual window and includes second image content as controlled by the web-based processing, the second logical window at least partially overlapping the first logical window; and

the coordination policy is configured to coordinate handling of user interaction by the native and web-based processes to establish at least one stipulation of the web-based process for the coordination policy that is accessible by the native process.

15. The computing device as described in claim 14, wherein the executing further comprises updating the coordination policy by the web-based process based on a change to the second image content that is displayed via the second logical window, the change made by the web-based process during the execution of the hybrid application.

16. The computing device as described in claim 14, wherein the coordination policy includes a pixel authorization policy that includes a pixel authorization grant indicative of which of the web-based process or native process is granted authorization to manipulate pixels that are affected by the user input event.

17. The computing device as described in claim 16, wherein the pixel authorization grant comprises at least one of an object-based pixel authorization grant or an area-based pixel authorization grant.

18. The computing device as described in claim 10, wherein the event routing rule includes at least one of a location-based event routing rule or a key-based event routing rule.

19. In a digital medium environment to enable inter-context coordination in a hybrid application in which a user modifies on-screen image content, a method implemented by a computing device, the method comprising:

executing, by the computing device, a native process and a web-based process of the hybrid application that correspond to respective visual windows and associated pixels that share a visual window associated with the hybrid application, the executing including;

receiving, through execution of the native process, an indication of a user input event;

analyzing, through execution of the native process, the indication of the user input event with regard to an event routing policy that includes an event routing rule stipulated by the web-based process;

responsive to the analyzing that the user input event comports with the event routing rule associated with the web-based process;

conveying, by the native process to the web-based process, the indication of the user input event; and

processing the user input event by the web-based process to modify at least one said pixel; and

responsive to the analyzing that the user input event does not comport with the event routing rule associated with the web-based process, processing the user input event by the native process to modify at least one said pixel.

20. The method as described in claim 19, wherein:

the coordination policy includes a pixel authorization policy that includes a pixel authorization grant indicative of which of the web-based process or native process is granted authorization to manipulate the pixels that are affected by the user input event; and

the pixel authorization grant includes at least one of an object-based pixel authorization grant or an area-based pixel authorization grant.