System having movie clip object controlling an external native application

• US 9,014,530 B2
• Filed: 08/12/2008
• Issued: 04/21/2015
• Est. Priority Date: 08/12/2008
• Status: Active Grant

• Current Assignee: Blackberry Limited
• Original Assignee: 2236008 Ontario Inc. (Blackberry Limited)
• Inventors: Dodge, Dan, Streatch, Paul, Maclean, Roger
• Primary Examiner(s): Colin, Carl
• Assistant Examiner(s): LAVELLE, GARY E
• Application Number:
  US12/190,380
• Publication Number:
  US 20100040346A1
• Time in Patent Office: 2,443 Days
• Field of Search: 386/239, 386/240, 386/243, 386246-248
• US Class Current: 386/125
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2320/0247 Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2360/02 Graphics controller able to handle multiple formats, e.g. input or output formats
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: G11B 19/025 'Virtual' control panels, e.g. Graphical User Interface [GUI]
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A system comprises a movie clip environment in which a movie clip object is defined, and a native application that is external to the movie clip environment. The native application renders an image to an off-screen surface of the system. A composition manager is responsive to communications from the movie clip object to control where the off-screen surface is to be rendered on a display screen. The composition manager may be responsive to communications from the movie clip object to direct the native application to control one or more properties of the image of the off-screen surface.

Claims

1. A system comprising:

one or more hardware processors or circuits that are operable to execute;

a movie clip environment in which a plurality of movie clip objects are defined, where each movie clip object displays controls on a display screen for user interaction with an image provided by an external native application, and each of the plurality of movie clip objects generates scripted commands that are communicated to a composition manager for controlling an image provided by a respective external native application;

a plurality of external native applications that are external to the movie clip environment, wherein;

each of the plurality of movie clip objects is associated with a particular external native application and a respective off-screen surface of the respective external native application for rendering of an image by the external native application;

each of the plurality of external native applications is associated with information including a unique identifier that is used in the movie clip environment to identify the external native application and a location of its respective off-screen surface; and

each of the plurality of external native applications generates or receives an image and renders the image to its respective off-screen surface of the system; and

a composition manager that is communicatively coupled to the plurality of external native applications and the plurality of movie clip objects, the composition manager being operable to;

receive the information about each of the off-screen surfaces from their respective external native applications;

receive scripted commands from each of the plurality of movie the clip objects for each movie clip object'"'"'s corresponding external native application wherein;

a scripted command of a particular movie clip object directs the composition manager to provide an image rendered by its corresponding external native application on an off-screen surface to a display screen;

the scripted command from the particular movie clip object controls where the image is to be placed on the display screen through the composition manager; and

the scripted commands from the plurality of movie clip objects direct the composition manager as to where all of the images rendered by the corresponding external native applications on their respective off-screen surfaces are to be placed on the display screen.

2. The system of claim 1, where the composition manager is responsive to communications from each movie clip object to direct the corresponding external native application to control a property of the respective off-screen surface and the corresponding external native application communicates changes made to the respective off-screen surface to the movie clip object through the composition manager.

3. The system of claim 2, where the property of the off-screen surface comprises rotation of the image of the off-screen surface.

4. The system of claim 1, where the external native applications provide information about the off-screen surfaces to the composition manager.

5. The system of claim 1, where each movie clip object shadows a corresponding external native application to pass mouse movement, mouse selection, and text input to the shadowed external native application through the composition manager.

6. The system of claim 1, where the composition manager is responsive to communications from the movie clip objects to determine whether the off-screen surfaces are visible on the display screen.

7. The system of claim 2, where the property of the off-screen surface comprises a size of the off-screen surface.

8. The system of claim 2, where the property of the off-screen surface comprises a resolution of the off-screen surface.

9. The system of claim 1, further comprising a plurality of movie clip objects associated with a plurality of off-screen surfaces rendered by respective external native applications, where each movie clip is respectively associated with an off-screen surface.

10. The system of claim 1, where the external native applications comprise a web browser.

11. The system of claim 1, where the external native applications comprise a DVD player application.

12. The system of claim 1, where the external native applications comprise a navigation application.

42. The system of claim 1, where screen interactions are communicated to the composition manager by the movie clip objects.

43. The system of claim 1, where the movie clip objects produce a user interface comprising any of controls, vector graphic objects, images objects, and text objects.

13. A system comprising:

movie clip environment means comprising one or more hardware processors or circuits for generating a plurality of movie clip objects, where the movie clip environment means displays controls on a display screen for user interaction with an image provided by an external native application means and each of the plurality of movie clip objects generates scripted commands that are communicated to a composition manager means for controlling an image provided by a respective external native application;

a plurality of external native application means comprising one or more hardware processors or circuits that are external to the movie clip environment means, wherein;

each of the plurality of movie clip object means is associated with a particular external native application means and a respective off screen surface of the particular external native application means for rendering of an image by the external native application means,

each of the plurality of external native application means is associated with information including a unique identifier that is used in the movie clip environment means to identify the external native application means and a location of a respective off-screen surface of the external native application means; and

each of the plurality external native application means generates or receives an image and renders the image to its respective off-screen surface of the system that is external to the movie clip environment; and

composition manager means comprising one or more hardware processors or circuits that is communicatively coupled to the plurality of external native application means and the plurality of movie clip object means and is operable to;

receive the information about each of the off-screen surfaces from their respective external native applications means,

receive scripted commands from each of the plurality of movie the clip objects for each movie clip object'"'"'s corresponding external native application means wherein;

a scripted command of a particular movie clip object directs the composition manager means to provide an image rendered by its corresponding external native application means on an off-screen surface to a display screen;

the scripted command from the particular movie clip object controls where the image is to be placed on the display screen through the composition manager means; and

the scripted commands from the plurality of movie clip objects direct the composition manager means as to where all of the images rendered by the corresponding external native application means on their respective off-screen surfaces are to be placed on the display screen.

14. The system of claim 13, where the composition manager means is responsive to communications from the movie clip object means to direct the external native application means to control a property of a respective off-screen surface.

15. The system of claim 14, where the property of the respective off-screen surface comprises a resolution of the off-screen surface.

16. The system of claim 13, where the external native application means provide information about the off-screen surfaces to the composition manager means.

17. The system of claim 13, where the movie clip objects shadow the external native application means to pass mouse movement, mouse selection, and text input to the shadowed external native application means through the composition manager means.

18. The system of claim 14, where the property of the respective off-screen surface comprises a size of the off-screen surface.

19. The system of claim 14, where the property of the respective off-screen surface comprises rotation of the image of the off-screen surface.

20. The system of claim 14, where the property of the respective off-screen surface comprises a color characteristic of the image of the respective off-screen surface.

21. The system of claim 13, further comprising a plurality of movie clip objects associated with a plurality of off-screen surfaces rendered by respective external native application means, where each movie clip is respectively associated with an off-screen surface.

22. The system of claim 13, where the external native application means comprises a web browser.

23. The system of claim 13, where the external native application means comprises a DVD player application.

24. The system of claim 13, where the external native application means comprises a navigation application.

44. The system of claim 13, where screen interactions are communicated to the composition manager means by the movie clip objects.

45. The system of claim 13, where the movie clip objects produce a user interface comprising any of controls, vector graphic objects, images objects, and text objects.

25. A method for operating a processing system comprising:

in one or more hardware processors or circuits;

defining a plurality of movie clip objects in a movie clip environment, where each of the movie clip objects displays controls on a display screen for user interaction with an image provided by a respective external native application and each of the plurality of movie clip objects generates scripted commands that are communicated to a composition manager for controlling a property of the image provided by the respective external native application;

rendering by a plurality of external native applications, each associated with a corresponding movie clip object, an image to a respective off-screen surface;

controlling by the movie clip objects a property of the respective off-screen surfaces rendered by the external native applications through a composition manager, where the property corresponds to a property associated with rendering of the respective off-screen surfaces to the display screen; and

responding, by the composition manager, to the scripted commands from each of the movie clip objects by;

directing the respective external native applications to control the properties of the images residing in the respective off-screen surfaces based on the scripted commands from the respective movie clip objects; and

providing the images residing in the respective off-screen surfaces to the display screen based on the scripted commands from the respective movie clip objects.

26. The method of claim 25, where the property of the respective off-screen surfaces comprises rotation of an image of the off-screen surface.

27. The method of claim 25, where the property of the respective off-screen surfaces comprises a resolution of the off-screen surface.

28. The method of claim 25, further comprising using the movie clip objects to shadow the external native applications to pass mouse movement, mouse selection, and text input to the shadowed external native application.

29. The method of claim 25, where the property of the respective off-screen surfaces comprises a position of the off-screen surface with respect to the display screen.

30. The method of claim 25, where the property of the off-screen surfaces comprises a size of the off-screen surfaces.

46. The method of claim 25, further comprising communicating screen interactions to a composition manager using the movie clip objects.

47. The method of claim 25, where the movie clip objects produce a user interface comprising any of controls, vector graphic objects, images objects, and text objects.

31. A system comprising:

one or more hardware processors or circuits that are operable to execute;

a movie clip environment in which a plurality of movie clip objects are defined, where each movie clip object displays controls on a display screen for user interaction with a an image provided by a respective external native application and each of the plurality of movie clip objects generates scripted commands that are communicated to a composition manager for controlling a property of the image provided by the respective external native application;

a plurality of external native applications that are external to the movie clip environment, wherein;

each of the plurality of movie clip objects is associated with a particular external native application;

each of the plurality of external native applications is associated with a unique identifier that is used in the movie clip environment to identify the external native application and a location of a respective off-screen surface of the external native application; and

each of the plurality of external native applications renders an image to its respective off-screen surface of the system; and

a composition manager that is communicatively coupled to the plurality of external native applications and the plurality of movie clip objects and is operable to;

receive information about a plurality of off-screen surfaces from their respective external native applications;

receive scripted commands from each of the plurality of movie clip objects for each movie clip object'"'"'s respective external native application;

direct the respective external native applications to control a property of the images residing on the respective off-screen surfaces based on the scripted commands from each of the plurality of movie clip objects; and

provide the images residing on the respective off-screen surfaces to the display screen based on the scripted commands from each of the plurality of movie clip objects.

32. The system of claim 31, where the property of the respective off-screen surface comprises rotation of the image of the off-screen surface.

33. The system of claim 31, where the property of the respective off-screen surface comprises a resolution of the off-screen surface.

34. The system of claim 31, where the external native application provides information about the respective off-screen surface to the composition manager.

35. The system of claim 31, where the movie clip object shadows the external native application to pass mouse movement, mouse selection, and text input to the shadowed external native application.

36. The system of claim 31, where the composition manager is responsive to communications from the corresponding movie clip object to determine whether the respective off-screen surface is to be visible on the display screen.

37. The system of claim 31, where the property of the respective off-screen surface comprises a size of the off-screen surface.

38. The system of claim 31, further comprising a plurality of movie clip objects associated with a plurality of off-screen surfaces rendered by respective external native applications, where each movie clip object is respectively associated with an off-screen surface.

39. The system of claim 31, where the external native applications comprise a web browser.

40. The system of claim 31, where the external native applications comprise a DVD player application.

41. The system of claim 31, where the external native applications comprise a navigation application.

48. The system of claim 31, where screen interactions are communicated to the composition manager by the movie clip objects.

49. The system of claim 31, where the movie clip objects produce a user interface comprising any of controls, vector graphic objects, images objects, and text objects.